]>
git.ipfire.org Git - thirdparty/zstd.git/log
Carl Woffenden [Thu, 29 Aug 2019 09:16:57 +0000 (11:16 +0200)]
C99 and older GCC fixes
Yann Collet [Wed, 28 Aug 2019 19:26:29 +0000 (12:26 -0700)]
Merge pull request #1749 from facebook/rmadapt
removed adaptive-compression
Yann Collet [Wed, 28 Aug 2019 19:14:29 +0000 (12:14 -0700)]
Merge pull request #1750 from cwoffenden/amalgamate-bash2sh
Rewrote the scripts to use sh instead of bash
Carl Woffenden [Wed, 28 Aug 2019 17:20:42 +0000 (19:20 +0200)]
Rewrote the scripts to sh instead of bash
Yann Collet [Tue, 27 Aug 2019 21:50:18 +0000 (14:50 -0700)]
removed associated test
Yann Collet [Tue, 27 Aug 2019 21:47:40 +0000 (14:47 -0700)]
removed adaptive-compression
the functionality is already integrated into `zstd` through `--adapt` command
Nick Terrell [Tue, 27 Aug 2019 17:17:28 +0000 (10:17 -0700)]
Merge pull request #1748 from terrelln/cover-deadlock
[dictBuilder] Fix deadlock in *COVER error case
Yann Collet [Tue, 27 Aug 2019 17:05:26 +0000 (10:05 -0700)]
Merge pull request #1739 from cwoffenden/amalgamate
Tweaks to create a single-file decompressor
Carl Woffenden [Tue, 27 Aug 2019 15:12:57 +0000 (17:12 +0200)]
Fixed test failure when Emscripten not present
Carl Woffenden [Tue, 27 Aug 2019 14:57:23 +0000 (16:57 +0200)]
Minor repetition
Carl Woffenden [Tue, 27 Aug 2019 14:55:03 +0000 (16:55 +0200)]
Typo
Carl Woffenden [Tue, 27 Aug 2019 13:53:26 +0000 (15:53 +0200)]
Added clarification
Carl Woffenden [Tue, 27 Aug 2019 13:51:14 +0000 (15:51 +0200)]
Added reasoning
Carl Woffenden [Tue, 27 Aug 2019 13:38:34 +0000 (15:38 +0200)]
Typo
Carl Woffenden [Tue, 27 Aug 2019 13:36:06 +0000 (15:36 +0200)]
Added test script; tidied and documented
The test script combines the sources then builds and runs an example. A futher example is built if the Emscripten compiler is available on the system. Documentation covers building.
Nick Terrell [Tue, 27 Aug 2019 01:32:08 +0000 (18:32 -0700)]
[test][dictBuilder] Add multithreaded tests
Nick Terrell [Tue, 27 Aug 2019 01:19:29 +0000 (18:19 -0700)]
[dictBuilder] Fix deadlock in *COVER error case
The COVER and FASTCOVER dictionary builders can deadlock when
dictionary construction errors, likely because there are too few
samples, or too few distinct dmers. The deadlock only occurs when
there are errors.
Fixes #1746.
Carl Woffenden [Mon, 26 Aug 2019 19:28:19 +0000 (21:28 +0200)]
Added Emscripten example, removed Buck, minor tidy
Work-in-progress. Added simple Emscripten WebGL example that adds 25kB when build with Zstd. Removed Buck (will replace). Minor correctness.
Carl Woffenden [Mon, 26 Aug 2019 05:48:57 +0000 (07:48 +0200)]
Able to test combine script; minor tidy
Carl Woffenden [Sun, 25 Aug 2019 20:49:01 +0000 (22:49 +0200)]
Preparing to run tests
Combine script more robust and can output to a specified file. Initial buck files added (work in progress).
Carl Woffenden [Fri, 23 Aug 2019 21:09:13 +0000 (23:09 +0200)]
Minor fix for files with spaces. Typo.
Carl Woffenden [Fri, 23 Aug 2019 21:05:02 +0000 (23:05 +0200)]
Merge branch 'dev' into amalgamate
Carl Woffenden [Fri, 23 Aug 2019 21:04:21 +0000 (23:04 +0200)]
Revert "Merge remote-tracking branch 'origin/master' into dev"
This reverts commit
0df29a4e5ff118ec7aa870ea9c032e9f99870e43 , reversing
changes made to
69c875a0cc771098f9ae9bb7a0a3e3ff6eb3f5c1 .
Carl Woffenden [Fri, 23 Aug 2019 21:03:52 +0000 (23:03 +0200)]
Merge remote-tracking branch 'upstream/dev' into dev
Carl Woffenden [Fri, 23 Aug 2019 20:57:06 +0000 (22:57 +0200)]
Merge remote-tracking branch 'origin/master' into dev
Nick Terrell [Fri, 23 Aug 2019 17:16:10 +0000 (10:16 -0700)]
Merge pull request #1733 from nmagerko/size-hint
Add --size-hint=# option
Nick Terrell [Fri, 23 Aug 2019 17:15:52 +0000 (10:15 -0700)]
Merge pull request #1745 from terrelln/regression-driver
[fuzz] Add a DEBUGLOG(3) statement to print file
Carl Woffenden [Fri, 23 Aug 2019 16:43:29 +0000 (18:43 +0200)]
Added generator script and simple test
The script will combine decompressor sources into a single file. The example shows this in use.
Nick Terrell [Fri, 23 Aug 2019 00:27:15 +0000 (17:27 -0700)]
[fuzz] Add a DEBUGLOG(3) statement to print file
Enable it by building with this command:
```
./fuzz.py build all --debug 3
```
Nick Magerko [Thu, 22 Aug 2019 18:51:41 +0000 (11:51 -0700)]
Fix merge conflicts
Nick Terrell [Thu, 22 Aug 2019 18:31:15 +0000 (11:31 -0700)]
Merge pull request #1726 from nmagerko/stream-size
Add --stream-size=# option
Nick Magerko [Thu, 22 Aug 2019 16:37:47 +0000 (09:37 -0700)]
Differentiate --stream-size from --size-hint
Nick Magerko [Thu, 22 Aug 2019 16:13:28 +0000 (09:13 -0700)]
Minor documentation update
Nick Magerko [Wed, 21 Aug 2019 17:27:54 +0000 (10:27 -0700)]
Remove bc from play tests
Nick Terrell [Wed, 21 Aug 2019 17:10:24 +0000 (10:10 -0700)]
Merge pull request #1737 from terrelln/legacy-fix
[legacy] Fix buffer overflow in v0.2 and v0.4 raw literals decompression
Nick Terrell [Wed, 21 Aug 2019 17:09:38 +0000 (10:09 -0700)]
Merge pull request #1736 from terrelln/fuzz-fix
[fuzz] Improve fuzzer build script and docs
Carl Woffenden [Wed, 21 Aug 2019 15:49:17 +0000 (17:49 +0200)]
Tweaks to create a single-file decoder
The CHECK_F macros differ slightly (but eventually do the same thing). Older GCC needs to fallback on the old-style pragma optimisation flags.
Yann Collet [Wed, 21 Aug 2019 12:19:43 +0000 (05:19 -0700)]
Merge pull request #1724 from facebook/blockSize
clarifications on field `Block_Size`
Yann Collet [Wed, 21 Aug 2019 12:19:30 +0000 (05:19 -0700)]
Merge pull request #1725 from emaste/dev
remove extraneous doubled ;s
Yann Collet [Wed, 21 Aug 2019 12:19:12 +0000 (05:19 -0700)]
Merge pull request #1721 from facebook/seq127
fixed very minor inefficiency (nbSeq==127)
Yann Collet [Wed, 21 Aug 2019 12:17:42 +0000 (05:17 -0700)]
Merge pull request #1713 from cemeyer/fix_gcc4_build
Fix the build on GCC 4.x after
812e8f2a1
Nick Terrell [Wed, 21 Aug 2019 00:13:04 +0000 (17:13 -0700)]
[legacy] Fix buffer overflow in v0.2 and v0.4 raw literals decompression
Extends the fix in PR#1722 to v0.2 and v0.4. These aren't built into
zstd by default, and v0.5 onward are not affected.
I only add the `srcSize > BLOCKSIZE` check to v0.4 because the comments
say that it must hold, but the equivalent comment isn't present in v0.2.
Credit to OSS-Fuzz.
Nick Terrell [Tue, 20 Aug 2019 18:33:33 +0000 (11:33 -0700)]
[fuzz] Improve fuzzer build script and docs
* Remove the `make libFuzzer` target since it is broken and obsoleted
by `CC=clang CXX=clang++ ./fuzz.py build all --enable-fuzzer`. The
new `-fsanitize=fuzzer` is much better because it works with MSAN
by default.
* Improve the `./fuzz.py gen` command by making the input type explicit
when creating a new target.
* Update the `README` for `--enable-fuzzer`.
Fixes #1727.
Nick Magerko [Tue, 20 Aug 2019 21:08:26 +0000 (14:08 -0700)]
Document --size-hint
Nick Magerko [Tue, 20 Aug 2019 20:07:51 +0000 (13:07 -0700)]
Fix ZSTD_SRCSIZEHINT_MIN typo
Nick Magerko [Tue, 20 Aug 2019 20:06:15 +0000 (13:06 -0700)]
Define ZSTD_SRCSIZEHINT_MIN as 0
Nick Magerko [Tue, 20 Aug 2019 00:20:46 +0000 (17:20 -0700)]
Remove unnecessary test case
Nick Magerko [Mon, 19 Aug 2019 23:53:02 +0000 (16:53 -0700)]
Fix typo in test
Nick Magerko [Mon, 19 Aug 2019 23:50:26 +0000 (16:50 -0700)]
Revert change to zstd manual
Nick Magerko [Mon, 19 Aug 2019 23:49:25 +0000 (16:49 -0700)]
Use int for srcSizeHint when sensible
Nick Magerko [Mon, 19 Aug 2019 23:48:35 +0000 (16:48 -0700)]
Fix playTests and add additional cases
Nick Magerko [Mon, 19 Aug 2019 22:12:24 +0000 (15:12 -0700)]
Add size-hint to fuzz tests
Felix Handte [Mon, 19 Aug 2019 20:48:01 +0000 (16:48 -0400)]
v1.4.3: Merge pull request #1730 from facebook/dev
Nick Magerko [Mon, 19 Aug 2019 20:08:41 +0000 (13:08 -0700)]
Add mention of regression with poor size hints
Nick Magerko [Mon, 19 Aug 2019 19:58:54 +0000 (12:58 -0700)]
Make upper bound INT_MAX
Nick Magerko [Mon, 19 Aug 2019 19:32:43 +0000 (12:32 -0700)]
Fix fall-through case
Nick Magerko [Mon, 19 Aug 2019 15:52:08 +0000 (08:52 -0700)]
Add --size-hint=# option
Nick Magerko [Mon, 19 Aug 2019 18:20:28 +0000 (11:20 -0700)]
Keep content size flag set in stream size mode
Nick Magerko [Mon, 19 Aug 2019 18:14:56 +0000 (11:14 -0700)]
Remove extraneous variables
Nick Magerko [Mon, 19 Aug 2019 18:07:43 +0000 (11:07 -0700)]
Remove extraneous parameter
Nick Magerko [Mon, 19 Aug 2019 16:11:22 +0000 (09:11 -0700)]
Update man page
Nick Magerko [Mon, 19 Aug 2019 16:01:31 +0000 (09:01 -0700)]
Set pledged size just before compression
Yann Collet [Sat, 17 Aug 2019 06:04:42 +0000 (08:04 +0200)]
`number` instead of `nb`
suggested by @terrelln
Nick Magerko [Fri, 16 Aug 2019 19:49:21 +0000 (12:49 -0700)]
Tweak stdout, stderr redirection in new playTests
Nick Magerko [Fri, 16 Aug 2019 06:57:55 +0000 (23:57 -0700)]
Add --stream-size=# command
Yann Collet [Fri, 16 Aug 2019 13:13:42 +0000 (15:13 +0200)]
clarifications on the meaning of field `Block_Size`
following comments from Intel's Smita Kumar.
Ed Maste [Fri, 16 Aug 2019 01:17:06 +0000 (21:17 -0400)]
remove extraneous doubled ;s
Felix Handte [Thu, 15 Aug 2019 19:55:46 +0000 (15:55 -0400)]
Merge pull request #1722 from felixhandte/legacy-decompression-fix
Fix Buffer Overflow in Legacy (v0.3) Raw Literals Decompression
W. Felix Handte [Thu, 15 Aug 2019 18:42:38 +0000 (14:42 -0400)]
Add to CHANGELOG for Upcoming Release
W. Felix Handte [Thu, 15 Aug 2019 18:24:45 +0000 (14:24 -0400)]
Fix Buffer Overflow in Legacy (v0.3) Raw Literals Decompression
Yann Collet [Thu, 15 Aug 2019 14:41:34 +0000 (16:41 +0200)]
fixed very minor inefficiency (nbSeq==127)
The nbSeq "short" format (1-byte)
is compatible with any value < 128.
However, the code would cautiously only accept values < 127.
This is not an error, because the general 2-bytes format
is compatible with small values < 128.
Hence the inefficiency never triggered any warning.
Spotted by Intel's Smita Kumar.
Conrad Meyer [Thu, 8 Aug 2019 21:16:36 +0000 (14:16 -0700)]
Fix the build on GCC 4.x after
812e8f2a1
The ancient GCC 4.x doesn't understand the "optimize" attribute until 4.4.
Fix the build on platforms with GCC 4.x < 4.4 by limiting the DONT_VECTORIZE
definition to GCC 5 and greater.
Noticed and patch proposed by Warner Losh <imp@FreeBSD.org>.
Felix Handte [Tue, 6 Aug 2019 21:02:37 +0000 (17:02 -0400)]
Merge pull request #1711 from felixhandte/changelog-v1.4.3
Update Changelog for v1.4.3
W. Felix Handte [Tue, 6 Aug 2019 17:44:05 +0000 (13:44 -0400)]
Update Changelog for v1.4.3
Yann Collet [Mon, 5 Aug 2019 15:17:16 +0000 (17:17 +0200)]
bumped version number
to v1.4.3
Yann Collet [Mon, 5 Aug 2019 13:57:28 +0000 (15:57 +0200)]
Merge pull request #1705 from josepho0918/dev
Add support for IAR C/C++ Compiler for Arm
Yann Collet [Mon, 5 Aug 2019 13:56:50 +0000 (15:56 +0200)]
Merge pull request #1706 from LeeYoung624/dev
add NULL pointer check in util.c
Yann Collet [Mon, 5 Aug 2019 13:54:59 +0000 (15:54 +0200)]
Merge pull request #1709 from facebook/fix1624
Fix compression ratio inefficiency
Yann Collet [Mon, 5 Aug 2019 13:18:43 +0000 (15:18 +0200)]
factored the logic selecting lowest match index
as suggested by @terrelln
Yann Collet [Sat, 3 Aug 2019 14:43:34 +0000 (16:43 +0200)]
fix test 122
it's an unsupported scenario.
Yann Collet [Fri, 2 Aug 2019 17:31:19 +0000 (19:31 +0200)]
minor test refactoring
just for clarity, for the currently failing unit test
Yann Collet [Fri, 2 Aug 2019 16:02:54 +0000 (18:02 +0200)]
fixed minor conversion warning in datagen
Yann Collet [Fri, 2 Aug 2019 15:34:53 +0000 (17:34 +0200)]
fixed datagen
to produce same content on both 32 and 64-bit platforms
by removing floating from literal table determination.
also : added checksum trace in compression control test,
so that it's easier to determine if test fails
as a consequence of compressing a different sample.
Yann Collet [Fri, 2 Aug 2019 13:31:00 +0000 (15:31 +0200)]
regenerate sample to compress
to reduce chances of differences between 32 and 64-bit fuzzer tests
Yann Collet [Fri, 2 Aug 2019 12:42:53 +0000 (14:42 +0200)]
fixed strategies btopt+
Yann Collet [Fri, 2 Aug 2019 12:26:26 +0000 (14:26 +0200)]
fixed strategy btlazy2
Yann Collet [Fri, 2 Aug 2019 12:21:39 +0000 (14:21 +0200)]
fixed strategies greedy, lazy & lazy2
restore dictionary compression ratio
Yann Collet [Thu, 1 Aug 2019 15:12:26 +0000 (17:12 +0200)]
minor : fixed ptr arithmetic
invalid on void ptr
Yann Collet [Thu, 1 Aug 2019 14:59:22 +0000 (16:59 +0200)]
added efficiency test
to detect gross CR variations after a patch.
Tests normal and dictionary compression.
Yann Collet [Thu, 1 Aug 2019 13:58:17 +0000 (15:58 +0200)]
fixed compression ratio regression when dictionary-compressing medium-size inputs at levels 1-3
Yann Collet [Wed, 31 Jul 2019 11:43:00 +0000 (13:43 +0200)]
Merge pull request #1707 from felixhandte/travis-versions-test
Run `versionsTest` in CI
W. Felix Handte [Wed, 31 Jul 2019 00:11:25 +0000 (20:11 -0400)]
Run `versionsTest` in CI
LeeYoung624 [Mon, 29 Jul 2019 09:05:50 +0000 (17:05 +0800)]
bug fix : NULL pointer
Joseph Chen [Mon, 29 Jul 2019 07:20:37 +0000 (15:20 +0800)]
Add support for IAR C/C++ Compiler for Arm
Felix Handte [Thu, 25 Jul 2019 17:44:51 +0000 (13:44 -0400)]
v1.4.2: Merge pull request #1700 from facebook/dev
Felix Handte [Thu, 25 Jul 2019 15:56:37 +0000 (11:56 -0400)]
Merge pull request #1701 from LeeYoung624/dev
memory leak fix
LeeYoung624 [Thu, 25 Jul 2019 13:07:57 +0000 (21:07 +0800)]
memory leak fix
Felix Handte [Wed, 24 Jul 2019 23:07:55 +0000 (19:07 -0400)]
Merge pull request #1699 from felixhandte/seekable-gitignore
Add New Seekable Compression Example to .gitignore
Yann Collet [Wed, 24 Jul 2019 23:04:37 +0000 (16:04 -0700)]
updated man page
Yann Collet [Wed, 24 Jul 2019 23:03:01 +0000 (16:03 -0700)]
Merge pull request #1698 from felixhandte/bump-version-to-1.4.2
Bump Library Version Number to 1.4.2