]>
git.ipfire.org Git - thirdparty/zstd.git/log
Sen Huang [Wed, 9 Oct 2019 13:39:52 +0000 (09:39 -0400)]
Only check for filename collisions when using --output-dir-flat
Sen Huang [Tue, 8 Oct 2019 13:54:59 +0000 (09:54 -0400)]
Casting to void* to avoid C4090 warnings
Sen Huang [Tue, 8 Oct 2019 13:44:24 +0000 (09:44 -0400)]
Suppress C4090 warning
Sen Huang [Tue, 8 Oct 2019 04:15:28 +0000 (00:15 -0400)]
Hopefully fix VS compiler warning
Sen Huang [Thu, 3 Oct 2019 19:23:49 +0000 (15:23 -0400)]
Changed function name, fix test
Sen Huang [Thu, 3 Oct 2019 17:53:04 +0000 (13:53 -0400)]
Now constructs final destination path without allocating new table
Sen Huang [Wed, 2 Oct 2019 22:34:42 +0000 (18:34 -0400)]
Addressed comments on malloc
Sen Huang [Wed, 2 Oct 2019 19:30:24 +0000 (15:30 -0400)]
Static analyze fix
Sen Huang [Wed, 2 Oct 2019 15:29:34 +0000 (11:29 -0400)]
CI Tests fix
Sen Huang [Wed, 2 Oct 2019 15:18:14 +0000 (11:18 -0400)]
Removed strdup() dependency
Sen Huang [Wed, 2 Oct 2019 15:11:35 +0000 (11:11 -0400)]
Modified message
Sen Huang [Wed, 2 Oct 2019 15:08:20 +0000 (11:08 -0400)]
Add support for --output-dir-flat
New flag to specify output directory destination for multiple files.
Sen Huang [Fri, 6 Sep 2019 20:20:50 +0000 (13:20 -0700)]
fixes for windows compilation
Sen Huang [Fri, 6 Sep 2019 18:10:53 +0000 (11:10 -0700)]
fixes for tests and segfault
Sen Huang [Fri, 6 Sep 2019 17:17:04 +0000 (10:17 -0700)]
kill memory leaks, cleanup, fix some dumb bugs
Sen Huang [Fri, 6 Sep 2019 00:56:24 +0000 (17:56 -0700)]
added decompression support
Sen Huang [Thu, 5 Sep 2019 23:03:35 +0000 (16:03 -0700)]
adding support for -O flag: multiple files into one directory for compressions (decompression to come)
Yann Collet [Wed, 4 Sep 2019 21:51:23 +0000 (14:51 -0700)]
Merge pull request #1770 from cwoffenden/amalgamate-correctness
Single file decoder correctness and tidy
Carl Woffenden [Mon, 2 Sep 2019 16:15:31 +0000 (18:15 +0200)]
Minor: documented sizes smaller
Carl Woffenden [Mon, 2 Sep 2019 16:02:50 +0000 (18:02 +0200)]
Correctness and tidy
Test compilation performed with warnings. Author and license added. Test for failing grep on ancient OSX versions. Replaced the test image with something less noisy (which compresses better).
Yann Collet [Mon, 2 Sep 2019 01:11:54 +0000 (18:11 -0700)]
Merge pull request #1769 from cybojanek/update_streaming_examples
Fix streaming compression/decompression examples
Jan Kasiak [Sun, 1 Sep 2019 19:35:53 +0000 (15:35 -0400)]
Fix streaming compression/decompression examples
* Handle compression of empty file
* Error in decompression in case of trailing data
Yann Collet [Fri, 30 Aug 2019 17:48:02 +0000 (10:48 -0700)]
Merge pull request #1761 from terrelln/regression
[regression] small improvement from RLE blocks
Nick Terrell [Fri, 30 Aug 2019 01:05:58 +0000 (18:05 -0700)]
[regression] small improvement from RLE blocks
Yann Collet [Thu, 29 Aug 2019 22:19:10 +0000 (15:19 -0700)]
Merge pull request #1744 from bimbashrestha/dev
Generate RLE blocks in the encoder
Yann Collet [Thu, 29 Aug 2019 19:09:09 +0000 (12:09 -0700)]
Merge pull request #1754 from facebook/decTest
Tests for single-file decompressor
Bimba Shrestha [Thu, 29 Aug 2019 19:05:47 +0000 (12:05 -0700)]
Undoing the last commit (that was an accident)
bimbashrestha [Thu, 29 Aug 2019 18:55:12 +0000 (11:55 -0700)]
Adding method for extracting sequences.
Yann Collet [Thu, 29 Aug 2019 16:48:12 +0000 (09:48 -0700)]
Merge branch 'dev' into decTest
Yann Collet [Thu, 29 Aug 2019 16:47:28 +0000 (09:47 -0700)]
Merge pull request #1755 from cwoffenden/amalgamate-c99-fixes
C99 and older GCC fixes
Carl Woffenden [Thu, 29 Aug 2019 09:16:57 +0000 (11:16 +0200)]
C99 and older GCC fixes
Yann Collet [Wed, 28 Aug 2019 20:46:18 +0000 (13:46 -0700)]
update test script
Yann Collet [Wed, 28 Aug 2019 20:23:48 +0000 (13:23 -0700)]
fix create_ script for sh
Yann Collet [Wed, 28 Aug 2019 19:26:29 +0000 (12:26 -0700)]
Merge pull request #1749 from facebook/rmadapt
removed adaptive-compression
Yann Collet [Wed, 28 Aug 2019 19:17:29 +0000 (12:17 -0700)]
Merge branch 'dev' into decTest
Yann Collet [Wed, 28 Aug 2019 19:14:29 +0000 (12:14 -0700)]
Merge pull request #1750 from cwoffenden/amalgamate-bash2sh
Rewrote the scripts to use sh instead of bash
Carl Woffenden [Wed, 28 Aug 2019 17:20:42 +0000 (19:20 +0200)]
Rewrote the scripts to sh instead of bash
bimbashrestha [Wed, 28 Aug 2019 15:32:34 +0000 (08:32 -0700)]
Added test for multiple blocks of zeros and fixed nit about comments
Yann Collet [Tue, 27 Aug 2019 23:38:21 +0000 (16:38 -0700)]
try to debug issues on CirrusCI
Yann Collet [Tue, 27 Aug 2019 23:04:12 +0000 (16:04 -0700)]
added single_file_decoder to contrib/ tests
Yann Collet [Tue, 27 Aug 2019 23:01:39 +0000 (16:01 -0700)]
minor script renaming, for clarity
Yann Collet [Tue, 27 Aug 2019 22:50:47 +0000 (15:50 -0700)]
changed contrib project name for clarity
Yann Collet [Tue, 27 Aug 2019 21:50:18 +0000 (14:50 -0700)]
removed associated test
Yann Collet [Tue, 27 Aug 2019 21:47:40 +0000 (14:47 -0700)]
removed adaptive-compression
the functionality is already integrated into `zstd` through `--adapt` command
Nick Terrell [Tue, 27 Aug 2019 17:17:28 +0000 (10:17 -0700)]
Merge pull request #1748 from terrelln/cover-deadlock
[dictBuilder] Fix deadlock in *COVER error case
Yann Collet [Tue, 27 Aug 2019 17:05:26 +0000 (10:05 -0700)]
Merge pull request #1739 from cwoffenden/amalgamate
Tweaks to create a single-file decompressor
Carl Woffenden [Tue, 27 Aug 2019 15:12:57 +0000 (17:12 +0200)]
Fixed test failure when Emscripten not present
Carl Woffenden [Tue, 27 Aug 2019 14:57:23 +0000 (16:57 +0200)]
Minor repetition
Carl Woffenden [Tue, 27 Aug 2019 14:55:03 +0000 (16:55 +0200)]
Typo
Carl Woffenden [Tue, 27 Aug 2019 13:53:26 +0000 (15:53 +0200)]
Added clarification
Carl Woffenden [Tue, 27 Aug 2019 13:51:14 +0000 (15:51 +0200)]
Added reasoning
Carl Woffenden [Tue, 27 Aug 2019 13:38:34 +0000 (15:38 +0200)]
Typo
Carl Woffenden [Tue, 27 Aug 2019 13:36:06 +0000 (15:36 +0200)]
Added test script; tidied and documented
The test script combines the sources then builds and runs an example. A futher example is built if the Emscripten compiler is available on the system. Documentation covers building.
Nick Terrell [Tue, 27 Aug 2019 01:32:08 +0000 (18:32 -0700)]
[test][dictBuilder] Add multithreaded tests
Nick Terrell [Tue, 27 Aug 2019 01:19:29 +0000 (18:19 -0700)]
[dictBuilder] Fix deadlock in *COVER error case
The COVER and FASTCOVER dictionary builders can deadlock when
dictionary construction errors, likely because there are too few
samples, or too few distinct dmers. The deadlock only occurs when
there are errors.
Fixes #1746.
bimbashrestha [Mon, 26 Aug 2019 22:30:41 +0000 (15:30 -0700)]
Added bool to cctx and fixed some comment nits
bimbashrestha [Mon, 26 Aug 2019 22:00:50 +0000 (15:00 -0700)]
Fixing mixed declaration compiler complaint
bimbashrestha [Mon, 26 Aug 2019 21:54:29 +0000 (14:54 -0700)]
Forbiding emission of RLE when its the first block
bimbashrestha [Mon, 26 Aug 2019 21:34:43 +0000 (14:34 -0700)]
Removing accidental method call
Carl Woffenden [Mon, 26 Aug 2019 19:28:19 +0000 (21:28 +0200)]
Added Emscripten example, removed Buck, minor tidy
Work-in-progress. Added simple Emscripten WebGL example that adds 25kB when build with Zstd. Removed Buck (will replace). Minor correctness.
bimbashrestha [Mon, 26 Aug 2019 19:26:53 +0000 (12:26 -0700)]
Removing assert for rle that doesn't always hold
bimbashrestha [Mon, 26 Aug 2019 16:00:22 +0000 (09:00 -0700)]
Using typedef U32 instead of int
bimbashrestha [Mon, 26 Aug 2019 15:51:34 +0000 (08:51 -0700)]
Removing implicit conversion from const void* to const BYTE* and added constant for threshold
Carl Woffenden [Mon, 26 Aug 2019 05:48:57 +0000 (07:48 +0200)]
Able to test combine script; minor tidy
Carl Woffenden [Sun, 25 Aug 2019 20:49:01 +0000 (22:49 +0200)]
Preparing to run tests
Combine script more robust and can output to a specified file. Initial buck files added (work in progress).
Carl Woffenden [Fri, 23 Aug 2019 21:09:13 +0000 (23:09 +0200)]
Minor fix for files with spaces. Typo.
Carl Woffenden [Fri, 23 Aug 2019 21:05:02 +0000 (23:05 +0200)]
Merge branch 'dev' into amalgamate
Carl Woffenden [Fri, 23 Aug 2019 21:04:21 +0000 (23:04 +0200)]
Revert "Merge remote-tracking branch 'origin/master' into dev"
This reverts commit
0df29a4e5ff118ec7aa870ea9c032e9f99870e43 , reversing
changes made to
69c875a0cc771098f9ae9bb7a0a3e3ff6eb3f5c1 .
Carl Woffenden [Fri, 23 Aug 2019 21:03:52 +0000 (23:03 +0200)]
Merge remote-tracking branch 'upstream/dev' into dev
Carl Woffenden [Fri, 23 Aug 2019 20:57:06 +0000 (22:57 +0200)]
Merge remote-tracking branch 'origin/master' into dev
Nick Terrell [Fri, 23 Aug 2019 17:16:10 +0000 (10:16 -0700)]
Merge pull request #1733 from nmagerko/size-hint
Add --size-hint=# option
Nick Terrell [Fri, 23 Aug 2019 17:15:52 +0000 (10:15 -0700)]
Merge pull request #1745 from terrelln/regression-driver
[fuzz] Add a DEBUGLOG(3) statement to print file
Carl Woffenden [Fri, 23 Aug 2019 16:43:29 +0000 (18:43 +0200)]
Added generator script and simple test
The script will combine decompressor sources into a single file. The example shows this in use.
Nick Terrell [Fri, 23 Aug 2019 00:27:15 +0000 (17:27 -0700)]
[fuzz] Add a DEBUGLOG(3) statement to print file
Enable it by building with this command:
```
./fuzz.py build all --debug 3
```
bimbashrestha [Thu, 22 Aug 2019 20:54:41 +0000 (13:54 -0700)]
Fixing more test falure errors
bimbashrestha [Thu, 22 Aug 2019 20:46:15 +0000 (13:46 -0700)]
Fixing ci-circle test failure issues
bimbashrestha [Thu, 22 Aug 2019 19:12:44 +0000 (12:12 -0700)]
Moving RLE logic to inside ZSTD_compressBlock_internal and adding assert
Nick Magerko [Thu, 22 Aug 2019 18:51:41 +0000 (11:51 -0700)]
Fix merge conflicts
Nick Terrell [Thu, 22 Aug 2019 18:31:15 +0000 (11:31 -0700)]
Merge pull request #1726 from nmagerko/stream-size
Add --stream-size=# option
bimbashrestha [Thu, 22 Aug 2019 18:27:20 +0000 (11:27 -0700)]
Generate RLE blocks in the encoder
Nick Magerko [Thu, 22 Aug 2019 16:37:47 +0000 (09:37 -0700)]
Differentiate --stream-size from --size-hint
Nick Magerko [Thu, 22 Aug 2019 16:13:28 +0000 (09:13 -0700)]
Minor documentation update
Nick Magerko [Wed, 21 Aug 2019 17:27:54 +0000 (10:27 -0700)]
Remove bc from play tests
Nick Terrell [Wed, 21 Aug 2019 17:10:24 +0000 (10:10 -0700)]
Merge pull request #1737 from terrelln/legacy-fix
[legacy] Fix buffer overflow in v0.2 and v0.4 raw literals decompression
Nick Terrell [Wed, 21 Aug 2019 17:09:38 +0000 (10:09 -0700)]
Merge pull request #1736 from terrelln/fuzz-fix
[fuzz] Improve fuzzer build script and docs
Carl Woffenden [Wed, 21 Aug 2019 15:49:17 +0000 (17:49 +0200)]
Tweaks to create a single-file decoder
The CHECK_F macros differ slightly (but eventually do the same thing). Older GCC needs to fallback on the old-style pragma optimisation flags.
Yann Collet [Wed, 21 Aug 2019 12:19:43 +0000 (05:19 -0700)]
Merge pull request #1724 from facebook/blockSize
clarifications on field `Block_Size`
Yann Collet [Wed, 21 Aug 2019 12:19:30 +0000 (05:19 -0700)]
Merge pull request #1725 from emaste/dev
remove extraneous doubled ;s
Yann Collet [Wed, 21 Aug 2019 12:19:12 +0000 (05:19 -0700)]
Merge pull request #1721 from facebook/seq127
fixed very minor inefficiency (nbSeq==127)
Yann Collet [Wed, 21 Aug 2019 12:17:42 +0000 (05:17 -0700)]
Merge pull request #1713 from cemeyer/fix_gcc4_build
Fix the build on GCC 4.x after
812e8f2a1
Nick Terrell [Wed, 21 Aug 2019 00:13:04 +0000 (17:13 -0700)]
[legacy] Fix buffer overflow in v0.2 and v0.4 raw literals decompression
Extends the fix in PR#1722 to v0.2 and v0.4. These aren't built into
zstd by default, and v0.5 onward are not affected.
I only add the `srcSize > BLOCKSIZE` check to v0.4 because the comments
say that it must hold, but the equivalent comment isn't present in v0.2.
Credit to OSS-Fuzz.
Nick Terrell [Tue, 20 Aug 2019 18:33:33 +0000 (11:33 -0700)]
[fuzz] Improve fuzzer build script and docs
* Remove the `make libFuzzer` target since it is broken and obsoleted
by `CC=clang CXX=clang++ ./fuzz.py build all --enable-fuzzer`. The
new `-fsanitize=fuzzer` is much better because it works with MSAN
by default.
* Improve the `./fuzz.py gen` command by making the input type explicit
when creating a new target.
* Update the `README` for `--enable-fuzzer`.
Fixes #1727.
Nick Magerko [Tue, 20 Aug 2019 21:08:26 +0000 (14:08 -0700)]
Document --size-hint
Nick Magerko [Tue, 20 Aug 2019 20:07:51 +0000 (13:07 -0700)]
Fix ZSTD_SRCSIZEHINT_MIN typo
Nick Magerko [Tue, 20 Aug 2019 20:06:15 +0000 (13:06 -0700)]
Define ZSTD_SRCSIZEHINT_MIN as 0
Nick Magerko [Tue, 20 Aug 2019 00:20:46 +0000 (17:20 -0700)]
Remove unnecessary test case
Nick Magerko [Mon, 19 Aug 2019 23:53:02 +0000 (16:53 -0700)]
Fix typo in test
Nick Magerko [Mon, 19 Aug 2019 23:50:26 +0000 (16:50 -0700)]
Revert change to zstd manual
Nick Magerko [Mon, 19 Aug 2019 23:49:25 +0000 (16:49 -0700)]
Use int for srcSizeHint when sensible
Nick Magerko [Mon, 19 Aug 2019 23:48:35 +0000 (16:48 -0700)]
Fix playTests and add additional cases