]>
git.ipfire.org Git - thirdparty/zstd.git/log
moozzyk [Wed, 23 Oct 2019 06:21:54 +0000 (23:21 -0700)]
Take ZSTD_parameters as a const pointer
Fixes: #1637
Nick Terrell [Wed, 23 Oct 2019 00:58:31 +0000 (17:58 -0700)]
Merge pull request #1840 from terrelln/regression-fix
[regression] Fix the old streaming regression test
Yann Collet [Wed, 23 Oct 2019 00:43:09 +0000 (17:43 -0700)]
added documentation on DYNAMIC_BMI2 build macro
Yann Collet [Tue, 22 Oct 2019 23:22:55 +0000 (16:22 -0700)]
Merge pull request #1838 from facebook/fixAdvanced
fix initCStream_advanced() for fast strategies
Nick Terrell [Tue, 22 Oct 2019 22:29:48 +0000 (15:29 -0700)]
[regression] Fix the old streaming regression test
* A copy-paste error made it so we weren't running the advanced/cdict
streaming tests with the old API.
* Clean up the old streaming tests to skip incompatible configs.
* Update `results.csv`.
The tests now catch the bug in #1787.
Yann Collet [Tue, 22 Oct 2019 22:19:04 +0000 (15:19 -0700)]
Merge pull request #1836 from facebook/dirFlat2
Added --output-dir-flat=
Yann Collet [Tue, 22 Oct 2019 21:57:15 +0000 (14:57 -0700)]
fix initCStream_advanced() for fast strategies
Compression ratio of fast strategies (levels 1 & 2)
was seriously reduced, due to accidental disabling of Literals compression.
Credit to @QrczakMK, which perfectly described the issue, and implementation details,
making the fix straightforward.
Example : initCStream with level 1 on synthetic sample P50 :
Before : 5,273,976 bytes
After : 3,154,678 bytes
ZSTD_compress (for comparison) : 3,154,550
Fix #1787.
To follow : refactor the test which was supposed to catch this issue (and failed)
Yann Collet [Tue, 22 Oct 2019 20:51:18 +0000 (13:51 -0700)]
update documentation on deprecated functions
mostly : note that these functions will soon generate deprecation warnings
Nick Terrell [Tue, 22 Oct 2019 17:50:14 +0000 (10:50 -0700)]
Merge pull request #1837 from terrelln/magic-isnt-real
Fix ZSTD_f_zstd1_magicless for small data
Nick Terrell [Tue, 22 Oct 2019 02:42:14 +0000 (19:42 -0700)]
Fix ZSTD_f_zstd1_magicless for small data
* Fix `ZSTD_FRAMEHEADERSIZE_PREFIX` and `ZSTD_FRAMEHEADERSIZE_MIN` to
take a `format` parameter, so it is impossible to get the wrong size.
* Fix the places that called `ZSTD_FRAMEHEADERSIZE_PREFIX` without
taking the format into account, which is now impossible by design.
* Call `ZSTD_frameHeaderSize_internal()` with `dctx->format`.
* The added tests catch both bugs in `ZSTD_decompressFrame()`.
Fixes #1813.
Nick Terrell [Mon, 21 Oct 2019 22:53:57 +0000 (15:53 -0700)]
Merge pull request #1831 from terrelln/zstdmt-bad-memset
[zstdmt] Don't memset the jobDescription
Yann Collet [Mon, 21 Oct 2019 21:33:50 +0000 (14:33 -0700)]
Added --output-dir-flat=
which is a preferred construction when applicable.
Also, added --output-dir-flat into man page.
Yann Collet [Mon, 21 Oct 2019 20:45:17 +0000 (13:45 -0700)]
Merge pull request #1834 from facebook/winFix
Windows fixes
Yann Collet [Mon, 21 Oct 2019 19:55:39 +0000 (12:55 -0700)]
turned off zlib tests during msan
since the local zlib library is not msan-instrumented
Yann Collet [Mon, 21 Oct 2019 19:14:59 +0000 (12:14 -0700)]
minor refactor of FIO_compressGzFrame()
mostly narrowing variables lifetime and mutability.
Felix Handte [Mon, 21 Oct 2019 16:15:17 +0000 (12:15 -0400)]
Merge pull request #1795 from felixhandte/workspace-asan
Add Poisoned Redzones to the Workspace When Compiling with ASAN
Yann Collet [Sat, 19 Oct 2019 12:24:42 +0000 (05:24 -0700)]
Merge pull request #1835 from facebook/format034
clarifications for the FSE decoding table
Yann Collet [Sat, 19 Oct 2019 00:48:12 +0000 (17:48 -0700)]
clarifications for the FSE decoding table
requested in #1782
Yann Collet [Sat, 19 Oct 2019 00:23:39 +0000 (17:23 -0700)]
Merge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Sat, 19 Oct 2019 00:22:45 +0000 (17:22 -0700)]
added mode documentation on ZSTD_CLEVEL
providing range restriction [1-19] explicitly
partially answering #1829
Yann Collet [Sat, 19 Oct 2019 00:08:52 +0000 (17:08 -0700)]
fixed visual defined test
Yann Collet [Sat, 19 Oct 2019 00:05:42 +0000 (17:05 -0700)]
removed Visual warning
for pointer casts
Nick Terrell [Fri, 18 Oct 2019 23:35:23 +0000 (16:35 -0700)]
Merge pull request #1832 from terrelln/fuzz-stream-fix
[fuzz] Increase output buffer size of stream_round_trip
Yann Collet [Fri, 18 Oct 2019 22:45:31 +0000 (15:45 -0700)]
fix function cast warning on Windows with gcc9
Yann Collet [Fri, 18 Oct 2019 22:41:12 +0000 (15:41 -0700)]
updated windows binary resources
Yann Collet [Fri, 18 Oct 2019 22:37:07 +0000 (15:37 -0700)]
validated 'make test' for mingw environment
Yann Collet [Fri, 18 Oct 2019 22:21:50 +0000 (15:21 -0700)]
made `make check` faster
for shorter feedback loop
Nick Terrell [Fri, 18 Oct 2019 17:59:15 +0000 (10:59 -0700)]
[zstdmt] Don't memset the jobDescription
Nick Terrell [Fri, 18 Oct 2019 19:33:45 +0000 (12:33 -0700)]
[threading] Add debug utilities
Yann Collet [Fri, 18 Oct 2019 22:02:30 +0000 (15:02 -0700)]
minor appveyor test script fix
Yann Collet [Fri, 18 Oct 2019 21:52:16 +0000 (14:52 -0700)]
attempt to run 'make check' tests on Appveyor
for mingw builds
Yann Collet [Fri, 18 Oct 2019 21:28:34 +0000 (14:28 -0700)]
fix test on windows
isDirectory() doesn't work on Windows
if directory name is followed by '/'
Nick Terrell [Fri, 18 Oct 2019 20:34:35 +0000 (13:34 -0700)]
[fuzz] Increase output buffer size of stream_round_trip
Fixes OSS-Fuzz crash.
Credit to OSS-Fuzz
Yann Collet [Fri, 18 Oct 2019 18:15:10 +0000 (11:15 -0700)]
rewrite FIO_createFilename_fromOutDir()
Yann Collet [Thu, 17 Oct 2019 23:58:49 +0000 (16:58 -0700)]
fix : no output file opened in test mode
also : redistributed error code within fileio.c
for more precise diagnosis.
Yann Collet [Thu, 17 Oct 2019 23:39:47 +0000 (16:39 -0700)]
removed regular file test on Windows
since it does not work well on this platform
(tested with MinGW).
Note : could be an issue within UTIL_isRegularFile()
Yann Collet [Thu, 17 Oct 2019 23:09:53 +0000 (16:09 -0700)]
improved test mode `-t`
The test mode do no longer open a file `/dev/null` nor write anything to output.
This is supposed to be more efficient than writing to `/dev/null`,
and more universal too : the previous method was failing on Windows.
Yann Collet [Thu, 17 Oct 2019 22:32:03 +0000 (15:32 -0700)]
refactored FIO_compressMultipleFilenames() prototype
for consistency
Yann Collet [Thu, 17 Oct 2019 22:27:25 +0000 (15:27 -0700)]
fixed multiple implicit casts
Yann Collet [Thu, 17 Oct 2019 22:07:47 +0000 (15:07 -0700)]
tests: can override isTerminal with environment variable
Yann Collet [Thu, 17 Oct 2019 21:31:42 +0000 (14:31 -0700)]
fixed isSameFile()
Yann Collet [Thu, 17 Oct 2019 21:29:48 +0000 (14:29 -0700)]
fix harness test
Yann Collet [Thu, 17 Oct 2019 21:15:00 +0000 (14:15 -0700)]
fixed dict ptr init
Yann Collet [Thu, 17 Oct 2019 21:11:54 +0000 (14:11 -0700)]
minor refactoring of harness
Yann Collet [Thu, 17 Oct 2019 21:03:20 +0000 (14:03 -0700)]
minor: DIFF determination
use gdiff on SunOS
Yann Collet [Thu, 17 Oct 2019 20:01:18 +0000 (13:01 -0700)]
force compression during tests
to erase potentially remaining artifacts from previous runs
Yann Collet [Thu, 17 Oct 2019 18:01:20 +0000 (11:01 -0700)]
fix several cast
Yann Collet [Thu, 17 Oct 2019 17:56:14 +0000 (10:56 -0700)]
fix incorrect dictName/FileName comparison on Windows
inode identification does not seem to work on Windows,
even with on a msys2 posix layer.
Yann Collet [Thu, 17 Oct 2019 17:50:58 +0000 (10:50 -0700)]
Merge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Thu, 17 Oct 2019 17:50:39 +0000 (10:50 -0700)]
ignore build artifact from educational decoder test
Yann Collet [Thu, 17 Oct 2019 17:30:58 +0000 (10:30 -0700)]
Merge pull request #1827 from facebook/dm_Dct
updated erroneous comments using ZSTD_dm_*
Yann Collet [Thu, 17 Oct 2019 00:27:03 +0000 (17:27 -0700)]
removed UNALIGNED() macro from educational decoder
as this name collides with existing macro in mingw64+clang9.
Yann Collet [Thu, 17 Oct 2019 00:21:47 +0000 (17:21 -0700)]
Merge pull request #1828 from bimbashrestha/education_decoder_check
Removing unnecessary check on education decoder
Yann Collet [Wed, 16 Oct 2019 23:45:15 +0000 (16:45 -0700)]
Merge pull request #1815 from facebook/zlibwrap
make zlibWrapper strict ISO-C90 compatible
Yann Collet [Wed, 16 Oct 2019 23:43:36 +0000 (16:43 -0700)]
Merge pull request #1826 from facebook/noWild8
removed wildcopy8()
Bimba Shrestha [Wed, 16 Oct 2019 23:26:46 +0000 (16:26 -0700)]
Removing unnecessary check from decode side
Yann Collet [Wed, 16 Oct 2019 23:14:04 +0000 (16:14 -0700)]
updated erroneous comments using ZSTD_dm_*
instead of the current ZSTD_dct_*,
reported by @nigeltao (#1822)
Yann Collet [Wed, 16 Oct 2019 21:51:33 +0000 (14:51 -0700)]
removed wildcopy8()
which is no longer used,
noticed by @davidbolvansky
Yann Collet [Tue, 15 Oct 2019 23:09:18 +0000 (16:09 -0700)]
minor comments & refactoring
Yann Collet [Mon, 14 Oct 2019 16:34:56 +0000 (09:34 -0700)]
Merge pull request #1731 from chungy/stdin_nochmod
[programs] don’t do chmod when coming from stdin or multiple files
Yann Collet [Mon, 14 Oct 2019 16:27:25 +0000 (09:27 -0700)]
Merge pull request #1792 from dmitri-shubin/dev
Don't hardcode installation directories in CMakeLists.txt
Yann Collet [Mon, 14 Oct 2019 16:25:05 +0000 (09:25 -0700)]
Merge pull request #1812 from senhuang42/output-dir-flat
Support for --output-dir-flat: output into a directory
Yann Collet [Mon, 14 Oct 2019 16:20:18 +0000 (09:20 -0700)]
Merge pull request #1823 from vangyzen/fwrite_errno
Include errno in all fwrite error messages in fileio.c
Yann Collet [Thu, 10 Oct 2019 20:11:18 +0000 (13:11 -0700)]
Merge pull request #1760 from bimbashrestha/extract_sequences_api
Adding api for extracting sequences from seqstore
W. Felix Handte [Thu, 10 Oct 2019 19:02:08 +0000 (15:02 -0400)]
Fix CCtx Size Estimation
W. Felix Handte [Thu, 10 Oct 2019 17:45:55 +0000 (13:45 -0400)]
Expand Default Redzone Size
W. Felix Handte [Tue, 17 Sep 2019 15:35:49 +0000 (11:35 -0400)]
Check if CCtx in Workspace after Null Check
W. Felix Handte [Mon, 16 Sep 2019 23:04:05 +0000 (19:04 -0400)]
Declare the ASAN Functions We Need, Don't Include the Header
W. Felix Handte [Mon, 16 Sep 2019 22:06:16 +0000 (18:06 -0400)]
Stop Allocating Extra Space for Table Redzones
W. Felix Handte [Mon, 16 Sep 2019 21:56:28 +0000 (17:56 -0400)]
Don't Try to Redzone the Tables
W. Felix Handte [Mon, 16 Sep 2019 21:47:29 +0000 (17:47 -0400)]
Fix Workspace Size Calculation
W. Felix Handte [Mon, 16 Sep 2019 21:45:40 +0000 (17:45 -0400)]
Fix ZSTD_sizeof_matchState() Calculation
W. Felix Handte [Mon, 16 Sep 2019 21:43:55 +0000 (17:43 -0400)]
Avoid ASAN Failure in ZSTD_cwksp_free()
W. Felix Handte [Mon, 16 Sep 2019 21:43:05 +0000 (17:43 -0400)]
Refactor Freeing CCtxes / CDicts Inside Workspaces
W. Felix Handte [Thu, 12 Sep 2019 23:41:45 +0000 (19:41 -0400)]
Surround Workspace Allocs with Dead Zone
W. Felix Handte [Thu, 12 Sep 2019 23:40:38 +0000 (19:40 -0400)]
Add `ZSTD_cwksp_alloc_size()` to Help Calculate Needed Workspace Size
W. Felix Handte [Thu, 12 Sep 2019 22:39:46 +0000 (18:39 -0400)]
Stop Assuming Tables are Adjacent
W. Felix Handte [Thu, 12 Sep 2019 22:33:00 +0000 (18:33 -0400)]
Poison Unused Workspace Memory
W. Felix Handte [Thu, 12 Sep 2019 22:32:22 +0000 (18:32 -0400)]
Detect Whether We're Being Compiled with ASAN
W. Felix Handte [Thu, 12 Sep 2019 22:24:44 +0000 (18:24 -0400)]
Remove Unused MEM_SKIP_MSAN Macro
Eric van Gyzen [Thu, 10 Oct 2019 14:21:29 +0000 (09:21 -0500)]
Include errno in all fwrite error messages in fileio.c
Sen Huang [Wed, 9 Oct 2019 13:39:52 +0000 (09:39 -0400)]
Only check for filename collisions when using --output-dir-flat
Nick Terrell [Tue, 8 Oct 2019 21:58:16 +0000 (17:58 -0400)]
Merge pull request #1820 from mhlakhani/dev
Add OSS-Fuzz fuzzing badge
Hasnain Lakhani [Tue, 8 Oct 2019 21:13:45 +0000 (14:13 -0700)]
Add OSS-Fuzz fuzzing badge
This is basically redoing https://github.com/facebook/zstd/pull/1818 by @inferno-chromium from the OSS-Fuzz team
Sen Huang [Tue, 8 Oct 2019 13:54:59 +0000 (09:54 -0400)]
Casting to void* to avoid C4090 warnings
Sen Huang [Tue, 8 Oct 2019 13:44:24 +0000 (09:44 -0400)]
Suppress C4090 warning
Sen Huang [Tue, 8 Oct 2019 04:15:28 +0000 (00:15 -0400)]
Hopefully fix VS compiler warning
Yann Collet [Fri, 4 Oct 2019 22:09:52 +0000 (15:09 -0700)]
fixed init warning
Bimba Shrestha [Fri, 4 Oct 2019 17:29:29 +0000 (10:29 -0700)]
Merge pull request #1 from facebook/dev
Merging main dev
Sen Huang [Thu, 3 Oct 2019 19:23:49 +0000 (15:23 -0400)]
Changed function name, fix test
Sen Huang [Thu, 3 Oct 2019 17:53:04 +0000 (13:53 -0400)]
Now constructs final destination path without allocating new table
Bimba Shrestha [Thu, 3 Oct 2019 16:26:51 +0000 (09:26 -0700)]
Manually moving instead of memcpy on decoder and using genBuffer()
Bimba Shrestha [Thu, 3 Oct 2019 13:42:40 +0000 (06:42 -0700)]
Cleaning sequence parsing logic
Yann Collet [Thu, 3 Oct 2019 00:41:19 +0000 (17:41 -0700)]
zlibwrapper : fixed flag-variable name
release doesn't use specific std/debug flags
Yann Collet [Thu, 3 Oct 2019 00:32:19 +0000 (17:32 -0700)]
updated tests for zlibwrapper C90 strict compatibility
Sen Huang [Wed, 2 Oct 2019 22:34:42 +0000 (18:34 -0400)]
Addressed comments on malloc
Sen Huang [Wed, 2 Oct 2019 19:30:24 +0000 (15:30 -0400)]
Static analyze fix
Sen Huang [Wed, 2 Oct 2019 15:29:34 +0000 (11:29 -0400)]
CI Tests fix
Sen Huang [Wed, 2 Oct 2019 15:18:14 +0000 (11:18 -0400)]
Removed strdup() dependency
Sen Huang [Wed, 2 Oct 2019 15:11:35 +0000 (11:11 -0400)]
Modified message