]>
git.ipfire.org Git - thirdparty/zstd.git/log
Ahmed Abdellah [Fri, 25 Oct 2019 14:54:52 +0000 (15:54 +0100)]
adding some functional tests
Ahmed Abdellah [Thu, 24 Oct 2019 19:54:40 +0000 (20:54 +0100)]
fixing free const char** filenamesTable
Ahmed Abdellah [Thu, 24 Oct 2019 15:20:58 +0000 (16:20 +0100)]
fixing type conversion error
Ahmed Abdellah [Thu, 24 Oct 2019 14:25:48 +0000 (15:25 +0100)]
fixing AppVeyor errors
Ahmed Abdellah [Thu, 24 Oct 2019 13:42:37 +0000 (14:42 +0100)]
fixing some warning
Ahmed Abdellah [Thu, 24 Oct 2019 13:21:01 +0000 (14:21 +0100)]
fixing some warning
Ahmed Abdellah [Thu, 24 Oct 2019 12:51:12 +0000 (13:51 +0100)]
fixing newTable issues and some warnings
Ahmed Abdellah [Thu, 24 Oct 2019 10:35:26 +0000 (11:35 +0100)]
removing extra logs
Ahmed Abdellah [Thu, 24 Oct 2019 10:10:13 +0000 (11:10 +0100)]
fixing continuous integeration errors and removing a lot of logs
Ahmed Abdellah [Thu, 24 Oct 2019 09:30:05 +0000 (10:30 +0100)]
fixing c90 issue in util.c cont.
Ahmed Abdellah [Thu, 24 Oct 2019 09:23:36 +0000 (10:23 +0100)]
fixing c90 issue in util.c cont. again
Ahmed Abdellah [Thu, 24 Oct 2019 09:17:31 +0000 (10:17 +0100)]
fixing c90 issue in util.c cont.
Ahmed Abdellah [Thu, 24 Oct 2019 09:12:51 +0000 (10:12 +0100)]
fixing c90 issue in util.c
Ahmed Abdellah [Thu, 24 Oct 2019 08:39:16 +0000 (09:39 +0100)]
fixing memory leak issue and removing c90 issue
Ahmed Abdellah [Wed, 23 Oct 2019 19:22:07 +0000 (20:22 +0100)]
solving the rest of C90 issues in defining local variables in middle of code and comparing uncompatible types
Ahmed Abdellah [Wed, 23 Oct 2019 19:14:48 +0000 (20:14 +0100)]
solving C90 issues in defining local variables in middle of code and comparing uncompatible types
AhmedAbdellah19 [Wed, 23 Oct 2019 18:29:01 +0000 (20:29 +0200)]
Merge branch 'dev' into adding_read_files_from_file_feature
Nick Terrell [Wed, 23 Oct 2019 00:58:31 +0000 (17:58 -0700)]
Merge pull request #1840 from terrelln/regression-fix
[regression] Fix the old streaming regression test
Yann Collet [Wed, 23 Oct 2019 00:43:09 +0000 (17:43 -0700)]
added documentation on DYNAMIC_BMI2 build macro
Yann Collet [Tue, 22 Oct 2019 23:22:55 +0000 (16:22 -0700)]
Merge pull request #1838 from facebook/fixAdvanced
fix initCStream_advanced() for fast strategies
Nick Terrell [Tue, 22 Oct 2019 22:29:48 +0000 (15:29 -0700)]
[regression] Fix the old streaming regression test
* A copy-paste error made it so we weren't running the advanced/cdict
streaming tests with the old API.
* Clean up the old streaming tests to skip incompatible configs.
* Update `results.csv`.
The tests now catch the bug in #1787.
Yann Collet [Tue, 22 Oct 2019 22:19:04 +0000 (15:19 -0700)]
Merge pull request #1836 from facebook/dirFlat2
Added --output-dir-flat=
Yann Collet [Tue, 22 Oct 2019 21:57:15 +0000 (14:57 -0700)]
fix initCStream_advanced() for fast strategies
Compression ratio of fast strategies (levels 1 & 2)
was seriously reduced, due to accidental disabling of Literals compression.
Credit to @QrczakMK, which perfectly described the issue, and implementation details,
making the fix straightforward.
Example : initCStream with level 1 on synthetic sample P50 :
Before : 5,273,976 bytes
After : 3,154,678 bytes
ZSTD_compress (for comparison) : 3,154,550
Fix #1787.
To follow : refactor the test which was supposed to catch this issue (and failed)
Yann Collet [Tue, 22 Oct 2019 20:51:18 +0000 (13:51 -0700)]
update documentation on deprecated functions
mostly : note that these functions will soon generate deprecation warnings
Nick Terrell [Tue, 22 Oct 2019 17:50:14 +0000 (10:50 -0700)]
Merge pull request #1837 from terrelln/magic-isnt-real
Fix ZSTD_f_zstd1_magicless for small data
Nick Terrell [Tue, 22 Oct 2019 02:42:14 +0000 (19:42 -0700)]
Fix ZSTD_f_zstd1_magicless for small data
* Fix `ZSTD_FRAMEHEADERSIZE_PREFIX` and `ZSTD_FRAMEHEADERSIZE_MIN` to
take a `format` parameter, so it is impossible to get the wrong size.
* Fix the places that called `ZSTD_FRAMEHEADERSIZE_PREFIX` without
taking the format into account, which is now impossible by design.
* Call `ZSTD_frameHeaderSize_internal()` with `dctx->format`.
* The added tests catch both bugs in `ZSTD_decompressFrame()`.
Fixes #1813.
Nick Terrell [Mon, 21 Oct 2019 22:53:57 +0000 (15:53 -0700)]
Merge pull request #1831 from terrelln/zstdmt-bad-memset
[zstdmt] Don't memset the jobDescription
Yann Collet [Mon, 21 Oct 2019 21:33:50 +0000 (14:33 -0700)]
Added --output-dir-flat=
which is a preferred construction when applicable.
Also, added --output-dir-flat into man page.
Yann Collet [Mon, 21 Oct 2019 20:45:17 +0000 (13:45 -0700)]
Merge pull request #1834 from facebook/winFix
Windows fixes
Yann Collet [Mon, 21 Oct 2019 19:55:39 +0000 (12:55 -0700)]
turned off zlib tests during msan
since the local zlib library is not msan-instrumented
Yann Collet [Mon, 21 Oct 2019 19:14:59 +0000 (12:14 -0700)]
minor refactor of FIO_compressGzFrame()
mostly narrowing variables lifetime and mutability.
Felix Handte [Mon, 21 Oct 2019 16:15:17 +0000 (12:15 -0400)]
Merge pull request #1795 from felixhandte/workspace-asan
Add Poisoned Redzones to the Workspace When Compiling with ASAN
Yann Collet [Sat, 19 Oct 2019 12:24:42 +0000 (05:24 -0700)]
Merge pull request #1835 from facebook/format034
clarifications for the FSE decoding table
Yann Collet [Sat, 19 Oct 2019 00:48:12 +0000 (17:48 -0700)]
clarifications for the FSE decoding table
requested in #1782
Yann Collet [Sat, 19 Oct 2019 00:23:39 +0000 (17:23 -0700)]
Merge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Sat, 19 Oct 2019 00:22:45 +0000 (17:22 -0700)]
added mode documentation on ZSTD_CLEVEL
providing range restriction [1-19] explicitly
partially answering #1829
Yann Collet [Sat, 19 Oct 2019 00:08:52 +0000 (17:08 -0700)]
fixed visual defined test
Yann Collet [Sat, 19 Oct 2019 00:05:42 +0000 (17:05 -0700)]
removed Visual warning
for pointer casts
Nick Terrell [Fri, 18 Oct 2019 23:35:23 +0000 (16:35 -0700)]
Merge pull request #1832 from terrelln/fuzz-stream-fix
[fuzz] Increase output buffer size of stream_round_trip
Yann Collet [Fri, 18 Oct 2019 22:45:31 +0000 (15:45 -0700)]
fix function cast warning on Windows with gcc9
Yann Collet [Fri, 18 Oct 2019 22:41:12 +0000 (15:41 -0700)]
updated windows binary resources
Yann Collet [Fri, 18 Oct 2019 22:37:07 +0000 (15:37 -0700)]
validated 'make test' for mingw environment
Yann Collet [Fri, 18 Oct 2019 22:21:50 +0000 (15:21 -0700)]
made `make check` faster
for shorter feedback loop
Nick Terrell [Fri, 18 Oct 2019 17:59:15 +0000 (10:59 -0700)]
[zstdmt] Don't memset the jobDescription
Nick Terrell [Fri, 18 Oct 2019 19:33:45 +0000 (12:33 -0700)]
[threading] Add debug utilities
Yann Collet [Fri, 18 Oct 2019 22:02:30 +0000 (15:02 -0700)]
minor appveyor test script fix
Yann Collet [Fri, 18 Oct 2019 21:52:16 +0000 (14:52 -0700)]
attempt to run 'make check' tests on Appveyor
for mingw builds
Yann Collet [Fri, 18 Oct 2019 21:28:34 +0000 (14:28 -0700)]
fix test on windows
isDirectory() doesn't work on Windows
if directory name is followed by '/'
Nick Terrell [Fri, 18 Oct 2019 20:34:35 +0000 (13:34 -0700)]
[fuzz] Increase output buffer size of stream_round_trip
Fixes OSS-Fuzz crash.
Credit to OSS-Fuzz
Yann Collet [Fri, 18 Oct 2019 18:15:10 +0000 (11:15 -0700)]
rewrite FIO_createFilename_fromOutDir()
Yann Collet [Thu, 17 Oct 2019 23:58:49 +0000 (16:58 -0700)]
fix : no output file opened in test mode
also : redistributed error code within fileio.c
for more precise diagnosis.
Yann Collet [Thu, 17 Oct 2019 23:39:47 +0000 (16:39 -0700)]
removed regular file test on Windows
since it does not work well on this platform
(tested with MinGW).
Note : could be an issue within UTIL_isRegularFile()
Yann Collet [Thu, 17 Oct 2019 23:09:53 +0000 (16:09 -0700)]
improved test mode `-t`
The test mode do no longer open a file `/dev/null` nor write anything to output.
This is supposed to be more efficient than writing to `/dev/null`,
and more universal too : the previous method was failing on Windows.
Yann Collet [Thu, 17 Oct 2019 22:32:03 +0000 (15:32 -0700)]
refactored FIO_compressMultipleFilenames() prototype
for consistency
Yann Collet [Thu, 17 Oct 2019 22:27:25 +0000 (15:27 -0700)]
fixed multiple implicit casts
Yann Collet [Thu, 17 Oct 2019 22:07:47 +0000 (15:07 -0700)]
tests: can override isTerminal with environment variable
Yann Collet [Thu, 17 Oct 2019 21:31:42 +0000 (14:31 -0700)]
fixed isSameFile()
Yann Collet [Thu, 17 Oct 2019 21:29:48 +0000 (14:29 -0700)]
fix harness test
Yann Collet [Thu, 17 Oct 2019 21:15:00 +0000 (14:15 -0700)]
fixed dict ptr init
Yann Collet [Thu, 17 Oct 2019 21:11:54 +0000 (14:11 -0700)]
minor refactoring of harness
Yann Collet [Thu, 17 Oct 2019 21:03:20 +0000 (14:03 -0700)]
minor: DIFF determination
use gdiff on SunOS
Yann Collet [Thu, 17 Oct 2019 20:01:18 +0000 (13:01 -0700)]
force compression during tests
to erase potentially remaining artifacts from previous runs
Yann Collet [Thu, 17 Oct 2019 18:01:20 +0000 (11:01 -0700)]
fix several cast
Yann Collet [Thu, 17 Oct 2019 17:56:14 +0000 (10:56 -0700)]
fix incorrect dictName/FileName comparison on Windows
inode identification does not seem to work on Windows,
even with on a msys2 posix layer.
Yann Collet [Thu, 17 Oct 2019 17:50:58 +0000 (10:50 -0700)]
Merge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Thu, 17 Oct 2019 17:50:39 +0000 (10:50 -0700)]
ignore build artifact from educational decoder test
Yann Collet [Thu, 17 Oct 2019 17:30:58 +0000 (10:30 -0700)]
Merge pull request #1827 from facebook/dm_Dct
updated erroneous comments using ZSTD_dm_*
Yann Collet [Thu, 17 Oct 2019 00:27:03 +0000 (17:27 -0700)]
removed UNALIGNED() macro from educational decoder
as this name collides with existing macro in mingw64+clang9.
Yann Collet [Thu, 17 Oct 2019 00:21:47 +0000 (17:21 -0700)]
Merge pull request #1828 from bimbashrestha/education_decoder_check
Removing unnecessary check on education decoder
Yann Collet [Wed, 16 Oct 2019 23:45:15 +0000 (16:45 -0700)]
Merge pull request #1815 from facebook/zlibwrap
make zlibWrapper strict ISO-C90 compatible
Yann Collet [Wed, 16 Oct 2019 23:43:36 +0000 (16:43 -0700)]
Merge pull request #1826 from facebook/noWild8
removed wildcopy8()
Bimba Shrestha [Wed, 16 Oct 2019 23:26:46 +0000 (16:26 -0700)]
Removing unnecessary check from decode side
Yann Collet [Wed, 16 Oct 2019 23:14:04 +0000 (16:14 -0700)]
updated erroneous comments using ZSTD_dm_*
instead of the current ZSTD_dct_*,
reported by @nigeltao (#1822)
Yann Collet [Wed, 16 Oct 2019 21:51:33 +0000 (14:51 -0700)]
removed wildcopy8()
which is no longer used,
noticed by @davidbolvansky
Yann Collet [Tue, 15 Oct 2019 23:09:18 +0000 (16:09 -0700)]
minor comments & refactoring
Ahmed Abdellah [Tue, 15 Oct 2019 06:49:13 +0000 (07:49 +0100)]
Adding --file=FILE feature
Yann Collet [Mon, 14 Oct 2019 16:34:56 +0000 (09:34 -0700)]
Merge pull request #1731 from chungy/stdin_nochmod
[programs] don’t do chmod when coming from stdin or multiple files
Yann Collet [Mon, 14 Oct 2019 16:27:25 +0000 (09:27 -0700)]
Merge pull request #1792 from dmitri-shubin/dev
Don't hardcode installation directories in CMakeLists.txt
Yann Collet [Mon, 14 Oct 2019 16:25:05 +0000 (09:25 -0700)]
Merge pull request #1812 from senhuang42/output-dir-flat
Support for --output-dir-flat: output into a directory
Yann Collet [Mon, 14 Oct 2019 16:20:18 +0000 (09:20 -0700)]
Merge pull request #1823 from vangyzen/fwrite_errno
Include errno in all fwrite error messages in fileio.c
Yann Collet [Thu, 10 Oct 2019 20:11:18 +0000 (13:11 -0700)]
Merge pull request #1760 from bimbashrestha/extract_sequences_api
Adding api for extracting sequences from seqstore
W. Felix Handte [Thu, 10 Oct 2019 19:02:08 +0000 (15:02 -0400)]
Fix CCtx Size Estimation
W. Felix Handte [Thu, 10 Oct 2019 17:45:55 +0000 (13:45 -0400)]
Expand Default Redzone Size
W. Felix Handte [Tue, 17 Sep 2019 15:35:49 +0000 (11:35 -0400)]
Check if CCtx in Workspace after Null Check
W. Felix Handte [Mon, 16 Sep 2019 23:04:05 +0000 (19:04 -0400)]
Declare the ASAN Functions We Need, Don't Include the Header
W. Felix Handte [Mon, 16 Sep 2019 22:06:16 +0000 (18:06 -0400)]
Stop Allocating Extra Space for Table Redzones
W. Felix Handte [Mon, 16 Sep 2019 21:56:28 +0000 (17:56 -0400)]
Don't Try to Redzone the Tables
W. Felix Handte [Mon, 16 Sep 2019 21:47:29 +0000 (17:47 -0400)]
Fix Workspace Size Calculation
W. Felix Handte [Mon, 16 Sep 2019 21:45:40 +0000 (17:45 -0400)]
Fix ZSTD_sizeof_matchState() Calculation
W. Felix Handte [Mon, 16 Sep 2019 21:43:55 +0000 (17:43 -0400)]
Avoid ASAN Failure in ZSTD_cwksp_free()
W. Felix Handte [Mon, 16 Sep 2019 21:43:05 +0000 (17:43 -0400)]
Refactor Freeing CCtxes / CDicts Inside Workspaces
W. Felix Handte [Thu, 12 Sep 2019 23:41:45 +0000 (19:41 -0400)]
Surround Workspace Allocs with Dead Zone
W. Felix Handte [Thu, 12 Sep 2019 23:40:38 +0000 (19:40 -0400)]
Add `ZSTD_cwksp_alloc_size()` to Help Calculate Needed Workspace Size
W. Felix Handte [Thu, 12 Sep 2019 22:39:46 +0000 (18:39 -0400)]
Stop Assuming Tables are Adjacent
W. Felix Handte [Thu, 12 Sep 2019 22:33:00 +0000 (18:33 -0400)]
Poison Unused Workspace Memory
W. Felix Handte [Thu, 12 Sep 2019 22:32:22 +0000 (18:32 -0400)]
Detect Whether We're Being Compiled with ASAN
W. Felix Handte [Thu, 12 Sep 2019 22:24:44 +0000 (18:24 -0400)]
Remove Unused MEM_SKIP_MSAN Macro
Eric van Gyzen [Thu, 10 Oct 2019 14:21:29 +0000 (09:21 -0500)]
Include errno in all fwrite error messages in fileio.c
Sen Huang [Wed, 9 Oct 2019 13:39:52 +0000 (09:39 -0400)]
Only check for filename collisions when using --output-dir-flat
Nick Terrell [Tue, 8 Oct 2019 21:58:16 +0000 (17:58 -0400)]
Merge pull request #1820 from mhlakhani/dev
Add OSS-Fuzz fuzzing badge