]>
git.ipfire.org Git - thirdparty/zstd.git/log
Yann Collet [Mon, 21 Oct 2019 19:55:39 +0000 (12:55 -0700)]
turned off zlib tests during msan
since the local zlib library is not msan-instrumented
Yann Collet [Mon, 21 Oct 2019 19:14:59 +0000 (12:14 -0700)]
minor refactor of FIO_compressGzFrame()
mostly narrowing variables lifetime and mutability.
Yann Collet [Sat, 19 Oct 2019 00:08:52 +0000 (17:08 -0700)]
fixed visual defined test
Yann Collet [Sat, 19 Oct 2019 00:05:42 +0000 (17:05 -0700)]
removed Visual warning
for pointer casts
Yann Collet [Fri, 18 Oct 2019 22:45:31 +0000 (15:45 -0700)]
fix function cast warning on Windows with gcc9
Yann Collet [Fri, 18 Oct 2019 22:41:12 +0000 (15:41 -0700)]
updated windows binary resources
Yann Collet [Fri, 18 Oct 2019 22:37:07 +0000 (15:37 -0700)]
validated 'make test' for mingw environment
Yann Collet [Fri, 18 Oct 2019 22:21:50 +0000 (15:21 -0700)]
made `make check` faster
for shorter feedback loop
Yann Collet [Fri, 18 Oct 2019 22:02:30 +0000 (15:02 -0700)]
minor appveyor test script fix
Yann Collet [Fri, 18 Oct 2019 21:52:16 +0000 (14:52 -0700)]
attempt to run 'make check' tests on Appveyor
for mingw builds
Yann Collet [Fri, 18 Oct 2019 21:28:34 +0000 (14:28 -0700)]
fix test on windows
isDirectory() doesn't work on Windows
if directory name is followed by '/'
Yann Collet [Fri, 18 Oct 2019 18:15:10 +0000 (11:15 -0700)]
rewrite FIO_createFilename_fromOutDir()
Yann Collet [Thu, 17 Oct 2019 23:58:49 +0000 (16:58 -0700)]
fix : no output file opened in test mode
also : redistributed error code within fileio.c
for more precise diagnosis.
Yann Collet [Thu, 17 Oct 2019 23:39:47 +0000 (16:39 -0700)]
removed regular file test on Windows
since it does not work well on this platform
(tested with MinGW).
Note : could be an issue within UTIL_isRegularFile()
Yann Collet [Thu, 17 Oct 2019 23:09:53 +0000 (16:09 -0700)]
improved test mode `-t`
The test mode do no longer open a file `/dev/null` nor write anything to output.
This is supposed to be more efficient than writing to `/dev/null`,
and more universal too : the previous method was failing on Windows.
Yann Collet [Thu, 17 Oct 2019 22:32:03 +0000 (15:32 -0700)]
refactored FIO_compressMultipleFilenames() prototype
for consistency
Yann Collet [Thu, 17 Oct 2019 22:27:25 +0000 (15:27 -0700)]
fixed multiple implicit casts
Yann Collet [Thu, 17 Oct 2019 22:07:47 +0000 (15:07 -0700)]
tests: can override isTerminal with environment variable
Yann Collet [Thu, 17 Oct 2019 21:31:42 +0000 (14:31 -0700)]
fixed isSameFile()
Yann Collet [Thu, 17 Oct 2019 21:29:48 +0000 (14:29 -0700)]
fix harness test
Yann Collet [Thu, 17 Oct 2019 21:15:00 +0000 (14:15 -0700)]
fixed dict ptr init
Yann Collet [Thu, 17 Oct 2019 21:11:54 +0000 (14:11 -0700)]
minor refactoring of harness
Yann Collet [Thu, 17 Oct 2019 21:03:20 +0000 (14:03 -0700)]
minor: DIFF determination
use gdiff on SunOS
Yann Collet [Thu, 17 Oct 2019 20:01:18 +0000 (13:01 -0700)]
force compression during tests
to erase potentially remaining artifacts from previous runs
Yann Collet [Thu, 17 Oct 2019 18:01:20 +0000 (11:01 -0700)]
fix several cast
Yann Collet [Thu, 17 Oct 2019 17:56:14 +0000 (10:56 -0700)]
fix incorrect dictName/FileName comparison on Windows
inode identification does not seem to work on Windows,
even with on a msys2 posix layer.
Yann Collet [Thu, 17 Oct 2019 17:50:58 +0000 (10:50 -0700)]
Merge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Thu, 17 Oct 2019 17:50:39 +0000 (10:50 -0700)]
ignore build artifact from educational decoder test
Yann Collet [Thu, 17 Oct 2019 17:30:58 +0000 (10:30 -0700)]
Merge pull request #1827 from facebook/dm_Dct
updated erroneous comments using ZSTD_dm_*
Yann Collet [Thu, 17 Oct 2019 00:27:03 +0000 (17:27 -0700)]
removed UNALIGNED() macro from educational decoder
as this name collides with existing macro in mingw64+clang9.
Yann Collet [Thu, 17 Oct 2019 00:21:47 +0000 (17:21 -0700)]
Merge pull request #1828 from bimbashrestha/education_decoder_check
Removing unnecessary check on education decoder
Yann Collet [Wed, 16 Oct 2019 23:45:15 +0000 (16:45 -0700)]
Merge pull request #1815 from facebook/zlibwrap
make zlibWrapper strict ISO-C90 compatible
Yann Collet [Wed, 16 Oct 2019 23:43:36 +0000 (16:43 -0700)]
Merge pull request #1826 from facebook/noWild8
removed wildcopy8()
Bimba Shrestha [Wed, 16 Oct 2019 23:26:46 +0000 (16:26 -0700)]
Removing unnecessary check from decode side
Yann Collet [Wed, 16 Oct 2019 23:14:04 +0000 (16:14 -0700)]
updated erroneous comments using ZSTD_dm_*
instead of the current ZSTD_dct_*,
reported by @nigeltao (#1822)
Yann Collet [Wed, 16 Oct 2019 21:51:33 +0000 (14:51 -0700)]
removed wildcopy8()
which is no longer used,
noticed by @davidbolvansky
Yann Collet [Tue, 15 Oct 2019 23:09:18 +0000 (16:09 -0700)]
minor comments & refactoring
Yann Collet [Mon, 14 Oct 2019 16:34:56 +0000 (09:34 -0700)]
Merge pull request #1731 from chungy/stdin_nochmod
[programs] don’t do chmod when coming from stdin or multiple files
Yann Collet [Mon, 14 Oct 2019 16:27:25 +0000 (09:27 -0700)]
Merge pull request #1792 from dmitri-shubin/dev
Don't hardcode installation directories in CMakeLists.txt
Yann Collet [Mon, 14 Oct 2019 16:25:05 +0000 (09:25 -0700)]
Merge pull request #1812 from senhuang42/output-dir-flat
Support for --output-dir-flat: output into a directory
Yann Collet [Mon, 14 Oct 2019 16:20:18 +0000 (09:20 -0700)]
Merge pull request #1823 from vangyzen/fwrite_errno
Include errno in all fwrite error messages in fileio.c
Yann Collet [Thu, 10 Oct 2019 20:11:18 +0000 (13:11 -0700)]
Merge pull request #1760 from bimbashrestha/extract_sequences_api
Adding api for extracting sequences from seqstore
Eric van Gyzen [Thu, 10 Oct 2019 14:21:29 +0000 (09:21 -0500)]
Include errno in all fwrite error messages in fileio.c
Sen Huang [Wed, 9 Oct 2019 13:39:52 +0000 (09:39 -0400)]
Only check for filename collisions when using --output-dir-flat
Nick Terrell [Tue, 8 Oct 2019 21:58:16 +0000 (17:58 -0400)]
Merge pull request #1820 from mhlakhani/dev
Add OSS-Fuzz fuzzing badge
Hasnain Lakhani [Tue, 8 Oct 2019 21:13:45 +0000 (14:13 -0700)]
Add OSS-Fuzz fuzzing badge
This is basically redoing https://github.com/facebook/zstd/pull/1818 by @inferno-chromium from the OSS-Fuzz team
Sen Huang [Tue, 8 Oct 2019 13:54:59 +0000 (09:54 -0400)]
Casting to void* to avoid C4090 warnings
Sen Huang [Tue, 8 Oct 2019 13:44:24 +0000 (09:44 -0400)]
Suppress C4090 warning
Sen Huang [Tue, 8 Oct 2019 04:15:28 +0000 (00:15 -0400)]
Hopefully fix VS compiler warning
Yann Collet [Fri, 4 Oct 2019 22:09:52 +0000 (15:09 -0700)]
fixed init warning
Bimba Shrestha [Fri, 4 Oct 2019 17:29:29 +0000 (10:29 -0700)]
Merge pull request #1 from facebook/dev
Merging main dev
Sen Huang [Thu, 3 Oct 2019 19:23:49 +0000 (15:23 -0400)]
Changed function name, fix test
Sen Huang [Thu, 3 Oct 2019 17:53:04 +0000 (13:53 -0400)]
Now constructs final destination path without allocating new table
Bimba Shrestha [Thu, 3 Oct 2019 16:26:51 +0000 (09:26 -0700)]
Manually moving instead of memcpy on decoder and using genBuffer()
Bimba Shrestha [Thu, 3 Oct 2019 13:42:40 +0000 (06:42 -0700)]
Cleaning sequence parsing logic
Yann Collet [Thu, 3 Oct 2019 00:41:19 +0000 (17:41 -0700)]
zlibwrapper : fixed flag-variable name
release doesn't use specific std/debug flags
Yann Collet [Thu, 3 Oct 2019 00:32:19 +0000 (17:32 -0700)]
updated tests for zlibwrapper C90 strict compatibility
Sen Huang [Wed, 2 Oct 2019 22:34:42 +0000 (18:34 -0400)]
Addressed comments on malloc
Sen Huang [Wed, 2 Oct 2019 19:30:24 +0000 (15:30 -0400)]
Static analyze fix
Sen Huang [Wed, 2 Oct 2019 15:29:34 +0000 (11:29 -0400)]
CI Tests fix
Sen Huang [Wed, 2 Oct 2019 15:18:14 +0000 (11:18 -0400)]
Removed strdup() dependency
Sen Huang [Wed, 2 Oct 2019 15:11:35 +0000 (11:11 -0400)]
Modified message
Sen Huang [Wed, 2 Oct 2019 15:08:20 +0000 (11:08 -0400)]
Add support for --output-dir-flat
New flag to specify output directory destination for multiple files.
Bimba Shrestha [Fri, 27 Sep 2019 14:20:20 +0000 (07:20 -0700)]
Typo fix
Bimba Shrestha [Thu, 26 Sep 2019 23:21:57 +0000 (16:21 -0700)]
Fixing appveyor test
Bimba Shrestha [Thu, 26 Sep 2019 23:07:34 +0000 (16:07 -0700)]
Fixing shortest failure
Bimba Shrestha [Thu, 26 Sep 2019 22:38:31 +0000 (15:38 -0700)]
Adding more realistic test for get sequences
Yann Collet [Thu, 26 Sep 2019 22:01:29 +0000 (15:01 -0700)]
simplified Makefile
and fixed a few c++-compat issues
Yann Collet [Thu, 26 Sep 2019 20:08:25 +0000 (13:08 -0700)]
added c++-compat build flag
ensure code can be compiled "as is" in C++ mode
also : restructured flags so that they can be individually changed / disabled on command line
Yann Collet [Wed, 25 Sep 2019 00:50:58 +0000 (17:50 -0700)]
enforce C90 compatibility for zlibWrapper
Yann Collet [Tue, 24 Sep 2019 22:15:33 +0000 (15:15 -0700)]
bump version number to v1.4.4
so that future reports on `dev` branch use this number instead
Bimba Shrestha [Mon, 23 Sep 2019 22:42:16 +0000 (15:42 -0700)]
Replacing assert with memory_allocation error code throw
Bimba Shrestha [Mon, 23 Sep 2019 22:08:18 +0000 (15:08 -0700)]
Adding test and null check for malloc
Yann Collet [Mon, 23 Sep 2019 20:44:27 +0000 (13:44 -0700)]
Merge pull request #1808 from davidbolvansky/highset-codegen
Improve ZSTD_highbit32's codegen
Dávid Bolvanský [Mon, 23 Sep 2019 19:32:56 +0000 (21:32 +0200)]
Fixed one more place
Dávid Bolvanský [Mon, 23 Sep 2019 19:23:09 +0000 (21:23 +0200)]
Use clz ^ 31 instead of 31 - clz; better codegen for GCC
Nick Terrell [Sun, 22 Sep 2019 00:04:36 +0000 (17:04 -0700)]
Merge pull request #1804 from terrelln/wild-and-fast
Optimize (de)compression and fix wildcopy overread
Nick Terrell [Sat, 21 Sep 2019 04:37:13 +0000 (21:37 -0700)]
Add UNUSED_ATTR to ZSTD_storeSeq()
Nick Terrell [Fri, 20 Sep 2019 23:39:27 +0000 (16:39 -0700)]
HINT_INLINE ZSTD_storeSeq()
Clang on Mac wasn't inlining `ZSTD_storeSeq()` in level 1, which was
causing a 5% performance regression. This fixes it.
Bimba Shrestha [Fri, 20 Sep 2019 22:50:58 +0000 (15:50 -0700)]
Passing in dummy dst buffer of compressbound(srcSize)
Felix Handte [Fri, 20 Sep 2019 19:36:00 +0000 (15:36 -0400)]
Merge pull request #1806 from felixhandte/estimate-cctx-doc
Update Comment on `ZSTD_estimateCCtxSize()`
Nick Terrell [Fri, 20 Sep 2019 19:23:25 +0000 (12:23 -0700)]
Remove literals overread in ZSTD_storeSeq() for ~neutral perf
W. Felix Handte [Fri, 20 Sep 2019 18:11:29 +0000 (14:11 -0400)]
Update Comment on `ZSTD_estimateCCtxSize()`
Nick Terrell [Fri, 20 Sep 2019 15:25:12 +0000 (08:25 -0700)]
Fix bounds check in ZSTD_storeSeq()
Nick Terrell [Fri, 20 Sep 2019 08:23:35 +0000 (01:23 -0700)]
Fix too strict assert
Nick Terrell [Fri, 20 Sep 2019 08:09:47 +0000 (01:09 -0700)]
[tests] Fix decodecorpus
Nick Terrell [Fri, 20 Sep 2019 07:52:55 +0000 (00:52 -0700)]
Pass iend into ZSTD_storeSeq() to allow ZSTD_wildcopy()
Nick Terrell [Fri, 20 Sep 2019 07:52:15 +0000 (00:52 -0700)]
Widen ZSTD_wildcopy to 32 bytes
Nick Terrell [Thu, 19 Sep 2019 20:25:03 +0000 (13:25 -0700)]
Optimize decompression and fix wildcopy overread
* Bump `WILDCOPY_OVERLENGTH` to 16 to fix the wildcopy overread.
* Optimize `ZSTD_wildcopy()` by removing unnecessary branches and
unrolling the loop.
* Extract `ZSTD_overlapCopy8()` into its own function.
* Add `ZSTD_safecopy()` for `ZSTD_execSequenceEnd()`. It is
optimized for single long sequences, since that is the important
case that can end up in `ZSTD_execSequenceEnd()`. Without this
optimization, decompressing a block with 1 long match goes
from 5.7 GB/s to 800 MB/s.
* Refactor `ZSTD_execSequenceEnd()`.
* Increase the literal copy shortcut to 16.
* Add a shortcut for offset >= 16.
* Simplify `ZSTD_execSequence()` by pushing more cases into
`ZSTD_execSequenceEnd()`.
* Delete `ZSTD_execSequenceLong()` since it is exactly the
same as `ZSTD_execSequence()`.
clang-8 seeds +17.5% on silesia and +21.8% on enwik8.
gcc-9 sees +12% on silesia and +15.5% on enwik8.
TODO: More detailed measurements, and on more datasets.
Crdit to OSS-Fuzz for finding the wildcopy overread.
Bimba Shrestha [Thu, 19 Sep 2019 22:25:20 +0000 (15:25 -0700)]
Addressing comments
Nick Terrell [Thu, 19 Sep 2019 18:10:13 +0000 (11:10 -0700)]
Merge pull request #1801 from terrelln/int-max
[test] Test the bounds of ZSTD_c_srcSizeHint
Yann Collet [Wed, 18 Sep 2019 23:32:37 +0000 (16:32 -0700)]
Merge pull request #1802 from bimbashrestha/rle_block_bound_fix_pt2
Adding 4 blocks to FSE_BLOCKBOUND() in lib/common (different from las…
Bimba Shrestha [Wed, 18 Sep 2019 20:49:45 +0000 (13:49 -0700)]
adding bit container size
Bimba Shrestha [Wed, 18 Sep 2019 20:29:05 +0000 (13:29 -0700)]
Adding 4 blocks to FSE_BLOCKBOUND() in lib/common (different from last week)
Yann Collet [Wed, 18 Sep 2019 18:35:50 +0000 (11:35 -0700)]
Merge pull request #1756 from mgrice/dev
Improvements in zstd decode performance
Nick Terrell [Wed, 18 Sep 2019 18:05:08 +0000 (11:05 -0700)]
[test] Test the bounds of ZSTD_c_srcSizeHint
Bimba Shrestha [Wed, 18 Sep 2019 00:44:08 +0000 (17:44 -0700)]
Casting void pointer to ZSTD_Sequence pointer
Yann Collet [Tue, 17 Sep 2019 21:54:23 +0000 (14:54 -0700)]
Merge pull request #1798 from facebook/refac_fast
minor refactor of ZSTD_fast
Yann Collet [Tue, 17 Sep 2019 21:02:57 +0000 (14:02 -0700)]
minor refactor of ZSTD_fast
- reduced variables lifetime
- more accurate code comments
Felix Handte [Tue, 17 Sep 2019 17:30:21 +0000 (13:30 -0400)]
Merge pull request #1783 from felixhandte/mtime-nsec
Set Mod Time Nanoseconds