]>
git.ipfire.org Git - thirdparty/zstd.git/log
W. Felix Handte [Thu, 5 Dec 2019 17:02:35 +0000 (12:02 -0500)]
Also Define _ATFILE_SOURCE
W. Felix Handte [Wed, 4 Dec 2019 21:59:16 +0000 (16:59 -0500)]
Add Comment
W. Felix Handte [Wed, 4 Dec 2019 15:25:07 +0000 (10:25 -0500)]
Use statbuf->st_mtim Again
W. Felix Handte [Thu, 5 Dec 2019 22:14:57 +0000 (17:14 -0500)]
Add Travis Test that Builds ARM on Trusty
W. Felix Handte [Thu, 5 Dec 2019 22:14:29 +0000 (17:14 -0500)]
Fix playTests.sh Under QEMU
Yann Collet [Thu, 19 Dec 2019 20:58:24 +0000 (12:58 -0800)]
Merge pull request #1928 from bimbashrestha/bimba-oss
[fuzz] Adding bool to check if there is enough room to emit noCompress Superblocks
Felix Handte [Thu, 19 Dec 2019 17:08:28 +0000 (12:08 -0500)]
Merge pull request #1932 from felixhandte/diagnose-corruption-dicts
Add Support for Dictionaries in Corruption Diagnosis Tool
W. Felix Handte [Wed, 18 Dec 2019 19:26:35 +0000 (11:26 -0800)]
Add Support for Dictionaries
Yann Collet [Wed, 18 Dec 2019 19:49:26 +0000 (11:49 -0800)]
Merge pull request #1929 from facebook/travisTest
added ppc64le tests on travis
W. Felix Handte [Wed, 18 Dec 2019 19:29:53 +0000 (11:29 -0800)]
Print Summary of Errors Encountered
Bimba Shrestha [Wed, 18 Dec 2019 01:16:51 +0000 (17:16 -0800)]
Constifying, malloc check and naming nit
W. Felix Handte [Tue, 17 Dec 2019 19:26:18 +0000 (11:26 -0800)]
Don't Rely on Implicit Return in Main
Yann Collet [Sat, 14 Dec 2019 21:29:24 +0000 (13:29 -0800)]
added ppc64le tests on travis
on real hardware
Bimba Shrestha [Sat, 14 Dec 2019 00:50:21 +0000 (16:50 -0800)]
One more type conversion
Bimba Shrestha [Sat, 14 Dec 2019 00:38:11 +0000 (16:38 -0800)]
Adding explict cast to satisfy appveyor ci
Bimba Shrestha [Sat, 14 Dec 2019 00:24:49 +0000 (16:24 -0800)]
More void* issues. Just replacing with BYTE*
Bimba Shrestha [Sat, 14 Dec 2019 00:06:57 +0000 (16:06 -0800)]
'void* size issue' fix
Bimba Shrestha [Fri, 13 Dec 2019 23:47:28 +0000 (15:47 -0800)]
Adding bool to check if enough room left for noCompress superblocks
Bimba Shrestha [Fri, 13 Dec 2019 23:31:29 +0000 (15:31 -0800)]
Add test to catch too many noCompress superblocks on streaming
Yann Collet [Tue, 10 Dec 2019 21:17:00 +0000 (13:17 -0800)]
Merge pull request #1891 from bimbashrestha/oss
[fuzz] Superblock fuzz issues
Yann Collet [Tue, 10 Dec 2019 21:16:45 +0000 (13:16 -0800)]
Merge pull request #1924 from ned14/dev
Make idiomatic cmake install so third party cmake installers work right.
Make idiomatic cmake install so third party cmake installers work right.
Bimba Shrestha [Wed, 4 Dec 2019 23:51:17 +0000 (15:51 -0800)]
Making const, removing unnecessary indent, changing parameter order
Bimba Shrestha [Wed, 4 Dec 2019 23:23:13 +0000 (15:23 -0800)]
Moving init/end functions, moving compressSuperBlock inside body()
Bimba Shrestha [Wed, 4 Dec 2019 22:52:27 +0000 (14:52 -0800)]
Refactor
Bimba Shrestha [Wed, 4 Dec 2019 18:02:17 +0000 (10:02 -0800)]
[fuzz] msan uninitialized unsigned value (#1908)
Fixes new fuzz issue
Credit to OSS-Fuzz
* Initializing unsigned value
* Initialilzing to 1 instead of 0 because its more conservative
* Unconditionoally setting to check first and then checking zero
* Moving bool to before block for c90
* Move check set before block
Yann Collet [Wed, 4 Dec 2019 01:06:42 +0000 (17:06 -0800)]
bumped version number
so that potential issue report do not confuse `dev` with latest release
Yann Collet [Tue, 3 Dec 2019 23:35:07 +0000 (15:35 -0800)]
Merge pull request #1893 from felixhandte/check-flipped-bits
Add Tool to Diagnose Whether Corrupt Blobs are Plausibly Bit-Flips
Yann Collet [Tue, 3 Dec 2019 23:31:11 +0000 (15:31 -0800)]
Merge pull request #1907 from selavy/check-fread-r1895
Check for fread failure
Bimba Shrestha [Tue, 3 Dec 2019 05:39:06 +0000 (21:39 -0800)]
Using bss var instead of creating new bool
Yann Collet [Tue, 3 Dec 2019 01:30:37 +0000 (17:30 -0800)]
Merge pull request #1918 from facebook/recurse_fix
small refactoring : remove global variable g_displayOut
Yann Collet [Tue, 3 Dec 2019 00:08:08 +0000 (16:08 -0800)]
refactoring : remove global variable g_displayOut
displaying into stderr or stdout is now an explicit operation,
no longer depending on some global state set elsewhere in the code.
Yann Collet [Mon, 2 Dec 2019 23:38:14 +0000 (15:38 -0800)]
Merge pull request #1917 from facebook/recurse_fix
fix recent issue combining -r with empty list of input files
Yann Collet [Mon, 2 Dec 2019 22:28:18 +0000 (14:28 -0800)]
fix recent issue combining -r with empty list of input files
This would resize the table of input filenames to zero,
delivering an empty table,
to which it was no longer possible to add stdin.
Yann Collet [Thu, 28 Nov 2019 02:45:16 +0000 (18:45 -0800)]
Merge pull request #1910 from facebook/travisTest
mingw cross compilation test
Yann Collet [Wed, 27 Nov 2019 22:48:26 +0000 (14:48 -0800)]
Merge pull request #1883 from Ericson2314/fix-mingw-cross
Fix MinGW cross
Yann Collet [Wed, 27 Nov 2019 22:39:43 +0000 (14:39 -0800)]
travis: updated mingw cross compilation test
- only compiles zstd CLI
- enforces zero warning tolerance policy
note : mingw compilation of the library complains (warning) about -fPIC flag.
It mostly ignores it, so it's not a big issue.
Still, it would need to be fixed if library cross-compilation becomes part of CI.
At this stage, it's unclear if this is a scenario.
Yann Collet [Wed, 27 Nov 2019 20:44:02 +0000 (12:44 -0800)]
added mingw cross compilation tests
based on a script in RocksDB project.
also : pushed qemu aarch64 tests to master/cron,
since there are already hardware aarch64 tests on dev.
Bimba Shrestha [Wed, 27 Nov 2019 18:56:54 +0000 (10:56 -0800)]
Merge branch 'oss' of https://github.com/bimbashrestha/zstd into oss
Yann Collet [Wed, 27 Nov 2019 04:57:25 +0000 (20:57 -0800)]
Merge pull request #1853 from facebook/ahmed_file
--filelist=FILE feature
Peter Lesslie [Wed, 27 Nov 2019 01:36:33 +0000 (19:36 -0600)]
Check for fread failure
On failure fread may return either a short read or 0. Need to use
ferror to detect error versus eof.
Yann Collet [Wed, 27 Nov 2019 01:46:57 +0000 (17:46 -0800)]
removed scanbuild workaround
Yann Collet [Wed, 27 Nov 2019 00:44:56 +0000 (16:44 -0800)]
reverted ppc qemu and scanbuild on trusty
ppc cross-compilation seems broken outside of trusty
scan-build version changes with distrib version, resulting in a different list of false positives
Yann Collet [Tue, 26 Nov 2019 23:44:33 +0000 (15:44 -0800)]
assembleFNT() can no longer fail
Yann Collet [Tue, 26 Nov 2019 23:25:32 +0000 (15:25 -0800)]
pushed aside stdio.h too
since only UTIL_DISPLAY() depended on it.
Yann Collet [Tue, 26 Nov 2019 23:21:58 +0000 (15:21 -0800)]
moved UTIL_DISPLAY() inside util.c
Yann Collet [Tue, 26 Nov 2019 23:16:53 +0000 (15:16 -0800)]
util: isolated some dependencies
from *.h to *.c
so that they don't get transitively included
into users of util.h.
Yann Collet [Tue, 26 Nov 2019 23:01:16 +0000 (15:01 -0800)]
travisCI : removed `trusty` generic statement
trusty is out of long term support.
let's run (most) tests on "current" platform.
Yann Collet [Tue, 26 Nov 2019 22:53:37 +0000 (14:53 -0800)]
fixed minor VS warning, on parameter difference
complaining about a `const` property on one side but not the other.
Yann Collet [Tue, 26 Nov 2019 22:48:23 +0000 (14:48 -0800)]
switched UTIL_refFilename() to an assert()
Yann Collet [Tue, 26 Nov 2019 22:33:04 +0000 (14:33 -0800)]
Merge branch 'dev' into ahmed_file
Yann Collet [Tue, 26 Nov 2019 22:18:09 +0000 (14:18 -0800)]
fixed fifo test
Bimba Shrestha [Tue, 26 Nov 2019 20:24:19 +0000 (12:24 -0800)]
[fuzz] Only set HUF_repeat_valid if loaded table has all non-zero weights (#1898)
Fixes a fuzz issue where dictionary_round_trip failed because the compressor was generating corrupt files thanks to zero weights in the table.
* Only setting loaded dict huf table to valid on non-zero
* Adding hasNoZeroWeights test to fse tables
* Forbiding nbBits != 0 when weight == 0
* Reverting the last commit
* Setting table log to 0 when weight == 0
* Small (invalid) zero weight dict test
* Small (valid) zero weight dict test
* Initializing repeatMode vars to check before zero check
* Removing FSE changes to seperate pr
* Reverting accidentally changed file
* Negating bool, using unsigned, optimization nit
Bimba Shrestha [Tue, 26 Nov 2019 20:17:43 +0000 (12:17 -0800)]
Negating bool, updating bool on inner branches
Yann Collet [Tue, 26 Nov 2019 19:20:26 +0000 (11:20 -0800)]
Merge branch 'dev' into ahmed_file
Yann Collet [Tue, 26 Nov 2019 18:30:11 +0000 (10:30 -0800)]
travisCI: moved compatibility tests to `dev`
they are fast enough, and we want to catch such incompatibility early
Yann Collet [Tue, 26 Nov 2019 18:28:21 +0000 (10:28 -0800)]
moved meson and versions compatibility tests to master/cron
also : joined c99 compatibility tests with gnu90 and c++ ones
Yann Collet [Tue, 26 Nov 2019 18:24:09 +0000 (10:24 -0800)]
travis : added test durations
as a guide when doing test selection
Yann Collet [Tue, 26 Nov 2019 02:48:12 +0000 (18:48 -0800)]
Merge pull request #1905 from facebook/devnull
fix #1904
Nick Terrell [Tue, 26 Nov 2019 02:26:19 +0000 (18:26 -0800)]
Optimize decompression speed for gcc and clang (#1892)
* Optimize `ZSTD_decodeSequence()`
* Optimize Huffman decoding
* Optimize `ZSTD_decompressSequences()`
* Delete `ZSTD_decodeSequenceLong()`
Yann Collet [Mon, 25 Nov 2019 23:50:58 +0000 (15:50 -0800)]
silence scan-build false positive
blind attempt
Yann Collet [Mon, 25 Nov 2019 23:34:55 +0000 (15:34 -0800)]
changed name from createX to assembleX
shows that the resulting object just takes ownership of provided buffer.
Yann Collet [Mon, 25 Nov 2019 21:59:35 +0000 (13:59 -0800)]
fix mode_t on Windows
Yann Collet [Mon, 25 Nov 2019 21:45:22 +0000 (13:45 -0800)]
created UTIL_chmod()
protecting "/dev/null" from having its permissions changed.
also : minor : improved consistency of util.h API
Yann Collet [Mon, 25 Nov 2019 18:53:03 +0000 (10:53 -0800)]
added decompression into /dev/null tests
Yann Collet [Mon, 25 Nov 2019 18:35:36 +0000 (10:35 -0800)]
fix #1904
/dev/null permissions were modified when using sudo rights.
This fixes this bug during decompression.
More importantly, this patch adds a test, triggered in TravisCI,
ensuring unaltered /dev/null permissions.
Yann Collet [Sat, 23 Nov 2019 01:32:07 +0000 (17:32 -0800)]
minor update to travis script
many tests used to be run on Trusty platform,
they are now run on _current_ platform,
and now many test titles are incorrect.
Fixed.
Bimba Shrestha [Sat, 23 Nov 2019 01:29:33 +0000 (17:29 -0800)]
Merge branch 'dev' into oss
Yann Collet [Sat, 23 Nov 2019 01:25:55 +0000 (17:25 -0800)]
Merge pull request #1897 from sergey-dryabzhinsky/patch-1
WIP: Fix typo in util.c
Bimba Shrestha [Sat, 23 Nov 2019 01:25:36 +0000 (17:25 -0800)]
Test enough room for checksum in superblock
Nick Terrell [Fri, 22 Nov 2019 01:35:06 +0000 (17:35 -0800)]
Merge pull request #1903 from terrelln/null
Fix null pointer addition
Yann Collet [Thu, 21 Nov 2019 23:49:06 +0000 (15:49 -0800)]
Merge pull request #1902 from terrelln/ignore
[cmake][tests] Add zstreamtest executable
Bimba Shrestha [Thu, 21 Nov 2019 21:08:27 +0000 (13:08 -0800)]
Mixed declration fix
Bimba Shrestha [Thu, 21 Nov 2019 21:06:26 +0000 (13:06 -0800)]
Checking noCompressBlock explicitly for rep code confirmation
Nick Terrell [Thu, 21 Nov 2019 02:21:51 +0000 (18:21 -0800)]
Fix null pointer addition
Nick Terrell [Thu, 21 Nov 2019 01:26:06 +0000 (17:26 -0800)]
[cmake][tests] Add zstreamtest executable
Nick Terrell [Thu, 21 Nov 2019 01:24:19 +0000 (17:24 -0800)]
Merge pull request #1901 from terrelln/ignore
Update .gitignore
Nick Terrell [Thu, 21 Nov 2019 00:36:40 +0000 (16:36 -0800)]
Update .gitignore
Yann Collet [Wed, 20 Nov 2019 00:18:56 +0000 (16:18 -0800)]
Merge pull request #1894 from felixhandte/doc-clarify-dctx-reset
Easy: Update Comment on `ZSTD_initDStream()`
Yann Collet [Wed, 20 Nov 2019 00:14:20 +0000 (16:14 -0800)]
Merge pull request #1887 from bimbashrestha/doc-fix
Fixing hashLog error 2^26=64Mib
Nick Terrell [Tue, 19 Nov 2019 20:52:51 +0000 (12:52 -0800)]
Merge pull request #1896 from terrelln/test-fixes
Fix Appveyor failure
Sergey Dryabzhinsky [Tue, 19 Nov 2019 20:24:00 +0000 (23:24 +0300)]
Update util.c
Sergey Dryabzhinsky [Tue, 19 Nov 2019 20:15:28 +0000 (23:15 +0300)]
Fix typo in util.c
There must be mtim*e*
Nick Terrell [Tue, 19 Nov 2019 19:12:26 +0000 (11:12 -0800)]
Fix Appveyor failure
Bimba Shrestha [Tue, 19 Nov 2019 18:03:07 +0000 (10:03 -0800)]
Going back to original flow but removing else return
Bimba Shrestha [Tue, 19 Nov 2019 17:55:13 +0000 (09:55 -0800)]
Updated some more outdated bounds
W. Felix Handte [Tue, 19 Nov 2019 06:57:15 +0000 (01:57 -0500)]
Easy: Update Comment on `ZSTD_initDStream()`
W. Felix Handte [Tue, 19 Nov 2019 06:21:53 +0000 (01:21 -0500)]
Add Tool to Diagnose Whether Corrupt Blobs are Plausibly Bit-Flips
I spend an increasing amount of my time looking at "Corrupted block detected"
failures in decompression. Not infrequently, I suspect that it is the result
of hardware failure, and that the blob has become bit-flipped or otherwise
corrupted somewhere along the line.
For that reason I was motivated to write a little tool to inspect blobs that
fail to decompress, to try modifying them, and then check whether they
decompress successfully. This seems like potentially a generally useful tool,
so I figured it might be worth putting in `contrib/`.
Nick Terrell [Tue, 19 Nov 2019 00:16:30 +0000 (16:16 -0800)]
Merge pull request #1866 from legrosbuffle/dev
Optimized loop bounds to allow the compiler to unroll the loop.
Nick Terrell [Tue, 19 Nov 2019 00:09:33 +0000 (16:09 -0800)]
Merge pull request #1888 from senhuang42/superblocks_fixed
RLE test and re-enable RLE in main compression loop
Nick Terrell [Tue, 19 Nov 2019 00:07:28 +0000 (16:07 -0800)]
Merge pull request #1889 from vtorri/dev
shared library: rename import library with .dll.a extension
Bimba Shrestha [Mon, 18 Nov 2019 21:53:55 +0000 (13:53 -0800)]
Reversing condition order and forwarding error
Sen Huang [Mon, 18 Nov 2019 21:39:16 +0000 (16:39 -0500)]
No margin on RLE test size check
Bimba Shrestha [Mon, 18 Nov 2019 16:43:14 +0000 (08:43 -0800)]
Output regular uncompressed block when compressSequences fails
Bimba Shrestha [Sat, 16 Nov 2019 03:00:53 +0000 (19:00 -0800)]
Typo in comment
Bimba Shrestha [Sat, 16 Nov 2019 02:44:51 +0000 (18:44 -0800)]
Leaving room for checksum
Sen Huang [Fri, 15 Nov 2019 19:57:44 +0000 (14:57 -0500)]
Updated comment to reflect actual compression behavior
Vincent Torri [Fri, 15 Nov 2019 18:46:06 +0000 (19:46 +0100)]
shared library: rename import library with .dll.a extension
mort of open source project are using this extension for the import library.
The Win32 linker is supporting this extension, see
https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/4/html/Using_ld_the_GNU_Linker/win32.html
section "direct linking to a dll"
Vincent Torri [Fri, 15 Nov 2019 18:37:15 +0000 (19:37 +0100)]
Merge remote-tracking branch 'upstream/master' into dev
Sen Huang [Fri, 15 Nov 2019 17:26:48 +0000 (12:26 -0500)]
Modified existing RLE test to take compressed size into account