]>
git.ipfire.org Git - thirdparty/zstd.git/log
Yann Collet [Sat, 5 Dec 2020 04:25:01 +0000 (20:25 -0800)]
fix gcc-10 aliasing warning in zlib_wrapper
Yann Collet [Sat, 5 Dec 2020 03:21:40 +0000 (19:21 -0800)]
fix aliasing warning in decodecorpus
Yann Collet [Sat, 5 Dec 2020 00:43:19 +0000 (16:43 -0800)]
fix gcc-10 strict aliasing warnings
by exposing HUF_CElt declaration.
Yann Collet [Sat, 5 Dec 2020 00:33:39 +0000 (16:33 -0800)]
minor speed improvement to HUF_readCTable()
faster by ~+1-2%
Nick Terrell [Fri, 4 Dec 2020 01:48:25 +0000 (17:48 -0800)]
Merge pull request #2410 from terrelln/zlib-wrapper
[zlibWrapper] Only use public zstd functions
Nick Terrell [Thu, 3 Dec 2020 00:49:03 +0000 (16:49 -0800)]
Merge pull request #2406 from terrelln/linux-wrapper-api
[linux] Add the linux wrapper API
Nick Terrell [Wed, 2 Dec 2020 23:05:11 +0000 (15:05 -0800)]
[zlibWrapper] Only use public zstd functions
Yann Collet [Wed, 2 Dec 2020 23:33:54 +0000 (15:33 -0800)]
Merge pull request #2409 from facebook/test_makefile
Minor refactor
Nick Terrell [Wed, 2 Dec 2020 22:35:58 +0000 (14:35 -0800)]
Merge pull request #2390 from animalize/clamp_level
Clamp compression level
Nick Terrell [Wed, 2 Dec 2020 19:57:55 +0000 (11:57 -0800)]
[contrib][linux] Add SPDX-License-Identifier
Nick Terrell [Wed, 2 Dec 2020 19:42:25 +0000 (11:42 -0800)]
[contrib][linux] Fix make import-upstream
sen [Wed, 2 Dec 2020 19:40:02 +0000 (14:40 -0500)]
Merge pull request #2407 from senhuang42/sequence_compression_nbseqcheck_fix
[oss-fuzz] Move sequence compression API nbSequences check
Nick Terrell [Wed, 2 Dec 2020 19:07:17 +0000 (11:07 -0800)]
[contrib][linux] Follow style guide more closely
Nick Terrell [Wed, 2 Dec 2020 18:40:46 +0000 (10:40 -0800)]
[contrib][linux] Add a make target to import upstream
Yann Collet [Wed, 2 Dec 2020 18:34:12 +0000 (10:34 -0800)]
fixed fuzzer multithreading tests
Yann Collet [Wed, 2 Dec 2020 17:13:55 +0000 (09:13 -0800)]
fixed fuzzer32 to support multithreading tests
though it still fails on test33:
`test 33: superblock uncompressible data, too many nocompress superblocks`
senhuang42 [Wed, 2 Dec 2020 17:11:32 +0000 (12:11 -0500)]
Move max nb seq check to per-block
Nick Terrell [Wed, 2 Dec 2020 09:11:41 +0000 (01:11 -0800)]
[contrib][linux-kernel] Fix test warnings
Nick Terrell [Wed, 2 Dec 2020 08:59:31 +0000 (00:59 -0800)]
[minor][lib] Remove double semicolon
Nick Terrell [Wed, 2 Dec 2020 08:56:56 +0000 (00:56 -0800)]
[contrib][linux] Add wrapper API
Add the kernel wrapper API. This keeps the same API and semantics as the
existing kernel API with name changes to be more kernel style and avoid
symbol collisions with zstd.
Yann Collet [Wed, 2 Dec 2020 08:21:29 +0000 (00:21 -0800)]
removed fullbench-lib from tests/all
this build works fine on all my systems,
but since to fail on CI environment.
Unclear why there is a difference.
This build test is not relevant anyway.
Yann Collet [Wed, 2 Dec 2020 08:15:07 +0000 (00:15 -0800)]
fixed API documentation
Yann Collet [Wed, 2 Dec 2020 07:44:16 +0000 (23:44 -0800)]
streamline fuzzer
from fuzzer32
Yann Collet [Wed, 2 Dec 2020 07:36:05 +0000 (23:36 -0800)]
better usage of default build rules
Yann Collet [Wed, 2 Dec 2020 06:33:45 +0000 (22:33 -0800)]
simplified test makefile
removed gzstd target:
relevant tests are unused and broken anyway
Yann Collet [Wed, 2 Dec 2020 01:59:56 +0000 (17:59 -0800)]
Merge pull request #2348 from dscheg/dev
Fix dll path in case of cross-compilation
sen [Tue, 1 Dec 2020 22:34:01 +0000 (17:34 -0500)]
Merge pull request #2405 from senhuang42/sequence_compression_minmatch_fix
Sequence Compression API - make validator use cctx minMatch instead of global MINMATCH
senhuang42 [Tue, 1 Dec 2020 15:53:30 +0000 (10:53 -0500)]
Add sequence nb validation to compressSequences(), adjust minMatch comparisons
Yann Collet [Mon, 30 Nov 2020 22:13:42 +0000 (14:13 -0800)]
Merge pull request #2399 from brawner/brawner/update-cmake-minimum-version
Update cmake_minimum_required to 2.8.12
senhuang42 [Mon, 30 Nov 2020 20:38:12 +0000 (15:38 -0500)]
Use cctx's minMatch instead of global MINMATCH, make fuzzer use validation
Nick Terrell [Mon, 30 Nov 2020 18:38:45 +0000 (10:38 -0800)]
Merge pull request #2397 from dscheg/fixtrainfrombuffer
Pass dictBufferCapacity to COVER_selectDict()
Yann Collet [Mon, 30 Nov 2020 18:38:08 +0000 (10:38 -0800)]
Merge pull request #2404 from facebook/lz4check
fix lz4 compatibility test broken in docker
Yann Collet [Mon, 30 Nov 2020 14:47:16 +0000 (06:47 -0800)]
fix lz4 test messed by console detection
Yann Collet [Mon, 30 Nov 2020 14:30:26 +0000 (06:30 -0800)]
Merge pull request #2403 from facebook/no_strncpy
fix gcc10 warnings
Yann Collet [Mon, 30 Nov 2020 13:32:43 +0000 (05:32 -0800)]
added tests presumed to break lz4 console detection
Yann Collet [Mon, 30 Nov 2020 12:44:37 +0000 (04:44 -0800)]
fix gcc10 warnings
gcc10 doesn't like its own strncpy
Stephen Brawner [Tue, 24 Nov 2020 20:05:42 +0000 (12:05 -0800)]
Update cmake_minimum_required to 2.8.12
Signed-off-by: Stephen Brawner <brawner@gmail.com>
sen [Tue, 24 Nov 2020 02:54:16 +0000 (21:54 -0500)]
Merge pull request #2398 from senhuang42/fix_seq_compression_oss_fuzz
[OSS-Fuzz] Make sequence compression fuzzer's generated minmatch to be same as CCtx's minmatch
senhuang42 [Mon, 23 Nov 2020 18:29:20 +0000 (13:29 -0500)]
Force CCtx minmatch to be same as generated minmatch
Dmitriy Titarenko [Sun, 22 Nov 2020 18:45:18 +0000 (23:45 +0500)]
Pass dictBufferCapacity to COVER_selectDict()
closes #2371
sen [Sun, 22 Nov 2020 18:07:46 +0000 (13:07 -0500)]
Merge pull request #2394 from senhuang42/seq_compress_fuzzer
Fuzzer for sequence compression API
senhuang42 [Thu, 19 Nov 2020 22:34:39 +0000 (17:34 -0500)]
Fix generating 1 too few characters in random string generator
senhuang42 [Wed, 18 Nov 2020 15:25:48 +0000 (10:25 -0500)]
Add appropriate bound to matchlengths, and reduce srcSize max
senhuang42 [Tue, 17 Nov 2020 14:57:10 +0000 (09:57 -0500)]
Add a bound for matchlength dependent on window size
senhuang42 [Mon, 16 Nov 2020 22:53:38 +0000 (17:53 -0500)]
Variety of minor fixups, reduce allocation, make deterministic
senhuang42 [Mon, 16 Nov 2020 15:55:07 +0000 (10:55 -0500)]
Add built binary to .gitignore
senhuang42 [Mon, 16 Nov 2020 15:54:55 +0000 (10:54 -0500)]
Add new fuzzer to build targets
senhuang42 [Mon, 16 Nov 2020 15:54:19 +0000 (10:54 -0500)]
Implement new fuzzer for sequence compression
sen [Fri, 20 Nov 2020 21:54:20 +0000 (16:54 -0500)]
Merge pull request #2387 from senhuang42/compress_sequence_API
[RFC] New sequence compression API
senhuang42 [Fri, 20 Nov 2020 16:23:22 +0000 (11:23 -0500)]
Add experimental param for sequence validation
senhuang42 [Fri, 20 Nov 2020 15:07:55 +0000 (10:07 -0500)]
Remove unnecessary repcode backup, apply style choices, use function pointer
sen [Thu, 19 Nov 2020 23:26:42 +0000 (18:26 -0500)]
Merge pull request #2395 from senhuang42/is_rle_speedup
10x speedup for ZSTD_isRLE()
sen [Thu, 19 Nov 2020 22:32:40 +0000 (17:32 -0500)]
Explicit cast for visual warnings
Github has automatic commits now! Cool
Co-authored-by: Nick Terrell <nickrterrell@gmail.com>
senhuang42 [Thu, 19 Nov 2020 16:56:16 +0000 (11:56 -0500)]
Unroll isRLE loop
senhuang42 [Wed, 18 Nov 2020 15:01:30 +0000 (10:01 -0500)]
Clean up visual conversion warnings
senhuang42 [Wed, 18 Nov 2020 14:52:24 +0000 (09:52 -0500)]
Improve documentation on ZSTD_compressSequences()
senhuang42 [Tue, 17 Nov 2020 15:13:22 +0000 (10:13 -0500)]
Modification to offset validation to include entire sequence
senhuang42 [Mon, 16 Nov 2020 23:05:35 +0000 (18:05 -0500)]
Fix assert edge case, improve documentation in zstd.h
senhuang42 [Mon, 16 Nov 2020 16:47:27 +0000 (11:47 -0500)]
Fix warnings and make validation enabled by default
senhuang42 [Mon, 16 Nov 2020 15:47:26 +0000 (10:47 -0500)]
Fix unit tests to agree with new changes
senhuang42 [Mon, 16 Nov 2020 15:44:57 +0000 (10:44 -0500)]
Add new sequence format as an experimental CCtx param
senhuang42 [Mon, 16 Nov 2020 15:36:06 +0000 (10:36 -0500)]
Overhaul logic to simplify, add in proper validations, fix match splitting
senhuang42 [Wed, 11 Nov 2020 21:28:17 +0000 (16:28 -0500)]
Add new sequence compress api params to cctx
senhuang42 [Tue, 10 Nov 2020 20:33:33 +0000 (15:33 -0500)]
Fix srcSize=0 edge case
senhuang42 [Tue, 10 Nov 2020 18:48:02 +0000 (13:48 -0500)]
Fix literals length calculation
senhuang42 [Fri, 6 Nov 2020 18:24:43 +0000 (13:24 -0500)]
Adjust unit tests to agree with new sequence generation API
senhuang42 [Fri, 6 Nov 2020 18:09:15 +0000 (13:09 -0500)]
Remove dstCapacity error check
senhuang42 [Fri, 6 Nov 2020 16:35:10 +0000 (11:35 -0500)]
Remove extraneous function in this API
senhuang42 [Thu, 5 Nov 2020 17:36:08 +0000 (12:36 -0500)]
Add check comparing offset to window size
senhuang42 [Wed, 4 Nov 2020 17:42:19 +0000 (12:42 -0500)]
Fix MSAN errors
senhuang42 [Wed, 4 Nov 2020 16:05:41 +0000 (11:05 -0500)]
Address edge case with endPosInSequence
senhuang42 [Wed, 4 Nov 2020 15:43:35 +0000 (10:43 -0500)]
Change debug levels to appropriate ones
senhuang42 [Wed, 4 Nov 2020 14:36:36 +0000 (09:36 -0500)]
Add RLE support
senhuang42 [Wed, 4 Nov 2020 00:00:02 +0000 (19:00 -0500)]
Fix various build warnings
senhuang42 [Tue, 3 Nov 2020 23:53:44 +0000 (18:53 -0500)]
Add test case to roundtrip using ZSTD_getSequences() and ZSTD_compressSequences()
senhuang42 [Tue, 3 Nov 2020 18:52:21 +0000 (13:52 -0500)]
Add documentation for new api functions
senhuang42 [Tue, 3 Nov 2020 18:41:20 +0000 (13:41 -0500)]
Refactor for enhanced code clarity
senhuang42 [Tue, 3 Nov 2020 18:37:50 +0000 (13:37 -0500)]
Rename internal function compressSequences(), and promote new *_ext() functions to their actual name
senhuang42 [Tue, 3 Nov 2020 18:31:07 +0000 (13:31 -0500)]
Add another API function to compress with existing CCTX
senhuang42 [Tue, 3 Nov 2020 18:05:57 +0000 (13:05 -0500)]
More adjustments to improve code clarity
senhuang42 [Tue, 3 Nov 2020 16:59:07 +0000 (11:59 -0500)]
Pull compressStream2() transparent initialization into its own function
senhuang42 [Mon, 2 Nov 2020 18:29:56 +0000 (13:29 -0500)]
Add initial support for new ZSTD_Sequence mode
senhuang42 [Mon, 2 Nov 2020 15:01:18 +0000 (10:01 -0500)]
Add sequence compression format param
senhuang42 [Mon, 2 Nov 2020 14:52:52 +0000 (09:52 -0500)]
Always ensure sequenceRange updates properly, add more error forwarding
senhuang42 [Mon, 2 Nov 2020 14:40:26 +0000 (09:40 -0500)]
Various minor logical refactors to improve clarity
senhuang42 [Fri, 30 Oct 2020 15:55:20 +0000 (11:55 -0400)]
Fix cSize calculation for noCompressBlocks
senhuang42 [Thu, 29 Oct 2020 18:58:06 +0000 (14:58 -0400)]
Rebased, roundtrips silesia.tar
senhuang42 [Thu, 29 Oct 2020 18:47:36 +0000 (14:47 -0400)]
Refactor for better debugging info
senhuang42 [Thu, 29 Oct 2020 16:52:58 +0000 (12:52 -0400)]
Corrections and edge-case fixes to be able to roundtrip dickens
senhuang42 [Thu, 29 Oct 2020 15:01:04 +0000 (11:01 -0400)]
Multi-block compression scaffolding - works on single-block files
senhuang42 [Thu, 29 Oct 2020 14:24:45 +0000 (10:24 -0400)]
Add support for uncompressible blocks
senhuang42 [Wed, 28 Oct 2020 17:40:37 +0000 (13:40 -0400)]
Enable usage of ZSTD_sequenceRange for single-block compression
senhuang42 [Wed, 28 Oct 2020 17:28:27 +0000 (13:28 -0400)]
Add logic to handle ZSTD_sequenceRange
senhuang42 [Wed, 28 Oct 2020 15:57:21 +0000 (11:57 -0400)]
Add last literals handling like getSequences()
senhuang42 [Wed, 28 Oct 2020 15:50:38 +0000 (11:50 -0400)]
Pull block compression out of main compressSequences() function
senhuang42 [Wed, 28 Oct 2020 15:28:12 +0000 (11:28 -0400)]
Implement ZSTD_updateSequenceRange
senhuang42 [Wed, 28 Oct 2020 15:07:36 +0000 (11:07 -0400)]
Modify SequenceRange to have posInSequence
senhuang42 [Wed, 28 Oct 2020 15:04:44 +0000 (11:04 -0400)]
Add function definition for sequenceRange updater
senhuang42 [Wed, 28 Oct 2020 15:04:18 +0000 (11:04 -0400)]
Add ZSTD_SequenceRange to count ranges in array of ZSTD_Sequence
senhuang42 [Tue, 27 Oct 2020 15:02:58 +0000 (11:02 -0400)]
Add support for repcodes