]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
4 years agoUsing add-apt-repository instead and installing intel-basekit/hpckit 2417/head
Bimba Shrestha [Sat, 5 Dec 2020 15:42:44 +0000 (09:42 -0600)] 
Using add-apt-repository instead and installing intel-basekit/hpckit

4 years agoMerge pull request #2413 from senhuang42/paramgrill_windows
Yann Collet [Sat, 5 Dec 2020 05:38:39 +0000 (21:38 -0800)] 
Merge pull request #2413 from senhuang42/paramgrill_windows

Paramgrill for windows

4 years agoMerge pull request #2415 from facebook/fix_aliasing
Yann Collet [Sat, 5 Dec 2020 05:30:57 +0000 (21:30 -0800)] 
Merge pull request #2415 from facebook/fix_aliasing

fix gcc-10 strict aliasing warnings

4 years agofix gcc-10 aliasing warning in zlib_wrapper 2415/head
Yann Collet [Sat, 5 Dec 2020 04:25:01 +0000 (20:25 -0800)] 
fix gcc-10 aliasing warning in zlib_wrapper

4 years agofix aliasing warning in decodecorpus
Yann Collet [Sat, 5 Dec 2020 03:21:40 +0000 (19:21 -0800)] 
fix aliasing warning in decodecorpus

4 years agoMerge pull request #2412 from animalize/dict_compressionlevel
Nick Terrell [Sat, 5 Dec 2020 01:09:30 +0000 (17:09 -0800)] 
Merge pull request #2412 from animalize/dict_compressionlevel

use ZSTD_CLEVEL_DEFAULT in zdict.c

4 years agofix gcc-10 strict aliasing warnings
Yann Collet [Sat, 5 Dec 2020 00:43:19 +0000 (16:43 -0800)] 
fix gcc-10 strict aliasing warnings

by exposing HUF_CElt declaration.

4 years agominor speed improvement to HUF_readCTable()
Yann Collet [Sat, 5 Dec 2020 00:33:39 +0000 (16:33 -0800)] 
minor speed improvement to HUF_readCTable()

faster by ~+1-2%

4 years agoMerge pull request #2414 from terrelln/mt-progress
Nick Terrell [Sat, 5 Dec 2020 00:30:08 +0000 (16:30 -0800)] 
Merge pull request #2414 from terrelln/mt-progress

[lib] Ensure that multithreaded compression always makes some progress

4 years ago[lib] Ensure that multithreaded compression always makes some progress 2414/head
Nick Terrell [Fri, 4 Dec 2020 04:25:14 +0000 (20:25 -0800)] 
[lib] Ensure that multithreaded compression always makes some progress

4 years agoMerge pull request #2410 from terrelln/zlib-wrapper
Nick Terrell [Fri, 4 Dec 2020 01:48:25 +0000 (17:48 -0800)] 
Merge pull request #2410 from terrelln/zlib-wrapper

[zlibWrapper] Only use public zstd functions

4 years agoAllow paramgrill in cmake on windows 2413/head
senhuang42 [Thu, 3 Dec 2020 15:39:16 +0000 (10:39 -0500)] 
Allow paramgrill in cmake on windows

4 years agoFix MSVC 2019 warnings
senhuang42 [Thu, 3 Dec 2020 15:36:45 +0000 (10:36 -0500)] 
Fix MSVC 2019 warnings

4 years agouse ZSTD_CLEVEL_DEFAULT in zdict.c 2412/head
animalize [Thu, 3 Dec 2020 04:44:46 +0000 (12:44 +0800)] 
use ZSTD_CLEVEL_DEFAULT in zdict.c

4 years agoMerge pull request #2406 from terrelln/linux-wrapper-api
Nick Terrell [Thu, 3 Dec 2020 00:49:03 +0000 (16:49 -0800)] 
Merge pull request #2406 from terrelln/linux-wrapper-api

[linux] Add the linux wrapper API

4 years ago[zlibWrapper] Only use public zstd functions 2410/head
Nick Terrell [Wed, 2 Dec 2020 23:05:11 +0000 (15:05 -0800)] 
[zlibWrapper] Only use public zstd functions

4 years agoMerge pull request #2409 from facebook/test_makefile
Yann Collet [Wed, 2 Dec 2020 23:33:54 +0000 (15:33 -0800)] 
Merge pull request #2409 from facebook/test_makefile

Minor refactor

4 years agoMerge pull request #2390 from animalize/clamp_level
Nick Terrell [Wed, 2 Dec 2020 22:35:58 +0000 (14:35 -0800)] 
Merge pull request #2390 from animalize/clamp_level

Clamp compression level

4 years ago[contrib][linux] Add SPDX-License-Identifier 2406/head
Nick Terrell [Wed, 2 Dec 2020 19:57:55 +0000 (11:57 -0800)] 
[contrib][linux] Add SPDX-License-Identifier

4 years ago[contrib][linux] Fix make import-upstream
Nick Terrell [Wed, 2 Dec 2020 19:42:25 +0000 (11:42 -0800)] 
[contrib][linux] Fix make import-upstream

4 years agoMerge pull request #2407 from senhuang42/sequence_compression_nbseqcheck_fix
sen [Wed, 2 Dec 2020 19:40:02 +0000 (14:40 -0500)] 
Merge pull request #2407 from senhuang42/sequence_compression_nbseqcheck_fix

[oss-fuzz] Move sequence compression API nbSequences check

4 years ago[contrib][linux] Follow style guide more closely
Nick Terrell [Wed, 2 Dec 2020 19:07:17 +0000 (11:07 -0800)] 
[contrib][linux] Follow style guide more closely

4 years ago[contrib][linux] Add a make target to import upstream
Nick Terrell [Wed, 2 Dec 2020 18:40:46 +0000 (10:40 -0800)] 
[contrib][linux] Add a make target to import upstream

4 years agofixed fuzzer multithreading tests 2409/head
Yann Collet [Wed, 2 Dec 2020 18:34:12 +0000 (10:34 -0800)] 
fixed fuzzer multithreading tests

4 years agofixed fuzzer32 to support multithreading tests
Yann Collet [Wed, 2 Dec 2020 17:13:55 +0000 (09:13 -0800)] 
fixed fuzzer32 to support multithreading tests

though it still fails on test33:
`test 33: superblock uncompressible data, too many nocompress superblocks`

4 years agoMove max nb seq check to per-block 2407/head
senhuang42 [Wed, 2 Dec 2020 17:11:32 +0000 (12:11 -0500)] 
Move max nb seq check to per-block

4 years ago[contrib][linux-kernel] Fix test warnings
Nick Terrell [Wed, 2 Dec 2020 09:11:41 +0000 (01:11 -0800)] 
[contrib][linux-kernel] Fix test warnings

4 years ago[minor][lib] Remove double semicolon
Nick Terrell [Wed, 2 Dec 2020 08:59:31 +0000 (00:59 -0800)] 
[minor][lib] Remove double semicolon

4 years ago[contrib][linux] Add wrapper API
Nick Terrell [Wed, 2 Dec 2020 08:56:56 +0000 (00:56 -0800)] 
[contrib][linux] Add wrapper API

Add the kernel wrapper API. This keeps the same API and semantics as the
existing kernel API with name changes to be more kernel style and avoid
symbol collisions with zstd.

4 years agoremoved fullbench-lib from tests/all
Yann Collet [Wed, 2 Dec 2020 08:21:29 +0000 (00:21 -0800)] 
removed fullbench-lib from tests/all

this build works fine on all my systems,
but since to fail on CI environment.
Unclear why there is a difference.
This build test is not relevant anyway.

4 years agofixed API documentation
Yann Collet [Wed, 2 Dec 2020 08:15:07 +0000 (00:15 -0800)] 
fixed API documentation

4 years agostreamline fuzzer
Yann Collet [Wed, 2 Dec 2020 07:44:16 +0000 (23:44 -0800)] 
streamline fuzzer

from fuzzer32

4 years agobetter usage of default build rules
Yann Collet [Wed, 2 Dec 2020 07:36:05 +0000 (23:36 -0800)] 
better usage of default build rules

4 years agosimplified test makefile
Yann Collet [Wed, 2 Dec 2020 06:33:45 +0000 (22:33 -0800)] 
simplified test makefile

removed gzstd target:
relevant tests are unused and broken anyway

4 years agoMerge pull request #2348 from dscheg/dev
Yann Collet [Wed, 2 Dec 2020 01:59:56 +0000 (17:59 -0800)] 
Merge pull request #2348 from dscheg/dev

Fix dll path in case of cross-compilation

4 years agoMerge pull request #2405 from senhuang42/sequence_compression_minmatch_fix
sen [Tue, 1 Dec 2020 22:34:01 +0000 (17:34 -0500)] 
Merge pull request #2405 from senhuang42/sequence_compression_minmatch_fix

Sequence Compression API - make validator use cctx minMatch instead of global MINMATCH

4 years agoAdd sequence nb validation to compressSequences(), adjust minMatch comparisons 2405/head
senhuang42 [Tue, 1 Dec 2020 15:53:30 +0000 (10:53 -0500)] 
Add sequence nb validation to compressSequences(), adjust minMatch comparisons

4 years agoMerge pull request #2399 from brawner/brawner/update-cmake-minimum-version
Yann Collet [Mon, 30 Nov 2020 22:13:42 +0000 (14:13 -0800)] 
Merge pull request #2399 from brawner/brawner/update-cmake-minimum-version

Update cmake_minimum_required to 2.8.12

4 years agoUse cctx's minMatch instead of global MINMATCH, make fuzzer use validation
senhuang42 [Mon, 30 Nov 2020 20:38:12 +0000 (15:38 -0500)] 
Use cctx's minMatch instead of global MINMATCH, make fuzzer use validation

4 years agoMerge pull request #2397 from dscheg/fixtrainfrombuffer
Nick Terrell [Mon, 30 Nov 2020 18:38:45 +0000 (10:38 -0800)] 
Merge pull request #2397 from dscheg/fixtrainfrombuffer

Pass dictBufferCapacity to COVER_selectDict()

4 years agoMerge pull request #2404 from facebook/lz4check
Yann Collet [Mon, 30 Nov 2020 18:38:08 +0000 (10:38 -0800)] 
Merge pull request #2404 from facebook/lz4check

fix lz4 compatibility test broken in docker

4 years agofix lz4 test messed by console detection 2404/head
Yann Collet [Mon, 30 Nov 2020 14:47:16 +0000 (06:47 -0800)] 
fix lz4 test messed by console detection

4 years agoMerge pull request #2403 from facebook/no_strncpy
Yann Collet [Mon, 30 Nov 2020 14:30:26 +0000 (06:30 -0800)] 
Merge pull request #2403 from facebook/no_strncpy

fix gcc10 warnings

4 years agoadded tests presumed to break lz4 console detection
Yann Collet [Mon, 30 Nov 2020 13:32:43 +0000 (05:32 -0800)] 
added tests presumed to break lz4 console detection

4 years agofix gcc10 warnings 2403/head
Yann Collet [Mon, 30 Nov 2020 12:44:37 +0000 (04:44 -0800)] 
fix gcc10 warnings

gcc10 doesn't like its own strncpy

4 years agoUpdate cmake_minimum_required to 2.8.12 2399/head
Stephen Brawner [Tue, 24 Nov 2020 20:05:42 +0000 (12:05 -0800)] 
Update cmake_minimum_required to 2.8.12

Signed-off-by: Stephen Brawner <brawner@gmail.com>
4 years agoMerge pull request #2398 from senhuang42/fix_seq_compression_oss_fuzz
sen [Tue, 24 Nov 2020 02:54:16 +0000 (21:54 -0500)] 
Merge pull request #2398 from senhuang42/fix_seq_compression_oss_fuzz

[OSS-Fuzz] Make sequence compression fuzzer's generated minmatch to be same as CCtx's minmatch

4 years agoForce CCtx minmatch to be same as generated minmatch 2398/head
senhuang42 [Mon, 23 Nov 2020 18:29:20 +0000 (13:29 -0500)] 
Force CCtx minmatch to be same as generated minmatch

4 years agoPass dictBufferCapacity to COVER_selectDict() 2397/head
Dmitriy Titarenko [Sun, 22 Nov 2020 18:45:18 +0000 (23:45 +0500)] 
Pass dictBufferCapacity to COVER_selectDict()

closes #2371

4 years agoMerge pull request #2394 from senhuang42/seq_compress_fuzzer
sen [Sun, 22 Nov 2020 18:07:46 +0000 (13:07 -0500)] 
Merge pull request #2394 from senhuang42/seq_compress_fuzzer

Fuzzer for sequence compression API

4 years agoFix generating 1 too few characters in random string generator 2394/head
senhuang42 [Thu, 19 Nov 2020 22:34:39 +0000 (17:34 -0500)] 
Fix generating 1 too few characters in random string generator

4 years agoAdd appropriate bound to matchlengths, and reduce srcSize max
senhuang42 [Wed, 18 Nov 2020 15:25:48 +0000 (10:25 -0500)] 
Add appropriate bound to matchlengths, and reduce srcSize max

4 years agoAdd a bound for matchlength dependent on window size
senhuang42 [Tue, 17 Nov 2020 14:57:10 +0000 (09:57 -0500)] 
Add a bound for matchlength dependent on window size

4 years agoVariety of minor fixups, reduce allocation, make deterministic
senhuang42 [Mon, 16 Nov 2020 22:53:38 +0000 (17:53 -0500)] 
Variety of minor fixups, reduce allocation, make deterministic

4 years agoAdd built binary to .gitignore
senhuang42 [Mon, 16 Nov 2020 15:55:07 +0000 (10:55 -0500)] 
Add built binary to .gitignore

4 years agoAdd new fuzzer to build targets
senhuang42 [Mon, 16 Nov 2020 15:54:55 +0000 (10:54 -0500)] 
Add new fuzzer to build targets

4 years agoImplement new fuzzer for sequence compression
senhuang42 [Mon, 16 Nov 2020 15:54:19 +0000 (10:54 -0500)] 
Implement new fuzzer for sequence compression

4 years agoMerge pull request #2387 from senhuang42/compress_sequence_API
sen [Fri, 20 Nov 2020 21:54:20 +0000 (16:54 -0500)] 
Merge pull request #2387 from senhuang42/compress_sequence_API

[RFC] New sequence compression API

4 years agoAdd experimental param for sequence validation 2387/head
senhuang42 [Fri, 20 Nov 2020 16:23:22 +0000 (11:23 -0500)] 
Add experimental param for sequence validation

4 years agoRemove unnecessary repcode backup, apply style choices, use function pointer
senhuang42 [Fri, 20 Nov 2020 15:07:55 +0000 (10:07 -0500)] 
Remove unnecessary repcode backup, apply style choices, use function pointer

4 years agoMerge pull request #2395 from senhuang42/is_rle_speedup
sen [Thu, 19 Nov 2020 23:26:42 +0000 (18:26 -0500)] 
Merge pull request #2395 from senhuang42/is_rle_speedup

10x speedup for ZSTD_isRLE()

4 years agoExplicit cast for visual warnings 2395/head
sen [Thu, 19 Nov 2020 22:32:40 +0000 (17:32 -0500)] 
Explicit cast for visual warnings

Github has automatic commits now! Cool

Co-authored-by: Nick Terrell <nickrterrell@gmail.com>
4 years agoUnroll isRLE loop
senhuang42 [Thu, 19 Nov 2020 16:56:16 +0000 (11:56 -0500)] 
Unroll isRLE loop

4 years agoClean up visual conversion warnings
senhuang42 [Wed, 18 Nov 2020 15:01:30 +0000 (10:01 -0500)] 
Clean up visual conversion warnings

4 years agoImprove documentation on ZSTD_compressSequences()
senhuang42 [Wed, 18 Nov 2020 14:52:24 +0000 (09:52 -0500)] 
Improve documentation on ZSTD_compressSequences()

4 years agoModification to offset validation to include entire sequence
senhuang42 [Tue, 17 Nov 2020 15:13:22 +0000 (10:13 -0500)] 
Modification to offset validation to include entire sequence

4 years agoFix assert edge case, improve documentation in zstd.h
senhuang42 [Mon, 16 Nov 2020 23:05:35 +0000 (18:05 -0500)] 
Fix assert edge case, improve documentation in zstd.h

4 years agoFix warnings and make validation enabled by default
senhuang42 [Mon, 16 Nov 2020 16:47:27 +0000 (11:47 -0500)] 
Fix warnings and make validation enabled by default

4 years agoFix unit tests to agree with new changes
senhuang42 [Mon, 16 Nov 2020 15:47:26 +0000 (10:47 -0500)] 
Fix unit tests to agree with new changes

4 years agoAdd new sequence format as an experimental CCtx param
senhuang42 [Mon, 16 Nov 2020 15:44:57 +0000 (10:44 -0500)] 
Add new sequence format as an experimental CCtx param

4 years agoOverhaul logic to simplify, add in proper validations, fix match splitting
senhuang42 [Mon, 16 Nov 2020 15:36:06 +0000 (10:36 -0500)] 
Overhaul logic to simplify, add in proper validations, fix match splitting

4 years agoAdd new sequence compress api params to cctx
senhuang42 [Wed, 11 Nov 2020 21:28:17 +0000 (16:28 -0500)] 
Add new sequence compress api params to cctx

4 years agoFix srcSize=0 edge case
senhuang42 [Tue, 10 Nov 2020 20:33:33 +0000 (15:33 -0500)] 
Fix srcSize=0 edge case

4 years agoFix literals length calculation
senhuang42 [Tue, 10 Nov 2020 18:48:02 +0000 (13:48 -0500)] 
Fix literals length calculation

4 years agoAdjust unit tests to agree with new sequence generation API
senhuang42 [Fri, 6 Nov 2020 18:24:43 +0000 (13:24 -0500)] 
Adjust unit tests to agree with new sequence generation API

4 years agoRemove dstCapacity error check
senhuang42 [Fri, 6 Nov 2020 18:09:15 +0000 (13:09 -0500)] 
Remove dstCapacity error check

4 years agoRemove extraneous function in this API
senhuang42 [Fri, 6 Nov 2020 16:35:10 +0000 (11:35 -0500)] 
Remove extraneous function in this API

4 years agoAdd check comparing offset to window size
senhuang42 [Thu, 5 Nov 2020 17:36:08 +0000 (12:36 -0500)] 
Add check comparing offset to window size

4 years agoFix MSAN errors
senhuang42 [Wed, 4 Nov 2020 17:42:19 +0000 (12:42 -0500)] 
Fix MSAN errors

4 years agoAddress edge case with endPosInSequence
senhuang42 [Wed, 4 Nov 2020 16:05:41 +0000 (11:05 -0500)] 
Address edge case with endPosInSequence

4 years agoChange debug levels to appropriate ones
senhuang42 [Wed, 4 Nov 2020 15:43:35 +0000 (10:43 -0500)] 
Change debug levels to appropriate ones

4 years agoAdd RLE support
senhuang42 [Wed, 4 Nov 2020 14:36:36 +0000 (09:36 -0500)] 
Add RLE support

4 years agoFix various build warnings
senhuang42 [Wed, 4 Nov 2020 00:00:02 +0000 (19:00 -0500)] 
Fix various build warnings

4 years agoAdd test case to roundtrip using ZSTD_getSequences() and ZSTD_compressSequences()
senhuang42 [Tue, 3 Nov 2020 23:53:44 +0000 (18:53 -0500)] 
Add test case to roundtrip using ZSTD_getSequences() and ZSTD_compressSequences()

4 years agoAdd documentation for new api functions
senhuang42 [Tue, 3 Nov 2020 18:52:21 +0000 (13:52 -0500)] 
Add documentation for new api functions

4 years agoRefactor for enhanced code clarity
senhuang42 [Tue, 3 Nov 2020 18:41:20 +0000 (13:41 -0500)] 
Refactor for enhanced code clarity

4 years agoRename internal function compressSequences(), and promote new *_ext() functions to...
senhuang42 [Tue, 3 Nov 2020 18:37:50 +0000 (13:37 -0500)] 
Rename internal function compressSequences(), and promote new *_ext() functions to their actual name

4 years agoAdd another API function to compress with existing CCTX
senhuang42 [Tue, 3 Nov 2020 18:31:07 +0000 (13:31 -0500)] 
Add another API function to compress with existing CCTX

4 years agoMore adjustments to improve code clarity
senhuang42 [Tue, 3 Nov 2020 18:05:57 +0000 (13:05 -0500)] 
More adjustments to improve code clarity

4 years agoPull compressStream2() transparent initialization into its own function
senhuang42 [Tue, 3 Nov 2020 16:59:07 +0000 (11:59 -0500)] 
Pull compressStream2() transparent initialization into its own function

4 years agoAdd initial support for new ZSTD_Sequence mode
senhuang42 [Mon, 2 Nov 2020 18:29:56 +0000 (13:29 -0500)] 
Add initial support for new ZSTD_Sequence mode

4 years agoAdd sequence compression format param
senhuang42 [Mon, 2 Nov 2020 15:01:18 +0000 (10:01 -0500)] 
Add sequence compression format param

4 years agoAlways ensure sequenceRange updates properly, add more error forwarding
senhuang42 [Mon, 2 Nov 2020 14:52:52 +0000 (09:52 -0500)] 
Always ensure sequenceRange updates properly, add more error forwarding

4 years agoVarious minor logical refactors to improve clarity
senhuang42 [Mon, 2 Nov 2020 14:40:26 +0000 (09:40 -0500)] 
Various minor logical refactors to improve clarity

4 years agoFix cSize calculation for noCompressBlocks
senhuang42 [Fri, 30 Oct 2020 15:55:20 +0000 (11:55 -0400)] 
Fix cSize calculation for noCompressBlocks

4 years agoRebased, roundtrips silesia.tar
senhuang42 [Thu, 29 Oct 2020 18:58:06 +0000 (14:58 -0400)] 
Rebased, roundtrips silesia.tar

4 years agoRefactor for better debugging info
senhuang42 [Thu, 29 Oct 2020 18:47:36 +0000 (14:47 -0400)] 
Refactor for better debugging info

4 years agoCorrections and edge-case fixes to be able to roundtrip dickens
senhuang42 [Thu, 29 Oct 2020 16:52:58 +0000 (12:52 -0400)] 
Corrections and edge-case fixes to be able to roundtrip dickens

4 years agoMulti-block compression scaffolding - works on single-block files
senhuang42 [Thu, 29 Oct 2020 15:01:04 +0000 (11:01 -0400)] 
Multi-block compression scaffolding - works on single-block files

4 years agoAdd support for uncompressible blocks
senhuang42 [Thu, 29 Oct 2020 14:24:45 +0000 (10:24 -0400)] 
Add support for uncompressible blocks