]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
5 years agoAdd Fuzzer Test for the Various Dict Attachment Strategies
W. Felix Handte [Tue, 11 Aug 2020 19:29:12 +0000 (15:29 -0400)] 
Add Fuzzer Test for the Various Dict Attachment Strategies

5 years agoTODO: Comment
W. Felix Handte [Fri, 7 Aug 2020 20:41:16 +0000 (16:41 -0400)] 
TODO: Comment

5 years agoFix Compilation Warnings
W. Felix Handte [Fri, 7 Aug 2020 16:02:18 +0000 (12:02 -0400)] 
Fix Compilation Warnings

5 years agoupdating cold benchmark
Bimba Shrestha [Fri, 12 Jun 2020 15:53:58 +0000 (08:53 -0700)] 
updating cold benchmark

5 years agocreating ZSTD_createCDict_advanced_internal
Bimba Shrestha [Fri, 12 Jun 2020 15:01:18 +0000 (08:01 -0700)] 
creating ZSTD_createCDict_advanced_internal

5 years agochanging to int for consistency
Bimba Shrestha [Fri, 12 Jun 2020 05:57:53 +0000 (22:57 -0700)] 
changing to int for consistency

5 years agousing dict mls instead of src mls
Bimba Shrestha [Fri, 12 Jun 2020 05:55:32 +0000 (22:55 -0700)] 
using dict mls instead of src mls

5 years agoadd hashtable head prefetching
Bimba Shrestha [Fri, 12 Jun 2020 05:54:36 +0000 (22:54 -0700)] 
add hashtable head prefetching

5 years agochange method name for consistency
Bimba Shrestha [Fri, 12 Jun 2020 05:48:48 +0000 (22:48 -0700)] 
change method name for consistency

5 years agopass correct cparams
Bimba Shrestha [Fri, 12 Jun 2020 05:46:16 +0000 (22:46 -0700)] 
pass correct cparams

5 years agoremoving wrong comment
Bimba Shrestha [Fri, 12 Jun 2020 05:42:57 +0000 (22:42 -0700)] 
removing wrong comment

5 years agomaking cctxParams a pointer
Bimba Shrestha [Fri, 12 Jun 2020 05:42:11 +0000 (22:42 -0700)] 
making cctxParams a pointer

5 years agoloading dict using new algorithm
Bimba Shrestha [Fri, 12 Jun 2020 02:41:03 +0000 (19:41 -0700)] 
loading dict using new algorithm

5 years agoadding dedicatedDictSearch algorithm
Bimba Shrestha [Fri, 12 Jun 2020 01:54:44 +0000 (18:54 -0700)] 
adding dedicatedDictSearch algorithm

5 years agoadding enableDedicatedDictSearch to matchState_t
Bimba Shrestha [Fri, 12 Jun 2020 01:34:14 +0000 (18:34 -0700)] 
adding enableDedicatedDictSearch to matchState_t

5 years agoadding dedicated dict load method to lazy
Bimba Shrestha [Fri, 12 Jun 2020 01:27:07 +0000 (18:27 -0700)] 
adding dedicated dict load method to lazy

5 years agoadding ZSTD_createCDict_advanced2 to zstd.h
Bimba Shrestha [Fri, 12 Jun 2020 01:12:48 +0000 (18:12 -0700)] 
adding ZSTD_createCDict_advanced2 to zstd.h

5 years agoalways attach dict when using dedicatedDictSearch
Bimba Shrestha [Thu, 11 Jun 2020 21:19:12 +0000 (14:19 -0700)] 
always attach dict when using dedicatedDictSearch

5 years agoadding dedicatedDictSearch cParams helper methods
Bimba Shrestha [Thu, 11 Jun 2020 20:48:57 +0000 (13:48 -0700)] 
adding dedicatedDictSearch cParams helper methods

5 years agoadding ZSTD_dedicatedDictSearch_defaultCParameters variable
Bimba Shrestha [Thu, 11 Jun 2020 20:33:52 +0000 (13:33 -0700)] 
adding ZSTD_dedicatedDictSearch_defaultCParameters variable

5 years agoAdd ZSTD_c_enableDedicatedDictSearch Param
Bimba Shrestha [Thu, 11 Jun 2020 20:21:28 +0000 (13:21 -0700)] 
Add ZSTD_c_enableDedicatedDictSearch Param

5 years agoMerge pull request #2301 from terrelln/prepare-for-release
Nick Terrell [Thu, 10 Sep 2020 22:42:16 +0000 (15:42 -0700)] 
Merge pull request #2301 from terrelln/prepare-for-release

Prepare library for a release

5 years agoAdjust ZSTD_createCDict_byReference() function, and check for cdict when using compre...
senhuang42 [Thu, 10 Sep 2020 17:42:26 +0000 (13:42 -0400)] 
Adjust ZSTD_createCDict_byReference() function, and check for cdict when using compressStream2

5 years ago[lib] Bump version number to 1.4.6 2301/head
Nick Terrell [Thu, 10 Sep 2020 00:13:45 +0000 (17:13 -0700)] 
[lib] Bump version number to 1.4.6

5 years agoUpdate CHANGELOG for the next release
Nick Terrell [Thu, 10 Sep 2020 00:13:34 +0000 (17:13 -0700)] 
Update CHANGELOG for the next release

5 years ago[doc] Document new build macros in lib/README.md
Nick Terrell [Thu, 10 Sep 2020 00:13:16 +0000 (17:13 -0700)] 
[doc] Document new build macros in lib/README.md

5 years agoMerge pull request #2289 from terrelln/zstd-kernel-2
Nick Terrell [Wed, 9 Sep 2020 22:38:02 +0000 (15:38 -0700)] 
Merge pull request #2289 from terrelln/zstd-kernel-2

[linux-kernel] Prepare zstd for the Linux Kernel

5 years ago[linux-kernel] Update README with initial instructions on how to update zstd in the... 2289/head
Nick Terrell [Wed, 9 Sep 2020 19:45:16 +0000 (12:45 -0700)] 
[linux-kernel] Update README with initial instructions on how to update zstd in the kernel

5 years ago[linux-kernel] Add test that checks the ifdef hardwiring
Nick Terrell [Wed, 9 Sep 2020 19:36:58 +0000 (12:36 -0700)] 
[linux-kernel] Add test that checks the ifdef hardwiring

5 years agoAdd linux-kernel freestanding
Nick Terrell [Tue, 11 Aug 2020 06:11:20 +0000 (23:11 -0700)] 
Add linux-kernel freestanding

5 years ago[contrib] Add preprocessor hardwiring to freestanding.py
Nick Terrell [Tue, 11 Aug 2020 06:09:59 +0000 (23:09 -0700)] 
[contrib] Add preprocessor hardwiring to freestanding.py

5 years ago[lib] Add ZSTD_NO_UNUSED_FUNCTIONS macro to hide unused functions
Nick Terrell [Fri, 28 Aug 2020 00:10:04 +0000 (17:10 -0700)] 
[lib] Add ZSTD_NO_UNUSED_FUNCTIONS macro to hide unused functions

The unused function definitions are hidden behind a
`#ifndef ZSTD_NO_UNUSED_FUNCTIONS` check.

Initially hiding all functions which are unused and take up more than
2KB of stack space, because these will show up as warnings in the
Linux Kernel build system.

5 years ago[lib] Replace 64-bit divisions with ZSTD_div64()
Nick Terrell [Thu, 27 Aug 2020 22:01:18 +0000 (15:01 -0700)] 
[lib] Replace 64-bit divisions with ZSTD_div64()

5 years ago[lib] Reduce zstd stack usage by 1KB
Nick Terrell [Thu, 27 Aug 2020 00:52:54 +0000 (17:52 -0700)] 
[lib] Reduce zstd stack usage by 1KB

5 years agoFix ZSTD_initCStream_advanced() with no dictionary and static allocation
Nick Terrell [Fri, 14 Aug 2020 19:42:06 +0000 (12:42 -0700)] 
Fix ZSTD_initCStream_advanced() with no dictionary and static allocation

5 years agoAdd ZSTD_NO_INTRINSICS macro to avoid explicit intrinsics
Nick Terrell [Fri, 14 Aug 2020 19:41:28 +0000 (12:41 -0700)] 
Add ZSTD_NO_INTRINSICS macro to avoid explicit intrinsics

5 years ago[lib] s/current/curr because it collides with Linux Kernel macro
Nick Terrell [Tue, 11 Aug 2020 21:31:09 +0000 (14:31 -0700)] 
[lib] s/current/curr because it collides with Linux Kernel macro

5 years agonbThreads instead of numThreads 2299/head
senhuang42 [Wed, 9 Sep 2020 16:35:40 +0000 (12:35 -0400)] 
nbThreads instead of numThreads

5 years agoMerge pull request #2291 from i-do-cpp/fix-compression-level-default
Nick Terrell [Tue, 8 Sep 2020 23:42:34 +0000 (16:42 -0700)] 
Merge pull request #2291 from i-do-cpp/fix-compression-level-default

Fix setParameter not falling back to default compression level

5 years agoAdd ZSTD_NUMTHREADS tests to playTests.sh
senhuang42 [Tue, 8 Sep 2020 14:34:50 +0000 (10:34 -0400)] 
Add ZSTD_NUMTHREADS tests to playTests.sh

5 years agoAdd include guards for init_numThreads()
senhuang42 [Tue, 8 Sep 2020 13:26:16 +0000 (09:26 -0400)] 
Add include guards for init_numThreads()

5 years agoUpdate documentation for environment variable
senhuang42 [Mon, 7 Sep 2020 22:35:46 +0000 (18:35 -0400)] 
Update documentation for environment variable

5 years agoAdd quick documentation for ZSTD_NUMTHREADS in the code
senhuang42 [Mon, 7 Sep 2020 22:19:31 +0000 (18:19 -0400)] 
Add quick documentation for ZSTD_NUMTHREADS in the code

5 years agoChange param name to ZSTDCLI_NUMTHREADS_DEFAULT
senhuang42 [Mon, 7 Sep 2020 22:11:42 +0000 (18:11 -0400)] 
Change param name to ZSTDCLI_NUMTHREADS_DEFAULT

5 years agoChange default num_threads value
senhuang42 [Tue, 1 Sep 2020 20:08:49 +0000 (16:08 -0400)] 
Change default num_threads value

5 years agoAdjust function signatures 2292/head
senhuang42 [Mon, 7 Sep 2020 17:13:05 +0000 (13:13 -0400)] 
Adjust function signatures

5 years agoMerge pull request #2294 from felixhandte/makefile-lib-fix-var-order
Felix Handte [Fri, 4 Sep 2020 14:58:57 +0000 (10:58 -0400)] 
Merge pull request #2294 from felixhandte/makefile-lib-fix-var-order

Fix Makefile Variable Concatenation Order

5 years agoAlways update bytes status in FIO_ctx_t
senhuang42 [Fri, 4 Sep 2020 00:23:30 +0000 (20:23 -0400)] 
Always update bytes status in FIO_ctx_t

5 years agoRemove extraneous FIO_ctx_t functions
senhuang42 [Fri, 4 Sep 2020 00:22:34 +0000 (20:22 -0400)] 
Remove extraneous FIO_ctx_t functions

5 years agoFix Makefile Variable Concatenation Order 2294/head
W. Felix Handte [Thu, 3 Sep 2020 21:28:37 +0000 (17:28 -0400)] 
Fix Makefile Variable Concatenation Order

Previously, this construct would add `-O3` onto the end of the compiler flags
variable, **after** `MOREFLAGS`, which meant that it was impossible to over-
ride. This commit fixes this order and should otherwise be a no-op.

5 years agoMerge pull request #2293 from allanjude/coverity
Nick Terrell [Thu, 3 Sep 2020 20:58:45 +0000 (13:58 -0700)] 
Merge pull request #2293 from allanjude/coverity

Resolve Coverity 1432392 Unintentional integer overflow

5 years agoResolve Coverity 1432392 Unintentional integer overflow 2293/head
Allan Jude [Thu, 3 Sep 2020 19:31:50 +0000 (19:31 +0000)] 
Resolve Coverity 1432392 Unintentional integer overflow

Unintentional integer overflow (OVERFLOW_BEFORE_WIDEN)
overflow_before_widen: Potentially overflowing expression:
cdict->dictContentSize * 6U
with type unsigned int (32 bits, unsigned) is evaluated using 32-bit
arithmetic, and then used in a context that expects an expression of
type U64 (64 bits, unsigned).

5 years agoAddress memory leak in CLI from fCtx
senhuang42 [Thu, 3 Sep 2020 14:14:04 +0000 (10:14 -0400)] 
Address memory leak in CLI from fCtx

5 years agoFix FIO_removeMultiFilesWarning conflict
senhuang42 [Thu, 3 Sep 2020 13:49:13 +0000 (09:49 -0400)] 
Fix FIO_removeMultiFilesWarning conflict

5 years agoMerge branch 'dev' into multifile_status_update_fio_refactor
senhuang42 [Thu, 3 Sep 2020 13:44:47 +0000 (09:44 -0400)] 
Merge branch 'dev' into multifile_status_update_fio_refactor

5 years agoRemove comma-separated decls
senhuang42 [Thu, 3 Sep 2020 13:28:40 +0000 (09:28 -0400)] 
Remove comma-separated decls

5 years agoAdjust comments and struct to better reflect FIO_ctx_t
senhuang42 [Thu, 3 Sep 2020 13:26:30 +0000 (09:26 -0400)] 
Adjust comments and struct to better reflect FIO_ctx_t

5 years agoFix 1 file multifile logic, remove unnecessary variable assignments
senhuang42 [Thu, 3 Sep 2020 13:22:07 +0000 (09:22 -0400)] 
Fix 1 file multifile logic, remove unnecessary variable assignments

5 years agoMerge pull request #2279 from senhuang42/show_warnings_with_multiple_input_files
Nick Terrell [Wed, 2 Sep 2020 18:32:11 +0000 (11:32 -0700)] 
Merge pull request #2279 from senhuang42/show_warnings_with_multiple_input_files

Add a warning whenever (de)compressing multiple files

5 years agoAdjusted extra explanation warning to always pop up if applicable 2279/head
senhuang42 [Wed, 2 Sep 2020 12:44:42 +0000 (08:44 -0400)] 
Adjusted extra explanation warning to always pop up if applicable

5 years agoFixed newline issue and adjusted wording in comment
senhuang42 [Tue, 1 Sep 2020 17:18:30 +0000 (13:18 -0400)] 
Fixed newline issue and adjusted wording in comment

5 years agoCleanup comments, add function to set FIO_ctx_t.nbFilesProcessed
senhuang42 [Tue, 1 Sep 2020 16:52:18 +0000 (12:52 -0400)] 
Cleanup comments, add function to set FIO_ctx_t.nbFilesProcessed

5 years agoFix the logic in printing final status updates
senhuang42 [Tue, 1 Sep 2020 16:46:06 +0000 (12:46 -0400)] 
Fix the logic in printing final status updates

5 years agoIntegrate refactor into status print for multifiles, adjust logic for printing as...
senhuang42 [Tue, 1 Sep 2020 16:32:18 +0000 (12:32 -0400)] 
Integrate refactor into status print for multifiles, adjust logic for printing as needed

5 years agoChange name to ZSTD_NUMTHREADS
senhuang42 [Tue, 1 Sep 2020 13:02:23 +0000 (09:02 -0400)] 
Change name to ZSTD_NUMTHREADS

5 years agoUpdate zstd_compress.c 2291/head
i-do-cpp [Mon, 31 Aug 2020 07:34:08 +0000 (09:34 +0200)] 
Update zstd_compress.c

5 years agoFix setParameter not falling back to default compression level on 0 value
i-do-cpp [Mon, 31 Aug 2020 07:25:43 +0000 (09:25 +0200)] 
Fix setParameter not falling back to default compression level on 0 value

See documentation for `ZSTD_c_compressionLevel`: `Special: value 0 means default, which is controlled by ZSTD_CLEVEL_DEFAULT`

5 years agoFirst pass at refactoring and creating new FIO_ctx_t */
senhuang42 [Fri, 28 Aug 2020 15:01:04 +0000 (11:01 -0400)] 
First pass at refactoring and creating new FIO_ctx_t */

5 years agoImprove documentation, update man
senhuang42 [Thu, 27 Aug 2020 21:57:20 +0000 (17:57 -0400)] 
Improve documentation, update man

5 years agoMerge pull request #2288 from animalize/doc_version
Yann Collet [Thu, 27 Aug 2020 19:32:07 +0000 (12:32 -0700)] 
Merge pull request #2288 from animalize/doc_version

[doc] Add ZSTD_versionString() to manual

5 years agoAdd ZSTD_versionString() function to manual. 2288/head
animalize [Thu, 27 Aug 2020 05:51:22 +0000 (13:51 +0800)] 
Add ZSTD_versionString() function to manual.

5 years agoMerge pull request #2264 from terrelln/zstd-kernel
Nick Terrell [Thu, 27 Aug 2020 01:15:25 +0000 (18:15 -0700)] 
Merge pull request #2264 from terrelln/zstd-kernel

Prepare for freestanding library and add initial translator script

5 years agoFix potential memory leak
senhuang42 [Wed, 26 Aug 2020 22:52:32 +0000 (18:52 -0400)] 
Fix potential memory leak

5 years agoFix UTIL_requireUserConfirmation() declaration
senhuang42 [Wed, 26 Aug 2020 21:20:37 +0000 (17:20 -0400)] 
Fix UTIL_requireUserConfirmation() declaration

5 years agoMove logic into new function FIO_removeMultiFilesWarning, add support for decompression
senhuang42 [Wed, 26 Aug 2020 20:50:20 +0000 (16:50 -0400)] 
Move logic into new function FIO_removeMultiFilesWarning, add support for decompression

5 years agoFix merge conflicts
senhuang42 [Wed, 26 Aug 2020 19:43:38 +0000 (15:43 -0400)] 
Fix merge conflicts

5 years ago[contrib] Add freestanding translator prototype 2264/head
Nick Terrell [Mon, 10 Aug 2020 17:42:27 +0000 (10:42 -0700)] 
[contrib] Add freestanding translator prototype

This is the idea, some of the functionality isn't yet implemented.

5 years agoZSTD_ prefix mem{cpy,move,set},malloc,calloc,free
Nick Terrell [Mon, 10 Aug 2020 19:46:38 +0000 (12:46 -0700)] 
ZSTD_ prefix mem{cpy,move,set},malloc,calloc,free

5 years agoRename ZSTD_{malloc,calloc,free} to ZSTD_custom{Malloc,Calloc,Free}
Nick Terrell [Mon, 10 Aug 2020 19:42:03 +0000 (12:42 -0700)] 
Rename ZSTD_{malloc,calloc,free} to ZSTD_custom{Malloc,Calloc,Free}

5 years agoMove standard includes to zstd_deps.h
Nick Terrell [Fri, 7 Aug 2020 03:18:05 +0000 (20:18 -0700)] 
Move standard includes to zstd_deps.h

5 years agoMerge pull request #2283 from senhuang42/progress_bars_for_multiple_files
Yann Collet [Wed, 26 Aug 2020 18:54:50 +0000 (11:54 -0700)] 
Merge pull request #2283 from senhuang42/progress_bars_for_multiple_files

Refreshing progress bar for processing multiple files

5 years agoMerge pull request #2282 from terrelln/ncount-fix
Nick Terrell [Wed, 26 Aug 2020 17:31:07 +0000 (10:31 -0700)] 
Merge pull request #2282 from terrelln/ncount-fix

[bug] Fix FSE_readNCount()

5 years agoRemove extraneous FIO_setNbFiles() 2283/head
senhuang42 [Wed, 26 Aug 2020 16:05:04 +0000 (12:05 -0400)] 
Remove extraneous FIO_setNbFiles()

5 years agoFix bug in user prompt where line was not flushed on negative response
senhuang42 [Wed, 26 Aug 2020 15:57:38 +0000 (11:57 -0400)] 
Fix bug in user prompt where line was not flushed on negative response

5 years agoAdjust playTests.sh refuse overwrite test to include -q
senhuang42 [Wed, 26 Aug 2020 15:40:05 +0000 (11:40 -0400)] 
Adjust playTests.sh refuse overwrite test to include -q

5 years agoFix single file decompression summary, remove escape code dependency, add currFileIdx...
senhuang42 [Wed, 26 Aug 2020 15:35:07 +0000 (11:35 -0400)] 
Fix single file decompression summary, remove escape code dependency, add currFileIdx field to FIO_prefs, general cleanups/bugfixes

5 years agoMerge pull request #2285 from terrelln/oss-fuzz-fixes
Nick Terrell [Wed, 26 Aug 2020 01:35:16 +0000 (18:35 -0700)] 
Merge pull request #2285 from terrelln/oss-fuzz-fixes

[fuzz] Fix oss-fuzz test problems

5 years agoMerge pull request #2284 from terrelln/github-actions-arm
Yann Collet [Wed, 26 Aug 2020 00:50:12 +0000 (17:50 -0700)] 
Merge pull request #2284 from terrelln/github-actions-arm

[github actions] Disable armbuild and armfuzz tests

5 years ago[fuzz] Fix stream_decompress timeouts 2285/head
Nick Terrell [Wed, 26 Aug 2020 00:10:04 +0000 (17:10 -0700)] 
[fuzz] Fix stream_decompress timeouts

5 years ago[fuzz] Disable superblock expansion test
Nick Terrell [Tue, 25 Aug 2020 23:32:00 +0000 (16:32 -0700)] 
[fuzz] Disable superblock expansion test

5 years ago[github actions] Disable armbuild and armfuzz tests 2284/head
Nick Terrell [Tue, 25 Aug 2020 23:28:41 +0000 (16:28 -0700)] 
[github actions] Disable armbuild and armfuzz tests

5 years agoAdded env var function for threads
senhuang42 [Tue, 25 Aug 2020 22:49:52 +0000 (18:49 -0400)] 
Added env var function for threads

5 years ago[bug] Fix FSE_readNCount() 2282/head
Nick Terrell [Tue, 25 Aug 2020 18:37:41 +0000 (11:37 -0700)] 
[bug] Fix FSE_readNCount()

* Fix bug introduced in PR #2271
* Fix long-standing bug that is impossible to trigger inside of zstd
* Add a fuzzer that makes sure the normalized count always round trips
  correctly

5 years agoSmall formatting changes
senhuang42 [Tue, 25 Aug 2020 22:03:08 +0000 (18:03 -0400)] 
Small formatting changes

5 years agoRemove decompression status update
senhuang42 [Tue, 25 Aug 2020 21:54:00 +0000 (17:54 -0400)] 
Remove decompression status update

5 years agoSmall cleanups
senhuang42 [Tue, 25 Aug 2020 21:34:00 +0000 (17:34 -0400)] 
Small cleanups

5 years agoMake compatible with displaylevel = 2 and decompression
senhuang42 [Tue, 25 Aug 2020 21:23:47 +0000 (17:23 -0400)] 
Make compatible with displaylevel = 2 and decompression

5 years agoAdd initial live update with displayLevel = 2, add new field to FIO_prefs_t
senhuang42 [Tue, 25 Aug 2020 20:46:47 +0000 (16:46 -0400)] 
Add initial live update with displayLevel = 2, add new field to FIO_prefs_t

5 years agoMerge pull request #2278 from senhuang42/ignore_checksum_advanced_param
Yann Collet [Tue, 25 Aug 2020 19:08:53 +0000 (12:08 -0700)] 
Merge pull request #2278 from senhuang42/ignore_checksum_advanced_param

New advanced decompression param to ignore checksums

5 years agoAdd initial functionality to support -q
senhuang42 [Tue, 25 Aug 2020 17:50:44 +0000 (13:50 -0400)] 
Add initial functionality to support -q