]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
5 years agoMove Prefetch Before Insertion; Speed Up ~6%
W. Felix Handte [Thu, 13 Aug 2020 18:54:10 +0000 (14:54 -0400)] 
Move Prefetch Before Insertion; Speed Up ~6%

5 years agoMisc Refactor of DDS Search Code
W. Felix Handte [Thu, 13 Aug 2020 15:57:31 +0000 (11:57 -0400)] 
Misc Refactor of DDS Search Code

5 years agoRename enableDedicatedDictSearch to dedicatedDictSearch in MatchState
W. Felix Handte [Wed, 12 Aug 2020 20:50:44 +0000 (16:50 -0400)] 
Rename enableDedicatedDictSearch to dedicatedDictSearch in MatchState

This makes it clear that not only is the feature allowed here, we're actually
using it, as opposed to the CCtxParam field, in which it's enabled, but we may
or may not be using it.

5 years agoAlways Init CDict's enableDedicatedDictSearch Field
W. Felix Handte [Tue, 11 Aug 2020 22:57:12 +0000 (18:57 -0400)] 
Always Init CDict's enableDedicatedDictSearch Field

5 years agoAdd a ZSTD_dedicatedDictSearch ZSTD_dictMode_e to Allow Const Propagation
W. Felix Handte [Tue, 11 Aug 2020 22:48:22 +0000 (18:48 -0400)] 
Add a ZSTD_dedicatedDictSearch ZSTD_dictMode_e to Allow Const Propagation

Speed +1.5%.

5 years agoFix ZSTD_c_forceAttachDict Bounds
W. Felix Handte [Tue, 11 Aug 2020 22:24:11 +0000 (18:24 -0400)] 
Fix ZSTD_c_forceAttachDict Bounds

5 years agoMake ZSTD_c_enableDedicatedDictSearch an Experimental Param
W. Felix Handte [Tue, 11 Aug 2020 22:03:38 +0000 (18:03 -0400)] 
Make ZSTD_c_enableDedicatedDictSearch an Experimental Param

5 years agoAdd Fuzzer Test for the Various Dict Attachment Strategies
W. Felix Handte [Tue, 11 Aug 2020 19:29:12 +0000 (15:29 -0400)] 
Add Fuzzer Test for the Various Dict Attachment Strategies

5 years agoTODO: Comment
W. Felix Handte [Fri, 7 Aug 2020 20:41:16 +0000 (16:41 -0400)] 
TODO: Comment

5 years agoFix Compilation Warnings
W. Felix Handte [Fri, 7 Aug 2020 16:02:18 +0000 (12:02 -0400)] 
Fix Compilation Warnings

5 years agoupdating cold benchmark
Bimba Shrestha [Fri, 12 Jun 2020 15:53:58 +0000 (08:53 -0700)] 
updating cold benchmark

5 years agocreating ZSTD_createCDict_advanced_internal
Bimba Shrestha [Fri, 12 Jun 2020 15:01:18 +0000 (08:01 -0700)] 
creating ZSTD_createCDict_advanced_internal

5 years agochanging to int for consistency
Bimba Shrestha [Fri, 12 Jun 2020 05:57:53 +0000 (22:57 -0700)] 
changing to int for consistency

5 years agousing dict mls instead of src mls
Bimba Shrestha [Fri, 12 Jun 2020 05:55:32 +0000 (22:55 -0700)] 
using dict mls instead of src mls

5 years agoadd hashtable head prefetching
Bimba Shrestha [Fri, 12 Jun 2020 05:54:36 +0000 (22:54 -0700)] 
add hashtable head prefetching

5 years agochange method name for consistency
Bimba Shrestha [Fri, 12 Jun 2020 05:48:48 +0000 (22:48 -0700)] 
change method name for consistency

5 years agopass correct cparams
Bimba Shrestha [Fri, 12 Jun 2020 05:46:16 +0000 (22:46 -0700)] 
pass correct cparams

5 years agoremoving wrong comment
Bimba Shrestha [Fri, 12 Jun 2020 05:42:57 +0000 (22:42 -0700)] 
removing wrong comment

5 years agomaking cctxParams a pointer
Bimba Shrestha [Fri, 12 Jun 2020 05:42:11 +0000 (22:42 -0700)] 
making cctxParams a pointer

5 years agoloading dict using new algorithm
Bimba Shrestha [Fri, 12 Jun 2020 02:41:03 +0000 (19:41 -0700)] 
loading dict using new algorithm

5 years agoadding dedicatedDictSearch algorithm
Bimba Shrestha [Fri, 12 Jun 2020 01:54:44 +0000 (18:54 -0700)] 
adding dedicatedDictSearch algorithm

5 years agoadding enableDedicatedDictSearch to matchState_t
Bimba Shrestha [Fri, 12 Jun 2020 01:34:14 +0000 (18:34 -0700)] 
adding enableDedicatedDictSearch to matchState_t

5 years agoadding dedicated dict load method to lazy
Bimba Shrestha [Fri, 12 Jun 2020 01:27:07 +0000 (18:27 -0700)] 
adding dedicated dict load method to lazy

5 years agoadding ZSTD_createCDict_advanced2 to zstd.h
Bimba Shrestha [Fri, 12 Jun 2020 01:12:48 +0000 (18:12 -0700)] 
adding ZSTD_createCDict_advanced2 to zstd.h

5 years agoalways attach dict when using dedicatedDictSearch
Bimba Shrestha [Thu, 11 Jun 2020 21:19:12 +0000 (14:19 -0700)] 
always attach dict when using dedicatedDictSearch

5 years agoadding dedicatedDictSearch cParams helper methods
Bimba Shrestha [Thu, 11 Jun 2020 20:48:57 +0000 (13:48 -0700)] 
adding dedicatedDictSearch cParams helper methods

5 years agoadding ZSTD_dedicatedDictSearch_defaultCParameters variable
Bimba Shrestha [Thu, 11 Jun 2020 20:33:52 +0000 (13:33 -0700)] 
adding ZSTD_dedicatedDictSearch_defaultCParameters variable

5 years agoAdd ZSTD_c_enableDedicatedDictSearch Param
Bimba Shrestha [Thu, 11 Jun 2020 20:21:28 +0000 (13:21 -0700)] 
Add ZSTD_c_enableDedicatedDictSearch Param

5 years agoMerge pull request #2301 from terrelln/prepare-for-release
Nick Terrell [Thu, 10 Sep 2020 22:42:16 +0000 (15:42 -0700)] 
Merge pull request #2301 from terrelln/prepare-for-release

Prepare library for a release

5 years agoAdjust ZSTD_createCDict_byReference() function, and check for cdict when using compre...
senhuang42 [Thu, 10 Sep 2020 17:42:26 +0000 (13:42 -0400)] 
Adjust ZSTD_createCDict_byReference() function, and check for cdict when using compressStream2

5 years ago[lib] Bump version number to 1.4.6 2301/head
Nick Terrell [Thu, 10 Sep 2020 00:13:45 +0000 (17:13 -0700)] 
[lib] Bump version number to 1.4.6

5 years agoUpdate CHANGELOG for the next release
Nick Terrell [Thu, 10 Sep 2020 00:13:34 +0000 (17:13 -0700)] 
Update CHANGELOG for the next release

5 years ago[doc] Document new build macros in lib/README.md
Nick Terrell [Thu, 10 Sep 2020 00:13:16 +0000 (17:13 -0700)] 
[doc] Document new build macros in lib/README.md

5 years agoMerge pull request #2289 from terrelln/zstd-kernel-2
Nick Terrell [Wed, 9 Sep 2020 22:38:02 +0000 (15:38 -0700)] 
Merge pull request #2289 from terrelln/zstd-kernel-2

[linux-kernel] Prepare zstd for the Linux Kernel

5 years ago[linux-kernel] Update README with initial instructions on how to update zstd in the... 2289/head
Nick Terrell [Wed, 9 Sep 2020 19:45:16 +0000 (12:45 -0700)] 
[linux-kernel] Update README with initial instructions on how to update zstd in the kernel

5 years ago[linux-kernel] Add test that checks the ifdef hardwiring
Nick Terrell [Wed, 9 Sep 2020 19:36:58 +0000 (12:36 -0700)] 
[linux-kernel] Add test that checks the ifdef hardwiring

5 years agoAdd linux-kernel freestanding
Nick Terrell [Tue, 11 Aug 2020 06:11:20 +0000 (23:11 -0700)] 
Add linux-kernel freestanding

5 years ago[contrib] Add preprocessor hardwiring to freestanding.py
Nick Terrell [Tue, 11 Aug 2020 06:09:59 +0000 (23:09 -0700)] 
[contrib] Add preprocessor hardwiring to freestanding.py

5 years ago[lib] Add ZSTD_NO_UNUSED_FUNCTIONS macro to hide unused functions
Nick Terrell [Fri, 28 Aug 2020 00:10:04 +0000 (17:10 -0700)] 
[lib] Add ZSTD_NO_UNUSED_FUNCTIONS macro to hide unused functions

The unused function definitions are hidden behind a
`#ifndef ZSTD_NO_UNUSED_FUNCTIONS` check.

Initially hiding all functions which are unused and take up more than
2KB of stack space, because these will show up as warnings in the
Linux Kernel build system.

5 years ago[lib] Replace 64-bit divisions with ZSTD_div64()
Nick Terrell [Thu, 27 Aug 2020 22:01:18 +0000 (15:01 -0700)] 
[lib] Replace 64-bit divisions with ZSTD_div64()

5 years ago[lib] Reduce zstd stack usage by 1KB
Nick Terrell [Thu, 27 Aug 2020 00:52:54 +0000 (17:52 -0700)] 
[lib] Reduce zstd stack usage by 1KB

5 years agoFix ZSTD_initCStream_advanced() with no dictionary and static allocation
Nick Terrell [Fri, 14 Aug 2020 19:42:06 +0000 (12:42 -0700)] 
Fix ZSTD_initCStream_advanced() with no dictionary and static allocation

5 years agoAdd ZSTD_NO_INTRINSICS macro to avoid explicit intrinsics
Nick Terrell [Fri, 14 Aug 2020 19:41:28 +0000 (12:41 -0700)] 
Add ZSTD_NO_INTRINSICS macro to avoid explicit intrinsics

5 years ago[lib] s/current/curr because it collides with Linux Kernel macro
Nick Terrell [Tue, 11 Aug 2020 21:31:09 +0000 (14:31 -0700)] 
[lib] s/current/curr because it collides with Linux Kernel macro

5 years agonbThreads instead of numThreads 2299/head
senhuang42 [Wed, 9 Sep 2020 16:35:40 +0000 (12:35 -0400)] 
nbThreads instead of numThreads

5 years agoMerge pull request #2291 from i-do-cpp/fix-compression-level-default
Nick Terrell [Tue, 8 Sep 2020 23:42:34 +0000 (16:42 -0700)] 
Merge pull request #2291 from i-do-cpp/fix-compression-level-default

Fix setParameter not falling back to default compression level

5 years agoAdd ZSTD_NUMTHREADS tests to playTests.sh
senhuang42 [Tue, 8 Sep 2020 14:34:50 +0000 (10:34 -0400)] 
Add ZSTD_NUMTHREADS tests to playTests.sh

5 years agoAdd include guards for init_numThreads()
senhuang42 [Tue, 8 Sep 2020 13:26:16 +0000 (09:26 -0400)] 
Add include guards for init_numThreads()

5 years agoUpdate documentation for environment variable
senhuang42 [Mon, 7 Sep 2020 22:35:46 +0000 (18:35 -0400)] 
Update documentation for environment variable

5 years agoAdd quick documentation for ZSTD_NUMTHREADS in the code
senhuang42 [Mon, 7 Sep 2020 22:19:31 +0000 (18:19 -0400)] 
Add quick documentation for ZSTD_NUMTHREADS in the code

5 years agoChange param name to ZSTDCLI_NUMTHREADS_DEFAULT
senhuang42 [Mon, 7 Sep 2020 22:11:42 +0000 (18:11 -0400)] 
Change param name to ZSTDCLI_NUMTHREADS_DEFAULT

5 years agoChange default num_threads value
senhuang42 [Tue, 1 Sep 2020 20:08:49 +0000 (16:08 -0400)] 
Change default num_threads value

5 years agoAdjust function signatures 2292/head
senhuang42 [Mon, 7 Sep 2020 17:13:05 +0000 (13:13 -0400)] 
Adjust function signatures

5 years agoMerge pull request #2294 from felixhandte/makefile-lib-fix-var-order
Felix Handte [Fri, 4 Sep 2020 14:58:57 +0000 (10:58 -0400)] 
Merge pull request #2294 from felixhandte/makefile-lib-fix-var-order

Fix Makefile Variable Concatenation Order

5 years agoAlways update bytes status in FIO_ctx_t
senhuang42 [Fri, 4 Sep 2020 00:23:30 +0000 (20:23 -0400)] 
Always update bytes status in FIO_ctx_t

5 years agoRemove extraneous FIO_ctx_t functions
senhuang42 [Fri, 4 Sep 2020 00:22:34 +0000 (20:22 -0400)] 
Remove extraneous FIO_ctx_t functions

5 years agoFix Makefile Variable Concatenation Order 2294/head
W. Felix Handte [Thu, 3 Sep 2020 21:28:37 +0000 (17:28 -0400)] 
Fix Makefile Variable Concatenation Order

Previously, this construct would add `-O3` onto the end of the compiler flags
variable, **after** `MOREFLAGS`, which meant that it was impossible to over-
ride. This commit fixes this order and should otherwise be a no-op.

5 years agoMerge pull request #2293 from allanjude/coverity
Nick Terrell [Thu, 3 Sep 2020 20:58:45 +0000 (13:58 -0700)] 
Merge pull request #2293 from allanjude/coverity

Resolve Coverity 1432392 Unintentional integer overflow

5 years agoResolve Coverity 1432392 Unintentional integer overflow 2293/head
Allan Jude [Thu, 3 Sep 2020 19:31:50 +0000 (19:31 +0000)] 
Resolve Coverity 1432392 Unintentional integer overflow

Unintentional integer overflow (OVERFLOW_BEFORE_WIDEN)
overflow_before_widen: Potentially overflowing expression:
cdict->dictContentSize * 6U
with type unsigned int (32 bits, unsigned) is evaluated using 32-bit
arithmetic, and then used in a context that expects an expression of
type U64 (64 bits, unsigned).

5 years agoAddress memory leak in CLI from fCtx
senhuang42 [Thu, 3 Sep 2020 14:14:04 +0000 (10:14 -0400)] 
Address memory leak in CLI from fCtx

5 years agoFix FIO_removeMultiFilesWarning conflict
senhuang42 [Thu, 3 Sep 2020 13:49:13 +0000 (09:49 -0400)] 
Fix FIO_removeMultiFilesWarning conflict

5 years agoMerge branch 'dev' into multifile_status_update_fio_refactor
senhuang42 [Thu, 3 Sep 2020 13:44:47 +0000 (09:44 -0400)] 
Merge branch 'dev' into multifile_status_update_fio_refactor

5 years agoRemove comma-separated decls
senhuang42 [Thu, 3 Sep 2020 13:28:40 +0000 (09:28 -0400)] 
Remove comma-separated decls

5 years agoAdjust comments and struct to better reflect FIO_ctx_t
senhuang42 [Thu, 3 Sep 2020 13:26:30 +0000 (09:26 -0400)] 
Adjust comments and struct to better reflect FIO_ctx_t

5 years agoFix 1 file multifile logic, remove unnecessary variable assignments
senhuang42 [Thu, 3 Sep 2020 13:22:07 +0000 (09:22 -0400)] 
Fix 1 file multifile logic, remove unnecessary variable assignments

5 years agoMerge pull request #2279 from senhuang42/show_warnings_with_multiple_input_files
Nick Terrell [Wed, 2 Sep 2020 18:32:11 +0000 (11:32 -0700)] 
Merge pull request #2279 from senhuang42/show_warnings_with_multiple_input_files

Add a warning whenever (de)compressing multiple files

5 years agoAdjusted extra explanation warning to always pop up if applicable 2279/head
senhuang42 [Wed, 2 Sep 2020 12:44:42 +0000 (08:44 -0400)] 
Adjusted extra explanation warning to always pop up if applicable

5 years agoFixed newline issue and adjusted wording in comment
senhuang42 [Tue, 1 Sep 2020 17:18:30 +0000 (13:18 -0400)] 
Fixed newline issue and adjusted wording in comment

5 years agoCleanup comments, add function to set FIO_ctx_t.nbFilesProcessed
senhuang42 [Tue, 1 Sep 2020 16:52:18 +0000 (12:52 -0400)] 
Cleanup comments, add function to set FIO_ctx_t.nbFilesProcessed

5 years agoFix the logic in printing final status updates
senhuang42 [Tue, 1 Sep 2020 16:46:06 +0000 (12:46 -0400)] 
Fix the logic in printing final status updates

5 years agoIntegrate refactor into status print for multifiles, adjust logic for printing as...
senhuang42 [Tue, 1 Sep 2020 16:32:18 +0000 (12:32 -0400)] 
Integrate refactor into status print for multifiles, adjust logic for printing as needed

5 years agoChange name to ZSTD_NUMTHREADS
senhuang42 [Tue, 1 Sep 2020 13:02:23 +0000 (09:02 -0400)] 
Change name to ZSTD_NUMTHREADS

5 years agoUpdate zstd_compress.c 2291/head
i-do-cpp [Mon, 31 Aug 2020 07:34:08 +0000 (09:34 +0200)] 
Update zstd_compress.c

5 years agoFix setParameter not falling back to default compression level on 0 value
i-do-cpp [Mon, 31 Aug 2020 07:25:43 +0000 (09:25 +0200)] 
Fix setParameter not falling back to default compression level on 0 value

See documentation for `ZSTD_c_compressionLevel`: `Special: value 0 means default, which is controlled by ZSTD_CLEVEL_DEFAULT`

5 years agoFirst pass at refactoring and creating new FIO_ctx_t */
senhuang42 [Fri, 28 Aug 2020 15:01:04 +0000 (11:01 -0400)] 
First pass at refactoring and creating new FIO_ctx_t */

5 years agoImprove documentation, update man
senhuang42 [Thu, 27 Aug 2020 21:57:20 +0000 (17:57 -0400)] 
Improve documentation, update man

5 years agoMerge pull request #2288 from animalize/doc_version
Yann Collet [Thu, 27 Aug 2020 19:32:07 +0000 (12:32 -0700)] 
Merge pull request #2288 from animalize/doc_version

[doc] Add ZSTD_versionString() to manual

5 years agoAdd ZSTD_versionString() function to manual. 2288/head
animalize [Thu, 27 Aug 2020 05:51:22 +0000 (13:51 +0800)] 
Add ZSTD_versionString() function to manual.

5 years agoMerge pull request #2264 from terrelln/zstd-kernel
Nick Terrell [Thu, 27 Aug 2020 01:15:25 +0000 (18:15 -0700)] 
Merge pull request #2264 from terrelln/zstd-kernel

Prepare for freestanding library and add initial translator script

5 years agoFix potential memory leak
senhuang42 [Wed, 26 Aug 2020 22:52:32 +0000 (18:52 -0400)] 
Fix potential memory leak

5 years agoFix UTIL_requireUserConfirmation() declaration
senhuang42 [Wed, 26 Aug 2020 21:20:37 +0000 (17:20 -0400)] 
Fix UTIL_requireUserConfirmation() declaration

5 years agoMove logic into new function FIO_removeMultiFilesWarning, add support for decompression
senhuang42 [Wed, 26 Aug 2020 20:50:20 +0000 (16:50 -0400)] 
Move logic into new function FIO_removeMultiFilesWarning, add support for decompression

5 years agoFix merge conflicts
senhuang42 [Wed, 26 Aug 2020 19:43:38 +0000 (15:43 -0400)] 
Fix merge conflicts

5 years ago[contrib] Add freestanding translator prototype 2264/head
Nick Terrell [Mon, 10 Aug 2020 17:42:27 +0000 (10:42 -0700)] 
[contrib] Add freestanding translator prototype

This is the idea, some of the functionality isn't yet implemented.

5 years agoZSTD_ prefix mem{cpy,move,set},malloc,calloc,free
Nick Terrell [Mon, 10 Aug 2020 19:46:38 +0000 (12:46 -0700)] 
ZSTD_ prefix mem{cpy,move,set},malloc,calloc,free

5 years agoRename ZSTD_{malloc,calloc,free} to ZSTD_custom{Malloc,Calloc,Free}
Nick Terrell [Mon, 10 Aug 2020 19:42:03 +0000 (12:42 -0700)] 
Rename ZSTD_{malloc,calloc,free} to ZSTD_custom{Malloc,Calloc,Free}

5 years agoMove standard includes to zstd_deps.h
Nick Terrell [Fri, 7 Aug 2020 03:18:05 +0000 (20:18 -0700)] 
Move standard includes to zstd_deps.h

5 years agoMerge pull request #2283 from senhuang42/progress_bars_for_multiple_files
Yann Collet [Wed, 26 Aug 2020 18:54:50 +0000 (11:54 -0700)] 
Merge pull request #2283 from senhuang42/progress_bars_for_multiple_files

Refreshing progress bar for processing multiple files

5 years agoMerge pull request #2282 from terrelln/ncount-fix
Nick Terrell [Wed, 26 Aug 2020 17:31:07 +0000 (10:31 -0700)] 
Merge pull request #2282 from terrelln/ncount-fix

[bug] Fix FSE_readNCount()

5 years agoRemove extraneous FIO_setNbFiles() 2283/head
senhuang42 [Wed, 26 Aug 2020 16:05:04 +0000 (12:05 -0400)] 
Remove extraneous FIO_setNbFiles()

5 years agoFix bug in user prompt where line was not flushed on negative response
senhuang42 [Wed, 26 Aug 2020 15:57:38 +0000 (11:57 -0400)] 
Fix bug in user prompt where line was not flushed on negative response

5 years agoAdjust playTests.sh refuse overwrite test to include -q
senhuang42 [Wed, 26 Aug 2020 15:40:05 +0000 (11:40 -0400)] 
Adjust playTests.sh refuse overwrite test to include -q

5 years agoFix single file decompression summary, remove escape code dependency, add currFileIdx...
senhuang42 [Wed, 26 Aug 2020 15:35:07 +0000 (11:35 -0400)] 
Fix single file decompression summary, remove escape code dependency, add currFileIdx field to FIO_prefs, general cleanups/bugfixes

5 years agoMerge pull request #2285 from terrelln/oss-fuzz-fixes
Nick Terrell [Wed, 26 Aug 2020 01:35:16 +0000 (18:35 -0700)] 
Merge pull request #2285 from terrelln/oss-fuzz-fixes

[fuzz] Fix oss-fuzz test problems

5 years agoMerge pull request #2284 from terrelln/github-actions-arm
Yann Collet [Wed, 26 Aug 2020 00:50:12 +0000 (17:50 -0700)] 
Merge pull request #2284 from terrelln/github-actions-arm

[github actions] Disable armbuild and armfuzz tests

5 years ago[fuzz] Fix stream_decompress timeouts 2285/head
Nick Terrell [Wed, 26 Aug 2020 00:10:04 +0000 (17:10 -0700)] 
[fuzz] Fix stream_decompress timeouts

5 years ago[fuzz] Disable superblock expansion test
Nick Terrell [Tue, 25 Aug 2020 23:32:00 +0000 (16:32 -0700)] 
[fuzz] Disable superblock expansion test

5 years ago[github actions] Disable armbuild and armfuzz tests 2284/head
Nick Terrell [Tue, 25 Aug 2020 23:28:41 +0000 (16:28 -0700)] 
[github actions] Disable armbuild and armfuzz tests

5 years agoAdded env var function for threads
senhuang42 [Tue, 25 Aug 2020 22:49:52 +0000 (18:49 -0400)] 
Added env var function for threads

5 years ago[bug] Fix FSE_readNCount() 2282/head
Nick Terrell [Tue, 25 Aug 2020 18:37:41 +0000 (11:37 -0700)] 
[bug] Fix FSE_readNCount()

* Fix bug introduced in PR #2271
* Fix long-standing bug that is impossible to trigger inside of zstd
* Add a fuzzer that makes sure the normalized count always round trips
  correctly