]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
4 years ago[lib] Bump version number to 1.4.6 2301/head
Nick Terrell [Thu, 10 Sep 2020 00:13:45 +0000 (17:13 -0700)] 
[lib] Bump version number to 1.4.6

4 years agoUpdate CHANGELOG for the next release
Nick Terrell [Thu, 10 Sep 2020 00:13:34 +0000 (17:13 -0700)] 
Update CHANGELOG for the next release

4 years ago[doc] Document new build macros in lib/README.md
Nick Terrell [Thu, 10 Sep 2020 00:13:16 +0000 (17:13 -0700)] 
[doc] Document new build macros in lib/README.md

4 years agoMerge pull request #2289 from terrelln/zstd-kernel-2
Nick Terrell [Wed, 9 Sep 2020 22:38:02 +0000 (15:38 -0700)] 
Merge pull request #2289 from terrelln/zstd-kernel-2

[linux-kernel] Prepare zstd for the Linux Kernel

4 years ago[linux-kernel] Update README with initial instructions on how to update zstd in the... 2289/head
Nick Terrell [Wed, 9 Sep 2020 19:45:16 +0000 (12:45 -0700)] 
[linux-kernel] Update README with initial instructions on how to update zstd in the kernel

4 years ago[linux-kernel] Add test that checks the ifdef hardwiring
Nick Terrell [Wed, 9 Sep 2020 19:36:58 +0000 (12:36 -0700)] 
[linux-kernel] Add test that checks the ifdef hardwiring

4 years agoAdd linux-kernel freestanding
Nick Terrell [Tue, 11 Aug 2020 06:11:20 +0000 (23:11 -0700)] 
Add linux-kernel freestanding

4 years ago[contrib] Add preprocessor hardwiring to freestanding.py
Nick Terrell [Tue, 11 Aug 2020 06:09:59 +0000 (23:09 -0700)] 
[contrib] Add preprocessor hardwiring to freestanding.py

4 years ago[lib] Add ZSTD_NO_UNUSED_FUNCTIONS macro to hide unused functions
Nick Terrell [Fri, 28 Aug 2020 00:10:04 +0000 (17:10 -0700)] 
[lib] Add ZSTD_NO_UNUSED_FUNCTIONS macro to hide unused functions

The unused function definitions are hidden behind a
`#ifndef ZSTD_NO_UNUSED_FUNCTIONS` check.

Initially hiding all functions which are unused and take up more than
2KB of stack space, because these will show up as warnings in the
Linux Kernel build system.

4 years ago[lib] Replace 64-bit divisions with ZSTD_div64()
Nick Terrell [Thu, 27 Aug 2020 22:01:18 +0000 (15:01 -0700)] 
[lib] Replace 64-bit divisions with ZSTD_div64()

4 years ago[lib] Reduce zstd stack usage by 1KB
Nick Terrell [Thu, 27 Aug 2020 00:52:54 +0000 (17:52 -0700)] 
[lib] Reduce zstd stack usage by 1KB

4 years agoFix ZSTD_initCStream_advanced() with no dictionary and static allocation
Nick Terrell [Fri, 14 Aug 2020 19:42:06 +0000 (12:42 -0700)] 
Fix ZSTD_initCStream_advanced() with no dictionary and static allocation

4 years agoAdd ZSTD_NO_INTRINSICS macro to avoid explicit intrinsics
Nick Terrell [Fri, 14 Aug 2020 19:41:28 +0000 (12:41 -0700)] 
Add ZSTD_NO_INTRINSICS macro to avoid explicit intrinsics

4 years ago[lib] s/current/curr because it collides with Linux Kernel macro
Nick Terrell [Tue, 11 Aug 2020 21:31:09 +0000 (14:31 -0700)] 
[lib] s/current/curr because it collides with Linux Kernel macro

4 years agoMerge pull request #2291 from i-do-cpp/fix-compression-level-default
Nick Terrell [Tue, 8 Sep 2020 23:42:34 +0000 (16:42 -0700)] 
Merge pull request #2291 from i-do-cpp/fix-compression-level-default

Fix setParameter not falling back to default compression level

4 years agoMerge pull request #2294 from felixhandte/makefile-lib-fix-var-order
Felix Handte [Fri, 4 Sep 2020 14:58:57 +0000 (10:58 -0400)] 
Merge pull request #2294 from felixhandte/makefile-lib-fix-var-order

Fix Makefile Variable Concatenation Order

4 years agoFix Makefile Variable Concatenation Order 2294/head
W. Felix Handte [Thu, 3 Sep 2020 21:28:37 +0000 (17:28 -0400)] 
Fix Makefile Variable Concatenation Order

Previously, this construct would add `-O3` onto the end of the compiler flags
variable, **after** `MOREFLAGS`, which meant that it was impossible to over-
ride. This commit fixes this order and should otherwise be a no-op.

4 years agoMerge pull request #2293 from allanjude/coverity
Nick Terrell [Thu, 3 Sep 2020 20:58:45 +0000 (13:58 -0700)] 
Merge pull request #2293 from allanjude/coverity

Resolve Coverity 1432392 Unintentional integer overflow

4 years agoResolve Coverity 1432392 Unintentional integer overflow 2293/head
Allan Jude [Thu, 3 Sep 2020 19:31:50 +0000 (19:31 +0000)] 
Resolve Coverity 1432392 Unintentional integer overflow

Unintentional integer overflow (OVERFLOW_BEFORE_WIDEN)
overflow_before_widen: Potentially overflowing expression:
cdict->dictContentSize * 6U
with type unsigned int (32 bits, unsigned) is evaluated using 32-bit
arithmetic, and then used in a context that expects an expression of
type U64 (64 bits, unsigned).

4 years agoMerge pull request #2279 from senhuang42/show_warnings_with_multiple_input_files
Nick Terrell [Wed, 2 Sep 2020 18:32:11 +0000 (11:32 -0700)] 
Merge pull request #2279 from senhuang42/show_warnings_with_multiple_input_files

Add a warning whenever (de)compressing multiple files

4 years agoAdjusted extra explanation warning to always pop up if applicable 2279/head
senhuang42 [Wed, 2 Sep 2020 12:44:42 +0000 (08:44 -0400)] 
Adjusted extra explanation warning to always pop up if applicable

4 years agoFixed newline issue and adjusted wording in comment
senhuang42 [Tue, 1 Sep 2020 17:18:30 +0000 (13:18 -0400)] 
Fixed newline issue and adjusted wording in comment

4 years agoUpdate zstd_compress.c 2291/head
i-do-cpp [Mon, 31 Aug 2020 07:34:08 +0000 (09:34 +0200)] 
Update zstd_compress.c

4 years agoFix setParameter not falling back to default compression level on 0 value
i-do-cpp [Mon, 31 Aug 2020 07:25:43 +0000 (09:25 +0200)] 
Fix setParameter not falling back to default compression level on 0 value

See documentation for `ZSTD_c_compressionLevel`: `Special: value 0 means default, which is controlled by ZSTD_CLEVEL_DEFAULT`

4 years agoImprove documentation, update man
senhuang42 [Thu, 27 Aug 2020 21:57:20 +0000 (17:57 -0400)] 
Improve documentation, update man

4 years agoMerge pull request #2288 from animalize/doc_version
Yann Collet [Thu, 27 Aug 2020 19:32:07 +0000 (12:32 -0700)] 
Merge pull request #2288 from animalize/doc_version

[doc] Add ZSTD_versionString() to manual

4 years agoAdd ZSTD_versionString() function to manual. 2288/head
animalize [Thu, 27 Aug 2020 05:51:22 +0000 (13:51 +0800)] 
Add ZSTD_versionString() function to manual.

4 years agoMerge pull request #2264 from terrelln/zstd-kernel
Nick Terrell [Thu, 27 Aug 2020 01:15:25 +0000 (18:15 -0700)] 
Merge pull request #2264 from terrelln/zstd-kernel

Prepare for freestanding library and add initial translator script

4 years agoFix potential memory leak
senhuang42 [Wed, 26 Aug 2020 22:52:32 +0000 (18:52 -0400)] 
Fix potential memory leak

4 years agoFix UTIL_requireUserConfirmation() declaration
senhuang42 [Wed, 26 Aug 2020 21:20:37 +0000 (17:20 -0400)] 
Fix UTIL_requireUserConfirmation() declaration

4 years agoMove logic into new function FIO_removeMultiFilesWarning, add support for decompression
senhuang42 [Wed, 26 Aug 2020 20:50:20 +0000 (16:50 -0400)] 
Move logic into new function FIO_removeMultiFilesWarning, add support for decompression

4 years agoFix merge conflicts
senhuang42 [Wed, 26 Aug 2020 19:43:38 +0000 (15:43 -0400)] 
Fix merge conflicts

4 years ago[contrib] Add freestanding translator prototype 2264/head
Nick Terrell [Mon, 10 Aug 2020 17:42:27 +0000 (10:42 -0700)] 
[contrib] Add freestanding translator prototype

This is the idea, some of the functionality isn't yet implemented.

4 years agoZSTD_ prefix mem{cpy,move,set},malloc,calloc,free
Nick Terrell [Mon, 10 Aug 2020 19:46:38 +0000 (12:46 -0700)] 
ZSTD_ prefix mem{cpy,move,set},malloc,calloc,free

4 years agoRename ZSTD_{malloc,calloc,free} to ZSTD_custom{Malloc,Calloc,Free}
Nick Terrell [Mon, 10 Aug 2020 19:42:03 +0000 (12:42 -0700)] 
Rename ZSTD_{malloc,calloc,free} to ZSTD_custom{Malloc,Calloc,Free}

4 years agoMove standard includes to zstd_deps.h
Nick Terrell [Fri, 7 Aug 2020 03:18:05 +0000 (20:18 -0700)] 
Move standard includes to zstd_deps.h

4 years agoMerge pull request #2283 from senhuang42/progress_bars_for_multiple_files
Yann Collet [Wed, 26 Aug 2020 18:54:50 +0000 (11:54 -0700)] 
Merge pull request #2283 from senhuang42/progress_bars_for_multiple_files

Refreshing progress bar for processing multiple files

4 years agoMerge pull request #2282 from terrelln/ncount-fix
Nick Terrell [Wed, 26 Aug 2020 17:31:07 +0000 (10:31 -0700)] 
Merge pull request #2282 from terrelln/ncount-fix

[bug] Fix FSE_readNCount()

4 years agoRemove extraneous FIO_setNbFiles() 2283/head
senhuang42 [Wed, 26 Aug 2020 16:05:04 +0000 (12:05 -0400)] 
Remove extraneous FIO_setNbFiles()

4 years agoFix bug in user prompt where line was not flushed on negative response
senhuang42 [Wed, 26 Aug 2020 15:57:38 +0000 (11:57 -0400)] 
Fix bug in user prompt where line was not flushed on negative response

4 years agoAdjust playTests.sh refuse overwrite test to include -q
senhuang42 [Wed, 26 Aug 2020 15:40:05 +0000 (11:40 -0400)] 
Adjust playTests.sh refuse overwrite test to include -q

4 years agoFix single file decompression summary, remove escape code dependency, add currFileIdx...
senhuang42 [Wed, 26 Aug 2020 15:35:07 +0000 (11:35 -0400)] 
Fix single file decompression summary, remove escape code dependency, add currFileIdx field to FIO_prefs, general cleanups/bugfixes

4 years agoMerge pull request #2285 from terrelln/oss-fuzz-fixes
Nick Terrell [Wed, 26 Aug 2020 01:35:16 +0000 (18:35 -0700)] 
Merge pull request #2285 from terrelln/oss-fuzz-fixes

[fuzz] Fix oss-fuzz test problems

4 years agoMerge pull request #2284 from terrelln/github-actions-arm
Yann Collet [Wed, 26 Aug 2020 00:50:12 +0000 (17:50 -0700)] 
Merge pull request #2284 from terrelln/github-actions-arm

[github actions] Disable armbuild and armfuzz tests

4 years ago[fuzz] Fix stream_decompress timeouts 2285/head
Nick Terrell [Wed, 26 Aug 2020 00:10:04 +0000 (17:10 -0700)] 
[fuzz] Fix stream_decompress timeouts

4 years ago[fuzz] Disable superblock expansion test
Nick Terrell [Tue, 25 Aug 2020 23:32:00 +0000 (16:32 -0700)] 
[fuzz] Disable superblock expansion test

4 years ago[github actions] Disable armbuild and armfuzz tests 2284/head
Nick Terrell [Tue, 25 Aug 2020 23:28:41 +0000 (16:28 -0700)] 
[github actions] Disable armbuild and armfuzz tests

4 years ago[bug] Fix FSE_readNCount() 2282/head
Nick Terrell [Tue, 25 Aug 2020 18:37:41 +0000 (11:37 -0700)] 
[bug] Fix FSE_readNCount()

* Fix bug introduced in PR #2271
* Fix long-standing bug that is impossible to trigger inside of zstd
* Add a fuzzer that makes sure the normalized count always round trips
  correctly

4 years agoSmall formatting changes
senhuang42 [Tue, 25 Aug 2020 22:03:08 +0000 (18:03 -0400)] 
Small formatting changes

4 years agoRemove decompression status update
senhuang42 [Tue, 25 Aug 2020 21:54:00 +0000 (17:54 -0400)] 
Remove decompression status update

4 years agoSmall cleanups
senhuang42 [Tue, 25 Aug 2020 21:34:00 +0000 (17:34 -0400)] 
Small cleanups

4 years agoMake compatible with displaylevel = 2 and decompression
senhuang42 [Tue, 25 Aug 2020 21:23:47 +0000 (17:23 -0400)] 
Make compatible with displaylevel = 2 and decompression

4 years agoAdd initial live update with displayLevel = 2, add new field to FIO_prefs_t
senhuang42 [Tue, 25 Aug 2020 20:46:47 +0000 (16:46 -0400)] 
Add initial live update with displayLevel = 2, add new field to FIO_prefs_t

4 years agoMerge pull request #2278 from senhuang42/ignore_checksum_advanced_param
Yann Collet [Tue, 25 Aug 2020 19:08:53 +0000 (12:08 -0700)] 
Merge pull request #2278 from senhuang42/ignore_checksum_advanced_param

New advanced decompression param to ignore checksums

4 years agoAdd initial functionality to support -q
senhuang42 [Tue, 25 Aug 2020 17:50:44 +0000 (13:50 -0400)] 
Add initial functionality to support -q

4 years agoUnified warning prompts into new function UTIL_requireUserConfirmationToProceed()
senhuang42 [Tue, 25 Aug 2020 15:25:49 +0000 (11:25 -0400)] 
Unified warning prompts into new function UTIL_requireUserConfirmationToProceed()

4 years agoMerge pull request #2271 from terrelln/small-blocks
Nick Terrell [Tue, 25 Aug 2020 01:54:33 +0000 (18:54 -0700)] 
Merge pull request #2271 from terrelln/small-blocks

Small block optimizations

4 years agoOnly ask to proceed if using --rm, otherwise just display warning. -f bypasses it...
senhuang42 [Tue, 25 Aug 2020 00:19:55 +0000 (20:19 -0400)] 
Only ask to proceed if using --rm, otherwise just display warning. -f bypasses it all. More robust tests

4 years agoAdd a warning whenever (de)compressing multiple files into one source, or into stdout
senhuang42 [Mon, 24 Aug 2020 23:10:03 +0000 (19:10 -0400)] 
Add a warning whenever (de)compressing multiple files into one source, or into stdout

4 years agoFix compiler warnings 2271/head
Nick Terrell [Mon, 24 Aug 2020 23:09:45 +0000 (16:09 -0700)] 
Fix compiler warnings

4 years agoMerge pull request #2272 from terrelln/dstSize_tooSmall
Nick Terrell [Mon, 24 Aug 2020 22:01:17 +0000 (15:01 -0700)] 
Merge pull request #2272 from terrelln/dstSize_tooSmall

[fix] Always return dstSize_tooSmall when it is the case

4 years agoDocument the BMI2 default() functions
Nick Terrell [Mon, 24 Aug 2020 21:44:33 +0000 (14:44 -0700)] 
Document the BMI2 default() functions

4 years agoAdjust #ifndef logic 2278/head
senhuang42 [Mon, 24 Aug 2020 21:36:36 +0000 (17:36 -0400)] 
Adjust #ifndef logic

4 years agoAdd new DCtx param: validateChecksum and update unit tests
senhuang42 [Mon, 24 Aug 2020 21:28:00 +0000 (17:28 -0400)] 
Add new DCtx param: validateChecksum and update unit tests

4 years agoImprove FSE_normalizeCount() docs
Nick Terrell [Mon, 24 Aug 2020 20:58:34 +0000 (13:58 -0700)] 
Improve FSE_normalizeCount() docs

4 years ago[fix] Always return dstSize_tooSmall when it is the case 2272/head
Nick Terrell [Sat, 15 Aug 2020 19:32:57 +0000 (12:32 -0700)] 
[fix] Always return dstSize_tooSmall when it is the case

4 years agoAddressing comments: more comments, cleanup, remove extra function, checksum logic
senhuang42 [Mon, 24 Aug 2020 20:14:19 +0000 (16:14 -0400)] 
Addressing comments: more comments, cleanup, remove extra function, checksum logic

4 years agoFix up code after reading through
Nick Terrell [Mon, 24 Aug 2020 19:24:45 +0000 (12:24 -0700)] 
Fix up code after reading through

4 years agoDocument change in CLI for --no-check during decompression in --help menu
senhuang42 [Sat, 22 Aug 2020 20:58:41 +0000 (16:58 -0400)] 
Document change in CLI for --no-check during decompression in --help menu

4 years agoAdded CLI tests for --no-check, fixed ignore checksum logic
senhuang42 [Sat, 22 Aug 2020 20:05:40 +0000 (16:05 -0400)] 
Added CLI tests for --no-check, fixed ignore checksum logic

4 years agoAdded unit test to fuzzer.c, changed definition param name
senhuang42 [Sat, 22 Aug 2020 17:26:33 +0000 (13:26 -0400)] 
Added unit test to fuzzer.c, changed definition param name

4 years agoMove enum into zstd.h, and fix pesky switch() logic
senhuang42 [Fri, 21 Aug 2020 22:18:53 +0000 (18:18 -0400)] 
Move enum into zstd.h, and fix pesky switch() logic

4 years agoAdding CLI capability to invoke decompression with no checksum
senhuang42 [Fri, 21 Aug 2020 21:49:30 +0000 (17:49 -0400)] 
Adding CLI capability to invoke decompression with no checksum

4 years agoAdd function prototype
senhuang42 [Fri, 21 Aug 2020 20:51:43 +0000 (16:51 -0400)] 
Add function prototype

4 years agoModify decompression loop to gnore checksums if flag is enabled
senhuang42 [Fri, 21 Aug 2020 20:46:46 +0000 (16:46 -0400)] 
Modify decompression loop to gnore checksums if flag is enabled

4 years agoRename to ZSTD_d_forceIgnoreChecksum, add to DCtx, add function to set the advanced...
senhuang42 [Fri, 21 Aug 2020 20:23:39 +0000 (16:23 -0400)] 
Rename to ZSTD_d_forceIgnoreChecksum, add to DCtx, add function to set the advanced param

4 years agoAdd new definition of ZSTD_d_forceSkipChecksum in experimental section
senhuang42 [Fri, 21 Aug 2020 19:59:03 +0000 (15:59 -0400)] 
Add new definition of ZSTD_d_forceSkipChecksum in experimental section

4 years ago[regression] Update results.csv
Nick Terrell [Tue, 18 Aug 2020 23:57:35 +0000 (16:57 -0700)] 
[regression] Update results.csv

4 years agoMerge pull request #2277 from atnbueno/patch-1
Yann Collet [Wed, 19 Aug 2020 19:05:27 +0000 (12:05 -0700)] 
Merge pull request #2277 from atnbueno/patch-1

Fixed Markdown warnings. No visible changes.

4 years agoFixed Markdown warnings. No visible changes. 2277/head
Antonio Bueno [Wed, 19 Aug 2020 10:36:28 +0000 (12:36 +0200)] 
Fixed Markdown warnings. No visible changes.

4 years agoMerge pull request #2268 from bimbashrestha/actions-icc
Yann Collet [Wed, 19 Aug 2020 02:08:01 +0000 (19:08 -0700)] 
Merge pull request #2268 from bimbashrestha/actions-icc

[actions] removing broken icc test from travis and adding working version to actions

4 years agoUse ncount=1 when < 4096 symbols
Nick Terrell [Tue, 18 Aug 2020 22:26:54 +0000 (15:26 -0700)] 
Use ncount=1 when < 4096 symbols

4 years agowire up bmi2 support
Nick Terrell [Mon, 17 Aug 2020 20:44:49 +0000 (13:44 -0700)] 
wire up bmi2 support

4 years agospeed up literal header decoding
Nick Terrell [Mon, 17 Aug 2020 05:22:33 +0000 (22:22 -0700)] 
speed up literal header decoding

4 years agospeed up small blocks
Nick Terrell [Fri, 14 Aug 2020 22:28:59 +0000 (15:28 -0700)] 
speed up small blocks

4 years agosmall blocks benchmark
Nick Terrell [Fri, 14 Aug 2020 22:28:48 +0000 (15:28 -0700)] 
small blocks benchmark

4 years agoMerge pull request #2270 from felixhandte/fix-doc-cctx-set-param
Felix Handte [Sat, 15 Aug 2020 01:44:56 +0000 (21:44 -0400)] 
Merge pull request #2270 from felixhandte/fix-doc-cctx-set-param

Fix Documentation for ZSTD_CCtxParams_setParameter()

4 years agoFix Documentation for ZSTD_CCtxParams_setParameter() 2270/head
W. Felix Handte [Fri, 14 Aug 2020 18:44:08 +0000 (14:44 -0400)] 
Fix Documentation for ZSTD_CCtxParams_setParameter()

It does not only return 0 on success.

4 years agoremoving icc from travis 2268/head
Bimba Shrestha [Thu, 13 Aug 2020 17:47:04 +0000 (12:47 -0500)] 
removing icc from travis

4 years agoadding icc to actions
Bimba Shrestha [Thu, 13 Aug 2020 17:45:28 +0000 (12:45 -0500)] 
adding icc to actions

4 years agoMerge pull request #2267 from cwoffenden/clang-comma
Yann Collet [Thu, 13 Aug 2020 17:00:57 +0000 (10:00 -0700)] 
Merge pull request #2267 from cwoffenden/clang-comma

Fix clang -Wcomma warning (single file decoder)

4 years agoFix clang -Wcomma warning 2267/head
Carl Woffenden [Thu, 13 Aug 2020 14:11:22 +0000 (16:11 +0200)] 
Fix clang -Wcomma warning

4 years agoMerge pull request #2265 from terrelln/prefetch-fix
Nick Terrell [Tue, 11 Aug 2020 17:07:53 +0000 (10:07 -0700)] 
Merge pull request #2265 from terrelln/prefetch-fix

Prefer __builtin_prefetch over inline asm

4 years agoPrefer __builtin_prefetch over inline asm 2265/head
Nick Terrell [Tue, 11 Aug 2020 05:15:46 +0000 (22:15 -0700)] 
Prefer __builtin_prefetch over inline asm

Reorder the ifdefs for the PREFETCH macros so that the compiler builtin is
favored over the inline assembly for aarch64.

4 years agoMerge pull request #2262 from felixhandte/fewer-stat-syscalls
Yann Collet [Tue, 11 Aug 2020 01:20:13 +0000 (18:20 -0700)] 
Merge pull request #2262 from felixhandte/fewer-stat-syscalls

Share stat() Calls Where Convenient

4 years agoFix MS Build 2262/head
W. Felix Handte [Mon, 10 Aug 2020 21:28:34 +0000 (17:28 -0400)] 
Fix MS Build

4 years agoClean Up Redundant Checks, Rename FIO_remove() -> FIO_removeFile()
W. Felix Handte [Mon, 10 Aug 2020 19:39:14 +0000 (15:39 -0400)] 
Clean Up Redundant Checks, Rename FIO_remove() -> FIO_removeFile()

4 years agoRemove UTIL_statFile() and UTIL_statDir(); Decompose Former Call-Sites
W. Felix Handte [Mon, 10 Aug 2020 19:28:02 +0000 (15:28 -0400)] 
Remove UTIL_statFile() and UTIL_statDir(); Decompose Former Call-Sites

4 years agoRemove Unused Function UTIL_fileExist()
W. Felix Handte [Mon, 10 Aug 2020 19:22:29 +0000 (15:22 -0400)] 
Remove Unused Function UTIL_fileExist()

4 years agoRe-Organize and Document Prototypes in util.h
W. Felix Handte [Mon, 10 Aug 2020 19:16:14 +0000 (15:16 -0400)] 
Re-Organize and Document Prototypes in util.h