]>
git.ipfire.org Git - thirdparty/zstd.git/log
Nick Terrell [Wed, 9 Sep 2020 19:45:16 +0000 (12:45 -0700)]
[linux-kernel] Update README with initial instructions on how to update zstd in the kernel
Nick Terrell [Wed, 9 Sep 2020 19:36:58 +0000 (12:36 -0700)]
[linux-kernel] Add test that checks the ifdef hardwiring
Nick Terrell [Tue, 11 Aug 2020 06:11:20 +0000 (23:11 -0700)]
Add linux-kernel freestanding
Nick Terrell [Tue, 11 Aug 2020 06:09:59 +0000 (23:09 -0700)]
[contrib] Add preprocessor hardwiring to freestanding.py
Nick Terrell [Fri, 28 Aug 2020 00:10:04 +0000 (17:10 -0700)]
[lib] Add ZSTD_NO_UNUSED_FUNCTIONS macro to hide unused functions
The unused function definitions are hidden behind a
`#ifndef ZSTD_NO_UNUSED_FUNCTIONS` check.
Initially hiding all functions which are unused and take up more than
2KB of stack space, because these will show up as warnings in the
Linux Kernel build system.
Nick Terrell [Thu, 27 Aug 2020 22:01:18 +0000 (15:01 -0700)]
[lib] Replace 64-bit divisions with ZSTD_div64()
Nick Terrell [Thu, 27 Aug 2020 00:52:54 +0000 (17:52 -0700)]
[lib] Reduce zstd stack usage by 1KB
Nick Terrell [Fri, 14 Aug 2020 19:42:06 +0000 (12:42 -0700)]
Fix ZSTD_initCStream_advanced() with no dictionary and static allocation
Nick Terrell [Fri, 14 Aug 2020 19:41:28 +0000 (12:41 -0700)]
Add ZSTD_NO_INTRINSICS macro to avoid explicit intrinsics
Nick Terrell [Tue, 11 Aug 2020 21:31:09 +0000 (14:31 -0700)]
[lib] s/current/curr because it collides with Linux Kernel macro
Nick Terrell [Tue, 8 Sep 2020 23:42:34 +0000 (16:42 -0700)]
Merge pull request #2291 from i-do-cpp/fix-compression-level-default
Fix setParameter not falling back to default compression level
Felix Handte [Fri, 4 Sep 2020 14:58:57 +0000 (10:58 -0400)]
Merge pull request #2294 from felixhandte/makefile-lib-fix-var-order
Fix Makefile Variable Concatenation Order
W. Felix Handte [Thu, 3 Sep 2020 21:28:37 +0000 (17:28 -0400)]
Fix Makefile Variable Concatenation Order
Previously, this construct would add `-O3` onto the end of the compiler flags
variable, **after** `MOREFLAGS`, which meant that it was impossible to over-
ride. This commit fixes this order and should otherwise be a no-op.
Nick Terrell [Thu, 3 Sep 2020 20:58:45 +0000 (13:58 -0700)]
Merge pull request #2293 from allanjude/coverity
Resolve Coverity
1432392 Unintentional integer overflow
Allan Jude [Thu, 3 Sep 2020 19:31:50 +0000 (19:31 +0000)]
Resolve Coverity
1432392 Unintentional integer overflow
Unintentional integer overflow (OVERFLOW_BEFORE_WIDEN)
overflow_before_widen: Potentially overflowing expression:
cdict->dictContentSize * 6U
with type unsigned int (32 bits, unsigned) is evaluated using 32-bit
arithmetic, and then used in a context that expects an expression of
type U64 (64 bits, unsigned).
Nick Terrell [Wed, 2 Sep 2020 18:32:11 +0000 (11:32 -0700)]
Merge pull request #2279 from senhuang42/show_warnings_with_multiple_input_files
Add a warning whenever (de)compressing multiple files
senhuang42 [Wed, 2 Sep 2020 12:44:42 +0000 (08:44 -0400)]
Adjusted extra explanation warning to always pop up if applicable
senhuang42 [Tue, 1 Sep 2020 17:18:30 +0000 (13:18 -0400)]
Fixed newline issue and adjusted wording in comment
i-do-cpp [Mon, 31 Aug 2020 07:34:08 +0000 (09:34 +0200)]
Update zstd_compress.c
i-do-cpp [Mon, 31 Aug 2020 07:25:43 +0000 (09:25 +0200)]
Fix setParameter not falling back to default compression level on 0 value
See documentation for `ZSTD_c_compressionLevel`: `Special: value 0 means default, which is controlled by ZSTD_CLEVEL_DEFAULT`
senhuang42 [Thu, 27 Aug 2020 21:57:20 +0000 (17:57 -0400)]
Improve documentation, update man
Yann Collet [Thu, 27 Aug 2020 19:32:07 +0000 (12:32 -0700)]
Merge pull request #2288 from animalize/doc_version
[doc] Add ZSTD_versionString() to manual
animalize [Thu, 27 Aug 2020 05:51:22 +0000 (13:51 +0800)]
Add ZSTD_versionString() function to manual.
Nick Terrell [Thu, 27 Aug 2020 01:15:25 +0000 (18:15 -0700)]
Merge pull request #2264 from terrelln/zstd-kernel
Prepare for freestanding library and add initial translator script
senhuang42 [Wed, 26 Aug 2020 22:52:32 +0000 (18:52 -0400)]
Fix potential memory leak
senhuang42 [Wed, 26 Aug 2020 21:20:37 +0000 (17:20 -0400)]
Fix UTIL_requireUserConfirmation() declaration
senhuang42 [Wed, 26 Aug 2020 20:50:20 +0000 (16:50 -0400)]
Move logic into new function FIO_removeMultiFilesWarning, add support for decompression
senhuang42 [Wed, 26 Aug 2020 19:43:38 +0000 (15:43 -0400)]
Fix merge conflicts
Nick Terrell [Mon, 10 Aug 2020 17:42:27 +0000 (10:42 -0700)]
[contrib] Add freestanding translator prototype
This is the idea, some of the functionality isn't yet implemented.
Nick Terrell [Mon, 10 Aug 2020 19:46:38 +0000 (12:46 -0700)]
ZSTD_ prefix mem{cpy,move,set},malloc,calloc,free
Nick Terrell [Mon, 10 Aug 2020 19:42:03 +0000 (12:42 -0700)]
Rename ZSTD_{malloc,calloc,free} to ZSTD_custom{Malloc,Calloc,Free}
Nick Terrell [Fri, 7 Aug 2020 03:18:05 +0000 (20:18 -0700)]
Move standard includes to zstd_deps.h
Yann Collet [Wed, 26 Aug 2020 18:54:50 +0000 (11:54 -0700)]
Merge pull request #2283 from senhuang42/progress_bars_for_multiple_files
Refreshing progress bar for processing multiple files
Nick Terrell [Wed, 26 Aug 2020 17:31:07 +0000 (10:31 -0700)]
Merge pull request #2282 from terrelln/ncount-fix
[bug] Fix FSE_readNCount()
senhuang42 [Wed, 26 Aug 2020 16:05:04 +0000 (12:05 -0400)]
Remove extraneous FIO_setNbFiles()
senhuang42 [Wed, 26 Aug 2020 15:57:38 +0000 (11:57 -0400)]
Fix bug in user prompt where line was not flushed on negative response
senhuang42 [Wed, 26 Aug 2020 15:40:05 +0000 (11:40 -0400)]
Adjust playTests.sh refuse overwrite test to include -q
senhuang42 [Wed, 26 Aug 2020 15:35:07 +0000 (11:35 -0400)]
Fix single file decompression summary, remove escape code dependency, add currFileIdx field to FIO_prefs, general cleanups/bugfixes
Nick Terrell [Wed, 26 Aug 2020 01:35:16 +0000 (18:35 -0700)]
Merge pull request #2285 from terrelln/oss-fuzz-fixes
[fuzz] Fix oss-fuzz test problems
Yann Collet [Wed, 26 Aug 2020 00:50:12 +0000 (17:50 -0700)]
Merge pull request #2284 from terrelln/github-actions-arm
[github actions] Disable armbuild and armfuzz tests
Nick Terrell [Wed, 26 Aug 2020 00:10:04 +0000 (17:10 -0700)]
[fuzz] Fix stream_decompress timeouts
Nick Terrell [Tue, 25 Aug 2020 23:32:00 +0000 (16:32 -0700)]
[fuzz] Disable superblock expansion test
Nick Terrell [Tue, 25 Aug 2020 23:28:41 +0000 (16:28 -0700)]
[github actions] Disable armbuild and armfuzz tests
Nick Terrell [Tue, 25 Aug 2020 18:37:41 +0000 (11:37 -0700)]
[bug] Fix FSE_readNCount()
* Fix bug introduced in PR #2271
* Fix long-standing bug that is impossible to trigger inside of zstd
* Add a fuzzer that makes sure the normalized count always round trips
correctly
senhuang42 [Tue, 25 Aug 2020 22:03:08 +0000 (18:03 -0400)]
Small formatting changes
senhuang42 [Tue, 25 Aug 2020 21:54:00 +0000 (17:54 -0400)]
Remove decompression status update
senhuang42 [Tue, 25 Aug 2020 21:34:00 +0000 (17:34 -0400)]
Small cleanups
senhuang42 [Tue, 25 Aug 2020 21:23:47 +0000 (17:23 -0400)]
Make compatible with displaylevel = 2 and decompression
senhuang42 [Tue, 25 Aug 2020 20:46:47 +0000 (16:46 -0400)]
Add initial live update with displayLevel = 2, add new field to FIO_prefs_t
Yann Collet [Tue, 25 Aug 2020 19:08:53 +0000 (12:08 -0700)]
Merge pull request #2278 from senhuang42/ignore_checksum_advanced_param
New advanced decompression param to ignore checksums
senhuang42 [Tue, 25 Aug 2020 17:50:44 +0000 (13:50 -0400)]
Add initial functionality to support -q
senhuang42 [Tue, 25 Aug 2020 15:25:49 +0000 (11:25 -0400)]
Unified warning prompts into new function UTIL_requireUserConfirmationToProceed()
Nick Terrell [Tue, 25 Aug 2020 01:54:33 +0000 (18:54 -0700)]
Merge pull request #2271 from terrelln/small-blocks
Small block optimizations
senhuang42 [Tue, 25 Aug 2020 00:19:55 +0000 (20:19 -0400)]
Only ask to proceed if using --rm, otherwise just display warning. -f bypasses it all. More robust tests
senhuang42 [Mon, 24 Aug 2020 23:10:03 +0000 (19:10 -0400)]
Add a warning whenever (de)compressing multiple files into one source, or into stdout
Nick Terrell [Mon, 24 Aug 2020 23:09:45 +0000 (16:09 -0700)]
Fix compiler warnings
Nick Terrell [Mon, 24 Aug 2020 22:01:17 +0000 (15:01 -0700)]
Merge pull request #2272 from terrelln/dstSize_tooSmall
[fix] Always return dstSize_tooSmall when it is the case
Nick Terrell [Mon, 24 Aug 2020 21:44:33 +0000 (14:44 -0700)]
Document the BMI2 default() functions
senhuang42 [Mon, 24 Aug 2020 21:36:36 +0000 (17:36 -0400)]
Adjust #ifndef logic
senhuang42 [Mon, 24 Aug 2020 21:28:00 +0000 (17:28 -0400)]
Add new DCtx param: validateChecksum and update unit tests
Nick Terrell [Mon, 24 Aug 2020 20:58:34 +0000 (13:58 -0700)]
Improve FSE_normalizeCount() docs
Nick Terrell [Sat, 15 Aug 2020 19:32:57 +0000 (12:32 -0700)]
[fix] Always return dstSize_tooSmall when it is the case
senhuang42 [Mon, 24 Aug 2020 20:14:19 +0000 (16:14 -0400)]
Addressing comments: more comments, cleanup, remove extra function, checksum logic
Nick Terrell [Mon, 24 Aug 2020 19:24:45 +0000 (12:24 -0700)]
Fix up code after reading through
senhuang42 [Sat, 22 Aug 2020 20:58:41 +0000 (16:58 -0400)]
Document change in CLI for --no-check during decompression in --help menu
senhuang42 [Sat, 22 Aug 2020 20:05:40 +0000 (16:05 -0400)]
Added CLI tests for --no-check, fixed ignore checksum logic
senhuang42 [Sat, 22 Aug 2020 17:26:33 +0000 (13:26 -0400)]
Added unit test to fuzzer.c, changed definition param name
senhuang42 [Fri, 21 Aug 2020 22:18:53 +0000 (18:18 -0400)]
Move enum into zstd.h, and fix pesky switch() logic
senhuang42 [Fri, 21 Aug 2020 21:49:30 +0000 (17:49 -0400)]
Adding CLI capability to invoke decompression with no checksum
senhuang42 [Fri, 21 Aug 2020 20:51:43 +0000 (16:51 -0400)]
Add function prototype
senhuang42 [Fri, 21 Aug 2020 20:46:46 +0000 (16:46 -0400)]
Modify decompression loop to gnore checksums if flag is enabled
senhuang42 [Fri, 21 Aug 2020 20:23:39 +0000 (16:23 -0400)]
Rename to ZSTD_d_forceIgnoreChecksum, add to DCtx, add function to set the advanced param
senhuang42 [Fri, 21 Aug 2020 19:59:03 +0000 (15:59 -0400)]
Add new definition of ZSTD_d_forceSkipChecksum in experimental section
Nick Terrell [Tue, 18 Aug 2020 23:57:35 +0000 (16:57 -0700)]
[regression] Update results.csv
Yann Collet [Wed, 19 Aug 2020 19:05:27 +0000 (12:05 -0700)]
Merge pull request #2277 from atnbueno/patch-1
Fixed Markdown warnings. No visible changes.
Antonio Bueno [Wed, 19 Aug 2020 10:36:28 +0000 (12:36 +0200)]
Fixed Markdown warnings. No visible changes.
Yann Collet [Wed, 19 Aug 2020 02:08:01 +0000 (19:08 -0700)]
Merge pull request #2268 from bimbashrestha/actions-icc
[actions] removing broken icc test from travis and adding working version to actions
Nick Terrell [Tue, 18 Aug 2020 22:26:54 +0000 (15:26 -0700)]
Use ncount=1 when < 4096 symbols
Nick Terrell [Mon, 17 Aug 2020 20:44:49 +0000 (13:44 -0700)]
wire up bmi2 support
Nick Terrell [Mon, 17 Aug 2020 05:22:33 +0000 (22:22 -0700)]
speed up literal header decoding
Nick Terrell [Fri, 14 Aug 2020 22:28:59 +0000 (15:28 -0700)]
speed up small blocks
Nick Terrell [Fri, 14 Aug 2020 22:28:48 +0000 (15:28 -0700)]
small blocks benchmark
Felix Handte [Sat, 15 Aug 2020 01:44:56 +0000 (21:44 -0400)]
Merge pull request #2270 from felixhandte/fix-doc-cctx-set-param
Fix Documentation for ZSTD_CCtxParams_setParameter()
W. Felix Handte [Fri, 14 Aug 2020 18:44:08 +0000 (14:44 -0400)]
Fix Documentation for ZSTD_CCtxParams_setParameter()
It does not only return 0 on success.
Bimba Shrestha [Thu, 13 Aug 2020 17:47:04 +0000 (12:47 -0500)]
removing icc from travis
Bimba Shrestha [Thu, 13 Aug 2020 17:45:28 +0000 (12:45 -0500)]
adding icc to actions
Yann Collet [Thu, 13 Aug 2020 17:00:57 +0000 (10:00 -0700)]
Merge pull request #2267 from cwoffenden/clang-comma
Fix clang -Wcomma warning (single file decoder)
Carl Woffenden [Thu, 13 Aug 2020 14:11:22 +0000 (16:11 +0200)]
Fix clang -Wcomma warning
Nick Terrell [Tue, 11 Aug 2020 17:07:53 +0000 (10:07 -0700)]
Merge pull request #2265 from terrelln/prefetch-fix
Prefer __builtin_prefetch over inline asm
Nick Terrell [Tue, 11 Aug 2020 05:15:46 +0000 (22:15 -0700)]
Prefer __builtin_prefetch over inline asm
Reorder the ifdefs for the PREFETCH macros so that the compiler builtin is
favored over the inline assembly for aarch64.
Yann Collet [Tue, 11 Aug 2020 01:20:13 +0000 (18:20 -0700)]
Merge pull request #2262 from felixhandte/fewer-stat-syscalls
Share stat() Calls Where Convenient
W. Felix Handte [Mon, 10 Aug 2020 21:28:34 +0000 (17:28 -0400)]
Fix MS Build
W. Felix Handte [Mon, 10 Aug 2020 19:39:14 +0000 (15:39 -0400)]
Clean Up Redundant Checks, Rename FIO_remove() -> FIO_removeFile()
W. Felix Handte [Mon, 10 Aug 2020 19:28:02 +0000 (15:28 -0400)]
Remove UTIL_statFile() and UTIL_statDir(); Decompose Former Call-Sites
W. Felix Handte [Mon, 10 Aug 2020 19:22:29 +0000 (15:22 -0400)]
Remove Unused Function UTIL_fileExist()
W. Felix Handte [Mon, 10 Aug 2020 19:16:14 +0000 (15:16 -0400)]
Re-Organize and Document Prototypes in util.h
W. Felix Handte [Wed, 5 Aug 2020 16:10:42 +0000 (12:10 -0400)]
Share stat() Calls in Uses of UTIL_chmod()
W. Felix Handte [Wed, 5 Aug 2020 16:00:12 +0000 (12:00 -0400)]
Use stat() to Check that File Should be chmod()-ed
Rather than special-casing a check for `/dev/null`, this uses `stat()` to
avoid `chmod()`-ing any non-regular file. I believe this is the desirable
behavior. `UTIL_chmod()` is never called on directories at the moment, only
output files.
W. Felix Handte [Wed, 5 Aug 2020 05:08:34 +0000 (01:08 -0400)]
Deduplicate Some Low-Hanging Fruit of Redundant Stat Calls
W. Felix Handte [Wed, 5 Aug 2020 05:00:06 +0000 (01:00 -0400)]
Introduce Variants of Various UTIL Functions that Take Pre-Populated stat_t Structs
Instead of calling `stat()`, these functions accept the result of a previous
`stat()` call on the file in question, which will allow us to make multiple
decisions around a file without redundant `stat()` calls.