]>
git.ipfire.org Git - thirdparty/zstd.git/log
Nick Terrell [Tue, 27 Jun 2017 01:33:04 +0000 (18:33 -0700)]
[linux-kernel] Update patches for v2
* Reduce stack usage of many zstd functions, none use over 388 B anymore.
* Remove an incorrect `const` in `xxhash`.
Yann Collet [Fri, 23 Jun 2017 21:18:55 +0000 (14:18 -0700)]
Merge pull request #733 from terrelln/pzstd-deadlock
[pzstd] Fix potential deadlock in the case of errors
Yann Collet [Fri, 23 Jun 2017 16:50:47 +0000 (09:50 -0700)]
Merge pull request #725 from facebook/advancedAPI2
New Advanced API
Yann Collet [Fri, 23 Jun 2017 07:37:15 +0000 (00:37 -0700)]
--no-big-tests for msan
msan tests require too much RAM for 2 GB VM
Yann Collet [Fri, 23 Jun 2017 07:13:03 +0000 (00:13 -0700)]
Merge branch 'advancedAPI2' of github.com:facebook/zstd into advancedAPI2
Yann Collet [Fri, 23 Jun 2017 07:09:02 +0000 (00:09 -0700)]
zstreamtest : disabled multi-threading tests with --newapi --no-big-tests
--no-big-tests is typically used in combination with qemu-user-static
qemu-user-static allocated 4 GB of RAM upfront.
On 2 GB VM, this can degenerate into a crash.
It's not a problem as long as memory is not used.
But with multi-threading enabled, memory fragmentation kicks in,
so the amoung of RAM effectively touched increases,
and can pass beyond the 2 GB limit of the VM.
In single-threaded mode, there is no such issue :
memory requirement is smaller, and remains well-located,
so very little fragmentation is expected.
This modification should make `qemu-arm-static zstreamtests --newapi --no-big-tests`
work fine on Travis CI.
Nick Terrell [Fri, 23 Jun 2017 01:09:42 +0000 (18:09 -0700)]
[pzstd] Fix deadlock in the case of errors
Fixes #720.
Yann Collet [Thu, 22 Jun 2017 06:46:54 +0000 (23:46 -0700)]
Merge pull request #732 from terrelln/dev
[linux] Update patches
Yann Collet [Thu, 22 Jun 2017 06:35:58 +0000 (23:35 -0700)]
reduced --no-big-tests even more
to pass tests on qemu-aarch64
Nick Terrell [Thu, 22 Jun 2017 03:23:44 +0000 (20:23 -0700)]
[linux] Write all the patch summaries
Yann Collet [Thu, 22 Jun 2017 01:43:39 +0000 (18:43 -0700)]
fixed minor cast warning
Yann Collet [Thu, 22 Jun 2017 01:20:02 +0000 (18:20 -0700)]
reduced CLevelMax for --no-big-tests
Yann Collet [Thu, 22 Jun 2017 00:57:14 +0000 (17:57 -0700)]
--no-big-tests for zstreamtest
Apply --no-big-tests for tsan tests
Yann Collet [Thu, 22 Jun 2017 00:25:01 +0000 (17:25 -0700)]
add controls over streaming buffers
Yann Collet [Wed, 21 Jun 2017 22:58:36 +0000 (15:58 -0700)]
added --list command contrib by @paulcruz74
Yann Collet [Wed, 21 Jun 2017 22:56:05 +0000 (15:56 -0700)]
Merge pull request #730 from paulcruz74/dev
Patching ratio and non-existent file bugs
Yann Collet [Wed, 21 Jun 2017 22:53:42 +0000 (15:53 -0700)]
fixed : decompression of skippable frames in streaming mode
Nick Terrell [Wed, 21 Jun 2017 22:21:25 +0000 (15:21 -0700)]
[linux] Rename last 2 diffs to patch names
Nick Terrell [Wed, 21 Jun 2017 22:19:54 +0000 (15:19 -0700)]
[linux] Add summaries to xxhash and zstd patches
Nick Terrell [Wed, 21 Jun 2017 22:10:18 +0000 (15:10 -0700)]
[linux] Rename diffs to patch names
Nick Terrell [Wed, 21 Jun 2017 22:08:26 +0000 (15:08 -0700)]
[linux] Switch BtrFS compression level to 1
Yann Collet [Wed, 21 Jun 2017 22:16:13 +0000 (15:16 -0700)]
switched fileio.c to ZSTD_DEBUG trigger macro
Yann Collet [Wed, 21 Jun 2017 22:13:00 +0000 (15:13 -0700)]
fixed streaming buffered allocation with CDict compression
Yann Collet [Wed, 21 Jun 2017 20:26:10 +0000 (13:26 -0700)]
fixed dangling pointer risk, detected by @terrelln
Paul Cruz [Wed, 21 Jun 2017 19:42:38 +0000 (12:42 -0700)]
Merge pull request #3 from facebook/dev
pulling changes
Paul Cruz [Wed, 21 Jun 2017 19:41:10 +0000 (12:41 -0700)]
added newline to align output
Paul Cruz [Wed, 21 Jun 2017 19:37:23 +0000 (12:37 -0700)]
added error check for when file could not be opened
Paul Cruz [Wed, 21 Jun 2017 19:27:20 +0000 (12:27 -0700)]
reversed calculation of ratio
Yann Collet [Wed, 21 Jun 2017 19:26:40 +0000 (12:26 -0700)]
free cdictLocal faster, suggested by @terrelln
Yann Collet [Wed, 21 Jun 2017 19:09:53 +0000 (12:09 -0700)]
added test cases for new command --list
Yann Collet [Wed, 21 Jun 2017 18:50:33 +0000 (11:50 -0700)]
added ZSTD_dictMode_e to control dictionary loading mode
Yann Collet [Wed, 21 Jun 2017 16:41:55 +0000 (09:41 -0700)]
Merge pull request #723 from paulcruz74/dev
Adding zstd -l
Yann Collet [Wed, 21 Jun 2017 00:44:55 +0000 (17:44 -0700)]
fixed memcpy() overlap
Paul Cruz [Wed, 21 Jun 2017 00:43:36 +0000 (17:43 -0700)]
added test for files with no frame content size
Yann Collet [Tue, 20 Jun 2017 23:25:29 +0000 (16:25 -0700)]
removed one useless streaming compression stage, detected by @terrelln
Yann Collet [Tue, 20 Jun 2017 23:09:11 +0000 (16:09 -0700)]
fixed potential dangling pointer, detected by @terrelln
Paul Cruz [Tue, 20 Jun 2017 21:33:08 +0000 (14:33 -0700)]
added tests with null files, changed condition to check that the file is more than 0 bytes
Yann Collet [Tue, 20 Jun 2017 21:26:48 +0000 (14:26 -0700)]
fixed comments, following suggestion by @terrelln
Paul Cruz [Tue, 20 Jun 2017 21:14:53 +0000 (14:14 -0700)]
spacing matters for test scripts
Yann Collet [Tue, 20 Jun 2017 21:11:49 +0000 (14:11 -0700)]
ensure new ZSTD_strategy starts at value 1
Paul Cruz [Tue, 20 Jun 2017 21:04:46 +0000 (14:04 -0700)]
fixed error where extremely small files were not being detected as not compressed with zstd
Paul Cruz [Tue, 20 Jun 2017 20:44:05 +0000 (13:44 -0700)]
changed to use LONG_SEEK
Paul Cruz [Tue, 20 Jun 2017 20:26:25 +0000 (13:26 -0700)]
added progress metric to display
Paul Cruz [Tue, 20 Jun 2017 19:43:10 +0000 (12:43 -0700)]
moved signifcant operations to fileio.c
Yann Collet [Tue, 20 Jun 2017 19:17:32 +0000 (12:17 -0700)]
fixed fuzzer test
Yann Collet [Tue, 20 Jun 2017 19:13:51 +0000 (12:13 -0700)]
Merge pull request #728 from terrelln/ubsan-failure
[linux] Add more tests and fuzzing
Paul Cruz [Tue, 20 Jun 2017 18:59:45 +0000 (11:59 -0700)]
removed double if statements for same condition
Paul Cruz [Tue, 20 Jun 2017 18:58:27 +0000 (11:58 -0700)]
minor update to logic
Paul Cruz [Tue, 20 Jun 2017 18:56:11 +0000 (11:56 -0700)]
size_t const value
Paul Cruz [Tue, 20 Jun 2017 18:54:44 +0000 (11:54 -0700)]
added additional tests for error detection
Paul Cruz [Tue, 20 Jun 2017 18:47:24 +0000 (11:47 -0700)]
changed displayInfo alignment and const
Paul Cruz [Tue, 20 Jun 2017 17:45:06 +0000 (10:45 -0700)]
change test to list info on .zst files
Paul Cruz [Tue, 20 Jun 2017 16:35:21 +0000 (09:35 -0700)]
changed fileInfo initialization, updated error code
Nick Terrell [Tue, 20 Jun 2017 02:09:41 +0000 (19:09 -0700)]
[linux] Add xxhash and zstd in-kernel tests
Nick Terrell [Tue, 20 Jun 2017 02:09:15 +0000 (19:09 -0700)]
[linux] Add libfuzzer targets
Yann Collet [Tue, 20 Jun 2017 01:25:35 +0000 (18:25 -0700)]
first implementation of bench.c with new API ZSTD_compress_generic()
Doesn't speed optimize this buffer-to-buffer scenario yet.
Still internally defers to streaming implementation.
Also : fixed a long standing bug in ZSTDMT streaming API.
Yann Collet [Tue, 20 Jun 2017 00:45:43 +0000 (17:45 -0700)]
fix attempt : fullbench VS2008 project
Nick Terrell [Mon, 19 Jun 2017 22:48:30 +0000 (15:48 -0700)]
[linux] Port libzstd UBSAN fix
Yann Collet [Mon, 19 Jun 2017 22:43:17 +0000 (15:43 -0700)]
Merge pull request #727 from terrelln/ubsan-failure
[libzstd] Fix UBSAN failure
Yann Collet [Mon, 19 Jun 2017 22:27:30 +0000 (15:27 -0700)]
fixed IA64 compilation error, by @mcmilk
Yann Collet [Mon, 19 Jun 2017 22:23:19 +0000 (15:23 -0700)]
fix attempts : fullbench for VS2008
Nick Terrell [Mon, 19 Jun 2017 22:12:28 +0000 (15:12 -0700)]
[libzstd] Fix UBSAN failure
Yann Collet [Mon, 19 Jun 2017 21:13:46 +0000 (14:13 -0700)]
Merge pull request #726 from terrelln/malloc-failure
[linux] Fix decompression memory allocation
Yann Collet [Mon, 19 Jun 2017 19:56:25 +0000 (12:56 -0700)]
update new api presentation in zstd.h and manual
Nick Terrell [Mon, 19 Jun 2017 19:24:14 +0000 (12:24 -0700)]
[linux] Fix decompression memory allocation
Yann Collet [Mon, 19 Jun 2017 19:03:25 +0000 (12:03 -0700)]
updated manual
Yann Collet [Mon, 19 Jun 2017 18:53:42 +0000 (11:53 -0700)]
minor declaration statement warning fix
Yann Collet [Mon, 19 Jun 2017 18:53:01 +0000 (11:53 -0700)]
new api : setting compression parameters is refused if a dictionary is already loaded
Yann Collet [Mon, 19 Jun 2017 18:07:33 +0000 (11:07 -0700)]
newapi fuzzer tests : random flush orders in main loop
Paul Cruz [Mon, 19 Jun 2017 16:55:55 +0000 (09:55 -0700)]
made style changes, added description in man file
Yann Collet [Mon, 19 Jun 2017 06:41:38 +0000 (23:41 -0700)]
new api fuzzer tests : frame parameters are randonly set
Yann Collet [Mon, 19 Jun 2017 06:31:55 +0000 (23:31 -0700)]
new api fuzzer set : dictionary is randomly set
Yann Collet [Mon, 19 Jun 2017 06:25:15 +0000 (23:25 -0700)]
new api fuzzer tests : compression parameters are randomly set
Yann Collet [Sat, 17 Jun 2017 08:19:39 +0000 (01:19 -0700)]
Merge pull request #724 from yurivict/fix-install-static-lib
INSTALL_DATA instead of INSTALL_LIB for libzstd.a
Yuri [Sat, 17 Jun 2017 07:23:41 +0000 (00:23 -0700)]
INSTALL_DATA instead of INSTALL_LIB for libzstd.a
INSTALL_LIB can be passed -s flag to strip symbols. Static libraries should not be stripped, only dynamic ones should be stripped.
Yann Collet [Sat, 17 Jun 2017 01:16:27 +0000 (18:16 -0700)]
removed macro CLAMP from decodecorpus
never used,
and would duplicate with CLAMP from zstd_compress.c
Yann Collet [Sat, 17 Jun 2017 00:56:41 +0000 (17:56 -0700)]
fuzzer tests for new API
Yann Collet [Sat, 17 Jun 2017 00:29:35 +0000 (17:29 -0700)]
added ZSTD_clampCParams()
now ZSTD_adjustCParams() is always successful,
it always produces a valid CParams
Yann Collet [Sat, 17 Jun 2017 00:01:46 +0000 (17:01 -0700)]
fixed +/-1 error for pledgedSrcSizePlusOne
Yann Collet [Fri, 16 Jun 2017 23:51:33 +0000 (16:51 -0700)]
fix attempt 2 : Visual sign conversion warning
Yann Collet [Fri, 16 Jun 2017 21:04:30 +0000 (14:04 -0700)]
fixed attempt : minor Visual sign conversion warning
Yann Collet [Fri, 16 Jun 2017 21:00:46 +0000 (14:00 -0700)]
added ZSTD_startNewCompression()
Yann Collet [Fri, 16 Jun 2017 20:29:17 +0000 (13:29 -0700)]
changed frameContentSize field to pledgedSrcSizePlusOne
pledgedSrcSize is proper : it's a promise, not yet fulfilled.
It will be controlled at the end.
PlusOne is meant to have 0 (default) == unknown
Yann Collet [Fri, 16 Jun 2017 19:34:41 +0000 (12:34 -0700)]
fix : pledgedSrcSize correctly reset to unknown in "continue" mode
Yann Collet [Fri, 16 Jun 2017 19:24:01 +0000 (12:24 -0700)]
fix : correctly reset pledgedSrcSize to unknown status
when starting a new compression with an existing context
Yann Collet [Fri, 16 Jun 2017 19:04:21 +0000 (12:04 -0700)]
fixed : new advanced AIP : setting nbThreads to the same value > 1
Yann Collet [Fri, 16 Jun 2017 18:58:21 +0000 (11:58 -0700)]
fixed : calling ZSTD_compress_generic() to end-flush a stream in multiple steps
Yann Collet [Fri, 16 Jun 2017 17:17:50 +0000 (10:17 -0700)]
added ZSTD_CCtx_reset
Yann Collet [Fri, 16 Jun 2017 01:17:10 +0000 (18:17 -0700)]
protection : ZSTD_CONTENTSIZE_UNKNOWN automatically disables contentSizeFlag
Paul Cruz [Fri, 16 Jun 2017 01:09:15 +0000 (18:09 -0700)]
Merge branch 'list' into dev
Paul Cruz [Fri, 16 Jun 2017 01:08:22 +0000 (18:08 -0700)]
fixing more spacing on loops
Yann Collet [Fri, 16 Jun 2017 01:03:34 +0000 (18:03 -0700)]
added protection : MT incompatible with Static allocation
Paul Cruz [Fri, 16 Jun 2017 00:53:00 +0000 (17:53 -0700)]
Merge branch 'list' into dev
Paul Cruz [Fri, 16 Jun 2017 00:46:49 +0000 (17:46 -0700)]
added in correct error return from main in zstdcli.c
Paul Cruz [Fri, 16 Jun 2017 00:30:18 +0000 (17:30 -0700)]
initialized info manually to avoid error
Paul Cruz [Fri, 16 Jun 2017 00:12:41 +0000 (17:12 -0700)]
changed spacing on if statements
Paul Cruz [Fri, 16 Jun 2017 00:03:59 +0000 (17:03 -0700)]
added const
Paul Cruz [Fri, 16 Jun 2017 00:00:59 +0000 (17:00 -0700)]
added case for when file is not compressed with zstd (incorrect magic number)
Paul Cruz [Thu, 15 Jun 2017 23:53:03 +0000 (16:53 -0700)]
added tests in playTest.sh
Paul Cruz [Thu, 15 Jun 2017 23:46:54 +0000 (16:46 -0700)]
Merge branch 'list' into dev