]>
git.ipfire.org Git - thirdparty/zstd.git/log
Yann Collet [Thu, 29 Jun 2017 18:31:40 +0000 (11:31 -0700)]
minor : fix typo
Yann Collet [Thu, 29 Jun 2017 12:18:09 +0000 (05:18 -0700)]
ZSTD_getFrameContentSize() is promoted to "stable" status
Yann Collet [Thu, 29 Jun 2017 11:36:03 +0000 (04:36 -0700)]
Merge pull request #739 from facebook/refPrefix
ZSTD_refPrefix
Yann Collet [Thu, 29 Jun 2017 03:25:36 +0000 (20:25 -0700)]
Merge pull request #736 from terrelln/cover-default-api
[zdict] Make COVER the default algorithm
Yann Collet [Thu, 29 Jun 2017 03:25:22 +0000 (20:25 -0700)]
Merge pull request #737 from facebook/advancedAPI2
simplified API for *initStatic*()
Yann Collet [Thu, 29 Jun 2017 03:17:22 +0000 (20:17 -0700)]
refactor ZSTD_check_compressionLevel_monotonicIncrease_memoryBudget()
use less macro statements
the initial version was meant to work with STATIC_ASSERT
but since it doesn't work and needs assert()
it's possible to rewrite it using normally compiled code
which is better for compiler.
Downside : the error message is less precise.
There is a DEBUGLOG(3,) to compensate.
Yann Collet [Wed, 28 Jun 2017 23:35:49 +0000 (16:35 -0700)]
Merge branch 'advancedAPI2' into refPrefix
Yann Collet [Wed, 28 Jun 2017 23:25:13 +0000 (16:25 -0700)]
added a test to ensure ZSTD_refPrefix() doesn't impact the following compression job
Yann Collet [Wed, 28 Jun 2017 22:40:21 +0000 (15:40 -0700)]
fixed -Wdeclaration-after-statement
Yann Collet [Wed, 28 Jun 2017 22:36:36 +0000 (15:36 -0700)]
Merge pull request #740 from paulcruz74/dev
decodecorpus.c patch
Yann Collet [Wed, 28 Jun 2017 22:34:56 +0000 (15:34 -0700)]
added function to control monotonic memory budget increase of ZSTD_defaultCParameters[0]
It's a runtime test, based on assert(),
played once, on first ZSTD_getCParams() usage,
when ZSTD_DEBUG is enabled.
Yann Collet [Wed, 28 Jun 2017 20:22:37 +0000 (13:22 -0700)]
adjusted compression levels to guarantee a monotonically increasing memory budget
Paul Cruz [Wed, 28 Jun 2017 20:00:49 +0000 (13:00 -0700)]
removed fnum from DISPLAY statements
Paul Cruz [Wed, 28 Jun 2017 19:19:37 +0000 (12:19 -0700)]
fixed generation of buggy test, corrected DISPLAY statements for errors
Yann Collet [Wed, 28 Jun 2017 18:09:43 +0000 (11:09 -0700)]
fixed ZSTD_refPrefix with Multithread-enabled CCtx
Yann Collet [Wed, 28 Jun 2017 16:57:59 +0000 (09:57 -0700)]
fixed zstreamtest
modifying compression parameters is not allowed after ZSTD_CCtx_loadDictionary()
but it is still allowed after ZSTD_refPrefix()
Paul Cruz [Wed, 28 Jun 2017 16:45:54 +0000 (09:45 -0700)]
Merge remote-tracking branch 'upstream/dev' into dev
Yann Collet [Wed, 28 Jun 2017 00:09:12 +0000 (17:09 -0700)]
controlled dictMode
Yann Collet [Tue, 27 Jun 2017 22:49:12 +0000 (15:49 -0700)]
implemented ZSTD_refPrefix()
Yann Collet [Tue, 27 Jun 2017 20:50:34 +0000 (13:50 -0700)]
exposed ZSTD_MAGIC_DICTIONARY in zstd.h
makes it easier to explain ZSTD_dictMode
Yann Collet [Tue, 27 Jun 2017 18:46:39 +0000 (11:46 -0700)]
added parameter ZSTD_p_refDictContent
Yann Collet [Tue, 27 Jun 2017 16:42:02 +0000 (09:42 -0700)]
Merge pull request #735 from terrelln/xz-default
[zstdcli] Support xz by default when liblzma is available
Nick Terrell [Tue, 27 Jun 2017 01:57:04 +0000 (18:57 -0700)]
[tests] Fix HAVE_LZMA flag
Nick Terrell [Tue, 27 Jun 2017 04:07:14 +0000 (21:07 -0700)]
[zdict] Make COVER the default algorithm
Yann Collet [Tue, 27 Jun 2017 01:02:23 +0000 (18:02 -0700)]
fixed minor conversion warning
Yann Collet [Tue, 27 Jun 2017 00:47:28 +0000 (17:47 -0700)]
Merge pull request #729 from paulcruz74/corpus
Corpus
Yann Collet [Tue, 27 Jun 2017 00:44:26 +0000 (17:44 -0700)]
refactored ZSTD_estimateDStreamSize()
now uses windowSize as argument.
Also : created ZSTD_estimateDStreamSize_fromFrame()
Yann Collet [Mon, 26 Jun 2017 23:47:32 +0000 (16:47 -0700)]
ZSTD_estimateCDictSize_advanced()
ZSTD_estimateCDictSize() now uses same arguments as ZSTD_createCDict()
ZSTD_estimateCDictSize_advanced() uses same arguments as ZSTD_createCDict_advanced()
Yann Collet [Mon, 26 Jun 2017 23:02:25 +0000 (16:02 -0700)]
ZSTD_estimateCStreamSize_advanced()
Yann Collet [Mon, 26 Jun 2017 22:52:39 +0000 (15:52 -0700)]
ZSTD_estimateCCtx_advanced()
ZSTD_estimateCCtx() is now a "simple" function,
taking int compressionLevel as single argument.
ZSTD_estimateCCtx_advanced() takes a CParams argument,
which is both more complete and more complex to generate.
Nick Terrell [Mon, 26 Jun 2017 18:25:00 +0000 (11:25 -0700)]
[zstdcli] Document HAVE_LZMA and zstd-noxz
Nick Terrell [Mon, 26 Jun 2017 18:24:36 +0000 (11:24 -0700)]
[zstdcli] Add unlzma and unxz symlinks
Nick Terrell [Mon, 26 Jun 2017 18:23:56 +0000 (11:23 -0700)]
[zstdcli] Disable lzma support for MSAN testing
Paul Cruz [Mon, 26 Jun 2017 16:24:13 +0000 (09:24 -0700)]
Merge pull request #4 from facebook/dev
pull from facebook/zstd
Nick Terrell [Fri, 23 Jun 2017 23:54:16 +0000 (16:54 -0700)]
[zstdcli] Support xz by default when liblzma is available
Paul Cruz [Sat, 24 Jun 2017 00:10:41 +0000 (17:10 -0700)]
added cli tests to test-all
Paul Cruz [Fri, 23 Jun 2017 22:54:51 +0000 (15:54 -0700)]
added additional condition so large offsets into the dictionary are not generated past windowSize
Yann Collet [Fri, 23 Jun 2017 21:18:55 +0000 (14:18 -0700)]
Merge pull request #733 from terrelln/pzstd-deadlock
[pzstd] Fix potential deadlock in the case of errors
Paul Cruz [Fri, 23 Jun 2017 20:44:24 +0000 (13:44 -0700)]
fixed bug detected by the API test
Paul Cruz [Fri, 23 Jun 2017 19:00:48 +0000 (12:00 -0700)]
type warnings
Paul Cruz [Fri, 23 Jun 2017 18:22:29 +0000 (11:22 -0700)]
fixed bus error bug
Yann Collet [Fri, 23 Jun 2017 16:50:47 +0000 (09:50 -0700)]
Merge pull request #725 from facebook/advancedAPI2
New Advanced API
Yann Collet [Fri, 23 Jun 2017 07:37:15 +0000 (00:37 -0700)]
--no-big-tests for msan
msan tests require too much RAM for 2 GB VM
Yann Collet [Fri, 23 Jun 2017 07:13:03 +0000 (00:13 -0700)]
Merge branch 'advancedAPI2' of github.com:facebook/zstd into advancedAPI2
Yann Collet [Fri, 23 Jun 2017 07:09:02 +0000 (00:09 -0700)]
zstreamtest : disabled multi-threading tests with --newapi --no-big-tests
--no-big-tests is typically used in combination with qemu-user-static
qemu-user-static allocated 4 GB of RAM upfront.
On 2 GB VM, this can degenerate into a crash.
It's not a problem as long as memory is not used.
But with multi-threading enabled, memory fragmentation kicks in,
so the amoung of RAM effectively touched increases,
and can pass beyond the 2 GB limit of the VM.
In single-threaded mode, there is no such issue :
memory requirement is smaller, and remains well-located,
so very little fragmentation is expected.
This modification should make `qemu-arm-static zstreamtests --newapi --no-big-tests`
work fine on Travis CI.
Nick Terrell [Fri, 23 Jun 2017 01:09:42 +0000 (18:09 -0700)]
[pzstd] Fix deadlock in the case of errors
Fixes #720.
Paul Cruz [Thu, 22 Jun 2017 22:52:33 +0000 (15:52 -0700)]
added sizeof for clarity
Paul Cruz [Thu, 22 Jun 2017 22:44:01 +0000 (15:44 -0700)]
changed makefile test
Paul Cruz [Thu, 22 Jun 2017 22:36:28 +0000 (15:36 -0700)]
changed assignment
Paul Cruz [Thu, 22 Jun 2017 22:23:59 +0000 (15:23 -0700)]
added description for dictionary cli tests
Paul Cruz [Thu, 22 Jun 2017 22:13:41 +0000 (15:13 -0700)]
made changes to cli test so it runs properly
Paul Cruz [Thu, 22 Jun 2017 21:43:44 +0000 (14:43 -0700)]
added cli test for decodecorpus inside tests/Makefile. Also changed calculation of offset
Paul Cruz [Thu, 22 Jun 2017 20:53:39 +0000 (13:53 -0700)]
added cli test case in Makefile
Paul Cruz [Thu, 22 Jun 2017 17:23:36 +0000 (10:23 -0700)]
should be updating seed whenever multiple files are generated
Paul Cruz [Thu, 22 Jun 2017 17:04:14 +0000 (10:04 -0700)]
changed format of command to --use-dict=#
Yann Collet [Thu, 22 Jun 2017 06:46:54 +0000 (23:46 -0700)]
Merge pull request #732 from terrelln/dev
[linux] Update patches
Yann Collet [Thu, 22 Jun 2017 06:35:58 +0000 (23:35 -0700)]
reduced --no-big-tests even more
to pass tests on qemu-aarch64
Nick Terrell [Thu, 22 Jun 2017 03:23:44 +0000 (20:23 -0700)]
[linux] Write all the patch summaries
Paul Cruz [Thu, 22 Jun 2017 01:47:40 +0000 (18:47 -0700)]
fixed offset in this case os that it always goes past src start
Yann Collet [Thu, 22 Jun 2017 01:43:39 +0000 (18:43 -0700)]
fixed minor cast warning
Paul Cruz [Thu, 22 Jun 2017 01:30:27 +0000 (18:30 -0700)]
more meaningful names for count variables
Paul Cruz [Thu, 22 Jun 2017 01:24:19 +0000 (18:24 -0700)]
malloc samples instead of static allocation
Yann Collet [Thu, 22 Jun 2017 01:20:02 +0000 (18:20 -0700)]
reduced CLevelMax for --no-big-tests
Paul Cruz [Thu, 22 Jun 2017 01:13:52 +0000 (18:13 -0700)]
removed comment regarding windowSize requirement
Paul Cruz [Thu, 22 Jun 2017 01:00:47 +0000 (18:00 -0700)]
removed requirement that offset be less than windowSize
Yann Collet [Thu, 22 Jun 2017 00:57:14 +0000 (17:57 -0700)]
--no-big-tests for zstreamtest
Apply --no-big-tests for tsan tests
Paul Cruz [Thu, 22 Jun 2017 00:48:37 +0000 (17:48 -0700)]
added const x2
Paul Cruz [Thu, 22 Jun 2017 00:48:01 +0000 (17:48 -0700)]
added const
Paul Cruz [Thu, 22 Jun 2017 00:46:37 +0000 (17:46 -0700)]
got rid of unnecessary casting to void*
Paul Cruz [Thu, 22 Jun 2017 00:43:21 +0000 (17:43 -0700)]
added comment addressing use of bits in frame header descriptor
Yann Collet [Thu, 22 Jun 2017 00:25:01 +0000 (17:25 -0700)]
add controls over streaming buffers
Yann Collet [Wed, 21 Jun 2017 22:58:36 +0000 (15:58 -0700)]
added --list command contrib by @paulcruz74
Yann Collet [Wed, 21 Jun 2017 22:56:05 +0000 (15:56 -0700)]
Merge pull request #730 from paulcruz74/dev
Patching ratio and non-existent file bugs
Yann Collet [Wed, 21 Jun 2017 22:53:42 +0000 (15:53 -0700)]
fixed : decompression of skippable frames in streaming mode
Nick Terrell [Wed, 21 Jun 2017 22:21:25 +0000 (15:21 -0700)]
[linux] Rename last 2 diffs to patch names
Nick Terrell [Wed, 21 Jun 2017 22:19:54 +0000 (15:19 -0700)]
[linux] Add summaries to xxhash and zstd patches
Nick Terrell [Wed, 21 Jun 2017 22:10:18 +0000 (15:10 -0700)]
[linux] Rename diffs to patch names
Nick Terrell [Wed, 21 Jun 2017 22:08:26 +0000 (15:08 -0700)]
[linux] Switch BtrFS compression level to 1
Yann Collet [Wed, 21 Jun 2017 22:16:13 +0000 (15:16 -0700)]
switched fileio.c to ZSTD_DEBUG trigger macro
Yann Collet [Wed, 21 Jun 2017 22:13:00 +0000 (15:13 -0700)]
fixed streaming buffered allocation with CDict compression
Yann Collet [Wed, 21 Jun 2017 20:26:10 +0000 (13:26 -0700)]
fixed dangling pointer risk, detected by @terrelln
Paul Cruz [Wed, 21 Jun 2017 19:42:38 +0000 (12:42 -0700)]
Merge pull request #3 from facebook/dev
pulling changes
Paul Cruz [Wed, 21 Jun 2017 19:41:10 +0000 (12:41 -0700)]
added newline to align output
Paul Cruz [Wed, 21 Jun 2017 19:37:23 +0000 (12:37 -0700)]
added error check for when file could not be opened
Paul Cruz [Wed, 21 Jun 2017 19:27:20 +0000 (12:27 -0700)]
reversed calculation of ratio
Yann Collet [Wed, 21 Jun 2017 19:26:40 +0000 (12:26 -0700)]
free cdictLocal faster, suggested by @terrelln
Yann Collet [Wed, 21 Jun 2017 19:09:53 +0000 (12:09 -0700)]
added test cases for new command --list
Yann Collet [Wed, 21 Jun 2017 18:50:33 +0000 (11:50 -0700)]
added ZSTD_dictMode_e to control dictionary loading mode
Yann Collet [Wed, 21 Jun 2017 16:41:55 +0000 (09:41 -0700)]
Merge pull request #723 from paulcruz74/dev
Adding zstd -l
Yann Collet [Wed, 21 Jun 2017 00:44:55 +0000 (17:44 -0700)]
fixed memcpy() overlap
Paul Cruz [Wed, 21 Jun 2017 00:43:36 +0000 (17:43 -0700)]
added test for files with no frame content size
Yann Collet [Tue, 20 Jun 2017 23:25:29 +0000 (16:25 -0700)]
removed one useless streaming compression stage, detected by @terrelln
Yann Collet [Tue, 20 Jun 2017 23:09:11 +0000 (16:09 -0700)]
fixed potential dangling pointer, detected by @terrelln
Paul Cruz [Tue, 20 Jun 2017 22:41:43 +0000 (15:41 -0700)]
fixed strange spacing
Paul Cruz [Tue, 20 Jun 2017 22:37:14 +0000 (15:37 -0700)]
free the context object once done with decompression
Paul Cruz [Tue, 20 Jun 2017 22:31:54 +0000 (15:31 -0700)]
allocate statically so we don't have to deal with freeing
Paul Cruz [Tue, 20 Jun 2017 21:33:08 +0000 (14:33 -0700)]
added tests with null files, changed condition to check that the file is more than 0 bytes
Yann Collet [Tue, 20 Jun 2017 21:26:48 +0000 (14:26 -0700)]
fixed comments, following suggestion by @terrelln
Paul Cruz [Tue, 20 Jun 2017 21:14:53 +0000 (14:14 -0700)]
spacing matters for test scripts
Yann Collet [Tue, 20 Jun 2017 21:11:49 +0000 (14:11 -0700)]
ensure new ZSTD_strategy starts at value 1