]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
8 years agominor : fix typo 741/head
Yann Collet [Thu, 29 Jun 2017 18:31:40 +0000 (11:31 -0700)] 
minor : fix typo

8 years agoZSTD_getFrameContentSize() is promoted to "stable" status
Yann Collet [Thu, 29 Jun 2017 12:18:09 +0000 (05:18 -0700)] 
ZSTD_getFrameContentSize() is promoted to "stable" status

8 years agoMerge pull request #739 from facebook/refPrefix
Yann Collet [Thu, 29 Jun 2017 11:36:03 +0000 (04:36 -0700)] 
Merge pull request #739 from facebook/refPrefix

ZSTD_refPrefix

8 years agoMerge pull request #736 from terrelln/cover-default-api
Yann Collet [Thu, 29 Jun 2017 03:25:36 +0000 (20:25 -0700)] 
Merge pull request #736 from terrelln/cover-default-api

[zdict] Make COVER the default algorithm

8 years agoMerge pull request #737 from facebook/advancedAPI2
Yann Collet [Thu, 29 Jun 2017 03:25:22 +0000 (20:25 -0700)] 
Merge pull request #737 from facebook/advancedAPI2

simplified API for *initStatic*()

8 years agorefactor ZSTD_check_compressionLevel_monotonicIncrease_memoryBudget() 739/head
Yann Collet [Thu, 29 Jun 2017 03:17:22 +0000 (20:17 -0700)] 
refactor ZSTD_check_compressionLevel_monotonicIncrease_memoryBudget()

use less macro statements
the initial version was meant to work with STATIC_ASSERT
but since it doesn't work and needs assert()
it's possible to rewrite it using normally compiled code
which is better for compiler.

Downside : the error message is less precise.
There is a DEBUGLOG(3,) to compensate.

8 years agoMerge branch 'advancedAPI2' into refPrefix
Yann Collet [Wed, 28 Jun 2017 23:35:49 +0000 (16:35 -0700)] 
Merge branch 'advancedAPI2' into refPrefix

8 years agoadded a test to ensure ZSTD_refPrefix() doesn't impact the following compression job
Yann Collet [Wed, 28 Jun 2017 23:25:13 +0000 (16:25 -0700)] 
added a test to ensure ZSTD_refPrefix() doesn't impact the following compression job

8 years agofixed -Wdeclaration-after-statement 737/head
Yann Collet [Wed, 28 Jun 2017 22:40:21 +0000 (15:40 -0700)] 
fixed -Wdeclaration-after-statement

8 years agoMerge pull request #740 from paulcruz74/dev
Yann Collet [Wed, 28 Jun 2017 22:36:36 +0000 (15:36 -0700)] 
Merge pull request #740 from paulcruz74/dev

decodecorpus.c patch

8 years agoadded function to control monotonic memory budget increase of ZSTD_defaultCParameters[0]
Yann Collet [Wed, 28 Jun 2017 22:34:56 +0000 (15:34 -0700)] 
added function to control monotonic memory budget increase of ZSTD_defaultCParameters[0]

It's a runtime test, based on assert(),
played once, on first ZSTD_getCParams() usage,
when ZSTD_DEBUG is enabled.

8 years agoadjusted compression levels to guarantee a monotonically increasing memory budget
Yann Collet [Wed, 28 Jun 2017 20:22:37 +0000 (13:22 -0700)] 
adjusted compression levels to guarantee a monotonically increasing memory budget

8 years agoremoved fnum from DISPLAY statements 740/head
Paul Cruz [Wed, 28 Jun 2017 20:00:49 +0000 (13:00 -0700)] 
removed fnum from DISPLAY statements

8 years agofixed generation of buggy test, corrected DISPLAY statements for errors
Paul Cruz [Wed, 28 Jun 2017 19:19:37 +0000 (12:19 -0700)] 
fixed generation of buggy test, corrected DISPLAY statements for errors

8 years agofixed ZSTD_refPrefix with Multithread-enabled CCtx
Yann Collet [Wed, 28 Jun 2017 18:09:43 +0000 (11:09 -0700)] 
fixed ZSTD_refPrefix with Multithread-enabled CCtx

8 years agofixed zstreamtest
Yann Collet [Wed, 28 Jun 2017 16:57:59 +0000 (09:57 -0700)] 
fixed zstreamtest

modifying compression parameters is not allowed after ZSTD_CCtx_loadDictionary()
but it is still allowed after ZSTD_refPrefix()

8 years agoMerge remote-tracking branch 'upstream/dev' into dev
Paul Cruz [Wed, 28 Jun 2017 16:45:54 +0000 (09:45 -0700)] 
Merge remote-tracking branch 'upstream/dev' into dev

8 years agocontrolled dictMode
Yann Collet [Wed, 28 Jun 2017 00:09:12 +0000 (17:09 -0700)] 
controlled dictMode

8 years agoimplemented ZSTD_refPrefix()
Yann Collet [Tue, 27 Jun 2017 22:49:12 +0000 (15:49 -0700)] 
implemented ZSTD_refPrefix()

8 years agoexposed ZSTD_MAGIC_DICTIONARY in zstd.h
Yann Collet [Tue, 27 Jun 2017 20:50:34 +0000 (13:50 -0700)] 
exposed ZSTD_MAGIC_DICTIONARY in zstd.h

makes it easier to explain ZSTD_dictMode

8 years agoadded parameter ZSTD_p_refDictContent
Yann Collet [Tue, 27 Jun 2017 18:46:39 +0000 (11:46 -0700)] 
added parameter ZSTD_p_refDictContent

8 years agoMerge pull request #735 from terrelln/xz-default
Yann Collet [Tue, 27 Jun 2017 16:42:02 +0000 (09:42 -0700)] 
Merge pull request #735 from terrelln/xz-default

[zstdcli] Support xz by default when liblzma is available

8 years ago[tests] Fix HAVE_LZMA flag 735/head
Nick Terrell [Tue, 27 Jun 2017 01:57:04 +0000 (18:57 -0700)] 
[tests] Fix HAVE_LZMA flag

8 years ago[zdict] Make COVER the default algorithm 736/head
Nick Terrell [Tue, 27 Jun 2017 04:07:14 +0000 (21:07 -0700)] 
[zdict] Make COVER the default algorithm

8 years agofixed minor conversion warning
Yann Collet [Tue, 27 Jun 2017 01:02:23 +0000 (18:02 -0700)] 
fixed minor conversion warning

8 years agoMerge pull request #729 from paulcruz74/corpus
Yann Collet [Tue, 27 Jun 2017 00:47:28 +0000 (17:47 -0700)] 
Merge pull request #729 from paulcruz74/corpus

Corpus

8 years agorefactored ZSTD_estimateDStreamSize()
Yann Collet [Tue, 27 Jun 2017 00:44:26 +0000 (17:44 -0700)] 
refactored ZSTD_estimateDStreamSize()

now uses windowSize as argument.
Also : created ZSTD_estimateDStreamSize_fromFrame()

8 years agoZSTD_estimateCDictSize_advanced()
Yann Collet [Mon, 26 Jun 2017 23:47:32 +0000 (16:47 -0700)] 
ZSTD_estimateCDictSize_advanced()

ZSTD_estimateCDictSize() now uses same arguments as ZSTD_createCDict()
ZSTD_estimateCDictSize_advanced() uses same arguments as ZSTD_createCDict_advanced()

8 years agoZSTD_estimateCStreamSize_advanced()
Yann Collet [Mon, 26 Jun 2017 23:02:25 +0000 (16:02 -0700)] 
ZSTD_estimateCStreamSize_advanced()

8 years agoZSTD_estimateCCtx_advanced()
Yann Collet [Mon, 26 Jun 2017 22:52:39 +0000 (15:52 -0700)] 
ZSTD_estimateCCtx_advanced()

ZSTD_estimateCCtx() is now a "simple" function,
taking int compressionLevel as single argument.

ZSTD_estimateCCtx_advanced() takes a CParams argument,
which is both more complete and more complex to generate.

8 years ago[zstdcli] Document HAVE_LZMA and zstd-noxz
Nick Terrell [Mon, 26 Jun 2017 18:25:00 +0000 (11:25 -0700)] 
[zstdcli] Document HAVE_LZMA and zstd-noxz

8 years ago[zstdcli] Add unlzma and unxz symlinks
Nick Terrell [Mon, 26 Jun 2017 18:24:36 +0000 (11:24 -0700)] 
[zstdcli] Add unlzma and unxz symlinks

8 years ago[zstdcli] Disable lzma support for MSAN testing
Nick Terrell [Mon, 26 Jun 2017 18:23:56 +0000 (11:23 -0700)] 
[zstdcli] Disable lzma support for MSAN testing

8 years agoMerge pull request #4 from facebook/dev
Paul Cruz [Mon, 26 Jun 2017 16:24:13 +0000 (09:24 -0700)] 
Merge pull request #4 from facebook/dev

pull from facebook/zstd

8 years ago[zstdcli] Support xz by default when liblzma is available
Nick Terrell [Fri, 23 Jun 2017 23:54:16 +0000 (16:54 -0700)] 
[zstdcli] Support xz by default when liblzma is available

8 years agoadded cli tests to test-all 729/head
Paul Cruz [Sat, 24 Jun 2017 00:10:41 +0000 (17:10 -0700)] 
added cli tests to test-all

8 years agoadded additional condition so large offsets into the dictionary are not generated...
Paul Cruz [Fri, 23 Jun 2017 22:54:51 +0000 (15:54 -0700)] 
added additional condition so large offsets into the dictionary are not generated past windowSize

8 years agoMerge pull request #733 from terrelln/pzstd-deadlock
Yann Collet [Fri, 23 Jun 2017 21:18:55 +0000 (14:18 -0700)] 
Merge pull request #733 from terrelln/pzstd-deadlock

[pzstd] Fix potential deadlock in the case of errors

8 years agofixed bug detected by the API test
Paul Cruz [Fri, 23 Jun 2017 20:44:24 +0000 (13:44 -0700)] 
fixed bug detected by the API test

8 years agotype warnings
Paul Cruz [Fri, 23 Jun 2017 19:00:48 +0000 (12:00 -0700)] 
type warnings

8 years agofixed bus error bug
Paul Cruz [Fri, 23 Jun 2017 18:22:29 +0000 (11:22 -0700)] 
fixed bus error bug

8 years agoMerge pull request #725 from facebook/advancedAPI2
Yann Collet [Fri, 23 Jun 2017 16:50:47 +0000 (09:50 -0700)] 
Merge pull request #725 from facebook/advancedAPI2

New Advanced API

8 years ago--no-big-tests for msan 725/head
Yann Collet [Fri, 23 Jun 2017 07:37:15 +0000 (00:37 -0700)] 
--no-big-tests for msan

msan tests require too much RAM for 2 GB VM

8 years agoMerge branch 'advancedAPI2' of github.com:facebook/zstd into advancedAPI2
Yann Collet [Fri, 23 Jun 2017 07:13:03 +0000 (00:13 -0700)] 
Merge branch 'advancedAPI2' of github.com:facebook/zstd into advancedAPI2

8 years agozstreamtest : disabled multi-threading tests with --newapi --no-big-tests
Yann Collet [Fri, 23 Jun 2017 07:09:02 +0000 (00:09 -0700)] 
zstreamtest : disabled multi-threading tests with --newapi --no-big-tests

--no-big-tests is typically used in combination with qemu-user-static
qemu-user-static allocated 4 GB of RAM upfront.
On 2 GB VM, this can degenerate into a crash.
It's not a problem as long as memory is not used.
But with multi-threading enabled, memory fragmentation kicks in,
so the amoung of RAM effectively touched increases,
and can pass beyond the 2 GB limit of the VM.

In single-threaded mode, there is no such issue :
memory requirement is smaller, and remains well-located,
so very little fragmentation is expected.

This modification should make `qemu-arm-static zstreamtests --newapi --no-big-tests`
work fine on Travis CI.

8 years ago[pzstd] Fix deadlock in the case of errors 733/head
Nick Terrell [Fri, 23 Jun 2017 01:09:42 +0000 (18:09 -0700)] 
[pzstd] Fix deadlock in the case of errors

Fixes #720.

8 years agoadded sizeof for clarity
Paul Cruz [Thu, 22 Jun 2017 22:52:33 +0000 (15:52 -0700)] 
added sizeof for clarity

8 years agochanged makefile test
Paul Cruz [Thu, 22 Jun 2017 22:44:01 +0000 (15:44 -0700)] 
changed makefile test

8 years agochanged assignment
Paul Cruz [Thu, 22 Jun 2017 22:36:28 +0000 (15:36 -0700)] 
changed assignment

8 years agoadded description for dictionary cli tests
Paul Cruz [Thu, 22 Jun 2017 22:23:59 +0000 (15:23 -0700)] 
added description for dictionary cli tests

8 years agomade changes to cli test so it runs properly
Paul Cruz [Thu, 22 Jun 2017 22:13:41 +0000 (15:13 -0700)] 
made changes to cli test so it runs properly

8 years agoadded cli test for decodecorpus inside tests/Makefile. Also changed calculation of...
Paul Cruz [Thu, 22 Jun 2017 21:43:44 +0000 (14:43 -0700)] 
added cli test for decodecorpus inside tests/Makefile. Also changed calculation of offset

8 years agoadded cli test case in Makefile
Paul Cruz [Thu, 22 Jun 2017 20:53:39 +0000 (13:53 -0700)] 
added cli test case in Makefile

8 years agoshould be updating seed whenever multiple files are generated
Paul Cruz [Thu, 22 Jun 2017 17:23:36 +0000 (10:23 -0700)] 
should be updating seed whenever multiple files are generated

8 years agochanged format of command to --use-dict=#
Paul Cruz [Thu, 22 Jun 2017 17:04:14 +0000 (10:04 -0700)] 
changed format of command to --use-dict=#

8 years agoMerge pull request #732 from terrelln/dev
Yann Collet [Thu, 22 Jun 2017 06:46:54 +0000 (23:46 -0700)] 
Merge pull request #732 from terrelln/dev

[linux] Update patches

8 years agoreduced --no-big-tests even more
Yann Collet [Thu, 22 Jun 2017 06:35:58 +0000 (23:35 -0700)] 
reduced --no-big-tests even more

to pass tests on qemu-aarch64

8 years ago[linux] Write all the patch summaries 732/head
Nick Terrell [Thu, 22 Jun 2017 03:23:44 +0000 (20:23 -0700)] 
[linux] Write all the patch summaries

8 years agofixed offset in this case os that it always goes past src start
Paul Cruz [Thu, 22 Jun 2017 01:47:40 +0000 (18:47 -0700)] 
fixed offset in this case os that it always goes past src start

8 years agofixed minor cast warning
Yann Collet [Thu, 22 Jun 2017 01:43:39 +0000 (18:43 -0700)] 
fixed minor cast warning

8 years agomore meaningful names for count variables
Paul Cruz [Thu, 22 Jun 2017 01:30:27 +0000 (18:30 -0700)] 
more meaningful names for count variables

8 years agomalloc samples instead of static allocation
Paul Cruz [Thu, 22 Jun 2017 01:24:19 +0000 (18:24 -0700)] 
malloc samples instead of static allocation

8 years agoreduced CLevelMax for --no-big-tests
Yann Collet [Thu, 22 Jun 2017 01:20:02 +0000 (18:20 -0700)] 
reduced CLevelMax for --no-big-tests

8 years agoremoved comment regarding windowSize requirement
Paul Cruz [Thu, 22 Jun 2017 01:13:52 +0000 (18:13 -0700)] 
removed comment regarding windowSize requirement

8 years agoremoved requirement that offset be less than windowSize
Paul Cruz [Thu, 22 Jun 2017 01:00:47 +0000 (18:00 -0700)] 
removed requirement that offset be less than windowSize

8 years ago--no-big-tests for zstreamtest
Yann Collet [Thu, 22 Jun 2017 00:57:14 +0000 (17:57 -0700)] 
--no-big-tests for zstreamtest

Apply --no-big-tests for tsan tests

8 years agoadded const x2
Paul Cruz [Thu, 22 Jun 2017 00:48:37 +0000 (17:48 -0700)] 
added const x2

8 years agoadded const
Paul Cruz [Thu, 22 Jun 2017 00:48:01 +0000 (17:48 -0700)] 
added const

8 years agogot rid of unnecessary casting to void*
Paul Cruz [Thu, 22 Jun 2017 00:46:37 +0000 (17:46 -0700)] 
got rid of unnecessary casting to void*

8 years agoadded comment addressing use of bits in frame header descriptor
Paul Cruz [Thu, 22 Jun 2017 00:43:21 +0000 (17:43 -0700)] 
added comment addressing use of bits in frame header descriptor

8 years agoadd controls over streaming buffers
Yann Collet [Thu, 22 Jun 2017 00:25:01 +0000 (17:25 -0700)] 
add controls over streaming buffers

8 years agoadded --list command contrib by @paulcruz74
Yann Collet [Wed, 21 Jun 2017 22:58:36 +0000 (15:58 -0700)] 
added --list command contrib by @paulcruz74

8 years agoMerge pull request #730 from paulcruz74/dev
Yann Collet [Wed, 21 Jun 2017 22:56:05 +0000 (15:56 -0700)] 
Merge pull request #730 from paulcruz74/dev

Patching ratio and non-existent file bugs

8 years agofixed : decompression of skippable frames in streaming mode
Yann Collet [Wed, 21 Jun 2017 22:53:42 +0000 (15:53 -0700)] 
fixed : decompression of skippable frames in streaming mode

8 years ago[linux] Rename last 2 diffs to patch names
Nick Terrell [Wed, 21 Jun 2017 22:21:25 +0000 (15:21 -0700)] 
[linux] Rename last 2 diffs to patch names

8 years ago[linux] Add summaries to xxhash and zstd patches
Nick Terrell [Wed, 21 Jun 2017 22:19:54 +0000 (15:19 -0700)] 
[linux] Add summaries to xxhash and zstd patches

8 years ago[linux] Rename diffs to patch names
Nick Terrell [Wed, 21 Jun 2017 22:10:18 +0000 (15:10 -0700)] 
[linux] Rename diffs to patch names

8 years ago[linux] Switch BtrFS compression level to 1
Nick Terrell [Wed, 21 Jun 2017 22:08:26 +0000 (15:08 -0700)] 
[linux] Switch BtrFS compression level to 1

8 years agoswitched fileio.c to ZSTD_DEBUG trigger macro
Yann Collet [Wed, 21 Jun 2017 22:16:13 +0000 (15:16 -0700)] 
switched fileio.c to ZSTD_DEBUG trigger macro

8 years agofixed streaming buffered allocation with CDict compression
Yann Collet [Wed, 21 Jun 2017 22:13:00 +0000 (15:13 -0700)] 
fixed streaming buffered allocation with CDict compression

8 years agofixed dangling pointer risk, detected by @terrelln
Yann Collet [Wed, 21 Jun 2017 20:26:10 +0000 (13:26 -0700)] 
fixed dangling pointer risk, detected by @terrelln

8 years agoMerge pull request #3 from facebook/dev 730/head
Paul Cruz [Wed, 21 Jun 2017 19:42:38 +0000 (12:42 -0700)] 
Merge pull request #3 from facebook/dev

pulling changes

8 years agoadded newline to align output
Paul Cruz [Wed, 21 Jun 2017 19:41:10 +0000 (12:41 -0700)] 
added newline to align output

8 years agoadded error check for when file could not be opened
Paul Cruz [Wed, 21 Jun 2017 19:37:23 +0000 (12:37 -0700)] 
added error check for when file could not be opened

8 years agoreversed calculation of ratio
Paul Cruz [Wed, 21 Jun 2017 19:27:20 +0000 (12:27 -0700)] 
reversed calculation of ratio

8 years agofree cdictLocal faster, suggested by @terrelln
Yann Collet [Wed, 21 Jun 2017 19:26:40 +0000 (12:26 -0700)] 
free cdictLocal faster, suggested by @terrelln

8 years agoadded test cases for new command --list
Yann Collet [Wed, 21 Jun 2017 19:09:53 +0000 (12:09 -0700)] 
added test cases for new command --list

8 years agoadded ZSTD_dictMode_e to control dictionary loading mode
Yann Collet [Wed, 21 Jun 2017 18:50:33 +0000 (11:50 -0700)] 
added ZSTD_dictMode_e to control dictionary loading mode

8 years agoMerge pull request #723 from paulcruz74/dev
Yann Collet [Wed, 21 Jun 2017 16:41:55 +0000 (09:41 -0700)] 
Merge pull request #723 from paulcruz74/dev

Adding zstd -l

8 years agofixed memcpy() overlap
Yann Collet [Wed, 21 Jun 2017 00:44:55 +0000 (17:44 -0700)] 
fixed memcpy() overlap

8 years agoadded test for files with no frame content size 723/head
Paul Cruz [Wed, 21 Jun 2017 00:43:36 +0000 (17:43 -0700)] 
added test for files with no frame content size

8 years agoremoved one useless streaming compression stage, detected by @terrelln
Yann Collet [Tue, 20 Jun 2017 23:25:29 +0000 (16:25 -0700)] 
removed one useless streaming compression stage, detected by @terrelln

8 years agofixed potential dangling pointer, detected by @terrelln
Yann Collet [Tue, 20 Jun 2017 23:09:11 +0000 (16:09 -0700)] 
fixed potential dangling pointer, detected by @terrelln

8 years agofixed strange spacing
Paul Cruz [Tue, 20 Jun 2017 22:41:43 +0000 (15:41 -0700)] 
fixed strange spacing

8 years agofree the context object once done with decompression
Paul Cruz [Tue, 20 Jun 2017 22:37:14 +0000 (15:37 -0700)] 
free the context object once done with decompression

8 years agoallocate statically so we don't have to deal with freeing
Paul Cruz [Tue, 20 Jun 2017 22:31:54 +0000 (15:31 -0700)] 
allocate statically so we don't have to deal with freeing

8 years agoadded tests with null files, changed condition to check that the file is more than...
Paul Cruz [Tue, 20 Jun 2017 21:33:08 +0000 (14:33 -0700)] 
added tests with null files, changed condition to check that the file is more than 0 bytes

8 years agofixed comments, following suggestion by @terrelln
Yann Collet [Tue, 20 Jun 2017 21:26:48 +0000 (14:26 -0700)] 
fixed comments, following suggestion by @terrelln

8 years agospacing matters for test scripts
Paul Cruz [Tue, 20 Jun 2017 21:14:53 +0000 (14:14 -0700)] 
spacing matters for test scripts

8 years agoensure new ZSTD_strategy starts at value 1
Yann Collet [Tue, 20 Jun 2017 21:11:49 +0000 (14:11 -0700)] 
ensure new ZSTD_strategy starts at value 1