]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
7 years agoFix implicit conversion error 842/head
Stella Lau [Wed, 13 Sep 2017 23:01:16 +0000 (16:01 -0700)] 
Fix implicit conversion error

7 years agoAdd flag to limit max decompressed size in decodeCorpus
Stella Lau [Wed, 13 Sep 2017 22:07:03 +0000 (15:07 -0700)] 
Add flag to limit max decompressed size in decodeCorpus

7 years agoMerge pull request #841 from facebook/utilTimeAPI
Yann Collet [Wed, 13 Sep 2017 18:41:01 +0000 (11:41 -0700)] 
Merge pull request #841 from facebook/utilTimeAPI

modified util::time API (T19505791)

7 years agoMerge pull request #840 from stellamplau/decodeCorpus-blocks
Yann Collet [Wed, 13 Sep 2017 16:34:04 +0000 (09:34 -0700)] 
Merge pull request #840 from stellamplau/decodeCorpus-blocks

Make decodecorpus generate raw compressed blocks

7 years agoblindfix for Visual 841/head
Yann Collet [Wed, 13 Sep 2017 04:21:17 +0000 (21:21 -0700)] 
blindfix for Visual

LARGE_INTEGER is not an integer :
https://msdn.microsoft.com/en-us/library/windows/desktop/aa383713(v=vs.85).aspx

Do not take any risk with the structure definition :
use int init = 0; like Mac code

7 years agofixed minor prototype warning
Yann Collet [Wed, 13 Sep 2017 02:32:26 +0000 (19:32 -0700)] 
fixed minor prototype warning

7 years agomodified util::time API
Yann Collet [Wed, 13 Sep 2017 01:12:46 +0000 (18:12 -0700)] 
modified util::time API

for easier invocation.
- no longer expose frequency timer :
it's either useless, or stored internally in a static variable (init is only necessary once).
- UTIL_getTime() provides result by function return.

7 years agoMake decodecorpus generate raw compressed blocks 840/head
Stella Lau [Tue, 12 Sep 2017 21:29:39 +0000 (14:29 -0700)] 
Make decodecorpus generate raw compressed blocks

7 years agoMerge pull request #839 from terrelln/timer
Yann Collet [Wed, 13 Sep 2017 00:13:52 +0000 (17:13 -0700)] 
Merge pull request #839 from terrelln/timer

[bench] Use higher resolution timer on POSIX

7 years agoMerge pull request #837 from facebook/libzstd-nomt
Yann Collet [Wed, 13 Sep 2017 00:13:17 +0000 (17:13 -0700)] 
Merge pull request #837 from facebook/libzstd-nomt

makes it possible to compile libzstd in single-thread mode without zs…

7 years ago[bench] Use higher resolution timer on POSIX 839/head
Nick Terrell [Tue, 12 Sep 2017 20:09:08 +0000 (13:09 -0700)] 
[bench] Use higher resolution timer on POSIX

The timer used was only accurate up to 0.01 seconds. This timer is accurate up to 1 ns.
It is a monotonic timer that measures the real time difference, not on CPU time.

7 years agoMerge pull request #836 from facebook/decodingBufferSizeMin
Yann Collet [Mon, 11 Sep 2017 23:20:40 +0000 (16:20 -0700)] 
Merge pull request #836 from facebook/decodingBufferSizeMin

Decoding buffer size min

7 years agofix #820 : GCC v3.x 32-bits doesn't define 64-bits intrinsic 837/head
Yann Collet [Mon, 11 Sep 2017 22:17:31 +0000 (15:17 -0700)] 
fix #820 : GCC v3.x 32-bits doesn't define 64-bits intrinsic

resulting in undefined symbol error.
Push the requirement to GCC 4 for now.
Another solution, proposed by @NWilson, is to use __LONG_MAX__ instead.
__LONG_MAX__ is a GCC-specific constant, which value is supposed to depend on underlying target hardware (32/64 bits)
Might be better, but seems also more complex, hence more prone to side effects.
Keeping the simple solution for now (just rely on __GNUC__)

7 years agofixed pass-through warning
Yann Collet [Mon, 11 Sep 2017 21:37:03 +0000 (14:37 -0700)] 
fixed pass-through warning

7 years agomakes it possible to compile libzstd in single-thread mode without zstdmt_compress...
Yann Collet [Mon, 11 Sep 2017 21:09:34 +0000 (14:09 -0700)] 
makes it possible to compile libzstd in single-thread mode without zstdmt_compress.c (#819)

7 years agofix following suggestions by @terrelln 836/head
Yann Collet [Mon, 11 Sep 2017 20:12:52 +0000 (13:12 -0700)] 
fix following suggestions by @terrelln

7 years agouse ZSTD_decodingBufferSize_min() inside ZSTD_decompressStream()
Yann Collet [Sat, 9 Sep 2017 21:37:28 +0000 (14:37 -0700)] 
use ZSTD_decodingBufferSize_min() inside ZSTD_decompressStream()

Use same definition as public one
minor : reduce allocated buffer size in some cases
(when frameContentSize is known and == windowSize)

7 years agoZSTD_decodingBufferSize_min()
Yann Collet [Sat, 9 Sep 2017 08:03:29 +0000 (01:03 -0700)] 
ZSTD_decodingBufferSize_min()

supporting function for bufferless streaming API (ZSTD_decompressContinue())
makes it possible to correctly size a round buffer for decoding using this API.

also : added field blockSizeMax within ZSTD_frameHeader,
as it's a necessary information to know when to restart at beginning of decoding buffer.

7 years agoupdated license header
Yann Collet [Fri, 8 Sep 2017 07:09:23 +0000 (00:09 -0700)] 
updated license header

to clarify dual-license meaning as "or"

7 years agoprograms/Makefile : better support for GNU conventions
Yann Collet [Wed, 6 Sep 2017 23:53:59 +0000 (16:53 -0700)] 
programs/Makefile : better support for GNU conventions

see https://www.gnu.org/prep/standards/html_node/Command-Variables.html

7 years agolib/Makefile : better support for GNU conventions
Yann Collet [Wed, 6 Sep 2017 23:35:49 +0000 (16:35 -0700)] 
lib/Makefile : better support for GNU conventions

see https://www.gnu.org/prep/standards/html_node/Makefile-Conventions.html

7 years agoupdate README on BUCK file
Yann Collet [Wed, 6 Sep 2017 23:23:39 +0000 (16:23 -0700)] 
update README on BUCK file

7 years agoupdate and clarify lib/README
Yann Collet [Wed, 6 Sep 2017 23:15:18 +0000 (16:15 -0700)] 
update and clarify lib/README

7 years agoMerge pull request #834 from stellamplau/regressionDriverFix
Yann Collet [Wed, 6 Sep 2017 17:02:46 +0000 (10:02 -0700)] 
Merge pull request #834 from stellamplau/regressionDriverFix

Fix function name in tests/fuzz/regression_driver

7 years agoMerge pull request #831 from terrelln/split-compress
Yann Collet [Wed, 6 Sep 2017 17:01:27 +0000 (10:01 -0700)] 
Merge pull request #831 from terrelln/split-compress

Split parsers out of zstd_compress.c

7 years agoFix function name in tests/fuzz/regression_driver 834/head
Stella Lau [Wed, 6 Sep 2017 05:14:41 +0000 (22:14 -0700)] 
Fix function name in tests/fuzz/regression_driver

7 years agoUpdate build scripts 831/head
Nick Terrell [Sat, 2 Sep 2017 01:22:31 +0000 (18:22 -0700)] 
Update build scripts

7 years agoSplit parsers out of zstd_compress.c
Nick Terrell [Sat, 2 Sep 2017 01:28:35 +0000 (18:28 -0700)] 
Split parsers out of zstd_compress.c

7 years agoMerge pull request #833 from stellamplau/copyCCtxFix
Yann Collet [Tue, 5 Sep 2017 23:55:21 +0000 (16:55 -0700)] 
Merge pull request #833 from stellamplau/copyCCtxFix

Fix parameter handling with ZSTD_copyCCtx

7 years agoFix parameter handling with ZSTD_copyCCtx 833/head
Stella Lau [Tue, 5 Sep 2017 22:34:17 +0000 (15:34 -0700)] 
Fix parameter handling with ZSTD_copyCCtx

7 years agoMerge pull request #832 from terrelln/assert
Yann Collet [Tue, 5 Sep 2017 18:23:09 +0000 (11:23 -0700)] 
Merge pull request #832 from terrelln/assert

[POOL] Allow free on NULL when multithreading is disabled

7 years ago[POOL] Allow free on NULL when multithreading is disabled 832/head
Nick Terrell [Tue, 5 Sep 2017 18:18:13 +0000 (11:18 -0700)] 
[POOL] Allow free on NULL when multithreading is disabled

7 years agoMerge pull request #829 from facebook/fix828
Yann Collet [Fri, 1 Sep 2017 21:28:52 +0000 (14:28 -0700)] 
Merge pull request #829 from facebook/fix828

fixed decompression bug reported by @Etsukata (#828)

7 years agoupdated NEWS 829/head
Yann Collet [Fri, 1 Sep 2017 18:58:37 +0000 (11:58 -0700)] 
updated NEWS

fix for 32-bits decoder

7 years agorestored 32-bits decoder ability to decode long offsets (>32 MB, levels 21+)
Yann Collet [Fri, 1 Sep 2017 18:56:57 +0000 (11:56 -0700)] 
restored 32-bits decoder ability to decode long offsets (>32 MB, levels 21+)

7 years agobench stops immediately on decoding error
Yann Collet [Fri, 1 Sep 2017 18:46:15 +0000 (11:46 -0700)] 
bench stops immediately on decoding error

7 years agoimproved decoding speed
Yann Collet [Fri, 1 Sep 2017 18:40:59 +0000 (11:40 -0700)] 
improved decoding speed

7 years agoMerge pull request #830 from Etsukata/fix-tests-fuzz-build-error
Yann Collet [Fri, 1 Sep 2017 08:22:19 +0000 (01:22 -0700)] 
Merge pull request #830 from Etsukata/fix-tests-fuzz-build-error

Fix tests/fuzz build error

7 years agotests/fuzz: change ZSTD_BLOCKSIZE_ABSOLUTEMAX into ZSTD_BLOCKSIZE_MAX 830/head
Eiichi Tsukata [Fri, 1 Sep 2017 07:35:43 +0000 (16:35 +0900)] 
tests/fuzz: change ZSTD_BLOCKSIZE_ABSOLUTEMAX into ZSTD_BLOCKSIZE_MAX

ZSTD_BLOCKSIZE_ABSOLUTEMAX is changed at the commit:
https://github.com/facebook/zstd/commit/fa3671eac7097ce4ae9a1a4c53d2d1486c29d48f

7 years agotests/fuzz: fix make all target names
Eiichi Tsukata [Fri, 1 Sep 2017 07:31:58 +0000 (16:31 +0900)] 
tests/fuzz: fix make all target names

7 years agofixed minor warning (empty translation unit)
Yann Collet [Fri, 1 Sep 2017 07:12:07 +0000 (00:12 -0700)] 
fixed minor warning (empty translation unit)

7 years agofixed decompression bug reported by @Etsukata (#828)
Yann Collet [Fri, 1 Sep 2017 07:05:37 +0000 (00:05 -0700)] 
fixed decompression bug reported by @Etsukata (#828)

7 years agoupdated zstd API manual
Yann Collet [Fri, 1 Sep 2017 01:28:19 +0000 (18:28 -0700)] 
updated zstd API manual

for new CCtxParams object

7 years agofixed impact of merge conflict for longRange
Yann Collet [Fri, 1 Sep 2017 01:25:56 +0000 (18:25 -0700)] 
fixed impact of merge conflict for longRange

7 years agoMerge branch 'longRangeMatcher' into dev 827/head
Yann Collet [Fri, 1 Sep 2017 01:08:37 +0000 (18:08 -0700)] 
Merge branch 'longRangeMatcher' into dev

7 years agoMerge branch 'modTests' into dev
Yann Collet [Fri, 1 Sep 2017 00:00:16 +0000 (17:00 -0700)] 
Merge branch 'modTests' into dev

fixed conflict

7 years agoimproved console log of utils.h
Yann Collet [Thu, 31 Aug 2017 23:58:47 +0000 (16:58 -0700)] 
improved console log of utils.h

removed a warning when compiling on Windows

7 years agoblind attempt at removing gcc dependency
Yann Collet [Thu, 31 Aug 2017 22:24:17 +0000 (15:24 -0700)] 
blind attempt at removing gcc dependency

from appveyor's mingw builds, for #815

7 years agoMerge branch 'dev' into modTests
Yann Collet [Thu, 31 Aug 2017 22:14:13 +0000 (15:14 -0700)] 
Merge branch 'dev' into modTests

7 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Thu, 31 Aug 2017 22:13:48 +0000 (15:13 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

7 years agofixed poolTests
Yann Collet [Thu, 31 Aug 2017 22:02:14 +0000 (15:02 -0700)] 
fixed poolTests

needs more dependencies from zstd for custom allocators and error codes

7 years agofixed poolTest
Yann Collet [Thu, 31 Aug 2017 22:02:14 +0000 (15:02 -0700)] 
fixed poolTest

needs more dependencies from zstd for custom allocators and error codes

7 years agochanged target allarch into allzstd
Yann Collet [Thu, 31 Aug 2017 21:30:52 +0000 (14:30 -0700)] 
changed target allarch into allzstd

allzstd contains only zstd-related tests.
allmost = allzstd + zwrapper tests (which require zlib)

7 years agoMerge pull request #826 from terrelln/license
Yann Collet [Thu, 31 Aug 2017 19:52:23 +0000 (12:52 -0700)] 
Merge pull request #826 from terrelln/license

[linux-kernel] Update license

7 years ago[linux-kernel] Update license 826/head
Nick Terrell [Thu, 31 Aug 2017 19:48:36 +0000 (12:48 -0700)] 
[linux-kernel] Update license

7 years agolast batch of header files changed to reflect new license (#825)
Yann Collet [Thu, 31 Aug 2017 19:20:50 +0000 (12:20 -0700)] 
last batch of header files changed to reflect new license (#825)

only remains to update contrib/linux-kernel (@terrelln)

7 years agofixed more file headers after license change (#825)
Yann Collet [Thu, 31 Aug 2017 19:11:57 +0000 (12:11 -0700)] 
fixed more file headers after license change (#825)

7 years agoMerge pull request #810 from stellamplau/params
Yann Collet [Thu, 31 Aug 2017 18:29:16 +0000 (11:29 -0700)] 
Merge pull request #810 from stellamplau/params

Move parameters into a single (opaque) structure

7 years agofixed a bunch of headers after license change (#825)
Yann Collet [Thu, 31 Aug 2017 18:24:54 +0000 (11:24 -0700)] 
fixed a bunch of headers after license change (#825)

7 years agoupdated NEWS
Yann Collet [Thu, 31 Aug 2017 00:44:12 +0000 (17:44 -0700)] 
updated NEWS

7 years agoPass dictMode to ZSTDMT_initCStream; fix nits 810/head
Stella Lau [Wed, 30 Aug 2017 21:36:54 +0000 (14:36 -0700)] 
Pass dictMode to ZSTDMT_initCStream; fix nits

- Return error code in estimate{CCtx,CStream}Size functions

7 years agoMerge pull request #821 from facebook/licenseExample
Yann Collet [Wed, 30 Aug 2017 21:03:50 +0000 (14:03 -0700)] 
Merge pull request #821 from facebook/licenseExample

changed license for examples

7 years agoMinor fixes; remove formatting only changes
Stella Lau [Wed, 30 Aug 2017 03:27:35 +0000 (20:27 -0700)] 
Minor fixes; remove formatting only changes

7 years agoAdd test for raw content starting with dict header
Stella Lau [Wed, 30 Aug 2017 01:36:18 +0000 (18:36 -0700)] 
Add test for raw content starting with dict header

7 years agoUse ZSTD_dm_rawContent in zstdmt_compress
Stella Lau [Wed, 30 Aug 2017 01:04:32 +0000 (18:04 -0700)] 
Use ZSTD_dm_rawContent in zstdmt_compress

7 years agoRename applyCCtxParams()
Stella Lau [Wed, 30 Aug 2017 01:03:06 +0000 (18:03 -0700)] 
Rename applyCCtxParams()

7 years agoDelay creation of ZSTDMT_CCtx
Stella Lau [Tue, 29 Aug 2017 23:18:21 +0000 (16:18 -0700)] 
Delay creation of ZSTDMT_CCtx

7 years agoLocalize 'dictMode' from cctx to function param
Stella Lau [Tue, 29 Aug 2017 22:10:42 +0000 (15:10 -0700)] 
Localize 'dictMode' from cctx to function param

7 years agoMerge pull request #817 from terrelln/pool-custom-alloc
Yann Collet [Tue, 29 Aug 2017 20:05:39 +0000 (13:05 -0700)] 
Merge pull request #817 from terrelln/pool-custom-alloc

[pool] Accept custom allocators

7 years agoReplace 'byReference' with enum
Stella Lau [Tue, 29 Aug 2017 18:55:02 +0000 (11:55 -0700)] 
Replace 'byReference' with enum

7 years ago[error] Don't guard undef X with ifdef X 817/head
Nick Terrell [Tue, 29 Aug 2017 18:54:38 +0000 (11:54 -0700)] 
[error] Don't guard undef X with ifdef X

7 years agoRename estimateCCtxSize_advanced() and estimateCStreamSize_advanced()
Stella Lau [Tue, 29 Aug 2017 17:49:29 +0000 (10:49 -0700)] 
Rename estimateCCtxSize_advanced() and estimateCStreamSize_advanced()

7 years agochanged license for examples 821/head
Yann Collet [Tue, 29 Aug 2017 16:24:11 +0000 (09:24 -0700)] 
changed license for examples

intentionnally this time

7 years agoFix getting cParams from CCtxParams
Stella Lau [Tue, 29 Aug 2017 02:25:17 +0000 (19:25 -0700)] 
Fix getting cParams from CCtxParams

7 years ago[pool] Visual Studios disallows empty structs
Nick Terrell [Tue, 29 Aug 2017 00:19:01 +0000 (17:19 -0700)] 
[pool] Visual Studios disallows empty structs

7 years ago[threading] Fix ERROR macro after including windows.h
Nick Terrell [Sat, 26 Aug 2017 00:44:32 +0000 (17:44 -0700)] 
[threading] Fix ERROR macro after including windows.h

7 years agoMerge pull request #818 from bmwiedemann/sort
Yann Collet [Sat, 26 Aug 2017 19:11:55 +0000 (12:11 -0700)] 
Merge pull request #818 from bmwiedemann/sort

Sort input file list

7 years agoSort input file list 818/head
Bernhard M. Wiedemann [Sat, 26 Aug 2017 15:08:00 +0000 (17:08 +0200)] 
Sort input file list

in order to make builds reproducible
in spite of indeterministic filesystem readdir order.
See https://reproducible-builds.org/ for why this is good.

7 years agoFix parameter retrieval from cdict
Stella Lau [Sat, 26 Aug 2017 00:58:28 +0000 (17:58 -0700)] 
Fix parameter retrieval from cdict

7 years agoFix typo with ZSTDMT_parameter
Stella Lau [Fri, 25 Aug 2017 23:13:40 +0000 (16:13 -0700)] 
Fix typo with ZSTDMT_parameter

7 years agoRemove ZSTD_setCCtxParameter()
Stella Lau [Fri, 25 Aug 2017 20:58:41 +0000 (13:58 -0700)] 
Remove ZSTD_setCCtxParameter()

7 years agoAdd function initializing cctxParams from clevel
Stella Lau [Fri, 25 Aug 2017 20:23:16 +0000 (13:23 -0700)] 
Add function initializing cctxParams from clevel

7 years agoMove jobSize and overlapLog in zstdmt to cctxParams
Stella Lau [Fri, 25 Aug 2017 20:14:51 +0000 (13:14 -0700)] 
Move jobSize and overlapLog in zstdmt to cctxParams

7 years agoDistinguish between jobParams and cctxParams in zstdmt
Stella Lau [Fri, 25 Aug 2017 18:36:17 +0000 (11:36 -0700)] 
Distinguish between jobParams and cctxParams in zstdmt

7 years agoRemove ZSTD_p_refDictContent and dictContentByRef
Stella Lau [Fri, 25 Aug 2017 17:48:07 +0000 (10:48 -0700)] 
Remove ZSTD_p_refDictContent and dictContentByRef

7 years agoMerge pull request #816 from terrelln/default-level
Yann Collet [Fri, 25 Aug 2017 16:53:30 +0000 (09:53 -0700)] 
Merge pull request #816 from terrelln/default-level

[dictBuilder] Set default compression level to 3

7 years ago[zstdmt] Use POOL_create_advanced()
Nick Terrell [Fri, 25 Aug 2017 01:12:28 +0000 (18:12 -0700)] 
[zstdmt] Use POOL_create_advanced()

7 years agoFix zstd_internal.h for C++ mode
Nick Terrell [Fri, 25 Aug 2017 01:09:50 +0000 (18:09 -0700)] 
Fix zstd_internal.h for C++ mode

7 years ago[pool] Accept custom allocators
Nick Terrell [Fri, 25 Aug 2017 00:01:41 +0000 (17:01 -0700)] 
[pool] Accept custom allocators

7 years ago[pool] Fix formatting
Nick Terrell [Thu, 24 Aug 2017 23:48:32 +0000 (16:48 -0700)] 
[pool] Fix formatting

7 years agoEnforce nbThreads<=1 for estimateCCtxSize
Stella Lau [Thu, 24 Aug 2017 23:28:49 +0000 (16:28 -0700)] 
Enforce nbThreads<=1 for estimateCCtxSize

7 years ago[dictBuilder] Set default compression level to 3 816/head
Nick Terrell [Thu, 24 Aug 2017 21:45:06 +0000 (14:45 -0700)] 
[dictBuilder] Set default compression level to 3

7 years agoFix interaction with ZSTD_setCCtxParameter() and cleanup
Stella Lau [Thu, 24 Aug 2017 18:25:41 +0000 (11:25 -0700)] 
Fix interaction with ZSTD_setCCtxParameter() and cleanup

7 years agoFix forceWindow and dictMode setting for zstdmt jobs
Stella Lau [Thu, 24 Aug 2017 02:11:05 +0000 (19:11 -0700)] 
Fix forceWindow and dictMode setting for zstdmt jobs

7 years agoEnsure zstdmt uses 'job version' of cctx parameters
Stella Lau [Thu, 24 Aug 2017 00:03:31 +0000 (17:03 -0700)] 
Ensure zstdmt uses 'job version' of cctx parameters

7 years agoRemove duplicated testing code
Stella Lau [Wed, 23 Aug 2017 22:47:15 +0000 (15:47 -0700)] 
Remove duplicated testing code

7 years agoFix cstream compression level
Stella Lau [Wed, 23 Aug 2017 19:30:47 +0000 (12:30 -0700)] 
Fix cstream compression level

7 years agoAdd prototype support for customMem with cctxParams
Stella Lau [Wed, 23 Aug 2017 19:03:30 +0000 (12:03 -0700)] 
Add prototype support for customMem with cctxParams

7 years agoMerge pull request #812 from facebook/longRangeFix
Yann Collet [Wed, 23 Aug 2017 18:35:28 +0000 (11:35 -0700)] 
Merge pull request #812 from facebook/longRangeFix

fixed extraordinary scenario where all fields use maximum nbBits

7 years agoMerge pull request #813 from stellamplau/highbit32fix
Yann Collet [Wed, 23 Aug 2017 18:31:06 +0000 (11:31 -0700)] 
Merge pull request #813 from stellamplau/highbit32fix

Fix undefined behavior when srcSize==1