]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
8 years agoAdd test for invalid offset rep codes 494/head
Nick Terrell [Tue, 20 Dec 2016 19:13:45 +0000 (11:13 -0800)] 
Add test for invalid offset rep codes

8 years agoFix dictionary loading bug causing an MSAN failure
Nick Terrell [Tue, 20 Dec 2016 18:47:52 +0000 (10:47 -0800)] 
Fix dictionary loading bug causing an MSAN failure

Offset rep codes must be in the range `[1, dictSize)`.
Fix dictionary loading to reject `0` as a offset rep code.

8 years agofix : ZSTD_initCStream_srcSize() correctly set srcSize in frame header
Yann Collet [Sun, 18 Dec 2016 20:39:15 +0000 (21:39 +0100)] 
fix : ZSTD_initCStream_srcSize() correctly set srcSize in frame header

8 years agoFix : size estimation when some samples are very large
Yann Collet [Sun, 18 Dec 2016 10:58:23 +0000 (11:58 +0100)] 
Fix : size estimation when some samples are very large

8 years agoupdated NEWS
Yann Collet [Sat, 17 Dec 2016 18:37:55 +0000 (19:37 +0100)] 
updated NEWS

8 years agofix Travis long test list;
Yann Collet [Sat, 17 Dec 2016 18:10:10 +0000 (19:10 +0100)] 
fix Travis long test list;
added zbufftest-dll

8 years agoadded dll compilation tests
Yann Collet [Sat, 17 Dec 2016 15:28:12 +0000 (16:28 +0100)] 
added dll compilation tests

8 years agoMerge pull request #488 from terrelln/zbuff-errors2
Yann Collet [Sat, 17 Dec 2016 14:51:41 +0000 (15:51 +0100)] 
Merge pull request #488 from terrelln/zbuff-errors2

Export ZBUFF_isError() and ZBUFF_getErrorName()

8 years agoTest that all API symbols are exported 488/head
Nick Terrell [Fri, 16 Dec 2016 21:29:23 +0000 (13:29 -0800)] 
Test that all API symbols are exported

8 years agoExport all API functions
Nick Terrell [Fri, 16 Dec 2016 21:27:30 +0000 (13:27 -0800)] 
Export all API functions

8 years agoMerge pull request #480 from inikep/dev11
Yann Collet [Thu, 15 Dec 2016 21:27:50 +0000 (22:27 +0100)] 
Merge pull request #480 from inikep/dev11

advanced mode where each parameter can be selected on the command line

8 years agoimproved playTests.sh (3 480/head
Przemyslaw Skibinski [Wed, 14 Dec 2016 17:43:06 +0000 (18:43 +0100)] 
improved playTests.sh (3

8 years agoimproved playTests.sh (2)
Przemyslaw Skibinski [Wed, 14 Dec 2016 17:07:31 +0000 (18:07 +0100)] 
improved playTests.sh (2)

8 years agoimproved playTests.sh
Przemyslaw Skibinski [Wed, 14 Dec 2016 16:10:38 +0000 (17:10 +0100)] 
improved playTests.sh

8 years agoplayTests.sh: added Advanced compression parameters
Przemyslaw Skibinski [Wed, 14 Dec 2016 15:50:00 +0000 (16:50 +0100)] 
playTests.sh: added Advanced compression parameters

8 years agozstd.1: added advanced compression options
Przemyslaw Skibinski [Wed, 14 Dec 2016 15:10:13 +0000 (16:10 +0100)] 
zstd.1: added advanced compression options

8 years agoupdated manual 484/head v1.1.2
Yann Collet [Wed, 14 Dec 2016 13:53:47 +0000 (14:53 +0100)] 
updated manual

8 years agofixed "strategy" in advanced compression parameters
Przemyslaw Skibinski [Tue, 13 Dec 2016 19:04:32 +0000 (20:04 +0100)] 
fixed "strategy" in advanced compression parameters

8 years agoMerge pull request #482 from inikep/zlibWrapper
Yann Collet [Tue, 13 Dec 2016 18:50:34 +0000 (19:50 +0100)] 
Merge pull request #482 from inikep/zlibWrapper

Zlibwrapper

8 years agoupdated NEWS
Yann Collet [Tue, 13 Dec 2016 18:47:17 +0000 (19:47 +0100)] 
updated NEWS

8 years agoupdated zlib copyright notice 482/head
Przemyslaw Skibinski [Tue, 13 Dec 2016 18:44:07 +0000 (19:44 +0100)] 
updated zlib copyright notice

8 years agoMerge pull request #481 from inikep/zlibWrapper
Yann Collet [Tue, 13 Dec 2016 18:42:51 +0000 (19:42 +0100)] 
Merge pull request #481 from inikep/zlibWrapper

fixed fitblk

8 years agofixed fitblk 481/head
Przemyslaw Skibinski [Tue, 13 Dec 2016 18:14:04 +0000 (19:14 +0100)] 
fixed fitblk

8 years agochanged variable name to estimatedSrcSize, to emphasize it does not need to be exact
Yann Collet [Tue, 13 Dec 2016 16:59:55 +0000 (17:59 +0100)] 
changed variable name to estimatedSrcSize, to emphasize it does not need to be exact

8 years agoAdded ZSTD_initCStream_srcSize().
Yann Collet [Tue, 13 Dec 2016 15:39:36 +0000 (16:39 +0100)] 
Added ZSTD_initCStream_srcSize().
Added relevant test cases in zstreamtest

8 years agominor BMI version check
Yann Collet [Tue, 13 Dec 2016 14:21:06 +0000 (15:21 +0100)] 
minor BMI version check

8 years agofixed conversion warning
Przemyslaw Skibinski [Tue, 13 Dec 2016 13:52:21 +0000 (14:52 +0100)] 
fixed conversion warning

8 years agofileio.c: support advanced compression parameters
Przemyslaw Skibinski [Tue, 13 Dec 2016 12:24:59 +0000 (13:24 +0100)] 
fileio.c: support advanced compression parameters

8 years agobench.c: support advanced compression parameters
Przemyslaw Skibinski [Tue, 13 Dec 2016 12:03:41 +0000 (13:03 +0100)] 
bench.c: support advanced compression parameters

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Tue, 13 Dec 2016 11:19:19 +0000 (12:19 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agoadded parseCompressionParameters
Przemyslaw Skibinski [Tue, 13 Dec 2016 11:18:07 +0000 (12:18 +0100)] 
added parseCompressionParameters

8 years agoupdated NEWS
Yann Collet [Tue, 13 Dec 2016 10:45:19 +0000 (11:45 +0100)] 
updated NEWS

8 years agoMerge pull request #475 from DimitryAndric/fix-build-on-freebsd-1
Yann Collet [Tue, 13 Dec 2016 10:39:23 +0000 (11:39 +0100)] 
Merge pull request #475 from DimitryAndric/fix-build-on-freebsd-1

Make zstd build out of the box properly on FreeBSD

8 years agoMerge pull request #478 from terrelln/wildcopy-ub
Yann Collet [Tue, 13 Dec 2016 10:33:00 +0000 (11:33 +0100)] 
Merge pull request #478 from terrelln/wildcopy-ub

Fix execSequence wildcopy undefined behavior

8 years agoMerge pull request #479 from terrelln/decompression-bug
Yann Collet [Tue, 13 Dec 2016 10:30:37 +0000 (11:30 +0100)] 
Merge pull request #479 from terrelln/decompression-bug

Fix decompression bug

8 years agoFix execSequence wildcopy undefined behavior 478/head
Nick Terrell [Tue, 13 Dec 2016 03:01:23 +0000 (19:01 -0800)] 
Fix execSequence wildcopy undefined behavior

execSequence relied on pointer overflow to handle cases where
`sequence.matchLength < 8`.  Instead of passing an `size_t` to
wildcopy, pass a `ptrdiff_t`.

8 years agoFix decompression buffer overrun 479/head
Nick Terrell [Tue, 13 Dec 2016 02:05:30 +0000 (18:05 -0800)] 
Fix decompression buffer overrun

Allows an adversary to write up to 3 bytes beyond the end of the buffer.
Occurs if the match overlaps the `extDict` and `currentPrefix`, and the
match length in the `currentPrefix` is less than `MINMATCH`, and
`op-(16-MINMATCH) >= oMatchEnd > op-16`.

8 years agoEnable using isatty() and nanosleep() on *BSD 475/head
Dimitry Andric [Mon, 12 Dec 2016 18:24:51 +0000 (19:24 +0100)] 
Enable using isatty() and nanosleep() on *BSD

8 years agoFix running test suite on FreeBSD
Dimitry Andric [Mon, 12 Dec 2016 18:22:47 +0000 (19:22 +0100)] 
Fix running test suite on FreeBSD

* Remove last bashism from tests/playTests.sh
* Use gmd5sum from the sysutils/coreutils port

8 years agoMerge pull request #476 from inikep/dev11
Yann Collet [Mon, 12 Dec 2016 15:44:55 +0000 (16:44 +0100)] 
Merge pull request #476 from inikep/dev11

Dev11

8 years agoallow all operationg systems with _POSIX_C_SOURCE >= 200112L 476/head
Przemyslaw Skibinski [Mon, 12 Dec 2016 14:37:43 +0000 (15:37 +0100)] 
allow all operationg systems with _POSIX_C_SOURCE >= 200112L

8 years agoturn on the '-r' option for HP-UX and AIX
Przemyslaw Skibinski [Mon, 12 Dec 2016 10:59:17 +0000 (11:59 +0100)] 
turn on the '-r' option for HP-UX and AIX

8 years agoturn on the '-r' option for *BSD and Solaris
Przemyslaw Skibinski [Mon, 12 Dec 2016 10:23:21 +0000 (11:23 +0100)] 
turn on the '-r' option for *BSD and Solaris

8 years agominor coding style changes
Yann Collet [Mon, 12 Dec 2016 00:03:23 +0000 (01:03 +0100)] 
minor coding style changes

8 years agointroduced cycleLog
Yann Collet [Sun, 11 Dec 2016 23:47:30 +0000 (00:47 +0100)] 
introduced cycleLog

8 years agominor variation of rescale fix
Yann Collet [Sun, 11 Dec 2016 23:25:07 +0000 (00:25 +0100)] 
minor variation of rescale fix

8 years agoMerge pull request #474 from terrelln/compression-segfault
Yann Collet [Sun, 11 Dec 2016 21:28:24 +0000 (22:28 +0100)] 
Merge pull request #474 from terrelln/compression-segfault

Fix compression segfault

8 years agoFix longmatch test build errors. 474/head
Nick Terrell [Sun, 11 Dec 2016 07:17:36 +0000 (23:17 -0800)] 
Fix longmatch test build errors.

8 years agoSwitch uint64_t to U64
Nick Terrell [Sun, 11 Dec 2016 03:31:55 +0000 (19:31 -0800)] 
Switch uint64_t to U64

8 years agoAdd exposing test case
Nick Terrell [Sun, 11 Dec 2016 03:12:13 +0000 (19:12 -0800)] 
Add exposing test case

8 years agoSimplify segfault fix
Nick Terrell [Sun, 11 Dec 2016 02:46:55 +0000 (18:46 -0800)] 
Simplify segfault fix

Take advantage of the fact that `chainLog <= windowLog`.

8 years agoFix compression segfault
Nick Terrell [Sat, 10 Dec 2016 01:15:33 +0000 (17:15 -0800)] 
Fix compression segfault

When the overflow protection kicks in, it makes sure that ip - ctx->base
isn't too large.  However, it didn't ensure that saved offsets are
still valid.  This change ensures that any valid offsets (<= windowLog)
are still representable after the update.

The bug would shop up on line 1056, when `offset_1 > current + 1`, which
causes an underflow.  This in turn, would cause a segfault on line 1063.

The input must necessarily be longer than 1 GB for this issue to occur.
Even then, it only occurs if one of the last 3 matches is larger than
the chain size and block size.

8 years agominor lib build refactoring
Yann Collet [Fri, 9 Dec 2016 02:42:27 +0000 (18:42 -0800)] 
minor lib build refactoring

8 years agofixed lib soname.
Yann Collet [Fri, 9 Dec 2016 02:25:36 +0000 (18:25 -0800)] 
fixed lib soname.
example : simple_compression : size overflow check

8 years agostreaming example uses stable API
Yann Collet [Fri, 9 Dec 2016 01:28:26 +0000 (17:28 -0800)] 
streaming example uses stable API

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Thu, 8 Dec 2016 20:07:06 +0000 (12:07 -0800)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoMerge pull request #473 from inikep/dev11
Yann Collet [Thu, 8 Dec 2016 19:36:38 +0000 (11:36 -0800)] 
Merge pull request #473 from inikep/dev11

improved documentation

8 years agouse newer make with AppVeyor 473/head
Przemyslaw Skibinski [Thu, 8 Dec 2016 13:00:09 +0000 (14:00 +0100)] 
use newer make with AppVeyor

8 years agoimproved MSYS support
Przemyslaw Skibinski [Thu, 8 Dec 2016 09:49:59 +0000 (10:49 +0100)] 
improved MSYS support

8 years agoprograms\Makefile: use Linux paths
Przemyslaw Skibinski [Thu, 8 Dec 2016 09:43:55 +0000 (10:43 +0100)] 
programs\Makefile: use Linux paths

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Thu, 8 Dec 2016 09:42:42 +0000 (10:42 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agoVS projects: restored zbuff for libzstd*
Przemyslaw Skibinski [Thu, 8 Dec 2016 08:06:00 +0000 (09:06 +0100)] 
VS projects: restored zbuff for libzstd*

8 years agoupdated NEWS
Yann Collet [Thu, 8 Dec 2016 00:41:33 +0000 (16:41 -0800)] 
updated NEWS

8 years agochanged : dll : only approved ZSTD symbols are now exposed. All other symbols remain...
Yann Collet [Thu, 8 Dec 2016 00:39:34 +0000 (16:39 -0800)] 
changed : dll : only approved ZSTD symbols are now exposed. All other symbols remain internal.

8 years agobetter cleaning
Yann Collet [Wed, 7 Dec 2016 23:58:32 +0000 (15:58 -0800)] 
better cleaning

8 years agoremoved make artefact
Yann Collet [Wed, 7 Dec 2016 13:04:39 +0000 (14:04 +0100)] 
removed make artefact

8 years agozstd Manual updated to 1.1.2
Przemyslaw Skibinski [Wed, 7 Dec 2016 10:18:40 +0000 (11:18 +0100)] 
zstd Manual updated to 1.1.2

8 years agogen_html: comments of type /*= and /**= can be longer than a single line
Przemyslaw Skibinski [Wed, 7 Dec 2016 10:13:20 +0000 (11:13 +0100)] 
gen_html: comments of type /*= and /**= can be longer than a single line

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Wed, 7 Dec 2016 08:13:47 +0000 (09:13 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agocompatibility with zstd-frugal (noBench mode)
Yann Collet [Wed, 7 Dec 2016 01:56:20 +0000 (17:56 -0800)] 
compatibility with zstd-frugal (noBench mode)

8 years agodecode benchmark, multi-files
Yann Collet [Wed, 7 Dec 2016 01:46:49 +0000 (17:46 -0800)] 
decode benchmark, multi-files

8 years agodecode benchmark - single file (hidden option)
Yann Collet [Wed, 7 Dec 2016 00:49:23 +0000 (16:49 -0800)] 
decode benchmark - single file (hidden option)

8 years agocmake : SHARED_LIBRARY_OUTPUT_NAME is user-selectable, by @aparamon (#469)
Yann Collet [Tue, 6 Dec 2016 21:45:42 +0000 (13:45 -0800)] 
cmake : SHARED_LIBRARY_OUTPUT_NAME is user-selectable, by @aparamon (#469)

8 years agochanged environment variable comparison to sh compatible
Yann Collet [Tue, 6 Dec 2016 20:02:56 +0000 (12:02 -0800)] 
changed environment variable comparison to sh compatible

8 years agochanged gzstd build messages
Yann Collet [Tue, 6 Dec 2016 19:23:15 +0000 (11:23 -0800)] 
changed gzstd build messages

8 years agofixed zstd.h for manual
Yann Collet [Tue, 6 Dec 2016 18:36:15 +0000 (10:36 -0800)] 
fixed zstd.h for manual

8 years agoZBUFF_ as a wrapper to ZSTD streaming API.
Yann Collet [Tue, 6 Dec 2016 16:16:41 +0000 (17:16 +0100)] 
ZBUFF_ as a wrapper to ZSTD streaming API.

8 years agozlibWrapper/README.md: updated info about gzip file access functions
Przemyslaw Skibinski [Tue, 6 Dec 2016 10:36:24 +0000 (11:36 +0100)] 
zlibWrapper/README.md: updated info about gzip file access functions

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Tue, 6 Dec 2016 10:11:20 +0000 (11:11 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agofixed cmake build
Yann Collet [Tue, 6 Dec 2016 08:46:14 +0000 (09:46 +0100)] 
fixed cmake build

8 years agofixed zbuff in VS2005 projects
Yann Collet [Tue, 6 Dec 2016 08:08:43 +0000 (09:08 +0100)] 
fixed zbuff in VS2005 projects

8 years agofixed zlibwrapper use of xxh
Yann Collet [Tue, 6 Dec 2016 07:52:53 +0000 (08:52 +0100)] 
fixed zlibwrapper use of xxh

8 years agofixed fuzzer test
Yann Collet [Tue, 6 Dec 2016 05:11:46 +0000 (06:11 +0100)] 
fixed fuzzer test

8 years agomoved zbuff source files into lib/deprecated
Yann Collet [Tue, 6 Dec 2016 03:28:19 +0000 (19:28 -0800)] 
moved zbuff source files into lib/deprecated

8 years agofixed initialization warning
Yann Collet [Tue, 6 Dec 2016 02:00:50 +0000 (18:00 -0800)] 
fixed initialization warning

8 years agoadded : dictID retrieval functions.
Yann Collet [Tue, 6 Dec 2016 00:21:06 +0000 (16:21 -0800)] 
added : dictID retrieval functions.
added : unit tests for dictID retrieval functions

8 years agoMerge pull request #470 from inikep/decompressGZ
Yann Collet [Mon, 5 Dec 2016 19:06:47 +0000 (11:06 -0800)] 
Merge pull request #470 from inikep/decompressGZ

Decompressgz

8 years agoupdated FIO_passThrough 470/head
Przemyslaw Skibinski [Mon, 5 Dec 2016 17:31:14 +0000 (18:31 +0100)] 
updated FIO_passThrough

8 years agoupdated test-gzstd
Przemyslaw Skibinski [Mon, 5 Dec 2016 17:02:40 +0000 (18:02 +0100)] 
updated test-gzstd

8 years agointroduced srcBufferLoaded
Przemyslaw Skibinski [Mon, 5 Dec 2016 16:39:38 +0000 (17:39 +0100)] 
introduced srcBufferLoaded

8 years agoimproved FIO_decompressGzFrame
Przemyslaw Skibinski [Mon, 5 Dec 2016 14:58:23 +0000 (15:58 +0100)] 
improved FIO_decompressGzFrame

8 years agoimproved detection of -lz
Przemyslaw Skibinski [Mon, 5 Dec 2016 12:47:00 +0000 (13:47 +0100)] 
improved detection of -lz

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Mon, 5 Dec 2016 11:00:55 +0000 (12:00 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agoAPI : changed : streaming decompression : implicit reset on starting new frames
Yann Collet [Sat, 3 Dec 2016 02:37:38 +0000 (18:37 -0800)] 
API : changed : streaming decompression : implicit reset on starting new frames

8 years agoadded zstdgrep
Yann Collet [Fri, 2 Dec 2016 23:57:07 +0000 (15:57 -0800)] 
added zstdgrep

8 years agoadded zstdless
Yann Collet [Fri, 2 Dec 2016 23:24:40 +0000 (15:24 -0800)] 
added zstdless

8 years agofix zstdcat
Yann Collet [Fri, 2 Dec 2016 23:18:57 +0000 (15:18 -0800)] 
fix zstdcat

8 years agominor refactor
Yann Collet [Fri, 2 Dec 2016 20:40:57 +0000 (12:40 -0800)] 
minor refactor

8 years agofix dict loading
Yann Collet [Fri, 2 Dec 2016 19:36:11 +0000 (11:36 -0800)] 
fix dict loading

8 years agoMerge pull request #467 from inikep/dev11
Yann Collet [Fri, 2 Dec 2016 18:58:48 +0000 (10:58 -0800)] 
Merge pull request #467 from inikep/dev11

gzip decompression from CLI