]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
8 years agoZDICT_finalizeDictionary() flipped comparison 498/head
Nick Terrell [Fri, 23 Dec 2016 02:14:57 +0000 (18:14 -0800)] 
ZDICT_finalizeDictionary() flipped comparison

8 years agoZDICT_finalizeDictionary() flipped comparison
Nick Terrell [Fri, 23 Dec 2016 02:01:14 +0000 (18:01 -0800)] 
ZDICT_finalizeDictionary() flipped comparison

`ZDICT_finalizeDictionary()` had a flipped comparison.
I also allowed `dictBufferCapacity == dictContentSize`.
It might be the case that the user wants to fill the dictionary
completely up, and then let zstd take exactly the space it needs
for the entropy tables.

8 years agoFix failing test due to deprecation warning
Nick Terrell [Fri, 23 Dec 2016 01:28:49 +0000 (17:28 -0800)] 
Fix failing test due to deprecation warning

8 years agoadded ZDICT_finalizeDictionary()
Yann Collet [Thu, 22 Dec 2016 19:18:43 +0000 (20:18 +0100)] 
added ZDICT_finalizeDictionary()

8 years agofixed zlib_wrapper conversion warnings
Yann Collet [Thu, 22 Dec 2016 14:26:33 +0000 (15:26 +0100)] 
fixed zlib_wrapper conversion warnings

8 years agofixed allmost target
Yann Collet [Thu, 22 Dec 2016 11:43:00 +0000 (12:43 +0100)] 
fixed allmost target

8 years agoremoved examples from standard C tests, since they contain some POSIX elements
Yann Collet [Thu, 22 Dec 2016 10:31:39 +0000 (11:31 +0100)] 
removed examples from standard C tests, since they contain some POSIX elements

8 years agofix : zlib wrapper compile in gnu90 mode
Yann Collet [Wed, 21 Dec 2016 18:57:18 +0000 (19:57 +0100)] 
fix : zlib wrapper compile in gnu90 mode

8 years agoadded ZSTD_createDDict_byReference() body
Yann Collet [Wed, 21 Dec 2016 18:25:15 +0000 (19:25 +0100)] 
added ZSTD_createDDict_byReference() body

8 years agoadded ZSTD_createDDict_byReference()
Yann Collet [Wed, 21 Dec 2016 15:44:35 +0000 (16:44 +0100)] 
added ZSTD_createDDict_byReference()

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Wed, 21 Dec 2016 15:44:24 +0000 (16:44 +0100)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoMerge pull request #489 from inikep/v112
Yann Collet [Wed, 21 Dec 2016 15:42:46 +0000 (16:42 +0100)] 
Merge pull request #489 from inikep/v112

improved detection of POSIX

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Wed, 21 Dec 2016 15:20:41 +0000 (16:20 +0100)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoadded : ZSTD_createCDict_byReference()
Yann Collet [Wed, 21 Dec 2016 15:20:11 +0000 (16:20 +0100)] 
added : ZSTD_createCDict_byReference()

8 years agoMerge pull request #493 from inikep/fullbench
Yann Collet [Wed, 21 Dec 2016 14:12:06 +0000 (15:12 +0100)] 
Merge pull request #493 from inikep/fullbench

Fullbench extDict variant

8 years agoutil.h: restore BSD license for Facebook Open-Source 489/head
Przemyslaw Skibinski [Wed, 21 Dec 2016 14:08:44 +0000 (15:08 +0100)] 
util.h: restore BSD license for Facebook Open-Source

8 years agoupdated comments
Przemyslaw Skibinski [Wed, 21 Dec 2016 13:00:41 +0000 (14:00 +0100)] 
updated comments

8 years ago_CRT_SECURE_NO_WARNINGS moved to util.h
Przemyslaw Skibinski [Wed, 21 Dec 2016 12:47:11 +0000 (13:47 +0100)] 
_CRT_SECURE_NO_WARNINGS moved to util.h

8 years agoplatform.h: removed Compiler Options
Przemyslaw Skibinski [Wed, 21 Dec 2016 12:23:34 +0000 (13:23 +0100)] 
platform.h: removed Compiler Options

8 years agofixed Visual Studio compilation
Przemyslaw Skibinski [Wed, 21 Dec 2016 10:43:11 +0000 (11:43 +0100)] 
fixed Visual Studio compilation

8 years agoMerge pull request #492 from inikep/dev11
Yann Collet [Wed, 21 Dec 2016 10:23:04 +0000 (11:23 +0100)] 
Merge pull request #492 from inikep/dev11

test CMake on Windows

8 years agoMerge pull request #490 from jacquesg/cmake-fix
Yann Collet [Wed, 21 Dec 2016 10:22:28 +0000 (11:22 +0100)] 
Merge pull request #490 from jacquesg/cmake-fix

Fix cmake build (MSVC)

8 years agoimproved MinGW support
Przemyslaw Skibinski [Wed, 21 Dec 2016 10:18:45 +0000 (11:18 +0100)] 
improved MinGW support

8 years agoMerge pull request #494 from terrelln/msan-dict-load
Yann Collet [Wed, 21 Dec 2016 08:33:48 +0000 (09:33 +0100)] 
Merge pull request #494 from terrelln/msan-dict-load

Fix dictionary loading bug causing an MSAN failure

8 years agofix basic types redefinition
Przemyslaw Skibinski [Wed, 21 Dec 2016 08:26:00 +0000 (09:26 +0100)] 
fix basic types redefinition

8 years agosimplified zstdcli.c
Przemyslaw Skibinski [Wed, 21 Dec 2016 08:19:15 +0000 (09:19 +0100)] 
simplified zstdcli.c

8 years agoexecutables use new util.h and platform.h
Przemyslaw Skibinski [Wed, 21 Dec 2016 08:06:14 +0000 (09:06 +0100)] 
executables use new util.h and platform.h

8 years agoimproved util.h and platform.h
Przemyslaw Skibinski [Wed, 21 Dec 2016 08:04:59 +0000 (09:04 +0100)] 
improved util.h and platform.h

8 years agoAdd test for invalid offset rep codes 494/head
Nick Terrell [Tue, 20 Dec 2016 19:13:45 +0000 (11:13 -0800)] 
Add test for invalid offset rep codes

8 years agoFix dictionary loading bug causing an MSAN failure
Nick Terrell [Tue, 20 Dec 2016 18:47:52 +0000 (10:47 -0800)] 
Fix dictionary loading bug causing an MSAN failure

Offset rep codes must be in the range `[1, dictSize)`.
Fix dictionary loading to reject `0` as a offset rep code.

8 years agowindres updated to v1.1.3 493/head
Przemyslaw Skibinski [Tue, 20 Dec 2016 10:21:26 +0000 (11:21 +0100)] 
windres updated to v1.1.3

8 years agotests of ZSTD_compressContinue_extDict
Przemyslaw Skibinski [Tue, 20 Dec 2016 09:17:21 +0000 (10:17 +0100)] 
tests of ZSTD_compressContinue_extDict

8 years agocmake msvc: resources are not required for the static library 490/head
Jacques Germishuys [Mon, 19 Dec 2016 12:15:47 +0000 (14:15 +0200)] 
cmake msvc: resources are not required for the static library

8 years agoupdated appveyor.yml 492/head
Przemyslaw Skibinski [Mon, 19 Dec 2016 09:58:10 +0000 (10:58 +0100)] 
updated appveyor.yml

8 years agocmake msvc: correct resources
Jacques Germishuys [Sun, 18 Dec 2016 16:17:25 +0000 (18:17 +0200)] 
cmake msvc: correct resources

8 years agoupdated libzstd-dll.rc
Przemyslaw Skibinski [Mon, 19 Dec 2016 08:47:45 +0000 (09:47 +0100)] 
updated libzstd-dll.rc

8 years agofixed CMake compilation with Visual Studio
Przemyslaw Skibinski [Mon, 19 Dec 2016 08:28:55 +0000 (09:28 +0100)] 
fixed CMake compilation with Visual Studio

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Mon, 19 Dec 2016 07:49:36 +0000 (08:49 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into v112
Przemyslaw Skibinski [Mon, 19 Dec 2016 07:20:26 +0000 (08:20 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into v112

# Conflicts:
# appveyor.yml

8 years agofix : ZSTD_initCStream_srcSize() correctly set srcSize in frame header
Yann Collet [Sun, 18 Dec 2016 20:39:15 +0000 (21:39 +0100)] 
fix : ZSTD_initCStream_srcSize() correctly set srcSize in frame header

8 years agoFix : size estimation when some samples are very large
Yann Collet [Sun, 18 Dec 2016 10:58:23 +0000 (11:58 +0100)] 
Fix : size estimation when some samples are very large

8 years agoupdated NEWS
Yann Collet [Sat, 17 Dec 2016 18:37:55 +0000 (19:37 +0100)] 
updated NEWS

8 years agofix Travis long test list;
Yann Collet [Sat, 17 Dec 2016 18:10:10 +0000 (19:10 +0100)] 
fix Travis long test list;
added zbufftest-dll

8 years agoadded dll compilation tests
Yann Collet [Sat, 17 Dec 2016 15:28:12 +0000 (16:28 +0100)] 
added dll compilation tests

8 years agoMerge pull request #488 from terrelln/zbuff-errors2
Yann Collet [Sat, 17 Dec 2016 14:51:41 +0000 (15:51 +0100)] 
Merge pull request #488 from terrelln/zbuff-errors2

Export ZBUFF_isError() and ZBUFF_getErrorName()

8 years agoTest that all API symbols are exported 488/head
Nick Terrell [Fri, 16 Dec 2016 21:29:23 +0000 (13:29 -0800)] 
Test that all API symbols are exported

8 years agoExport all API functions
Nick Terrell [Fri, 16 Dec 2016 21:27:30 +0000 (13:27 -0800)] 
Export all API functions

8 years agoutil.h: minor improvement
Przemyslaw Skibinski [Fri, 16 Dec 2016 16:12:23 +0000 (17:12 +0100)] 
util.h: minor improvement

8 years agoimporved support for POSIX-type OSes
Przemyslaw Skibinski [Fri, 16 Dec 2016 14:41:18 +0000 (15:41 +0100)] 
imporved support for POSIX-type OSes

8 years agouse PLATFORM_POSIX_VERSION
Przemyslaw Skibinski [Fri, 16 Dec 2016 14:00:50 +0000 (15:00 +0100)] 
use PLATFORM_POSIX_VERSION

8 years agoutil.h uses platform.h
Przemyslaw Skibinski [Fri, 16 Dec 2016 13:25:12 +0000 (14:25 +0100)] 
util.h uses platform.h

8 years agotools use platform.h
Przemyslaw Skibinski [Fri, 16 Dec 2016 13:24:01 +0000 (14:24 +0100)] 
tools use platform.h

8 years agointroduced platform.h
Przemyslaw Skibinski [Fri, 16 Dec 2016 13:13:15 +0000 (14:13 +0100)] 
introduced platform.h

8 years agoMerge pull request #480 from inikep/dev11
Yann Collet [Thu, 15 Dec 2016 21:27:50 +0000 (22:27 +0100)] 
Merge pull request #480 from inikep/dev11

advanced mode where each parameter can be selected on the command line

8 years agoappveyor.yml: fixed tests of fullbench-dll fullbench-lib
Przemyslaw Skibinski [Thu, 15 Dec 2016 11:31:18 +0000 (12:31 +0100)] 
appveyor.yml: fixed tests of fullbench-dll fullbench-lib

8 years agoVS: fixed 32-bit DLL compilation
Przemyslaw Skibinski [Thu, 15 Dec 2016 11:12:46 +0000 (12:12 +0100)] 
VS: fixed 32-bit DLL compilation

8 years agoappveyor.yml: added tests of fullbench-dll fullbench-lib
Przemyslaw Skibinski [Thu, 15 Dec 2016 11:09:23 +0000 (12:09 +0100)] 
appveyor.yml: added tests of fullbench-dll fullbench-lib

8 years agointroduced ZSTDLIB_VISIBILITY
Przemyslaw Skibinski [Thu, 15 Dec 2016 10:32:31 +0000 (11:32 +0100)] 
introduced ZSTDLIB_VISIBILITY

8 years agoimproved playTests.sh (3 480/head
Przemyslaw Skibinski [Wed, 14 Dec 2016 17:43:06 +0000 (18:43 +0100)] 
improved playTests.sh (3

8 years agoimproved playTests.sh (2)
Przemyslaw Skibinski [Wed, 14 Dec 2016 17:07:31 +0000 (18:07 +0100)] 
improved playTests.sh (2)

8 years agoimproved playTests.sh
Przemyslaw Skibinski [Wed, 14 Dec 2016 16:10:38 +0000 (17:10 +0100)] 
improved playTests.sh

8 years agoplayTests.sh: added Advanced compression parameters
Przemyslaw Skibinski [Wed, 14 Dec 2016 15:50:00 +0000 (16:50 +0100)] 
playTests.sh: added Advanced compression parameters

8 years agozstd.1: added advanced compression options
Przemyslaw Skibinski [Wed, 14 Dec 2016 15:10:13 +0000 (16:10 +0100)] 
zstd.1: added advanced compression options

8 years agoupdated manual 484/head v1.1.2
Yann Collet [Wed, 14 Dec 2016 13:53:47 +0000 (14:53 +0100)] 
updated manual

8 years agofixed "strategy" in advanced compression parameters
Przemyslaw Skibinski [Tue, 13 Dec 2016 19:04:32 +0000 (20:04 +0100)] 
fixed "strategy" in advanced compression parameters

8 years agoMerge pull request #482 from inikep/zlibWrapper
Yann Collet [Tue, 13 Dec 2016 18:50:34 +0000 (19:50 +0100)] 
Merge pull request #482 from inikep/zlibWrapper

Zlibwrapper

8 years agoupdated NEWS
Yann Collet [Tue, 13 Dec 2016 18:47:17 +0000 (19:47 +0100)] 
updated NEWS

8 years agoupdated zlib copyright notice 482/head
Przemyslaw Skibinski [Tue, 13 Dec 2016 18:44:07 +0000 (19:44 +0100)] 
updated zlib copyright notice

8 years agoMerge pull request #481 from inikep/zlibWrapper
Yann Collet [Tue, 13 Dec 2016 18:42:51 +0000 (19:42 +0100)] 
Merge pull request #481 from inikep/zlibWrapper

fixed fitblk

8 years agofixed fitblk 481/head
Przemyslaw Skibinski [Tue, 13 Dec 2016 18:14:04 +0000 (19:14 +0100)] 
fixed fitblk

8 years agochanged variable name to estimatedSrcSize, to emphasize it does not need to be exact
Yann Collet [Tue, 13 Dec 2016 16:59:55 +0000 (17:59 +0100)] 
changed variable name to estimatedSrcSize, to emphasize it does not need to be exact

8 years agoAdded ZSTD_initCStream_srcSize().
Yann Collet [Tue, 13 Dec 2016 15:39:36 +0000 (16:39 +0100)] 
Added ZSTD_initCStream_srcSize().
Added relevant test cases in zstreamtest

8 years agominor BMI version check
Yann Collet [Tue, 13 Dec 2016 14:21:06 +0000 (15:21 +0100)] 
minor BMI version check

8 years agofixed conversion warning
Przemyslaw Skibinski [Tue, 13 Dec 2016 13:52:21 +0000 (14:52 +0100)] 
fixed conversion warning

8 years agofileio.c: support advanced compression parameters
Przemyslaw Skibinski [Tue, 13 Dec 2016 12:24:59 +0000 (13:24 +0100)] 
fileio.c: support advanced compression parameters

8 years agobench.c: support advanced compression parameters
Przemyslaw Skibinski [Tue, 13 Dec 2016 12:03:41 +0000 (13:03 +0100)] 
bench.c: support advanced compression parameters

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Tue, 13 Dec 2016 11:19:19 +0000 (12:19 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agoadded parseCompressionParameters
Przemyslaw Skibinski [Tue, 13 Dec 2016 11:18:07 +0000 (12:18 +0100)] 
added parseCompressionParameters

8 years agoupdated NEWS
Yann Collet [Tue, 13 Dec 2016 10:45:19 +0000 (11:45 +0100)] 
updated NEWS

8 years agoMerge pull request #475 from DimitryAndric/fix-build-on-freebsd-1
Yann Collet [Tue, 13 Dec 2016 10:39:23 +0000 (11:39 +0100)] 
Merge pull request #475 from DimitryAndric/fix-build-on-freebsd-1

Make zstd build out of the box properly on FreeBSD

8 years agoMerge pull request #478 from terrelln/wildcopy-ub
Yann Collet [Tue, 13 Dec 2016 10:33:00 +0000 (11:33 +0100)] 
Merge pull request #478 from terrelln/wildcopy-ub

Fix execSequence wildcopy undefined behavior

8 years agoMerge pull request #479 from terrelln/decompression-bug
Yann Collet [Tue, 13 Dec 2016 10:30:37 +0000 (11:30 +0100)] 
Merge pull request #479 from terrelln/decompression-bug

Fix decompression bug

8 years agoFix execSequence wildcopy undefined behavior 478/head
Nick Terrell [Tue, 13 Dec 2016 03:01:23 +0000 (19:01 -0800)] 
Fix execSequence wildcopy undefined behavior

execSequence relied on pointer overflow to handle cases where
`sequence.matchLength < 8`.  Instead of passing an `size_t` to
wildcopy, pass a `ptrdiff_t`.

8 years agoFix decompression buffer overrun 479/head
Nick Terrell [Tue, 13 Dec 2016 02:05:30 +0000 (18:05 -0800)] 
Fix decompression buffer overrun

Allows an adversary to write up to 3 bytes beyond the end of the buffer.
Occurs if the match overlaps the `extDict` and `currentPrefix`, and the
match length in the `currentPrefix` is less than `MINMATCH`, and
`op-(16-MINMATCH) >= oMatchEnd > op-16`.

8 years agoEnable using isatty() and nanosleep() on *BSD 475/head
Dimitry Andric [Mon, 12 Dec 2016 18:24:51 +0000 (19:24 +0100)] 
Enable using isatty() and nanosleep() on *BSD

8 years agoFix running test suite on FreeBSD
Dimitry Andric [Mon, 12 Dec 2016 18:22:47 +0000 (19:22 +0100)] 
Fix running test suite on FreeBSD

* Remove last bashism from tests/playTests.sh
* Use gmd5sum from the sysutils/coreutils port

8 years agoMerge pull request #476 from inikep/dev11
Yann Collet [Mon, 12 Dec 2016 15:44:55 +0000 (16:44 +0100)] 
Merge pull request #476 from inikep/dev11

Dev11

8 years agoallow all operationg systems with _POSIX_C_SOURCE >= 200112L 476/head
Przemyslaw Skibinski [Mon, 12 Dec 2016 14:37:43 +0000 (15:37 +0100)] 
allow all operationg systems with _POSIX_C_SOURCE >= 200112L

8 years agoturn on the '-r' option for HP-UX and AIX
Przemyslaw Skibinski [Mon, 12 Dec 2016 10:59:17 +0000 (11:59 +0100)] 
turn on the '-r' option for HP-UX and AIX

8 years agoturn on the '-r' option for *BSD and Solaris
Przemyslaw Skibinski [Mon, 12 Dec 2016 10:23:21 +0000 (11:23 +0100)] 
turn on the '-r' option for *BSD and Solaris

8 years agominor coding style changes
Yann Collet [Mon, 12 Dec 2016 00:03:23 +0000 (01:03 +0100)] 
minor coding style changes

8 years agointroduced cycleLog
Yann Collet [Sun, 11 Dec 2016 23:47:30 +0000 (00:47 +0100)] 
introduced cycleLog

8 years agominor variation of rescale fix
Yann Collet [Sun, 11 Dec 2016 23:25:07 +0000 (00:25 +0100)] 
minor variation of rescale fix

8 years agoMerge pull request #474 from terrelln/compression-segfault
Yann Collet [Sun, 11 Dec 2016 21:28:24 +0000 (22:28 +0100)] 
Merge pull request #474 from terrelln/compression-segfault

Fix compression segfault

8 years agoFix longmatch test build errors. 474/head
Nick Terrell [Sun, 11 Dec 2016 07:17:36 +0000 (23:17 -0800)] 
Fix longmatch test build errors.

8 years agoSwitch uint64_t to U64
Nick Terrell [Sun, 11 Dec 2016 03:31:55 +0000 (19:31 -0800)] 
Switch uint64_t to U64

8 years agoAdd exposing test case
Nick Terrell [Sun, 11 Dec 2016 03:12:13 +0000 (19:12 -0800)] 
Add exposing test case

8 years agoSimplify segfault fix
Nick Terrell [Sun, 11 Dec 2016 02:46:55 +0000 (18:46 -0800)] 
Simplify segfault fix

Take advantage of the fact that `chainLog <= windowLog`.

8 years agoFix compression segfault
Nick Terrell [Sat, 10 Dec 2016 01:15:33 +0000 (17:15 -0800)] 
Fix compression segfault

When the overflow protection kicks in, it makes sure that ip - ctx->base
isn't too large.  However, it didn't ensure that saved offsets are
still valid.  This change ensures that any valid offsets (<= windowLog)
are still representable after the update.

The bug would shop up on line 1056, when `offset_1 > current + 1`, which
causes an underflow.  This in turn, would cause a segfault on line 1063.

The input must necessarily be longer than 1 GB for this issue to occur.
Even then, it only occurs if one of the last 3 matches is larger than
the chain size and block size.

8 years agominor lib build refactoring
Yann Collet [Fri, 9 Dec 2016 02:42:27 +0000 (18:42 -0800)] 
minor lib build refactoring