]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
5 years agoFixed test failure when Emscripten not present 1739/head
Carl Woffenden [Tue, 27 Aug 2019 15:12:57 +0000 (17:12 +0200)] 
Fixed test failure when Emscripten not present

5 years agoMinor repetition
Carl Woffenden [Tue, 27 Aug 2019 14:57:23 +0000 (16:57 +0200)] 
Minor repetition

5 years agoTypo
Carl Woffenden [Tue, 27 Aug 2019 14:55:03 +0000 (16:55 +0200)] 
Typo

5 years agoAdded clarification
Carl Woffenden [Tue, 27 Aug 2019 13:53:26 +0000 (15:53 +0200)] 
Added clarification

5 years agoAdded reasoning
Carl Woffenden [Tue, 27 Aug 2019 13:51:14 +0000 (15:51 +0200)] 
Added reasoning

5 years agoTypo
Carl Woffenden [Tue, 27 Aug 2019 13:38:34 +0000 (15:38 +0200)] 
Typo

5 years agoAdded test script; tidied and documented
Carl Woffenden [Tue, 27 Aug 2019 13:36:06 +0000 (15:36 +0200)] 
Added test script; tidied and documented

The test script combines the sources then builds and runs an example. A futher example is built if the Emscripten compiler is available on the system. Documentation covers building.

5 years agoAdded Emscripten example, removed Buck, minor tidy
Carl Woffenden [Mon, 26 Aug 2019 19:28:19 +0000 (21:28 +0200)] 
Added Emscripten example, removed Buck, minor tidy

Work-in-progress. Added simple Emscripten WebGL example that adds 25kB when build with Zstd. Removed Buck (will replace). Minor correctness.

5 years agoAble to test combine script; minor tidy
Carl Woffenden [Mon, 26 Aug 2019 05:48:57 +0000 (07:48 +0200)] 
Able to test combine script; minor tidy

5 years agoPreparing to run tests
Carl Woffenden [Sun, 25 Aug 2019 20:49:01 +0000 (22:49 +0200)] 
Preparing to run tests

Combine script more robust and can output to a specified file. Initial buck files added (work in progress).

5 years agoMinor fix for files with spaces. Typo.
Carl Woffenden [Fri, 23 Aug 2019 21:09:13 +0000 (23:09 +0200)] 
Minor fix for files with spaces. Typo.

5 years agoMerge branch 'dev' into amalgamate
Carl Woffenden [Fri, 23 Aug 2019 21:05:02 +0000 (23:05 +0200)] 
Merge branch 'dev' into amalgamate

5 years agoRevert "Merge remote-tracking branch 'origin/master' into dev"
Carl Woffenden [Fri, 23 Aug 2019 21:04:21 +0000 (23:04 +0200)] 
Revert "Merge remote-tracking branch 'origin/master' into dev"

This reverts commit 0df29a4e5ff118ec7aa870ea9c032e9f99870e43, reversing
changes made to 69c875a0cc771098f9ae9bb7a0a3e3ff6eb3f5c1.

5 years agoMerge remote-tracking branch 'upstream/dev' into dev
Carl Woffenden [Fri, 23 Aug 2019 21:03:52 +0000 (23:03 +0200)] 
Merge remote-tracking branch 'upstream/dev' into dev

5 years agoMerge remote-tracking branch 'origin/master' into dev
Carl Woffenden [Fri, 23 Aug 2019 20:57:06 +0000 (22:57 +0200)] 
Merge remote-tracking branch 'origin/master' into dev

5 years agoMerge pull request #1733 from nmagerko/size-hint
Nick Terrell [Fri, 23 Aug 2019 17:16:10 +0000 (10:16 -0700)] 
Merge pull request #1733 from nmagerko/size-hint

Add --size-hint=# option

5 years agoMerge pull request #1745 from terrelln/regression-driver
Nick Terrell [Fri, 23 Aug 2019 17:15:52 +0000 (10:15 -0700)] 
Merge pull request #1745 from terrelln/regression-driver

[fuzz] Add a DEBUGLOG(3) statement to print file

5 years agoAdded generator script and simple test
Carl Woffenden [Fri, 23 Aug 2019 16:43:29 +0000 (18:43 +0200)] 
Added generator script and simple test

The script will combine decompressor sources into a single file. The example shows this in use.

5 years ago[fuzz] Add a DEBUGLOG(3) statement to print file 1745/head
Nick Terrell [Fri, 23 Aug 2019 00:27:15 +0000 (17:27 -0700)] 
[fuzz] Add a DEBUGLOG(3) statement to print file

Enable it by building with this command:

```
./fuzz.py build all --debug 3
```

5 years agoFix merge conflicts 1733/head
Nick Magerko [Thu, 22 Aug 2019 18:51:41 +0000 (11:51 -0700)] 
Fix merge conflicts

5 years agoMerge pull request #1726 from nmagerko/stream-size
Nick Terrell [Thu, 22 Aug 2019 18:31:15 +0000 (11:31 -0700)] 
Merge pull request #1726 from nmagerko/stream-size

Add --stream-size=# option

5 years agoDifferentiate --stream-size from --size-hint 1726/head
Nick Magerko [Thu, 22 Aug 2019 16:37:47 +0000 (09:37 -0700)] 
Differentiate --stream-size from --size-hint

5 years agoMinor documentation update
Nick Magerko [Thu, 22 Aug 2019 16:13:28 +0000 (09:13 -0700)] 
Minor documentation update

5 years agoRemove bc from play tests
Nick Magerko [Wed, 21 Aug 2019 17:27:54 +0000 (10:27 -0700)] 
Remove bc from play tests

5 years agoMerge pull request #1737 from terrelln/legacy-fix
Nick Terrell [Wed, 21 Aug 2019 17:10:24 +0000 (10:10 -0700)] 
Merge pull request #1737 from terrelln/legacy-fix

[legacy] Fix buffer overflow in v0.2 and v0.4 raw literals decompression

5 years agoMerge pull request #1736 from terrelln/fuzz-fix
Nick Terrell [Wed, 21 Aug 2019 17:09:38 +0000 (10:09 -0700)] 
Merge pull request #1736 from terrelln/fuzz-fix

[fuzz] Improve fuzzer build script and docs

5 years agoTweaks to create a single-file decoder
Carl Woffenden [Wed, 21 Aug 2019 15:49:17 +0000 (17:49 +0200)] 
Tweaks to create a single-file decoder

The CHECK_F macros differ slightly (but eventually do the same thing). Older GCC needs to fallback on the old-style pragma optimisation flags.

5 years agoMerge pull request #1724 from facebook/blockSize
Yann Collet [Wed, 21 Aug 2019 12:19:43 +0000 (05:19 -0700)] 
Merge pull request #1724 from facebook/blockSize

clarifications on field `Block_Size`

5 years agoMerge pull request #1725 from emaste/dev
Yann Collet [Wed, 21 Aug 2019 12:19:30 +0000 (05:19 -0700)] 
Merge pull request #1725 from emaste/dev

remove extraneous doubled ;s

5 years agoMerge pull request #1721 from facebook/seq127
Yann Collet [Wed, 21 Aug 2019 12:19:12 +0000 (05:19 -0700)] 
Merge pull request #1721 from facebook/seq127

fixed very minor inefficiency (nbSeq==127)

5 years agoMerge pull request #1713 from cemeyer/fix_gcc4_build
Yann Collet [Wed, 21 Aug 2019 12:17:42 +0000 (05:17 -0700)] 
Merge pull request #1713 from cemeyer/fix_gcc4_build

Fix the build on GCC 4.x after 812e8f2a1

5 years ago[legacy] Fix buffer overflow in v0.2 and v0.4 raw literals decompression 1737/head
Nick Terrell [Wed, 21 Aug 2019 00:13:04 +0000 (17:13 -0700)] 
[legacy] Fix buffer overflow in v0.2 and v0.4 raw literals decompression

Extends the fix in PR#1722 to v0.2 and v0.4. These aren't built into
zstd by default, and v0.5 onward are not affected.

I only add the `srcSize > BLOCKSIZE` check to v0.4 because the comments
say that it must hold, but the equivalent comment isn't present in v0.2.

Credit to OSS-Fuzz.

5 years ago[fuzz] Improve fuzzer build script and docs 1736/head
Nick Terrell [Tue, 20 Aug 2019 18:33:33 +0000 (11:33 -0700)] 
[fuzz] Improve fuzzer build script and docs

* Remove the `make libFuzzer` target since it is broken and obsoleted
  by `CC=clang CXX=clang++ ./fuzz.py build all --enable-fuzzer`. The
  new `-fsanitize=fuzzer` is much better because it works with MSAN
  by default.
* Improve the `./fuzz.py gen` command by making the input type explicit
  when creating a new target.
* Update the `README` for `--enable-fuzzer`.

Fixes #1727.

5 years agoDocument --size-hint
Nick Magerko [Tue, 20 Aug 2019 21:08:26 +0000 (14:08 -0700)] 
Document --size-hint

5 years agoFix ZSTD_SRCSIZEHINT_MIN typo
Nick Magerko [Tue, 20 Aug 2019 20:07:51 +0000 (13:07 -0700)] 
Fix ZSTD_SRCSIZEHINT_MIN typo

5 years agoDefine ZSTD_SRCSIZEHINT_MIN as 0
Nick Magerko [Tue, 20 Aug 2019 20:06:15 +0000 (13:06 -0700)] 
Define ZSTD_SRCSIZEHINT_MIN as 0

5 years agoRemove unnecessary test case
Nick Magerko [Tue, 20 Aug 2019 00:20:46 +0000 (17:20 -0700)] 
Remove unnecessary test case

5 years agoFix typo in test
Nick Magerko [Mon, 19 Aug 2019 23:53:02 +0000 (16:53 -0700)] 
Fix typo in test

5 years agoRevert change to zstd manual
Nick Magerko [Mon, 19 Aug 2019 23:50:26 +0000 (16:50 -0700)] 
Revert change to zstd manual

5 years agoUse int for srcSizeHint when sensible
Nick Magerko [Mon, 19 Aug 2019 23:49:25 +0000 (16:49 -0700)] 
Use int for srcSizeHint when sensible

5 years agoFix playTests and add additional cases
Nick Magerko [Mon, 19 Aug 2019 23:48:35 +0000 (16:48 -0700)] 
Fix playTests and add additional cases

5 years agoAdd size-hint to fuzz tests
Nick Magerko [Mon, 19 Aug 2019 22:12:24 +0000 (15:12 -0700)] 
Add size-hint to fuzz tests

5 years agov1.4.3: Merge pull request #1730 from facebook/dev v1.4.3
Felix Handte [Mon, 19 Aug 2019 20:48:01 +0000 (16:48 -0400)] 
v1.4.3: Merge pull request #1730 from facebook/dev

5 years agoAdd mention of regression with poor size hints
Nick Magerko [Mon, 19 Aug 2019 20:08:41 +0000 (13:08 -0700)] 
Add mention of regression with poor size hints

5 years agoMake upper bound INT_MAX
Nick Magerko [Mon, 19 Aug 2019 19:58:54 +0000 (12:58 -0700)] 
Make upper bound INT_MAX

5 years agoFix fall-through case
Nick Magerko [Mon, 19 Aug 2019 19:32:43 +0000 (12:32 -0700)] 
Fix fall-through case

5 years agoAdd --size-hint=# option
Nick Magerko [Mon, 19 Aug 2019 15:52:08 +0000 (08:52 -0700)] 
Add --size-hint=# option

5 years agoKeep content size flag set in stream size mode
Nick Magerko [Mon, 19 Aug 2019 18:20:28 +0000 (11:20 -0700)] 
Keep content size flag set in stream size mode

5 years agoRemove extraneous variables
Nick Magerko [Mon, 19 Aug 2019 18:14:56 +0000 (11:14 -0700)] 
Remove extraneous variables

5 years agoRemove extraneous parameter
Nick Magerko [Mon, 19 Aug 2019 18:07:43 +0000 (11:07 -0700)] 
Remove extraneous parameter

5 years agoUpdate man page
Nick Magerko [Mon, 19 Aug 2019 16:11:22 +0000 (09:11 -0700)] 
Update man page

5 years agoSet pledged size just before compression
Nick Magerko [Mon, 19 Aug 2019 16:01:31 +0000 (09:01 -0700)] 
Set pledged size just before compression

5 years ago`number` instead of `nb` 1724/head
Yann Collet [Sat, 17 Aug 2019 06:04:42 +0000 (08:04 +0200)] 
`number` instead of `nb`

suggested by @terrelln

5 years agoTweak stdout, stderr redirection in new playTests
Nick Magerko [Fri, 16 Aug 2019 19:49:21 +0000 (12:49 -0700)] 
Tweak stdout, stderr redirection in new  playTests

5 years agoAdd --stream-size=# command
Nick Magerko [Fri, 16 Aug 2019 06:57:55 +0000 (23:57 -0700)] 
Add --stream-size=# command

5 years agoclarifications on the meaning of field `Block_Size`
Yann Collet [Fri, 16 Aug 2019 13:13:42 +0000 (15:13 +0200)] 
clarifications on the meaning of field `Block_Size`

following comments from Intel's Smita Kumar.

5 years agoremove extraneous doubled ;s 1725/head
Ed Maste [Fri, 16 Aug 2019 01:17:06 +0000 (21:17 -0400)] 
remove extraneous doubled ;s

5 years agoMerge pull request #1722 from felixhandte/legacy-decompression-fix 1730/head
Felix Handte [Thu, 15 Aug 2019 19:55:46 +0000 (15:55 -0400)] 
Merge pull request #1722 from felixhandte/legacy-decompression-fix

Fix Buffer Overflow in Legacy (v0.3) Raw Literals Decompression

5 years agoAdd to CHANGELOG for Upcoming Release 1722/head
W. Felix Handte [Thu, 15 Aug 2019 18:42:38 +0000 (14:42 -0400)] 
Add to CHANGELOG for Upcoming Release

5 years agoFix Buffer Overflow in Legacy (v0.3) Raw Literals Decompression
W. Felix Handte [Thu, 15 Aug 2019 18:24:45 +0000 (14:24 -0400)] 
Fix Buffer Overflow in Legacy (v0.3) Raw Literals Decompression

5 years agofixed very minor inefficiency (nbSeq==127) 1721/head
Yann Collet [Thu, 15 Aug 2019 14:41:34 +0000 (16:41 +0200)] 
fixed very minor inefficiency (nbSeq==127)

The nbSeq "short" format (1-byte)
is compatible with any value < 128.

However, the code would cautiously only accept values < 127.
This is not an error, because the general 2-bytes format
is compatible with small values < 128.
Hence the inefficiency never triggered any warning.

Spotted by Intel's Smita Kumar.

6 years agoFix the build on GCC 4.x after 812e8f2a1 1713/head
Conrad Meyer [Thu, 8 Aug 2019 21:16:36 +0000 (14:16 -0700)] 
Fix the build on GCC 4.x after 812e8f2a1

The ancient GCC 4.x doesn't understand the "optimize" attribute until 4.4.
Fix the build on platforms with GCC 4.x < 4.4 by limiting the DONT_VECTORIZE
definition to GCC 5 and greater.

Noticed and patch proposed by Warner Losh <imp@FreeBSD.org>.

6 years agoMerge pull request #1711 from felixhandte/changelog-v1.4.3
Felix Handte [Tue, 6 Aug 2019 21:02:37 +0000 (17:02 -0400)] 
Merge pull request #1711 from felixhandte/changelog-v1.4.3

Update Changelog for v1.4.3

6 years agoUpdate Changelog for v1.4.3 1711/head
W. Felix Handte [Tue, 6 Aug 2019 17:44:05 +0000 (13:44 -0400)] 
Update Changelog for v1.4.3

6 years agobumped version number
Yann Collet [Mon, 5 Aug 2019 15:17:16 +0000 (17:17 +0200)] 
bumped version number

to v1.4.3

6 years agoMerge pull request #1705 from josepho0918/dev
Yann Collet [Mon, 5 Aug 2019 13:57:28 +0000 (15:57 +0200)] 
Merge pull request #1705 from josepho0918/dev

Add support for IAR C/C++ Compiler for Arm

6 years agoMerge pull request #1706 from LeeYoung624/dev
Yann Collet [Mon, 5 Aug 2019 13:56:50 +0000 (15:56 +0200)] 
Merge pull request #1706 from LeeYoung624/dev

add NULL pointer check in util.c

6 years agoMerge pull request #1709 from facebook/fix1624
Yann Collet [Mon, 5 Aug 2019 13:54:59 +0000 (15:54 +0200)] 
Merge pull request #1709 from facebook/fix1624

Fix compression ratio inefficiency

6 years agofactored the logic selecting lowest match index 1709/head
Yann Collet [Mon, 5 Aug 2019 13:18:43 +0000 (15:18 +0200)] 
factored the logic selecting lowest match index

as suggested by @terrelln

6 years agofix test 122
Yann Collet [Sat, 3 Aug 2019 14:43:34 +0000 (16:43 +0200)] 
fix test 122

it's an unsupported scenario.

6 years agominor test refactoring
Yann Collet [Fri, 2 Aug 2019 17:31:19 +0000 (19:31 +0200)] 
minor test refactoring

just for clarity, for the currently failing unit test

6 years agofixed minor conversion warning in datagen
Yann Collet [Fri, 2 Aug 2019 16:02:54 +0000 (18:02 +0200)] 
fixed minor conversion warning in datagen

6 years agofixed datagen
Yann Collet [Fri, 2 Aug 2019 15:34:53 +0000 (17:34 +0200)] 
fixed datagen

to produce same content on both 32 and 64-bit platforms
by removing floating from literal table determination.

also : added checksum trace in compression control test,
so that it's easier to determine if test fails
as a consequence of compressing a different sample.

6 years agoregenerate sample to compress
Yann Collet [Fri, 2 Aug 2019 13:31:00 +0000 (15:31 +0200)] 
regenerate sample to compress

to reduce chances of differences between 32 and 64-bit fuzzer tests

6 years agofixed strategies btopt+
Yann Collet [Fri, 2 Aug 2019 12:42:53 +0000 (14:42 +0200)] 
fixed strategies btopt+

6 years agofixed strategy btlazy2
Yann Collet [Fri, 2 Aug 2019 12:26:26 +0000 (14:26 +0200)] 
fixed strategy btlazy2

6 years agofixed strategies greedy, lazy & lazy2
Yann Collet [Fri, 2 Aug 2019 12:21:39 +0000 (14:21 +0200)] 
fixed strategies greedy, lazy & lazy2

restore dictionary compression ratio

6 years agominor : fixed ptr arithmetic
Yann Collet [Thu, 1 Aug 2019 15:12:26 +0000 (17:12 +0200)] 
minor : fixed ptr arithmetic

invalid on void ptr

6 years agoadded efficiency test
Yann Collet [Thu, 1 Aug 2019 14:59:22 +0000 (16:59 +0200)] 
added efficiency test

to detect gross CR variations after a patch.

Tests normal and dictionary compression.

6 years agofixed compression ratio regression when dictionary-compressing medium-size inputs...
Yann Collet [Thu, 1 Aug 2019 13:58:17 +0000 (15:58 +0200)] 
fixed compression ratio regression when dictionary-compressing medium-size inputs at levels 1-3

6 years agoMerge pull request #1707 from felixhandte/travis-versions-test
Yann Collet [Wed, 31 Jul 2019 11:43:00 +0000 (13:43 +0200)] 
Merge pull request #1707 from felixhandte/travis-versions-test

Run `versionsTest` in CI

6 years agoRun `versionsTest` in CI 1707/head
W. Felix Handte [Wed, 31 Jul 2019 00:11:25 +0000 (20:11 -0400)] 
Run `versionsTest` in CI

6 years agobug fix : NULL pointer 1706/head
LeeYoung624 [Mon, 29 Jul 2019 09:05:50 +0000 (17:05 +0800)] 
bug fix : NULL pointer

6 years agoAdd support for IAR C/C++ Compiler for Arm 1705/head
Joseph Chen [Mon, 29 Jul 2019 07:20:37 +0000 (15:20 +0800)] 
Add support for IAR C/C++ Compiler for Arm

6 years agov1.4.2: Merge pull request #1700 from facebook/dev v1.4.2
Felix Handte [Thu, 25 Jul 2019 17:44:51 +0000 (13:44 -0400)] 
v1.4.2: Merge pull request #1700 from facebook/dev

6 years agoMerge pull request #1701 from LeeYoung624/dev 1700/head
Felix Handte [Thu, 25 Jul 2019 15:56:37 +0000 (11:56 -0400)] 
Merge pull request #1701 from LeeYoung624/dev

memory leak fix

6 years agomemory leak fix 1701/head
LeeYoung624 [Thu, 25 Jul 2019 13:07:57 +0000 (21:07 +0800)] 
memory leak fix

6 years agoMerge pull request #1699 from felixhandte/seekable-gitignore
Felix Handte [Wed, 24 Jul 2019 23:07:55 +0000 (19:07 -0400)] 
Merge pull request #1699 from felixhandte/seekable-gitignore

Add New Seekable Compression Example to .gitignore

6 years agoupdated man page
Yann Collet [Wed, 24 Jul 2019 23:04:37 +0000 (16:04 -0700)] 
updated man page

6 years agoMerge pull request #1698 from felixhandte/bump-version-to-1.4.2
Yann Collet [Wed, 24 Jul 2019 23:03:01 +0000 (16:03 -0700)] 
Merge pull request #1698 from felixhandte/bump-version-to-1.4.2

Bump Library Version Number to 1.4.2

6 years agoMerge pull request #1690 from piguin/dev
Yann Collet [Wed, 24 Jul 2019 22:37:05 +0000 (15:37 -0700)] 
Merge pull request #1690 from piguin/dev

fix compiling errors with clang-8

6 years agoMerge pull request #1697 from Tyler-Tran/dev
Yann Collet [Wed, 24 Jul 2019 22:35:11 +0000 (15:35 -0700)] 
Merge pull request #1697 from Tyler-Tran/dev

Adding documentation for --shrink flag

6 years agoAdd New Seekable Compression Example to .gitignore 1699/head
W. Felix Handte [Wed, 24 Jul 2019 22:22:20 +0000 (18:22 -0400)] 
Add New Seekable Compression Example to .gitignore

6 years agoUpdate Manual 1698/head
W. Felix Handte [Wed, 24 Jul 2019 22:21:11 +0000 (18:21 -0400)] 
Update Manual

6 years agoUpdate CHANGELOG
W. Felix Handte [Wed, 24 Jul 2019 21:35:52 +0000 (17:35 -0400)] 
Update CHANGELOG

6 years agoBump Library Version Number to 1.4.2
W. Felix Handte [Wed, 24 Jul 2019 21:28:04 +0000 (17:28 -0400)] 
Bump Library Version Number to 1.4.2

6 years agoprevious commit did not undo all changes 1697/head
Tyler Tran [Wed, 24 Jul 2019 20:53:50 +0000 (13:53 -0700)] 
previous commit did not undo all changes

6 years agoremoving changes to zstd.1
Tyler Tran [Wed, 24 Jul 2019 20:52:34 +0000 (13:52 -0700)] 
removing changes to zstd.1

6 years agomodifying minor nit
Tyler Tran [Mon, 22 Jul 2019 23:36:44 +0000 (16:36 -0700)] 
modifying minor nit

6 years agoAdding documentation for shrink flag PR #1656
Tyler Tran [Mon, 22 Jul 2019 23:33:22 +0000 (16:33 -0700)] 
Adding documentation for shrink flag PR #1656