]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
5 years agoAddressing nits 1777/head
Dario Pavlovic [Mon, 9 Sep 2019 23:13:24 +0000 (16:13 -0700)] 
Addressing nits

5 years agoFixing issues with double usage of data.
Dario Pavlovic [Mon, 9 Sep 2019 22:39:04 +0000 (15:39 -0700)] 
Fixing issues with double usage of data.

5 years ago[Fuzz] Improve data generation #1723
Dario Pavlovic [Mon, 9 Sep 2019 15:43:22 +0000 (08:43 -0700)] 
[Fuzz] Improve data generation #1723

5 years agoMerge pull request #1771 from vnair81/dev
Yann Collet [Sat, 7 Sep 2019 00:02:53 +0000 (17:02 -0700)] 
Merge pull request #1771 from vnair81/dev

Passing ZSTD_CCtx_params by const pointer

5 years agoFixing assert and DEBUGLOG due to ZSTD_CCtx_params parameter change to const pointer 1771/head
Varun S Nair [Thu, 5 Sep 2019 10:17:17 +0000 (15:47 +0530)] 
Fixing assert and DEBUGLOG due to ZSTD_CCtx_params parameter change to const pointer

5 years agoPassing ZSTD_CCtx_params by const pointer
Varun S Nair [Thu, 5 Sep 2019 09:58:30 +0000 (15:28 +0530)] 
Passing ZSTD_CCtx_params by const pointer

5 years agoMerge pull request #1770 from cwoffenden/amalgamate-correctness
Yann Collet [Wed, 4 Sep 2019 21:51:23 +0000 (14:51 -0700)] 
Merge pull request #1770 from cwoffenden/amalgamate-correctness

Single file decoder correctness and tidy

5 years agoMinor: documented sizes smaller 1770/head
Carl Woffenden [Mon, 2 Sep 2019 16:15:31 +0000 (18:15 +0200)] 
Minor: documented sizes smaller

5 years agoCorrectness and tidy
Carl Woffenden [Mon, 2 Sep 2019 16:02:50 +0000 (18:02 +0200)] 
Correctness and tidy

Test compilation performed with warnings. Author and license added. Test for failing grep on ancient OSX versions. Replaced the test image with something less noisy (which compresses better).

5 years agoMerge pull request #1769 from cybojanek/update_streaming_examples
Yann Collet [Mon, 2 Sep 2019 01:11:54 +0000 (18:11 -0700)] 
Merge pull request #1769 from cybojanek/update_streaming_examples

Fix streaming compression/decompression examples

5 years agoFix streaming compression/decompression examples 1769/head
Jan Kasiak [Sun, 1 Sep 2019 19:35:53 +0000 (15:35 -0400)] 
Fix streaming compression/decompression examples

* Handle compression of empty file
* Error in decompression in case of trailing data

5 years agoMerge pull request #1761 from terrelln/regression
Yann Collet [Fri, 30 Aug 2019 17:48:02 +0000 (10:48 -0700)] 
Merge pull request #1761 from terrelln/regression

[regression] small improvement from RLE blocks

5 years ago[regression] small improvement from RLE blocks 1761/head
Nick Terrell [Fri, 30 Aug 2019 01:05:58 +0000 (18:05 -0700)] 
[regression] small improvement from RLE blocks

5 years agoMerge pull request #1744 from bimbashrestha/dev
Yann Collet [Thu, 29 Aug 2019 22:19:10 +0000 (15:19 -0700)] 
Merge pull request #1744 from bimbashrestha/dev

Generate RLE blocks in the encoder

5 years agoMerge pull request #1754 from facebook/decTest
Yann Collet [Thu, 29 Aug 2019 19:09:09 +0000 (12:09 -0700)] 
Merge pull request #1754 from facebook/decTest

Tests for single-file decompressor

5 years agoUndoing the last commit (that was an accident) 1744/head
Bimba Shrestha [Thu, 29 Aug 2019 19:05:47 +0000 (12:05 -0700)] 
Undoing the last commit (that was an accident)

5 years agoAdding method for extracting sequences.
bimbashrestha [Thu, 29 Aug 2019 18:55:12 +0000 (11:55 -0700)] 
Adding method for extracting sequences.

5 years agoMerge branch 'dev' into decTest 1754/head
Yann Collet [Thu, 29 Aug 2019 16:48:12 +0000 (09:48 -0700)] 
Merge branch 'dev' into decTest

5 years agoMerge pull request #1755 from cwoffenden/amalgamate-c99-fixes
Yann Collet [Thu, 29 Aug 2019 16:47:28 +0000 (09:47 -0700)] 
Merge pull request #1755 from cwoffenden/amalgamate-c99-fixes

C99 and older GCC fixes

5 years agoC99 and older GCC fixes 1755/head
Carl Woffenden [Thu, 29 Aug 2019 09:16:57 +0000 (11:16 +0200)] 
C99 and older GCC fixes

5 years agoupdate test script
Yann Collet [Wed, 28 Aug 2019 20:46:18 +0000 (13:46 -0700)] 
update test script

5 years agofix create_ script for sh
Yann Collet [Wed, 28 Aug 2019 20:23:48 +0000 (13:23 -0700)] 
fix create_ script for sh

5 years agoMerge pull request #1749 from facebook/rmadapt
Yann Collet [Wed, 28 Aug 2019 19:26:29 +0000 (12:26 -0700)] 
Merge pull request #1749 from facebook/rmadapt

removed adaptive-compression

5 years agoMerge branch 'dev' into decTest
Yann Collet [Wed, 28 Aug 2019 19:17:29 +0000 (12:17 -0700)] 
Merge branch 'dev' into decTest

5 years agoMerge pull request #1750 from cwoffenden/amalgamate-bash2sh
Yann Collet [Wed, 28 Aug 2019 19:14:29 +0000 (12:14 -0700)] 
Merge pull request #1750 from cwoffenden/amalgamate-bash2sh

Rewrote the scripts to use sh instead of bash

5 years agoRewrote the scripts to sh instead of bash 1750/head
Carl Woffenden [Wed, 28 Aug 2019 17:20:42 +0000 (19:20 +0200)] 
Rewrote the scripts to sh instead of bash

5 years agoAdded test for multiple blocks of zeros and fixed nit about comments
bimbashrestha [Wed, 28 Aug 2019 15:32:34 +0000 (08:32 -0700)] 
Added test for multiple blocks of zeros and fixed nit about comments

5 years agotry to debug issues on CirrusCI
Yann Collet [Tue, 27 Aug 2019 23:38:21 +0000 (16:38 -0700)] 
try to debug issues on CirrusCI

5 years agoadded single_file_decoder to contrib/ tests
Yann Collet [Tue, 27 Aug 2019 23:04:12 +0000 (16:04 -0700)] 
added single_file_decoder to contrib/ tests

5 years agominor script renaming, for clarity
Yann Collet [Tue, 27 Aug 2019 23:01:39 +0000 (16:01 -0700)] 
minor script renaming, for clarity

5 years agochanged contrib project name for clarity
Yann Collet [Tue, 27 Aug 2019 22:50:47 +0000 (15:50 -0700)] 
changed contrib project name for clarity

5 years agoremoved associated test 1749/head
Yann Collet [Tue, 27 Aug 2019 21:50:18 +0000 (14:50 -0700)] 
removed associated test

5 years agoremoved adaptive-compression
Yann Collet [Tue, 27 Aug 2019 21:47:40 +0000 (14:47 -0700)] 
removed adaptive-compression

the functionality is already integrated into `zstd` through `--adapt` command

5 years agoMerge pull request #1748 from terrelln/cover-deadlock
Nick Terrell [Tue, 27 Aug 2019 17:17:28 +0000 (10:17 -0700)] 
Merge pull request #1748 from terrelln/cover-deadlock

[dictBuilder] Fix deadlock in *COVER error case

5 years agoMerge pull request #1739 from cwoffenden/amalgamate
Yann Collet [Tue, 27 Aug 2019 17:05:26 +0000 (10:05 -0700)] 
Merge pull request #1739 from cwoffenden/amalgamate

Tweaks to create a single-file decompressor

5 years agoFixed test failure when Emscripten not present 1739/head
Carl Woffenden [Tue, 27 Aug 2019 15:12:57 +0000 (17:12 +0200)] 
Fixed test failure when Emscripten not present

5 years agoMinor repetition
Carl Woffenden [Tue, 27 Aug 2019 14:57:23 +0000 (16:57 +0200)] 
Minor repetition

5 years agoTypo
Carl Woffenden [Tue, 27 Aug 2019 14:55:03 +0000 (16:55 +0200)] 
Typo

5 years agoAdded clarification
Carl Woffenden [Tue, 27 Aug 2019 13:53:26 +0000 (15:53 +0200)] 
Added clarification

5 years agoAdded reasoning
Carl Woffenden [Tue, 27 Aug 2019 13:51:14 +0000 (15:51 +0200)] 
Added reasoning

5 years agoTypo
Carl Woffenden [Tue, 27 Aug 2019 13:38:34 +0000 (15:38 +0200)] 
Typo

5 years agoAdded test script; tidied and documented
Carl Woffenden [Tue, 27 Aug 2019 13:36:06 +0000 (15:36 +0200)] 
Added test script; tidied and documented

The test script combines the sources then builds and runs an example. A futher example is built if the Emscripten compiler is available on the system. Documentation covers building.

5 years ago[test][dictBuilder] Add multithreaded tests 1748/head
Nick Terrell [Tue, 27 Aug 2019 01:32:08 +0000 (18:32 -0700)] 
[test][dictBuilder] Add multithreaded tests

5 years ago[dictBuilder] Fix deadlock in *COVER error case
Nick Terrell [Tue, 27 Aug 2019 01:19:29 +0000 (18:19 -0700)] 
[dictBuilder] Fix deadlock in *COVER error case

The COVER and FASTCOVER dictionary builders can deadlock when
dictionary construction errors, likely because there are too few
samples, or too few distinct dmers. The deadlock only occurs when
there are errors.

Fixes #1746.

5 years agoAdded bool to cctx and fixed some comment nits
bimbashrestha [Mon, 26 Aug 2019 22:30:41 +0000 (15:30 -0700)] 
Added bool to cctx and fixed some comment nits

5 years agoFixing mixed declaration compiler complaint
bimbashrestha [Mon, 26 Aug 2019 22:00:50 +0000 (15:00 -0700)] 
Fixing mixed declaration compiler complaint

5 years agoForbiding emission of RLE when its the first block
bimbashrestha [Mon, 26 Aug 2019 21:54:29 +0000 (14:54 -0700)] 
Forbiding emission of RLE when its the first block

5 years agoRemoving accidental method call
bimbashrestha [Mon, 26 Aug 2019 21:34:43 +0000 (14:34 -0700)] 
Removing accidental method call

5 years agoAdded Emscripten example, removed Buck, minor tidy
Carl Woffenden [Mon, 26 Aug 2019 19:28:19 +0000 (21:28 +0200)] 
Added Emscripten example, removed Buck, minor tidy

Work-in-progress. Added simple Emscripten WebGL example that adds 25kB when build with Zstd. Removed Buck (will replace). Minor correctness.

5 years agoRemoving assert for rle that doesn't always hold
bimbashrestha [Mon, 26 Aug 2019 19:26:53 +0000 (12:26 -0700)] 
Removing assert for rle that doesn't always hold

5 years agoUsing typedef U32 instead of int
bimbashrestha [Mon, 26 Aug 2019 16:00:22 +0000 (09:00 -0700)] 
Using typedef U32 instead of int

5 years agoRemoving implicit conversion from const void* to const BYTE* and added constant for...
bimbashrestha [Mon, 26 Aug 2019 15:51:34 +0000 (08:51 -0700)] 
Removing implicit conversion from const void* to const BYTE* and added constant for threshold

5 years agoAble to test combine script; minor tidy
Carl Woffenden [Mon, 26 Aug 2019 05:48:57 +0000 (07:48 +0200)] 
Able to test combine script; minor tidy

5 years agoPreparing to run tests
Carl Woffenden [Sun, 25 Aug 2019 20:49:01 +0000 (22:49 +0200)] 
Preparing to run tests

Combine script more robust and can output to a specified file. Initial buck files added (work in progress).

5 years agoMinor fix for files with spaces. Typo.
Carl Woffenden [Fri, 23 Aug 2019 21:09:13 +0000 (23:09 +0200)] 
Minor fix for files with spaces. Typo.

5 years agoMerge branch 'dev' into amalgamate
Carl Woffenden [Fri, 23 Aug 2019 21:05:02 +0000 (23:05 +0200)] 
Merge branch 'dev' into amalgamate

5 years agoRevert "Merge remote-tracking branch 'origin/master' into dev"
Carl Woffenden [Fri, 23 Aug 2019 21:04:21 +0000 (23:04 +0200)] 
Revert "Merge remote-tracking branch 'origin/master' into dev"

This reverts commit 0df29a4e5ff118ec7aa870ea9c032e9f99870e43, reversing
changes made to 69c875a0cc771098f9ae9bb7a0a3e3ff6eb3f5c1.

5 years agoMerge remote-tracking branch 'upstream/dev' into dev
Carl Woffenden [Fri, 23 Aug 2019 21:03:52 +0000 (23:03 +0200)] 
Merge remote-tracking branch 'upstream/dev' into dev

5 years agoMerge remote-tracking branch 'origin/master' into dev
Carl Woffenden [Fri, 23 Aug 2019 20:57:06 +0000 (22:57 +0200)] 
Merge remote-tracking branch 'origin/master' into dev

5 years agoMerge pull request #1733 from nmagerko/size-hint
Nick Terrell [Fri, 23 Aug 2019 17:16:10 +0000 (10:16 -0700)] 
Merge pull request #1733 from nmagerko/size-hint

Add --size-hint=# option

5 years agoMerge pull request #1745 from terrelln/regression-driver
Nick Terrell [Fri, 23 Aug 2019 17:15:52 +0000 (10:15 -0700)] 
Merge pull request #1745 from terrelln/regression-driver

[fuzz] Add a DEBUGLOG(3) statement to print file

5 years agoAdded generator script and simple test
Carl Woffenden [Fri, 23 Aug 2019 16:43:29 +0000 (18:43 +0200)] 
Added generator script and simple test

The script will combine decompressor sources into a single file. The example shows this in use.

5 years ago[fuzz] Add a DEBUGLOG(3) statement to print file 1745/head
Nick Terrell [Fri, 23 Aug 2019 00:27:15 +0000 (17:27 -0700)] 
[fuzz] Add a DEBUGLOG(3) statement to print file

Enable it by building with this command:

```
./fuzz.py build all --debug 3
```

5 years agoFixing more test falure errors
bimbashrestha [Thu, 22 Aug 2019 20:54:41 +0000 (13:54 -0700)] 
Fixing more test falure errors

5 years agoFixing ci-circle test failure issues
bimbashrestha [Thu, 22 Aug 2019 20:46:15 +0000 (13:46 -0700)] 
Fixing ci-circle test failure issues

5 years agoMoving RLE logic to inside ZSTD_compressBlock_internal and adding assert
bimbashrestha [Thu, 22 Aug 2019 19:12:44 +0000 (12:12 -0700)] 
Moving RLE logic to inside ZSTD_compressBlock_internal and adding assert

5 years agoFix merge conflicts 1733/head
Nick Magerko [Thu, 22 Aug 2019 18:51:41 +0000 (11:51 -0700)] 
Fix merge conflicts

5 years agoMerge pull request #1726 from nmagerko/stream-size
Nick Terrell [Thu, 22 Aug 2019 18:31:15 +0000 (11:31 -0700)] 
Merge pull request #1726 from nmagerko/stream-size

Add --stream-size=# option

5 years agoGenerate RLE blocks in the encoder
bimbashrestha [Thu, 22 Aug 2019 18:27:20 +0000 (11:27 -0700)] 
Generate RLE blocks in the encoder

5 years agoDifferentiate --stream-size from --size-hint 1726/head
Nick Magerko [Thu, 22 Aug 2019 16:37:47 +0000 (09:37 -0700)] 
Differentiate --stream-size from --size-hint

5 years agoMinor documentation update
Nick Magerko [Thu, 22 Aug 2019 16:13:28 +0000 (09:13 -0700)] 
Minor documentation update

5 years agoRemove bc from play tests
Nick Magerko [Wed, 21 Aug 2019 17:27:54 +0000 (10:27 -0700)] 
Remove bc from play tests

5 years agoMerge pull request #1737 from terrelln/legacy-fix
Nick Terrell [Wed, 21 Aug 2019 17:10:24 +0000 (10:10 -0700)] 
Merge pull request #1737 from terrelln/legacy-fix

[legacy] Fix buffer overflow in v0.2 and v0.4 raw literals decompression

5 years agoMerge pull request #1736 from terrelln/fuzz-fix
Nick Terrell [Wed, 21 Aug 2019 17:09:38 +0000 (10:09 -0700)] 
Merge pull request #1736 from terrelln/fuzz-fix

[fuzz] Improve fuzzer build script and docs

5 years agoTweaks to create a single-file decoder
Carl Woffenden [Wed, 21 Aug 2019 15:49:17 +0000 (17:49 +0200)] 
Tweaks to create a single-file decoder

The CHECK_F macros differ slightly (but eventually do the same thing). Older GCC needs to fallback on the old-style pragma optimisation flags.

5 years agoMerge pull request #1724 from facebook/blockSize
Yann Collet [Wed, 21 Aug 2019 12:19:43 +0000 (05:19 -0700)] 
Merge pull request #1724 from facebook/blockSize

clarifications on field `Block_Size`

5 years agoMerge pull request #1725 from emaste/dev
Yann Collet [Wed, 21 Aug 2019 12:19:30 +0000 (05:19 -0700)] 
Merge pull request #1725 from emaste/dev

remove extraneous doubled ;s

5 years agoMerge pull request #1721 from facebook/seq127
Yann Collet [Wed, 21 Aug 2019 12:19:12 +0000 (05:19 -0700)] 
Merge pull request #1721 from facebook/seq127

fixed very minor inefficiency (nbSeq==127)

5 years agoMerge pull request #1713 from cemeyer/fix_gcc4_build
Yann Collet [Wed, 21 Aug 2019 12:17:42 +0000 (05:17 -0700)] 
Merge pull request #1713 from cemeyer/fix_gcc4_build

Fix the build on GCC 4.x after 812e8f2a1

5 years ago[legacy] Fix buffer overflow in v0.2 and v0.4 raw literals decompression 1737/head
Nick Terrell [Wed, 21 Aug 2019 00:13:04 +0000 (17:13 -0700)] 
[legacy] Fix buffer overflow in v0.2 and v0.4 raw literals decompression

Extends the fix in PR#1722 to v0.2 and v0.4. These aren't built into
zstd by default, and v0.5 onward are not affected.

I only add the `srcSize > BLOCKSIZE` check to v0.4 because the comments
say that it must hold, but the equivalent comment isn't present in v0.2.

Credit to OSS-Fuzz.

5 years ago[fuzz] Improve fuzzer build script and docs 1736/head
Nick Terrell [Tue, 20 Aug 2019 18:33:33 +0000 (11:33 -0700)] 
[fuzz] Improve fuzzer build script and docs

* Remove the `make libFuzzer` target since it is broken and obsoleted
  by `CC=clang CXX=clang++ ./fuzz.py build all --enable-fuzzer`. The
  new `-fsanitize=fuzzer` is much better because it works with MSAN
  by default.
* Improve the `./fuzz.py gen` command by making the input type explicit
  when creating a new target.
* Update the `README` for `--enable-fuzzer`.

Fixes #1727.

5 years agoDocument --size-hint
Nick Magerko [Tue, 20 Aug 2019 21:08:26 +0000 (14:08 -0700)] 
Document --size-hint

5 years agoFix ZSTD_SRCSIZEHINT_MIN typo
Nick Magerko [Tue, 20 Aug 2019 20:07:51 +0000 (13:07 -0700)] 
Fix ZSTD_SRCSIZEHINT_MIN typo

5 years agoDefine ZSTD_SRCSIZEHINT_MIN as 0
Nick Magerko [Tue, 20 Aug 2019 20:06:15 +0000 (13:06 -0700)] 
Define ZSTD_SRCSIZEHINT_MIN as 0

5 years agoRemove unnecessary test case
Nick Magerko [Tue, 20 Aug 2019 00:20:46 +0000 (17:20 -0700)] 
Remove unnecessary test case

5 years agoFix typo in test
Nick Magerko [Mon, 19 Aug 2019 23:53:02 +0000 (16:53 -0700)] 
Fix typo in test

5 years agoRevert change to zstd manual
Nick Magerko [Mon, 19 Aug 2019 23:50:26 +0000 (16:50 -0700)] 
Revert change to zstd manual

5 years agoUse int for srcSizeHint when sensible
Nick Magerko [Mon, 19 Aug 2019 23:49:25 +0000 (16:49 -0700)] 
Use int for srcSizeHint when sensible

5 years agoFix playTests and add additional cases
Nick Magerko [Mon, 19 Aug 2019 23:48:35 +0000 (16:48 -0700)] 
Fix playTests and add additional cases

5 years agoAdd size-hint to fuzz tests
Nick Magerko [Mon, 19 Aug 2019 22:12:24 +0000 (15:12 -0700)] 
Add size-hint to fuzz tests

5 years agov1.4.3: Merge pull request #1730 from facebook/dev v1.4.3
Felix Handte [Mon, 19 Aug 2019 20:48:01 +0000 (16:48 -0400)] 
v1.4.3: Merge pull request #1730 from facebook/dev

5 years agoAdd mention of regression with poor size hints
Nick Magerko [Mon, 19 Aug 2019 20:08:41 +0000 (13:08 -0700)] 
Add mention of regression with poor size hints

5 years agoMake upper bound INT_MAX
Nick Magerko [Mon, 19 Aug 2019 19:58:54 +0000 (12:58 -0700)] 
Make upper bound INT_MAX

5 years agoFix fall-through case
Nick Magerko [Mon, 19 Aug 2019 19:32:43 +0000 (12:32 -0700)] 
Fix fall-through case

5 years agoAdd --size-hint=# option
Nick Magerko [Mon, 19 Aug 2019 15:52:08 +0000 (08:52 -0700)] 
Add --size-hint=# option

5 years agoKeep content size flag set in stream size mode
Nick Magerko [Mon, 19 Aug 2019 18:20:28 +0000 (11:20 -0700)] 
Keep content size flag set in stream size mode

5 years agoRemove extraneous variables
Nick Magerko [Mon, 19 Aug 2019 18:14:56 +0000 (11:14 -0700)] 
Remove extraneous variables

5 years agoRemove extraneous parameter
Nick Magerko [Mon, 19 Aug 2019 18:07:43 +0000 (11:07 -0700)] 
Remove extraneous parameter

5 years agoUpdate man page
Nick Magerko [Mon, 19 Aug 2019 16:11:22 +0000 (09:11 -0700)] 
Update man page

5 years agoSet pledged size just before compression
Nick Magerko [Mon, 19 Aug 2019 16:01:31 +0000 (09:01 -0700)] 
Set pledged size just before compression