]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
7 years ago[dictBuilder] Set default compression level to 3 816/head
Nick Terrell [Thu, 24 Aug 2017 21:45:06 +0000 (14:45 -0700)] 
[dictBuilder] Set default compression level to 3

7 years agoMerge pull request #812 from facebook/longRangeFix
Yann Collet [Wed, 23 Aug 2017 18:35:28 +0000 (11:35 -0700)] 
Merge pull request #812 from facebook/longRangeFix

fixed extraordinary scenario where all fields use maximum nbBits

7 years agoMerge pull request #813 from stellamplau/highbit32fix
Yann Collet [Wed, 23 Aug 2017 18:31:06 +0000 (11:31 -0700)] 
Merge pull request #813 from stellamplau/highbit32fix

Fix undefined behavior when srcSize==1

7 years agoMerge pull request #814 from dscheg/dev
Yann Collet [Wed, 23 Aug 2017 18:30:45 +0000 (11:30 -0700)] 
Merge pull request #814 from dscheg/dev

Fix displayLevel overflow

7 years agoFix displayLevel overflow 814/head
Dmitriy Titarenko [Wed, 23 Aug 2017 10:56:15 +0000 (15:56 +0500)] 
Fix displayLevel overflow

7 years agoMerge pull request #811 from terrelln/segmentSize
Yann Collet [Tue, 22 Aug 2017 21:36:30 +0000 (14:36 -0700)] 
Merge pull request #811 from terrelln/segmentSize

[cover] Fix end condition for small dictionary

7 years agofixed extraordinary scenario where all fields use maximum possible nb of bits simulta... 812/head
Yann Collet [Tue, 22 Aug 2017 19:08:39 +0000 (12:08 -0700)] 
fixed extraordinary scenario where all fields use maximum possible nb of bits simultaneously

can only happen if windowLog>=27  (level 22 --ultra)

7 years agoFix undefined behavior when srcSize==1 813/head
Stella Lau [Tue, 22 Aug 2017 18:55:42 +0000 (11:55 -0700)] 
Fix undefined behavior when srcSize==1

7 years ago[cover] Turn down notification for ZDICT subroutines 811/head
Nick Terrell [Mon, 21 Aug 2017 21:28:31 +0000 (14:28 -0700)] 
[cover] Turn down notification for ZDICT subroutines

7 years ago[cover] Add dictionary size to compressed size
Nick Terrell [Mon, 21 Aug 2017 21:23:17 +0000 (14:23 -0700)] 
[cover] Add dictionary size to compressed size

7 years agoMerge pull request #809 from terrelln/dev
Yann Collet [Mon, 21 Aug 2017 20:33:19 +0000 (13:33 -0700)] 
Merge pull request #809 from terrelln/dev

[cover] Fix divide by zero

7 years ago[cover] Convert score to U32 and check for zero
Nick Terrell [Mon, 21 Aug 2017 20:30:07 +0000 (13:30 -0700)] 
[cover] Convert score to U32 and check for zero

7 years ago[cover] Stop when segmentSize is less than d
Nick Terrell [Mon, 21 Aug 2017 20:10:03 +0000 (13:10 -0700)] 
[cover] Stop when segmentSize is less than d

7 years agofixed a few headers that were too hastily copy/pasted during last license change
Yann Collet [Mon, 21 Aug 2017 18:24:32 +0000 (11:24 -0700)] 
fixed a few headers that were too hastily copy/pasted during last license change

7 years ago[cover] Test small maxdict 809/head
Nick Terrell [Mon, 21 Aug 2017 18:16:47 +0000 (11:16 -0700)] 
[cover] Test small maxdict

7 years ago[cover] Fix divide by zero
Nick Terrell [Mon, 21 Aug 2017 18:12:11 +0000 (11:12 -0700)] 
[cover] Fix divide by zero

7 years agoupdated NEWS for v1.3.1 808/head
Yann Collet [Sun, 20 Aug 2017 18:45:58 +0000 (11:45 -0700)] 
updated NEWS for v1.3.1

7 years agoMerge pull request #805 from facebook/huffmanDoc
Yann Collet [Sun, 20 Aug 2017 17:40:29 +0000 (10:40 -0700)] 
Merge pull request #805 from facebook/huffmanDoc

fix #803 : wrong example in huffman bitstream section

7 years agominor formulation change, recommended by @ulikunitz 805/head
Yann Collet [Sun, 20 Aug 2017 17:39:20 +0000 (10:39 -0700)] 
minor formulation change, recommended by @ulikunitz

7 years agofixed test-zstd-nolegacy
Yann Collet [Sun, 20 Aug 2017 17:15:44 +0000 (10:15 -0700)] 
fixed test-zstd-nolegacy

7 years agoMerge pull request #806 from facebook/printVersion
Yann Collet [Sun, 20 Aug 2017 05:25:01 +0000 (22:25 -0700)] 
Merge pull request #806 from facebook/printVersion

cli : Display supported formats on -vV command

7 years agoMerge pull request #807 from facebook/poolQueue0
Yann Collet [Sun, 20 Aug 2017 05:24:42 +0000 (22:24 -0700)] 
Merge pull request #807 from facebook/poolQueue0

reduced pool queue to 0 to save memory

7 years agoreduced pool queue to 0 to save memory 807/head
Yann Collet [Sat, 19 Aug 2017 22:07:54 +0000 (15:07 -0700)] 
reduced pool queue to 0 to save memory

fixed : pool performance when jobs are fires fast and queueSize==0

7 years agocli : Display supported formats on -vV command 806/head
Yann Collet [Sat, 19 Aug 2017 20:33:50 +0000 (13:33 -0700)] 
cli : Display supported formats on -vV command

Requested and inspired by patch from @ib (#771)

7 years agoadded alternative representation for huffman bistream
Yann Collet [Sat, 19 Aug 2017 19:26:09 +0000 (12:26 -0700)] 
added alternative representation for huffman bistream

7 years agofix #803 : wrong example in huffman bitstream section, reported by @ulikunitz
Yann Collet [Sat, 19 Aug 2017 19:17:57 +0000 (12:17 -0700)] 
fix #803 : wrong example in huffman bitstream section, reported by @ulikunitz

7 years agoMerge pull request #802 from facebook/variants
Yann Collet [Sat, 19 Aug 2017 18:57:50 +0000 (11:57 -0700)] 
Merge pull request #802 from facebook/variants

fix #788 : fix /programs binary variants

7 years agofixed unused variables warnings 802/head
Yann Collet [Sat, 19 Aug 2017 08:23:49 +0000 (01:23 -0700)] 
fixed unused variables warnings

7 years agoupdated doc on compilation variables
Yann Collet [Sat, 19 Aug 2017 08:14:36 +0000 (01:14 -0700)] 
updated doc on compilation variables

7 years agofixed zstd-nolegacy
Yann Collet [Sat, 19 Aug 2017 08:01:53 +0000 (01:01 -0700)] 
fixed zstd-nolegacy

and added it to allVariants for CI testings

7 years agofixed zstd-small
Yann Collet [Sat, 19 Aug 2017 07:48:29 +0000 (00:48 -0700)] 
fixed zstd-small

and added it to shortest for CI tests

7 years agoMerge branch 'dev' into variants
Yann Collet [Sat, 19 Aug 2017 07:37:06 +0000 (00:37 -0700)] 
Merge branch 'dev' into variants

7 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Sat, 19 Aug 2017 07:36:37 +0000 (00:36 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

7 years agoMerge pull request #801 from facebook/newLicense
Yann Collet [Sat, 19 Aug 2017 07:34:34 +0000 (00:34 -0700)] 
Merge pull request #801 from facebook/newLicense

New license

7 years agoadded zstd-decompress to the list of variants tested
Yann Collet [Sat, 19 Aug 2017 01:39:39 +0000 (18:39 -0700)] 
added zstd-decompress to the list of variants tested

7 years agofixed zstd-compress
Yann Collet [Sat, 19 Aug 2017 01:30:41 +0000 (18:30 -0700)] 
fixed zstd-compress

file-information is dependent on decompression functions.
it should only be enabled when ZSTD_NODECOMPRESS is not set.

also : added zstd-compress compilation test into `make shortest`

7 years agoblindfix for Windows conversion warning
Yann Collet [Sat, 19 Aug 2017 00:06:12 +0000 (17:06 -0700)] 
blindfix for Windows conversion warning

long type is 32-bits on Windows 64,
while it's 64-bits on Unix.
64-to-32 shortening conversion for long is a specific Windows issue.

7 years agoupdated a bunch of headers 801/head
Yann Collet [Fri, 18 Aug 2017 23:52:05 +0000 (16:52 -0700)] 
updated a bunch of headers

for the new license

7 years agoadded GPLv2 license
Yann Collet [Fri, 18 Aug 2017 23:32:08 +0000 (16:32 -0700)] 
added GPLv2 license

and removed PATENTS clause

7 years agofixed --list command in presence of special blocks
Yann Collet [Fri, 18 Aug 2017 23:18:20 +0000 (16:18 -0700)] 
fixed --list command in presence of special blocks

block type RLE is special, compressed size is always 1.
block type 3 is "reserved", aka not supported.

7 years agoimproved and fixed --list command, original patches by @ib (#772)
Yann Collet [Fri, 18 Aug 2017 22:57:53 +0000 (15:57 -0700)] 
improved and fixed --list command, original patches by @ib (#772)

accepts all skippable frame identifiers.
display in MB or KB, depending on frame size.
fixed combination of skippable and zstd frames.

7 years agoremoved --list from cli help (-h), reported by Agostino Sarubbo (@asarubbo) (#800)
Yann Collet [Fri, 18 Aug 2017 22:15:31 +0000 (15:15 -0700)] 
removed --list from cli help (-h), reported by Agostino Sarubbo (@asarubbo) (#800)

redundant with shorter -l.
both -l and --list do the same thing, and are documented in man page.

7 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Fri, 18 Aug 2017 22:12:30 +0000 (15:12 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

7 years agoMerge pull request #789 from paulcruz74/educational-decoder-2
Yann Collet [Wed, 16 Aug 2017 23:06:05 +0000 (16:06 -0700)] 
Merge pull request #789 from paulcruz74/educational-decoder-2

Educational decoder 2

7 years agoconst vars, change copy_literals() to only take size_t literal_length 789/head
Paul Cruz [Wed, 16 Aug 2017 18:11:52 +0000 (11:11 -0700)] 
const vars, change copy_literals() to only take size_t literal_length

7 years agoMerge pull request #797 from paulcruz74/documentation
Yann Collet [Wed, 16 Aug 2017 07:37:55 +0000 (00:37 -0700)] 
Merge pull request #797 from paulcruz74/documentation

Updating README.md

7 years agoUpdating README.md 797/head
Paul Cruz [Tue, 15 Aug 2017 17:14:38 +0000 (10:14 -0700)] 
Updating README.md

7 years agoMerge pull request #796 from terrelln/is-error
Yann Collet [Tue, 15 Aug 2017 19:37:28 +0000 (12:37 -0700)] 
Merge pull request #796 from terrelln/is-error

[FSE][HUF] Inline error checks

7 years agoMerge pull request #794 from terrelln/force-inline
Yann Collet [Tue, 15 Aug 2017 19:03:44 +0000 (12:03 -0700)] 
Merge pull request #794 from terrelln/force-inline

[libzstd] Fix FORCE_INLINE macro

7 years agoMerge pull request #795 from terrelln/squashfs-tools2
Yann Collet [Tue, 15 Aug 2017 18:59:41 +0000 (11:59 -0700)] 
Merge pull request #795 from terrelln/squashfs-tools2

[kernel] Update squashfs-tools patch

7 years ago[FSE][HUF] Inline error checks 796/head
Nick Terrell [Tue, 15 Aug 2017 18:23:28 +0000 (11:23 -0700)] 
[FSE][HUF] Inline error checks

Caught by Clang's optimization remarks.

7 years ago[kernel] Update squashfs-tools patch 795/head
Nick Terrell [Tue, 15 Aug 2017 05:43:36 +0000 (22:43 -0700)] 
[kernel] Update squashfs-tools patch

7 years ago[libzstd] Fix FORCE_INLINE macro 794/head
Nick Terrell [Tue, 15 Aug 2017 00:20:50 +0000 (17:20 -0700)] 
[libzstd] Fix FORCE_INLINE macro

7 years agorenamed IO functions for clarity
Paul Cruz [Tue, 15 Aug 2017 00:51:51 +0000 (17:51 -0700)] 
renamed IO functions for clarity

7 years agoadded comments for new functions
Paul Cruz [Mon, 14 Aug 2017 22:11:01 +0000 (15:11 -0700)] 
added comments for new functions

7 years agoadded separate function for executing match copy command
Paul Cruz [Mon, 14 Aug 2017 22:06:03 +0000 (15:06 -0700)] 
added separate function for executing match copy command

7 years agocreated separate function for offset computation
Paul Cruz [Mon, 14 Aug 2017 21:20:12 +0000 (14:20 -0700)] 
created separate function for offset computation

7 years agocreated separate function for copying literals during sequence execution
Paul Cruz [Mon, 14 Aug 2017 21:05:16 +0000 (14:05 -0700)] 
created separate function for copying literals during sequence execution

7 years agoadded free to free_dictionary()
Paul Cruz [Mon, 14 Aug 2017 20:08:30 +0000 (13:08 -0700)] 
added free to free_dictionary()

7 years agoMerge pull request #791 from romange/dev
Yann Collet [Mon, 14 Aug 2017 16:55:12 +0000 (09:55 -0700)] 
Merge pull request #791 from romange/dev

Fix ZSTD_estimateDStreamSize function - Fixes #45

7 years agoMerge pull request #793 from codicodi/fix-lz4-support
Yann Collet [Mon, 14 Aug 2017 16:54:00 +0000 (09:54 -0700)] 
Merge pull request #793 from codicodi/fix-lz4-support

fix typo in lz4 support code

7 years agoadded error checking for dictionary initialized with null src
Paul Cruz [Mon, 14 Aug 2017 16:41:04 +0000 (09:41 -0700)] 
added error checking for dictionary initialized with null src

7 years agofix typo in lz4 support code 793/head
codicodi [Mon, 14 Aug 2017 12:03:46 +0000 (14:03 +0200)] 
fix typo in lz4 support code

7 years agoFix ZSTD_estimateDStreamSize function after ZSTD_DStream and ZSTD_DCtx were merged 791/head
Roman Gershman [Sun, 13 Aug 2017 10:29:42 +0000 (13:29 +0300)] 
Fix ZSTD_estimateDStreamSize function after ZSTD_DStream and ZSTD_DCtx were merged

7 years agomade separate API for dictionary management
Paul Cruz [Sat, 12 Aug 2017 01:40:19 +0000 (18:40 -0700)] 
made separate API for dictionary management

7 years agoexposed dictionary functions/types
Paul Cruz [Sat, 12 Aug 2017 00:53:37 +0000 (17:53 -0700)] 
exposed dictionary functions/types

7 years agoremove debug symbols when cleaning, added a simple test
Paul Cruz [Fri, 11 Aug 2017 21:42:15 +0000 (14:42 -0700)] 
remove debug symbols when cleaning, added a simple test

7 years agofixed warnings shown by compiler
Paul Cruz [Fri, 11 Aug 2017 21:41:44 +0000 (14:41 -0700)] 
fixed warnings shown by compiler

7 years agoadd makefile
Paul Cruz [Fri, 11 Aug 2017 21:35:13 +0000 (14:35 -0700)] 
add makefile

7 years agoreduce educational decoder to single frame decompression
Paul Cruz [Fri, 11 Aug 2017 21:34:49 +0000 (14:34 -0700)] 
reduce educational decoder to single frame decompression

7 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Fri, 11 Aug 2017 17:17:49 +0000 (10:17 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoMerge pull request #787 from paulcruz74/dev
Yann Collet [Fri, 11 Aug 2017 00:39:17 +0000 (17:39 -0700)] 
Merge pull request #787 from paulcruz74/dev

Bugfixes for Valgrind and TSAN

8 years agoupdated program name print statement 787/head
Paul Cruz [Thu, 10 Aug 2017 23:11:59 +0000 (16:11 -0700)] 
updated program name print statement

8 years agoMerge remote-tracking branch 'upstream/dev' into dev
Paul Cruz [Thu, 10 Aug 2017 21:46:31 +0000 (14:46 -0700)] 
Merge remote-tracking branch 'upstream/dev' into dev

8 years agoMerge pull request #786 from terrelln/squashfs-tools
Yann Collet [Wed, 9 Aug 2017 23:00:11 +0000 (16:00 -0700)] 
Merge pull request #786 from terrelln/squashfs-tools

[linux-kernel] Update patches for v4 and v5

8 years ago[linux-kernel] Update patches for v5 786/head
Nick Terrell [Tue, 8 Aug 2017 23:27:10 +0000 (16:27 -0700)] 
[linux-kernel] Update patches for v5

8 years agoMerge pull request #785 from terrelln/dev
Yann Collet [Tue, 8 Aug 2017 21:21:45 +0000 (14:21 -0700)] 
Merge pull request #785 from terrelln/dev

[CI] Add gcc7build test

8 years ago[CI] Add gcc7build test 785/head
Nick Terrell [Tue, 8 Aug 2017 19:32:26 +0000 (12:32 -0700)] 
[CI] Add gcc7build test

8 years agoMerge pull request #782 from terrelln/dstSizeTooSmall
Yann Collet [Mon, 7 Aug 2017 21:52:02 +0000 (14:52 -0700)] 
Merge pull request #782 from terrelln/dstSizeTooSmall

Fix compression failure on incompressible data

8 years agoMerge pull request #779 from paulcruz74/adapt-approach-4
Yann Collet [Mon, 7 Aug 2017 21:50:38 +0000 (14:50 -0700)] 
Merge pull request #779 from paulcruz74/adapt-approach-4

Patching warnings, adding ability to bound compression variation

8 years agoMerge pull request #778 from terrelln/bad-huff
Yann Collet [Mon, 7 Aug 2017 21:05:58 +0000 (14:05 -0700)] 
Merge pull request #778 from terrelln/bad-huff

[libzstd] Fix bug in Huffman decompresser

8 years agoMerge pull request #781 from stellamplau/qSize
Yann Collet [Mon, 7 Aug 2017 20:55:19 +0000 (13:55 -0700)] 
Merge pull request #781 from stellamplau/qSize

Allow queueSize=0 in pool.c

8 years agoMerge branch 'adapt-approach-4' into bug-fixes
Paul Cruz [Mon, 7 Aug 2017 20:18:53 +0000 (13:18 -0700)] 
Merge branch 'adapt-approach-4' into bug-fixes

8 years agoremoved direct assignment of 22, used ZSTD_maxCLevel() instead 779/head
Paul Cruz [Mon, 7 Aug 2017 20:11:07 +0000 (13:11 -0700)] 
removed direct assignment of 22, used ZSTD_maxCLevel() instead

8 years ago[libzstd] Fix bug in Huffman decompresser 778/head
Nick Terrell [Fri, 28 Jul 2017 18:54:28 +0000 (11:54 -0700)] 
[libzstd] Fix bug in Huffman decompresser

The zstd format specification doesn't enforce that Huffman compressed
literals (including the table) have to be smaller than the uncompressed
literals. The compressor will never Huffman compress literals if the
compressed size is larger than the uncompressed size. The decompresser
doesn't accept Huffman compressed literals with 4 streams whose compressed
size is at least as large as the uncompressed size.

* Make the decompresser accept Huffman compressed literals whose size
  increases.
* Add a test case that exposes the bug. The compressed file has to be
  statically generated, since the compressor won't normally produce files
  that expose the bug.

8 years agoSwitch the sleep function to UTIL_sleepMilli 781/head
Stella Lau [Mon, 7 Aug 2017 18:43:37 +0000 (11:43 -0700)] 
Switch the sleep function to UTIL_sleepMilli

8 years agoFix compression failure on incompressible data 782/head
Nick Terrell [Thu, 3 Aug 2017 21:05:01 +0000 (14:05 -0700)] 
Fix compression failure on incompressible data

If the destination buffer is the minimum allowed size in
`ZSTD_compressSequences()` (2^17), then if the block isn't compressible
compression might fail with `dstSize_tooSmall`, when it should instead emit
a raw uncompressed block.

Additionally, `ZSTD_compressLiterals()` implicitly called
`ZSTD_noCompressLiterals()` if Huffman compression failed. Make that
explicit.

8 years ago[linux-kernel] Update patches for v4
Nick Terrell [Fri, 4 Aug 2017 23:57:03 +0000 (16:57 -0700)] 
[linux-kernel] Update patches for v4

8 years agochanged multi to zstd-adaptive in the help menu
Paul Cruz [Thu, 3 Aug 2017 22:13:49 +0000 (15:13 -0700)] 
changed multi to zstd-adaptive in the help menu

8 years agoAdd test for deadlock
Stella Lau [Wed, 2 Aug 2017 18:27:50 +0000 (11:27 -0700)] 
Add test for deadlock

8 years agoadded mutex for compression level to avoid data race
Paul Cruz [Wed, 2 Aug 2017 17:27:33 +0000 (10:27 -0700)] 
added mutex for compression level to avoid data race

8 years agoSignal after finishing job when queueSize=0
Stella Lau [Wed, 2 Aug 2017 03:12:06 +0000 (20:12 -0700)] 
Signal after finishing job when queueSize=0

8 years agoadded detach statements to prevent resource leak
Paul Cruz [Wed, 2 Aug 2017 00:36:13 +0000 (17:36 -0700)] 
added detach statements to prevent resource leak

8 years agoReplace marker with queueEmpty variable and update pool.h comment
Stella Lau [Tue, 1 Aug 2017 19:24:55 +0000 (12:24 -0700)] 
Replace marker with queueEmpty variable and update pool.h comment

8 years agoMerge branch 'adapt-approach-4' into dev
Paul Cruz [Mon, 31 Jul 2017 22:42:57 +0000 (15:42 -0700)] 
Merge branch 'adapt-approach-4' into dev

8 years agochange signal to broadcast for jobCompressed condition varaible since multiple thread...
Paul Cruz [Mon, 31 Jul 2017 20:43:03 +0000 (13:43 -0700)] 
change signal to broadcast for jobCompressed condition varaible since multiple threads waiting

8 years agoMerge remote-tracking branch 'upstream/dev' into dev
Paul Cruz [Mon, 31 Jul 2017 18:43:40 +0000 (11:43 -0700)] 
Merge remote-tracking branch 'upstream/dev' into dev

8 years agoMerge branch 'adapt-approach-4' into dev
Paul Cruz [Mon, 31 Jul 2017 18:43:01 +0000 (11:43 -0700)] 
Merge branch 'adapt-approach-4' into dev

8 years agoadd install target in makefile
Paul Cruz [Mon, 31 Jul 2017 18:04:17 +0000 (11:04 -0700)] 
add install target in makefile

8 years agoAllow queueSize=0 in pool.c and update poolTests
Stella Lau [Mon, 31 Jul 2017 17:10:16 +0000 (10:10 -0700)] 
Allow queueSize=0 in pool.c and update poolTests