]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
7 years agoupdated a bunch of headers 801/head
Yann Collet [Fri, 18 Aug 2017 23:52:05 +0000 (16:52 -0700)] 
updated a bunch of headers

for the new license

7 years agoadded GPLv2 license
Yann Collet [Fri, 18 Aug 2017 23:32:08 +0000 (16:32 -0700)] 
added GPLv2 license

and removed PATENTS clause

7 years agofixed --list command in presence of special blocks
Yann Collet [Fri, 18 Aug 2017 23:18:20 +0000 (16:18 -0700)] 
fixed --list command in presence of special blocks

block type RLE is special, compressed size is always 1.
block type 3 is "reserved", aka not supported.

7 years agoimproved and fixed --list command, original patches by @ib (#772)
Yann Collet [Fri, 18 Aug 2017 22:57:53 +0000 (15:57 -0700)] 
improved and fixed --list command, original patches by @ib (#772)

accepts all skippable frame identifiers.
display in MB or KB, depending on frame size.
fixed combination of skippable and zstd frames.

7 years agoremoved --list from cli help (-h), reported by Agostino Sarubbo (@asarubbo) (#800)
Yann Collet [Fri, 18 Aug 2017 22:15:31 +0000 (15:15 -0700)] 
removed --list from cli help (-h), reported by Agostino Sarubbo (@asarubbo) (#800)

redundant with shorter -l.
both -l and --list do the same thing, and are documented in man page.

7 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Fri, 18 Aug 2017 22:12:30 +0000 (15:12 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

7 years agoMerge pull request #789 from paulcruz74/educational-decoder-2
Yann Collet [Wed, 16 Aug 2017 23:06:05 +0000 (16:06 -0700)] 
Merge pull request #789 from paulcruz74/educational-decoder-2

Educational decoder 2

7 years agoconst vars, change copy_literals() to only take size_t literal_length 789/head
Paul Cruz [Wed, 16 Aug 2017 18:11:52 +0000 (11:11 -0700)] 
const vars, change copy_literals() to only take size_t literal_length

7 years agoMerge pull request #797 from paulcruz74/documentation
Yann Collet [Wed, 16 Aug 2017 07:37:55 +0000 (00:37 -0700)] 
Merge pull request #797 from paulcruz74/documentation

Updating README.md

7 years agoUpdating README.md 797/head
Paul Cruz [Tue, 15 Aug 2017 17:14:38 +0000 (10:14 -0700)] 
Updating README.md

7 years agoMerge pull request #796 from terrelln/is-error
Yann Collet [Tue, 15 Aug 2017 19:37:28 +0000 (12:37 -0700)] 
Merge pull request #796 from terrelln/is-error

[FSE][HUF] Inline error checks

7 years agoMerge pull request #794 from terrelln/force-inline
Yann Collet [Tue, 15 Aug 2017 19:03:44 +0000 (12:03 -0700)] 
Merge pull request #794 from terrelln/force-inline

[libzstd] Fix FORCE_INLINE macro

7 years agoMerge pull request #795 from terrelln/squashfs-tools2
Yann Collet [Tue, 15 Aug 2017 18:59:41 +0000 (11:59 -0700)] 
Merge pull request #795 from terrelln/squashfs-tools2

[kernel] Update squashfs-tools patch

7 years ago[FSE][HUF] Inline error checks 796/head
Nick Terrell [Tue, 15 Aug 2017 18:23:28 +0000 (11:23 -0700)] 
[FSE][HUF] Inline error checks

Caught by Clang's optimization remarks.

7 years ago[kernel] Update squashfs-tools patch 795/head
Nick Terrell [Tue, 15 Aug 2017 05:43:36 +0000 (22:43 -0700)] 
[kernel] Update squashfs-tools patch

7 years ago[libzstd] Fix FORCE_INLINE macro 794/head
Nick Terrell [Tue, 15 Aug 2017 00:20:50 +0000 (17:20 -0700)] 
[libzstd] Fix FORCE_INLINE macro

7 years agorenamed IO functions for clarity
Paul Cruz [Tue, 15 Aug 2017 00:51:51 +0000 (17:51 -0700)] 
renamed IO functions for clarity

7 years agoadded comments for new functions
Paul Cruz [Mon, 14 Aug 2017 22:11:01 +0000 (15:11 -0700)] 
added comments for new functions

7 years agoadded separate function for executing match copy command
Paul Cruz [Mon, 14 Aug 2017 22:06:03 +0000 (15:06 -0700)] 
added separate function for executing match copy command

7 years agocreated separate function for offset computation
Paul Cruz [Mon, 14 Aug 2017 21:20:12 +0000 (14:20 -0700)] 
created separate function for offset computation

7 years agocreated separate function for copying literals during sequence execution
Paul Cruz [Mon, 14 Aug 2017 21:05:16 +0000 (14:05 -0700)] 
created separate function for copying literals during sequence execution

7 years agoadded free to free_dictionary()
Paul Cruz [Mon, 14 Aug 2017 20:08:30 +0000 (13:08 -0700)] 
added free to free_dictionary()

7 years agoMerge pull request #791 from romange/dev
Yann Collet [Mon, 14 Aug 2017 16:55:12 +0000 (09:55 -0700)] 
Merge pull request #791 from romange/dev

Fix ZSTD_estimateDStreamSize function - Fixes #45

7 years agoMerge pull request #793 from codicodi/fix-lz4-support
Yann Collet [Mon, 14 Aug 2017 16:54:00 +0000 (09:54 -0700)] 
Merge pull request #793 from codicodi/fix-lz4-support

fix typo in lz4 support code

7 years agoadded error checking for dictionary initialized with null src
Paul Cruz [Mon, 14 Aug 2017 16:41:04 +0000 (09:41 -0700)] 
added error checking for dictionary initialized with null src

7 years agofix typo in lz4 support code 793/head
codicodi [Mon, 14 Aug 2017 12:03:46 +0000 (14:03 +0200)] 
fix typo in lz4 support code

7 years agoFix ZSTD_estimateDStreamSize function after ZSTD_DStream and ZSTD_DCtx were merged 791/head
Roman Gershman [Sun, 13 Aug 2017 10:29:42 +0000 (13:29 +0300)] 
Fix ZSTD_estimateDStreamSize function after ZSTD_DStream and ZSTD_DCtx were merged

7 years agomade separate API for dictionary management
Paul Cruz [Sat, 12 Aug 2017 01:40:19 +0000 (18:40 -0700)] 
made separate API for dictionary management

7 years agoexposed dictionary functions/types
Paul Cruz [Sat, 12 Aug 2017 00:53:37 +0000 (17:53 -0700)] 
exposed dictionary functions/types

7 years agoremove debug symbols when cleaning, added a simple test
Paul Cruz [Fri, 11 Aug 2017 21:42:15 +0000 (14:42 -0700)] 
remove debug symbols when cleaning, added a simple test

7 years agofixed warnings shown by compiler
Paul Cruz [Fri, 11 Aug 2017 21:41:44 +0000 (14:41 -0700)] 
fixed warnings shown by compiler

7 years agoadd makefile
Paul Cruz [Fri, 11 Aug 2017 21:35:13 +0000 (14:35 -0700)] 
add makefile

7 years agoreduce educational decoder to single frame decompression
Paul Cruz [Fri, 11 Aug 2017 21:34:49 +0000 (14:34 -0700)] 
reduce educational decoder to single frame decompression

7 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Fri, 11 Aug 2017 17:17:49 +0000 (10:17 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoMerge pull request #787 from paulcruz74/dev
Yann Collet [Fri, 11 Aug 2017 00:39:17 +0000 (17:39 -0700)] 
Merge pull request #787 from paulcruz74/dev

Bugfixes for Valgrind and TSAN

8 years agoupdated program name print statement 787/head
Paul Cruz [Thu, 10 Aug 2017 23:11:59 +0000 (16:11 -0700)] 
updated program name print statement

8 years agoMerge remote-tracking branch 'upstream/dev' into dev
Paul Cruz [Thu, 10 Aug 2017 21:46:31 +0000 (14:46 -0700)] 
Merge remote-tracking branch 'upstream/dev' into dev

8 years agoMerge pull request #786 from terrelln/squashfs-tools
Yann Collet [Wed, 9 Aug 2017 23:00:11 +0000 (16:00 -0700)] 
Merge pull request #786 from terrelln/squashfs-tools

[linux-kernel] Update patches for v4 and v5

8 years ago[linux-kernel] Update patches for v5 786/head
Nick Terrell [Tue, 8 Aug 2017 23:27:10 +0000 (16:27 -0700)] 
[linux-kernel] Update patches for v5

8 years agoMerge pull request #785 from terrelln/dev
Yann Collet [Tue, 8 Aug 2017 21:21:45 +0000 (14:21 -0700)] 
Merge pull request #785 from terrelln/dev

[CI] Add gcc7build test

8 years ago[CI] Add gcc7build test 785/head
Nick Terrell [Tue, 8 Aug 2017 19:32:26 +0000 (12:32 -0700)] 
[CI] Add gcc7build test

8 years agoMerge pull request #782 from terrelln/dstSizeTooSmall
Yann Collet [Mon, 7 Aug 2017 21:52:02 +0000 (14:52 -0700)] 
Merge pull request #782 from terrelln/dstSizeTooSmall

Fix compression failure on incompressible data

8 years agoMerge pull request #779 from paulcruz74/adapt-approach-4
Yann Collet [Mon, 7 Aug 2017 21:50:38 +0000 (14:50 -0700)] 
Merge pull request #779 from paulcruz74/adapt-approach-4

Patching warnings, adding ability to bound compression variation

8 years agoMerge pull request #778 from terrelln/bad-huff
Yann Collet [Mon, 7 Aug 2017 21:05:58 +0000 (14:05 -0700)] 
Merge pull request #778 from terrelln/bad-huff

[libzstd] Fix bug in Huffman decompresser

8 years agoMerge pull request #781 from stellamplau/qSize
Yann Collet [Mon, 7 Aug 2017 20:55:19 +0000 (13:55 -0700)] 
Merge pull request #781 from stellamplau/qSize

Allow queueSize=0 in pool.c

8 years agoMerge branch 'adapt-approach-4' into bug-fixes
Paul Cruz [Mon, 7 Aug 2017 20:18:53 +0000 (13:18 -0700)] 
Merge branch 'adapt-approach-4' into bug-fixes

8 years agoremoved direct assignment of 22, used ZSTD_maxCLevel() instead 779/head
Paul Cruz [Mon, 7 Aug 2017 20:11:07 +0000 (13:11 -0700)] 
removed direct assignment of 22, used ZSTD_maxCLevel() instead

8 years ago[libzstd] Fix bug in Huffman decompresser 778/head
Nick Terrell [Fri, 28 Jul 2017 18:54:28 +0000 (11:54 -0700)] 
[libzstd] Fix bug in Huffman decompresser

The zstd format specification doesn't enforce that Huffman compressed
literals (including the table) have to be smaller than the uncompressed
literals. The compressor will never Huffman compress literals if the
compressed size is larger than the uncompressed size. The decompresser
doesn't accept Huffman compressed literals with 4 streams whose compressed
size is at least as large as the uncompressed size.

* Make the decompresser accept Huffman compressed literals whose size
  increases.
* Add a test case that exposes the bug. The compressed file has to be
  statically generated, since the compressor won't normally produce files
  that expose the bug.

8 years agoSwitch the sleep function to UTIL_sleepMilli 781/head
Stella Lau [Mon, 7 Aug 2017 18:43:37 +0000 (11:43 -0700)] 
Switch the sleep function to UTIL_sleepMilli

8 years agoFix compression failure on incompressible data 782/head
Nick Terrell [Thu, 3 Aug 2017 21:05:01 +0000 (14:05 -0700)] 
Fix compression failure on incompressible data

If the destination buffer is the minimum allowed size in
`ZSTD_compressSequences()` (2^17), then if the block isn't compressible
compression might fail with `dstSize_tooSmall`, when it should instead emit
a raw uncompressed block.

Additionally, `ZSTD_compressLiterals()` implicitly called
`ZSTD_noCompressLiterals()` if Huffman compression failed. Make that
explicit.

8 years ago[linux-kernel] Update patches for v4
Nick Terrell [Fri, 4 Aug 2017 23:57:03 +0000 (16:57 -0700)] 
[linux-kernel] Update patches for v4

8 years agochanged multi to zstd-adaptive in the help menu
Paul Cruz [Thu, 3 Aug 2017 22:13:49 +0000 (15:13 -0700)] 
changed multi to zstd-adaptive in the help menu

8 years agoAdd test for deadlock
Stella Lau [Wed, 2 Aug 2017 18:27:50 +0000 (11:27 -0700)] 
Add test for deadlock

8 years agoadded mutex for compression level to avoid data race
Paul Cruz [Wed, 2 Aug 2017 17:27:33 +0000 (10:27 -0700)] 
added mutex for compression level to avoid data race

8 years agoSignal after finishing job when queueSize=0
Stella Lau [Wed, 2 Aug 2017 03:12:06 +0000 (20:12 -0700)] 
Signal after finishing job when queueSize=0

8 years agoadded detach statements to prevent resource leak
Paul Cruz [Wed, 2 Aug 2017 00:36:13 +0000 (17:36 -0700)] 
added detach statements to prevent resource leak

8 years agoReplace marker with queueEmpty variable and update pool.h comment
Stella Lau [Tue, 1 Aug 2017 19:24:55 +0000 (12:24 -0700)] 
Replace marker with queueEmpty variable and update pool.h comment

8 years agoMerge branch 'adapt-approach-4' into dev
Paul Cruz [Mon, 31 Jul 2017 22:42:57 +0000 (15:42 -0700)] 
Merge branch 'adapt-approach-4' into dev

8 years agochange signal to broadcast for jobCompressed condition varaible since multiple thread...
Paul Cruz [Mon, 31 Jul 2017 20:43:03 +0000 (13:43 -0700)] 
change signal to broadcast for jobCompressed condition varaible since multiple threads waiting

8 years agoMerge remote-tracking branch 'upstream/dev' into dev
Paul Cruz [Mon, 31 Jul 2017 18:43:40 +0000 (11:43 -0700)] 
Merge remote-tracking branch 'upstream/dev' into dev

8 years agoMerge branch 'adapt-approach-4' into dev
Paul Cruz [Mon, 31 Jul 2017 18:43:01 +0000 (11:43 -0700)] 
Merge branch 'adapt-approach-4' into dev

8 years agoadd install target in makefile
Paul Cruz [Mon, 31 Jul 2017 18:04:17 +0000 (11:04 -0700)] 
add install target in makefile

8 years agoAllow queueSize=0 in pool.c and update poolTests
Stella Lau [Mon, 31 Jul 2017 17:10:16 +0000 (10:10 -0700)] 
Allow queueSize=0 in pool.c and update poolTests

8 years agoprint defaults and range, remove EXT
Paul Cruz [Mon, 31 Jul 2017 16:47:09 +0000 (09:47 -0700)] 
print defaults and range, remove EXT

8 years agoremoved ternary operation, added assert statement, check to make sure initial compres...
Paul Cruz [Sat, 29 Jul 2017 00:46:51 +0000 (17:46 -0700)] 
removed ternary operation, added assert statement, check to make sure initial compression level is within bounds

8 years agodelete empty line
Paul Cruz [Sat, 29 Jul 2017 00:28:25 +0000 (17:28 -0700)] 
delete empty line

8 years agoremove exe extension from makefile, reinclude pthread flag
Paul Cruz [Sat, 29 Jul 2017 00:27:36 +0000 (17:27 -0700)] 
remove exe extension from makefile, reinclude pthread flag

8 years agoMerge pull request #758 from stellamplau/ldm
Yann Collet [Sat, 29 Jul 2017 00:07:21 +0000 (17:07 -0700)] 
Merge pull request #758 from stellamplau/ldm

Add working prototype of a long distance matcher

8 years agoadd flags for multithreading
Paul Cruz [Fri, 28 Jul 2017 23:12:58 +0000 (16:12 -0700)] 
add flags for multithreading

8 years agoadd tests for compression bounds, fix another warning
Paul Cruz [Fri, 28 Jul 2017 22:55:02 +0000 (15:55 -0700)] 
add tests for compression bounds, fix another warning

8 years agopatched style errors, add ability to bound compression level variation
Paul Cruz [Fri, 28 Jul 2017 22:30:46 +0000 (15:30 -0700)] 
patched style errors, add ability to bound compression level variation

8 years agoReturn error code in verify() and minor code cleanup 758/head
Stella Lau [Fri, 28 Jul 2017 00:14:05 +0000 (17:14 -0700)] 
Return error code in verify() and minor code cleanup

8 years agoFix typo
Stella Lau [Thu, 27 Jul 2017 22:49:46 +0000 (15:49 -0700)] 
Fix typo

8 years agoAdd checks in initialization code
Stella Lau [Thu, 27 Jul 2017 22:37:37 +0000 (15:37 -0700)] 
Add checks in initialization code

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Thu, 27 Jul 2017 20:49:46 +0000 (13:49 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoUpdate README
Stella Lau [Thu, 27 Jul 2017 18:11:35 +0000 (11:11 -0700)] 
Update README

8 years agoMerge pull request #753 from paulcruz74/adapt-approach-3
Yann Collet [Thu, 27 Jul 2017 17:00:10 +0000 (10:00 -0700)] 
Merge pull request #753 from paulcruz74/adapt-approach-3

adaptive compression v1

8 years agoremove unused variable, add documentation for context fields 753/head
Paul Cruz [Thu, 27 Jul 2017 00:02:47 +0000 (17:02 -0700)] 
remove unused variable, add documentation for context fields

8 years agoAllow HASH_ONLY_EVERY_LOG to be configured in ldm.h
Stella Lau [Wed, 26 Jul 2017 23:43:25 +0000 (16:43 -0700)] 
Allow HASH_ONLY_EVERY_LOG to be configured in ldm.h

8 years agofix leaky abstraction regarding measuring completion
Paul Cruz [Wed, 26 Jul 2017 23:40:05 +0000 (16:40 -0700)] 
fix leaky abstraction regarding measuring completion

8 years agoadded definitions for conversion constants, moved forced compression check to top...
Paul Cruz [Wed, 26 Jul 2017 22:52:15 +0000 (15:52 -0700)] 
added definitions for conversion constants, moved forced compression check to top of adaptCompressionLevel, used ZSTD_BLOCKSIZE_MAX

8 years agoset the window log value before performing compression
Paul Cruz [Wed, 26 Jul 2017 21:29:59 +0000 (14:29 -0700)] 
set the window log value before performing compression

8 years agoAdd README and clean up code
Stella Lau [Wed, 26 Jul 2017 20:18:53 +0000 (13:18 -0700)] 
Add README and clean up code

8 years agomoved reset of completion to right after wait
Paul Cruz [Wed, 26 Jul 2017 17:34:48 +0000 (10:34 -0700)] 
moved reset of completion to right after wait

8 years agochange to >= convergence counter
Paul Cruz [Wed, 26 Jul 2017 17:20:29 +0000 (10:20 -0700)] 
change to >= convergence counter

8 years agodecrease completion requirements for change, move create thread wait, merge cases...
Paul Cruz [Wed, 26 Jul 2017 17:05:10 +0000 (10:05 -0700)] 
decrease completion requirements for change, move create thread wait, merge cases where compression thread should wait

8 years agoAllow parameters to be modified from a separate file
Stella Lau [Wed, 26 Jul 2017 01:13:27 +0000 (18:13 -0700)] 
Allow parameters to be modified from a separate file

8 years agobuilding on readme, added another help tip in the menu
Paul Cruz [Wed, 26 Jul 2017 00:47:02 +0000 (17:47 -0700)] 
building on readme, added another help tip in the menu

8 years agoadding more to readme
Paul Cruz [Tue, 25 Jul 2017 23:55:16 +0000 (16:55 -0700)] 
adding more to readme

8 years agoupdated progress bar with better representation of time, added const
Paul Cruz [Tue, 25 Jul 2017 23:03:43 +0000 (16:03 -0700)] 
updated progress bar with better representation of time, added const

8 years agochanging time units to seconds
Paul Cruz [Tue, 25 Jul 2017 22:26:26 +0000 (15:26 -0700)] 
changing time units to seconds

8 years agoRename and remove unneeded files
Stella Lau [Tue, 25 Jul 2017 22:17:36 +0000 (15:17 -0700)] 
Rename and remove unneeded files

8 years agoupdated const values, added more comments
Paul Cruz [Tue, 25 Jul 2017 21:53:40 +0000 (14:53 -0700)] 
updated const values, added more comments

8 years agoMerge pull request #776 from terrelln/dev
Yann Collet [Tue, 25 Jul 2017 21:39:32 +0000 (14:39 -0700)] 
Merge pull request #776 from terrelln/dev

[libzstd] Fix CHECK_V_F() macro

8 years agoremoved old debug statements no longer being used
Paul Cruz [Tue, 25 Jul 2017 21:31:48 +0000 (14:31 -0700)] 
removed old debug statements no longer being used

8 years agoprogress bar -- don't print num jobs, time elapsed shown in seconds
Paul Cruz [Tue, 25 Jul 2017 21:26:55 +0000 (14:26 -0700)] 
progress bar -- don't print num jobs, time elapsed shown in seconds

8 years agomoved debug statements to a compiler flag
Paul Cruz [Tue, 25 Jul 2017 21:08:39 +0000 (14:08 -0700)] 
moved debug statements to a compiler flag

8 years ago[libzstd] Fix CHECK_V_F macros 776/head
Nick Terrell [Tue, 25 Jul 2017 19:52:01 +0000 (12:52 -0700)] 
[libzstd] Fix CHECK_V_F macros

8 years agostarted using decrease cooldown so that compression level would not decrease several...
Paul Cruz [Tue, 25 Jul 2017 18:16:27 +0000 (11:16 -0700)] 
started using decrease cooldown so that compression level would not decrease several times in a row

8 years agocreated independent function for controlling how completion relates to compression...
Paul Cruz [Tue, 25 Jul 2017 17:32:14 +0000 (10:32 -0700)] 
created independent function for controlling how completion relates to compression level change