]>
git.ipfire.org Git - thirdparty/zstd.git/log
Roman Gershman [Sun, 13 Aug 2017 10:29:42 +0000 (13:29 +0300)]
Fix ZSTD_estimateDStreamSize function after ZSTD_DStream and ZSTD_DCtx were merged
Yann Collet [Fri, 11 Aug 2017 00:39:17 +0000 (17:39 -0700)]
Merge pull request #787 from paulcruz74/dev
Bugfixes for Valgrind and TSAN
Paul Cruz [Thu, 10 Aug 2017 23:11:59 +0000 (16:11 -0700)]
updated program name print statement
Paul Cruz [Thu, 10 Aug 2017 21:46:31 +0000 (14:46 -0700)]
Merge remote-tracking branch 'upstream/dev' into dev
Yann Collet [Wed, 9 Aug 2017 23:00:11 +0000 (16:00 -0700)]
Merge pull request #786 from terrelln/squashfs-tools
[linux-kernel] Update patches for v4 and v5
Nick Terrell [Tue, 8 Aug 2017 23:27:10 +0000 (16:27 -0700)]
[linux-kernel] Update patches for v5
Yann Collet [Tue, 8 Aug 2017 21:21:45 +0000 (14:21 -0700)]
Merge pull request #785 from terrelln/dev
[CI] Add gcc7build test
Nick Terrell [Tue, 8 Aug 2017 19:32:26 +0000 (12:32 -0700)]
[CI] Add gcc7build test
Yann Collet [Mon, 7 Aug 2017 21:52:02 +0000 (14:52 -0700)]
Merge pull request #782 from terrelln/dstSizeTooSmall
Fix compression failure on incompressible data
Yann Collet [Mon, 7 Aug 2017 21:50:38 +0000 (14:50 -0700)]
Merge pull request #779 from paulcruz74/adapt-approach-4
Patching warnings, adding ability to bound compression variation
Yann Collet [Mon, 7 Aug 2017 21:05:58 +0000 (14:05 -0700)]
Merge pull request #778 from terrelln/bad-huff
[libzstd] Fix bug in Huffman decompresser
Yann Collet [Mon, 7 Aug 2017 20:55:19 +0000 (13:55 -0700)]
Merge pull request #781 from stellamplau/qSize
Allow queueSize=0 in pool.c
Paul Cruz [Mon, 7 Aug 2017 20:18:53 +0000 (13:18 -0700)]
Merge branch 'adapt-approach-4' into bug-fixes
Paul Cruz [Mon, 7 Aug 2017 20:11:07 +0000 (13:11 -0700)]
removed direct assignment of 22, used ZSTD_maxCLevel() instead
Nick Terrell [Fri, 28 Jul 2017 18:54:28 +0000 (11:54 -0700)]
[libzstd] Fix bug in Huffman decompresser
The zstd format specification doesn't enforce that Huffman compressed
literals (including the table) have to be smaller than the uncompressed
literals. The compressor will never Huffman compress literals if the
compressed size is larger than the uncompressed size. The decompresser
doesn't accept Huffman compressed literals with 4 streams whose compressed
size is at least as large as the uncompressed size.
* Make the decompresser accept Huffman compressed literals whose size
increases.
* Add a test case that exposes the bug. The compressed file has to be
statically generated, since the compressor won't normally produce files
that expose the bug.
Stella Lau [Mon, 7 Aug 2017 18:43:37 +0000 (11:43 -0700)]
Switch the sleep function to UTIL_sleepMilli
Nick Terrell [Thu, 3 Aug 2017 21:05:01 +0000 (14:05 -0700)]
Fix compression failure on incompressible data
If the destination buffer is the minimum allowed size in
`ZSTD_compressSequences()` (2^17), then if the block isn't compressible
compression might fail with `dstSize_tooSmall`, when it should instead emit
a raw uncompressed block.
Additionally, `ZSTD_compressLiterals()` implicitly called
`ZSTD_noCompressLiterals()` if Huffman compression failed. Make that
explicit.
Nick Terrell [Fri, 4 Aug 2017 23:57:03 +0000 (16:57 -0700)]
[linux-kernel] Update patches for v4
Paul Cruz [Thu, 3 Aug 2017 22:13:49 +0000 (15:13 -0700)]
changed multi to zstd-adaptive in the help menu
Stella Lau [Wed, 2 Aug 2017 18:27:50 +0000 (11:27 -0700)]
Add test for deadlock
Paul Cruz [Wed, 2 Aug 2017 17:27:33 +0000 (10:27 -0700)]
added mutex for compression level to avoid data race
Stella Lau [Wed, 2 Aug 2017 03:12:06 +0000 (20:12 -0700)]
Signal after finishing job when queueSize=0
Paul Cruz [Wed, 2 Aug 2017 00:36:13 +0000 (17:36 -0700)]
added detach statements to prevent resource leak
Stella Lau [Tue, 1 Aug 2017 19:24:55 +0000 (12:24 -0700)]
Replace marker with queueEmpty variable and update pool.h comment
Paul Cruz [Mon, 31 Jul 2017 22:42:57 +0000 (15:42 -0700)]
Merge branch 'adapt-approach-4' into dev
Paul Cruz [Mon, 31 Jul 2017 20:43:03 +0000 (13:43 -0700)]
change signal to broadcast for jobCompressed condition varaible since multiple threads waiting
Paul Cruz [Mon, 31 Jul 2017 18:43:40 +0000 (11:43 -0700)]
Merge remote-tracking branch 'upstream/dev' into dev
Paul Cruz [Mon, 31 Jul 2017 18:43:01 +0000 (11:43 -0700)]
Merge branch 'adapt-approach-4' into dev
Paul Cruz [Mon, 31 Jul 2017 18:04:17 +0000 (11:04 -0700)]
add install target in makefile
Stella Lau [Mon, 31 Jul 2017 17:10:16 +0000 (10:10 -0700)]
Allow queueSize=0 in pool.c and update poolTests
Paul Cruz [Mon, 31 Jul 2017 16:47:09 +0000 (09:47 -0700)]
print defaults and range, remove EXT
Paul Cruz [Sat, 29 Jul 2017 00:46:51 +0000 (17:46 -0700)]
removed ternary operation, added assert statement, check to make sure initial compression level is within bounds
Paul Cruz [Sat, 29 Jul 2017 00:28:25 +0000 (17:28 -0700)]
delete empty line
Paul Cruz [Sat, 29 Jul 2017 00:27:36 +0000 (17:27 -0700)]
remove exe extension from makefile, reinclude pthread flag
Yann Collet [Sat, 29 Jul 2017 00:07:21 +0000 (17:07 -0700)]
Merge pull request #758 from stellamplau/ldm
Add working prototype of a long distance matcher
Paul Cruz [Fri, 28 Jul 2017 23:12:58 +0000 (16:12 -0700)]
add flags for multithreading
Paul Cruz [Fri, 28 Jul 2017 22:55:02 +0000 (15:55 -0700)]
add tests for compression bounds, fix another warning
Paul Cruz [Fri, 28 Jul 2017 22:30:46 +0000 (15:30 -0700)]
patched style errors, add ability to bound compression level variation
Stella Lau [Fri, 28 Jul 2017 00:14:05 +0000 (17:14 -0700)]
Return error code in verify() and minor code cleanup
Stella Lau [Thu, 27 Jul 2017 22:49:46 +0000 (15:49 -0700)]
Fix typo
Stella Lau [Thu, 27 Jul 2017 22:37:37 +0000 (15:37 -0700)]
Add checks in initialization code
Stella Lau [Thu, 27 Jul 2017 18:11:35 +0000 (11:11 -0700)]
Update README
Yann Collet [Thu, 27 Jul 2017 17:00:10 +0000 (10:00 -0700)]
Merge pull request #753 from paulcruz74/adapt-approach-3
adaptive compression v1
Paul Cruz [Thu, 27 Jul 2017 00:02:47 +0000 (17:02 -0700)]
remove unused variable, add documentation for context fields
Stella Lau [Wed, 26 Jul 2017 23:43:25 +0000 (16:43 -0700)]
Allow HASH_ONLY_EVERY_LOG to be configured in ldm.h
Paul Cruz [Wed, 26 Jul 2017 23:40:05 +0000 (16:40 -0700)]
fix leaky abstraction regarding measuring completion
Paul Cruz [Wed, 26 Jul 2017 22:52:15 +0000 (15:52 -0700)]
added definitions for conversion constants, moved forced compression check to top of adaptCompressionLevel, used ZSTD_BLOCKSIZE_MAX
Paul Cruz [Wed, 26 Jul 2017 21:29:59 +0000 (14:29 -0700)]
set the window log value before performing compression
Stella Lau [Wed, 26 Jul 2017 20:18:53 +0000 (13:18 -0700)]
Add README and clean up code
Paul Cruz [Wed, 26 Jul 2017 17:34:48 +0000 (10:34 -0700)]
moved reset of completion to right after wait
Paul Cruz [Wed, 26 Jul 2017 17:20:29 +0000 (10:20 -0700)]
change to >= convergence counter
Paul Cruz [Wed, 26 Jul 2017 17:05:10 +0000 (10:05 -0700)]
decrease completion requirements for change, move create thread wait, merge cases where compression thread should wait
Stella Lau [Wed, 26 Jul 2017 01:13:27 +0000 (18:13 -0700)]
Allow parameters to be modified from a separate file
Paul Cruz [Wed, 26 Jul 2017 00:47:02 +0000 (17:47 -0700)]
building on readme, added another help tip in the menu
Paul Cruz [Tue, 25 Jul 2017 23:55:16 +0000 (16:55 -0700)]
adding more to readme
Paul Cruz [Tue, 25 Jul 2017 23:03:43 +0000 (16:03 -0700)]
updated progress bar with better representation of time, added const
Paul Cruz [Tue, 25 Jul 2017 22:26:26 +0000 (15:26 -0700)]
changing time units to seconds
Stella Lau [Tue, 25 Jul 2017 22:17:36 +0000 (15:17 -0700)]
Rename and remove unneeded files
Paul Cruz [Tue, 25 Jul 2017 21:53:40 +0000 (14:53 -0700)]
updated const values, added more comments
Yann Collet [Tue, 25 Jul 2017 21:39:32 +0000 (14:39 -0700)]
Merge pull request #776 from terrelln/dev
[libzstd] Fix CHECK_V_F() macro
Paul Cruz [Tue, 25 Jul 2017 21:31:48 +0000 (14:31 -0700)]
removed old debug statements no longer being used
Paul Cruz [Tue, 25 Jul 2017 21:26:55 +0000 (14:26 -0700)]
progress bar -- don't print num jobs, time elapsed shown in seconds
Paul Cruz [Tue, 25 Jul 2017 21:08:39 +0000 (14:08 -0700)]
moved debug statements to a compiler flag
Nick Terrell [Tue, 25 Jul 2017 19:52:01 +0000 (12:52 -0700)]
[libzstd] Fix CHECK_V_F macros
Paul Cruz [Tue, 25 Jul 2017 18:16:27 +0000 (11:16 -0700)]
started using decrease cooldown so that compression level would not decrease several times in a row
Paul Cruz [Tue, 25 Jul 2017 17:32:14 +0000 (10:32 -0700)]
created independent function for controlling how completion relates to compression level change
Paul Cruz [Tue, 25 Jul 2017 17:01:10 +0000 (10:01 -0700)]
added mechanism for getting rid of spikes
Paul Cruz [Mon, 24 Jul 2017 23:26:20 +0000 (16:26 -0700)]
added help statement for -p, switched it to hide progress bar now that progress bar is default
Paul Cruz [Mon, 24 Jul 2017 23:19:07 +0000 (16:19 -0700)]
add quiet option, make progress bar default
Stella Lau [Mon, 24 Jul 2017 22:26:44 +0000 (15:26 -0700)]
Experiment with not using a checksum
Paul Cruz [Mon, 24 Jul 2017 22:14:58 +0000 (15:14 -0700)]
compression thread should take measurements independently based on whether or not the create/write thread will actually bottleneck performance
Paul Cruz [Mon, 24 Jul 2017 22:06:11 +0000 (15:06 -0700)]
adding more debug
Paul Cruz [Mon, 24 Jul 2017 21:40:23 +0000 (14:40 -0700)]
updating debug statements again
Paul Cruz [Mon, 24 Jul 2017 20:47:39 +0000 (13:47 -0700)]
changing position of endline for debug
Stella Lau [Mon, 24 Jul 2017 20:22:00 +0000 (13:22 -0700)]
Minor code cleanup
Stella Lau [Mon, 24 Jul 2017 19:40:59 +0000 (12:40 -0700)]
Deduplicate code
Stella Lau [Mon, 24 Jul 2017 19:05:43 +0000 (12:05 -0700)]
Experiment with eviction policies and minor code cleanup
Paul Cruz [Mon, 24 Jul 2017 18:01:36 +0000 (11:01 -0700)]
updated comments and debug statements
Stella Lau [Mon, 24 Jul 2017 17:18:58 +0000 (10:18 -0700)]
Minor clean up
Stella Lau [Fri, 21 Jul 2017 17:44:39 +0000 (10:44 -0700)]
Fix overflow bug when calculating hash
Stella Lau [Thu, 20 Jul 2017 23:51:01 +0000 (16:51 -0700)]
Experiment with 64-bit hash insertion policy
Stella Lau [Thu, 20 Jul 2017 23:50:06 +0000 (16:50 -0700)]
Experiment with 64-bit hash and checksum
Paul Cruz [Sun, 23 Jul 2017 21:09:16 +0000 (14:09 -0700)]
reduced competition for completion mutex by separating mutex use based on which values is updated
Paul Cruz [Sun, 23 Jul 2017 17:18:54 +0000 (10:18 -0700)]
change how completion is measured in compression thread
Paul Cruz [Sat, 22 Jul 2017 01:02:55 +0000 (18:02 -0700)]
removed useless measurements
Paul Cruz [Sat, 22 Jul 2017 00:49:39 +0000 (17:49 -0700)]
switched over to model where reading only waits on compression thread
Paul Cruz [Fri, 21 Jul 2017 23:05:01 +0000 (16:05 -0700)]
taking the maximum of the completion level reads in order to determine which one was waiting more
Paul Cruz [Fri, 21 Jul 2017 21:06:24 +0000 (14:06 -0700)]
updating debug statements
Paul Cruz [Fri, 21 Jul 2017 20:38:24 +0000 (13:38 -0700)]
measure multiple completion levels during each wait
Paul Cruz [Fri, 21 Jul 2017 16:30:24 +0000 (09:30 -0700)]
added bounding to compression level change
Paul Cruz [Fri, 21 Jul 2017 16:26:35 +0000 (09:26 -0700)]
added priority decision making for adapt compression level
Paul Cruz [Fri, 21 Jul 2017 01:45:33 +0000 (18:45 -0700)]
semi working version that stabilizes
Yann Collet [Fri, 21 Jul 2017 01:39:04 +0000 (18:39 -0700)]
fixed minor warning on unused variable in shell function
Paul Cruz [Thu, 20 Jul 2017 23:38:02 +0000 (16:38 -0700)]
fixed bug where writeSize could be zero
Paul Cruz [Thu, 20 Jul 2017 23:19:16 +0000 (16:19 -0700)]
reworked adaptCompressionLevel to only account for completion information
Yann Collet [Thu, 20 Jul 2017 22:57:55 +0000 (15:57 -0700)]
Visual blind fix 2
Yann Collet [Thu, 20 Jul 2017 22:12:21 +0000 (15:12 -0700)]
Merge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Thu, 20 Jul 2017 22:11:56 +0000 (15:11 -0700)]
fixed fuzzer test for non OS-X platforms
Yann Collet [Thu, 20 Jul 2017 21:47:26 +0000 (14:47 -0700)]
Merge pull request #773 from terrelln/lk-v3
[linux] Update patches for v3
Nick Terrell [Thu, 20 Jul 2017 20:33:55 +0000 (13:33 -0700)]
[linux] Update patches for v3