]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
8 years agochanged dictionary size, added debugging statements
Paul Cruz [Tue, 11 Jul 2017 22:49:52 +0000 (15:49 -0700)] 
changed dictionary size, added debugging statements

8 years agoupdated DEBUG statements
Paul Cruz [Tue, 11 Jul 2017 22:15:41 +0000 (15:15 -0700)] 
updated DEBUG statements

8 years agoadded error message, updated copying dictionary into the input buffer
Paul Cruz [Tue, 11 Jul 2017 22:00:52 +0000 (15:00 -0700)] 
added error message, updated copying dictionary into the input buffer

8 years agochanged to using ZSTD_compressBegin_usingDict() and fixed strange issue with ZSTD_com...
Paul Cruz [Tue, 11 Jul 2017 18:50:00 +0000 (11:50 -0700)] 
changed to using ZSTD_compressBegin_usingDict() and fixed strange issue with ZSTD_compressContinue()

8 years agofixed an error where -c argument wasn't working for single files
Paul Cruz [Tue, 11 Jul 2017 17:23:25 +0000 (10:23 -0700)] 
fixed an error where -c argument wasn't working for single files

8 years agomade some progress on improving compression ratio, but problems exist with speed...
Paul Cruz [Tue, 11 Jul 2017 01:16:42 +0000 (18:16 -0700)] 
made some progress on improving compression ratio, but problems exist with speed limits, and for some reason higher compression levels are really slow

8 years agochanged how the detection of the last job works
Paul Cruz [Mon, 10 Jul 2017 23:27:58 +0000 (16:27 -0700)] 
changed how the detection of the last job works

8 years agodst buffer should use ZSTD_compressBound to determine how much space it needs
Paul Cruz [Mon, 10 Jul 2017 23:10:19 +0000 (16:10 -0700)] 
dst buffer should use ZSTD_compressBound to determine how much space it needs

8 years agofixed memory leak that was happening when creating jobs
Paul Cruz [Mon, 10 Jul 2017 23:03:09 +0000 (16:03 -0700)] 
fixed memory leak that was happening when creating jobs

8 years agomade input buffer an internal part of the compression context
Paul Cruz [Mon, 10 Jul 2017 22:37:14 +0000 (15:37 -0700)] 
made input buffer an internal part of the compression context

8 years agosmall changes
Paul Cruz [Mon, 10 Jul 2017 18:10:11 +0000 (11:10 -0700)] 
small changes

8 years agochanged name
Paul Cruz [Mon, 10 Jul 2017 18:05:37 +0000 (11:05 -0700)] 
changed name

8 years agoremoved single from Makefile
Paul Cruz [Mon, 10 Jul 2017 17:58:03 +0000 (10:58 -0700)] 
removed single from Makefile

8 years agoremoved scripts
Paul Cruz [Mon, 10 Jul 2017 17:53:02 +0000 (10:53 -0700)] 
removed scripts

8 years agoremoved single.c
Paul Cruz [Mon, 10 Jul 2017 17:51:50 +0000 (10:51 -0700)] 
removed single.c

8 years agoupdated error checking in each thread
Paul Cruz [Mon, 10 Jul 2017 16:36:22 +0000 (09:36 -0700)] 
updated error checking in each thread

8 years agoadded ability to compress without specifying out filename
Paul Cruz [Sat, 8 Jul 2017 00:07:05 +0000 (17:07 -0700)] 
added ability to compress without specifying out filename

8 years agoplaying around with adapt param
Paul Cruz [Fri, 7 Jul 2017 22:56:00 +0000 (15:56 -0700)] 
playing around with adapt param

8 years agorewrote time elapsed with UTIL
Paul Cruz [Fri, 7 Jul 2017 22:42:20 +0000 (15:42 -0700)] 
rewrote time elapsed with UTIL

8 years agochanged to using compressCCtx
Paul Cruz [Fri, 7 Jul 2017 22:13:40 +0000 (15:13 -0700)] 
changed to using compressCCtx

8 years agochanged completed -> compressed
Paul Cruz [Fri, 7 Jul 2017 20:55:38 +0000 (13:55 -0700)] 
changed completed -> compressed

8 years agochanged completed variables to compressed for clarity
Paul Cruz [Fri, 7 Jul 2017 20:18:55 +0000 (13:18 -0700)] 
changed completed variables to compressed for clarity

8 years agoremoved unnecessary comments, uncommented DEBUGLOG for later use
Paul Cruz [Fri, 7 Jul 2017 18:47:16 +0000 (11:47 -0700)] 
removed unnecessary comments, uncommented DEBUGLOG for later use

8 years agoadded ability to force output to stdout, wrote an additional test for this functionality
Paul Cruz [Fri, 7 Jul 2017 18:32:14 +0000 (11:32 -0700)] 
added ability to force output to stdout, wrote an additional test for this functionality

8 years agocleaned up code for arguments a bit
Paul Cruz [Fri, 7 Jul 2017 17:58:43 +0000 (10:58 -0700)] 
cleaned up code for arguments a bit

8 years agoadded tests that check to ensure stdout is working
Paul Cruz [Fri, 7 Jul 2017 17:29:06 +0000 (10:29 -0700)] 
added tests that check to ensure stdout is working

8 years agoupdated avg compression rate, also hiding progress bar behind a flag now
Paul Cruz [Fri, 7 Jul 2017 17:25:38 +0000 (10:25 -0700)] 
updated avg compression rate, also hiding progress bar behind a flag now

8 years agoadded compression rate to status bar
Paul Cruz [Fri, 7 Jul 2017 16:35:39 +0000 (09:35 -0700)] 
added compression rate to status bar

8 years agoadded data amount
Paul Cruz [Fri, 7 Jul 2017 03:40:00 +0000 (20:40 -0700)] 
added data amount

8 years agofixed problem with progress bar not persisting, added time elapsed
Paul Cruz [Fri, 7 Jul 2017 03:30:20 +0000 (20:30 -0700)] 
fixed problem with progress bar not persisting, added time elapsed

8 years agoadded help menu
Paul Cruz [Fri, 7 Jul 2017 01:09:10 +0000 (18:09 -0700)] 
added help menu

8 years agoadded really simple progress update in the corner
Paul Cruz [Fri, 7 Jul 2017 00:48:18 +0000 (17:48 -0700)] 
added really simple progress update in the corner

8 years agoadded some basic logic for altering compression level
Paul Cruz [Thu, 6 Jul 2017 23:06:53 +0000 (16:06 -0700)] 
added some basic logic for altering compression level

8 years agoadded ability to congregate statistics into single print statement rather than using...
Paul Cruz [Thu, 6 Jul 2017 20:09:17 +0000 (13:09 -0700)] 
added ability to congregate statistics into single print statement rather than using debug

8 years agoadded ability to set initial compression level
Paul Cruz [Thu, 6 Jul 2017 18:05:51 +0000 (11:05 -0700)] 
added ability to set initial compression level

8 years agochanged to work with std out
Paul Cruz [Thu, 6 Jul 2017 17:49:26 +0000 (10:49 -0700)] 
changed to work with std out

8 years agosmall changes
Paul Cruz [Thu, 6 Jul 2017 17:29:16 +0000 (10:29 -0700)] 
small changes

8 years agosmall changes
Paul Cruz [Thu, 6 Jul 2017 00:44:36 +0000 (17:44 -0700)] 
small changes

8 years agofixed the problem with pipeline tests by changing how jobs move through the threads
Paul Cruz [Thu, 6 Jul 2017 00:24:21 +0000 (17:24 -0700)] 
fixed the problem with pipeline tests by changing how jobs move through the threads

8 years agoadded print statements and debuglog
Paul Cruz [Wed, 5 Jul 2017 23:54:34 +0000 (16:54 -0700)] 
added print statements and debuglog

8 years agoadded more tests, changed makefile
Paul Cruz [Wed, 5 Jul 2017 21:36:09 +0000 (14:36 -0700)] 
added more tests, changed makefile

8 years agoadded filenameTable for multiple files
Paul Cruz [Wed, 5 Jul 2017 21:19:56 +0000 (14:19 -0700)] 
added filenameTable for multiple files

8 years agoadded tests to run.sh
Paul Cruz [Wed, 5 Jul 2017 20:23:34 +0000 (13:23 -0700)] 
added tests to run.sh

8 years agoadded some basic parsing for args
Paul Cruz [Wed, 5 Jul 2017 19:20:16 +0000 (12:20 -0700)] 
added some basic parsing for args

8 years agoremoved references to file size computation and file size function
Paul Cruz [Wed, 5 Jul 2017 18:54:21 +0000 (11:54 -0700)] 
removed references to file size computation and file size function

8 years agoremoved calculation of file size and replaced with limited number of available jobs
Paul Cruz [Wed, 5 Jul 2017 18:52:55 +0000 (11:52 -0700)] 
removed calculation of file size and replaced with limited number of available jobs

8 years agomoved main logic for job creation into a separate function
Paul Cruz [Wed, 5 Jul 2017 17:48:04 +0000 (10:48 -0700)] 
moved main logic for job creation into a separate function

8 years agofree ctx fields when error occurs during creation
Paul Cruz [Wed, 5 Jul 2017 17:20:56 +0000 (10:20 -0700)] 
free ctx fields when error occurs during creation

8 years agorenamed files
Paul Cruz [Wed, 5 Jul 2017 16:57:50 +0000 (09:57 -0700)] 
renamed files

8 years agofixed TODOs
Paul Cruz [Wed, 5 Jul 2017 16:49:27 +0000 (09:49 -0700)] 
fixed TODOs

8 years agoremoved unnecessary checks for null pointer on free
Paul Cruz [Wed, 5 Jul 2017 16:37:52 +0000 (09:37 -0700)] 
removed unnecessary checks for null pointer on free

8 years agoremoved print statements
Paul Cruz [Wed, 5 Jul 2017 16:23:46 +0000 (09:23 -0700)] 
removed print statements

8 years agoworking I believe
Paul Cruz [Tue, 4 Jul 2017 03:05:42 +0000 (20:05 -0700)] 
working I believe

8 years agofixed some issues with segfaults
Paul Cruz [Tue, 4 Jul 2017 02:28:48 +0000 (19:28 -0700)] 
fixed some issues with segfaults

8 years agoadded code for waiitng for all jobs to finish
Paul Cruz [Tue, 4 Jul 2017 02:24:22 +0000 (19:24 -0700)] 
added code for waiitng for all jobs to finish

8 years agofixed an error with number of jobs
Paul Cruz [Tue, 4 Jul 2017 02:00:55 +0000 (19:00 -0700)] 
fixed an error with number of jobs

8 years agoremoved unnecessary files
Paul Cruz [Tue, 4 Jul 2017 00:44:40 +0000 (17:44 -0700)] 
removed unnecessary files

8 years agoadded print statements for debugging, fixed long memset by changing to calloc
Paul Cruz [Tue, 4 Jul 2017 00:44:22 +0000 (17:44 -0700)] 
added print statements for debugging, fixed long memset by changing to calloc

8 years agofinished main portion of code, now need to debug
Paul Cruz [Tue, 4 Jul 2017 00:28:59 +0000 (17:28 -0700)] 
finished main portion of code, now need to debug

8 years agocontinuing work on v2
Paul Cruz [Mon, 3 Jul 2017 21:18:46 +0000 (14:18 -0700)] 
continuing work on v2

8 years agoversion one complete, can compress a file given input and output names
Paul Cruz [Mon, 3 Jul 2017 21:11:55 +0000 (14:11 -0700)] 
version one complete, can compress a file given input and output names

8 years agoMerge pull request #744 from terrelln/dev
Yann Collet [Sat, 1 Jul 2017 12:58:33 +0000 (05:58 -0700)] 
Merge pull request #744 from terrelln/dev

[pzstd] Remove appveyor tests

8 years ago[pzstd] Remove appveyor tests 744/head
Nick Terrell [Fri, 30 Jun 2017 23:31:11 +0000 (16:31 -0700)] 
[pzstd] Remove appveyor tests

The appveyor tests sometimes hang, and pzstd is now deprecated in favor of
zstdmt, so delete the tests.

8 years ago[man] Specify that strategies start at 1
Nick Terrell [Fri, 30 Jun 2017 23:29:37 +0000 (16:29 -0700)] 
[man] Specify that strategies start at 1

8 years agoMerge pull request #742 from stellamplau/stack-space
Yann Collet [Fri, 30 Jun 2017 21:50:23 +0000 (14:50 -0700)] 
Merge pull request #742 from stellamplau/stack-space

Reduce stack usage of HUF_readDTableX4 and HUF_readDTableX2

8 years agoFix typo 742/head
Stella Lau [Fri, 30 Jun 2017 19:56:24 +0000 (12:56 -0700)] 
Fix typo

8 years agoAdd comment to HUF_DECOMPRESS_WORKSPACE_SIZE
Stella Lau [Fri, 30 Jun 2017 19:53:56 +0000 (12:53 -0700)] 
Add comment to HUF_DECOMPRESS_WORKSPACE_SIZE

8 years agoClarify typedef of rankVal_t and rankValCol_t
Stella Lau [Fri, 30 Jun 2017 16:52:20 +0000 (09:52 -0700)] 
Clarify typedef of rankVal_t and rankValCol_t

8 years agoRename ALIGN and ALIGN_MASK to HUF_ALIGN and HUF_ALIGN_MASK
Stella Lau [Fri, 30 Jun 2017 16:38:11 +0000 (09:38 -0700)] 
Rename ALIGN and ALIGN_MASK to HUF_ALIGN and HUF_ALIGN_MASK

8 years agoDelegate HUF_decompress4X_hufOnly to workspace version
Stella Lau [Thu, 29 Jun 2017 23:22:32 +0000 (16:22 -0700)] 
Delegate HUF_decompress4X_hufOnly to workspace version

8 years agoFix bitshift error
Stella Lau [Thu, 29 Jun 2017 22:40:49 +0000 (15:40 -0700)] 
Fix bitshift error

8 years agoMerge pull request #741 from facebook/promotion
Yann Collet [Thu, 29 Jun 2017 21:48:32 +0000 (14:48 -0700)] 
Merge pull request #741 from facebook/promotion

ZSTD_getFrameContentSize() promoted to "stable" status

8 years agoFix pointer casting warning
Stella Lau [Thu, 29 Jun 2017 20:04:15 +0000 (13:04 -0700)] 
Fix pointer casting warning

8 years agoFix alignment warnings with pointer casting
Stella Lau [Thu, 29 Jun 2017 19:39:34 +0000 (12:39 -0700)] 
Fix alignment warnings with pointer casting

8 years agoReduce stack usage of HUF_readDTableX4 and HUF_readDTableX2
Stella Lau [Thu, 29 Jun 2017 18:49:59 +0000 (11:49 -0700)] 
Reduce stack usage of HUF_readDTableX4 and HUF_readDTableX2

8 years agominor : fix typo 741/head
Yann Collet [Thu, 29 Jun 2017 18:31:40 +0000 (11:31 -0700)] 
minor : fix typo

8 years agoMerge pull request #738 from terrelln/lk-div
Yann Collet [Thu, 29 Jun 2017 18:01:28 +0000 (11:01 -0700)] 
Merge pull request #738 from terrelln/lk-div

[linux-kernel] Update patches for v2

8 years agoZSTD_getFrameContentSize() is promoted to "stable" status
Yann Collet [Thu, 29 Jun 2017 12:18:09 +0000 (05:18 -0700)] 
ZSTD_getFrameContentSize() is promoted to "stable" status

8 years agoMerge pull request #739 from facebook/refPrefix
Yann Collet [Thu, 29 Jun 2017 11:36:03 +0000 (04:36 -0700)] 
Merge pull request #739 from facebook/refPrefix

ZSTD_refPrefix

8 years ago[linux-kernel] Update patches for v2 738/head
Nick Terrell [Tue, 27 Jun 2017 01:33:04 +0000 (18:33 -0700)] 
[linux-kernel] Update patches for v2

* Reduce stack usage of many zstd functions, none use over 388 B anymore.
* Remove an incorrect `const` in `xxhash`.

8 years agoMerge pull request #736 from terrelln/cover-default-api
Yann Collet [Thu, 29 Jun 2017 03:25:36 +0000 (20:25 -0700)] 
Merge pull request #736 from terrelln/cover-default-api

[zdict] Make COVER the default algorithm

8 years agoMerge pull request #737 from facebook/advancedAPI2
Yann Collet [Thu, 29 Jun 2017 03:25:22 +0000 (20:25 -0700)] 
Merge pull request #737 from facebook/advancedAPI2

simplified API for *initStatic*()

8 years agorefactor ZSTD_check_compressionLevel_monotonicIncrease_memoryBudget() 739/head
Yann Collet [Thu, 29 Jun 2017 03:17:22 +0000 (20:17 -0700)] 
refactor ZSTD_check_compressionLevel_monotonicIncrease_memoryBudget()

use less macro statements
the initial version was meant to work with STATIC_ASSERT
but since it doesn't work and needs assert()
it's possible to rewrite it using normally compiled code
which is better for compiler.

Downside : the error message is less precise.
There is a DEBUGLOG(3,) to compensate.

8 years agoMerge branch 'advancedAPI2' into refPrefix
Yann Collet [Wed, 28 Jun 2017 23:35:49 +0000 (16:35 -0700)] 
Merge branch 'advancedAPI2' into refPrefix

8 years agoadded a test to ensure ZSTD_refPrefix() doesn't impact the following compression job
Yann Collet [Wed, 28 Jun 2017 23:25:13 +0000 (16:25 -0700)] 
added a test to ensure ZSTD_refPrefix() doesn't impact the following compression job

8 years agofixed -Wdeclaration-after-statement 737/head
Yann Collet [Wed, 28 Jun 2017 22:40:21 +0000 (15:40 -0700)] 
fixed -Wdeclaration-after-statement

8 years agoMerge pull request #740 from paulcruz74/dev
Yann Collet [Wed, 28 Jun 2017 22:36:36 +0000 (15:36 -0700)] 
Merge pull request #740 from paulcruz74/dev

decodecorpus.c patch

8 years agoadded function to control monotonic memory budget increase of ZSTD_defaultCParameters[0]
Yann Collet [Wed, 28 Jun 2017 22:34:56 +0000 (15:34 -0700)] 
added function to control monotonic memory budget increase of ZSTD_defaultCParameters[0]

It's a runtime test, based on assert(),
played once, on first ZSTD_getCParams() usage,
when ZSTD_DEBUG is enabled.

8 years agoadjusted compression levels to guarantee a monotonically increasing memory budget
Yann Collet [Wed, 28 Jun 2017 20:22:37 +0000 (13:22 -0700)] 
adjusted compression levels to guarantee a monotonically increasing memory budget

8 years agoremoved fnum from DISPLAY statements 740/head
Paul Cruz [Wed, 28 Jun 2017 20:00:49 +0000 (13:00 -0700)] 
removed fnum from DISPLAY statements

8 years agofixed generation of buggy test, corrected DISPLAY statements for errors
Paul Cruz [Wed, 28 Jun 2017 19:19:37 +0000 (12:19 -0700)] 
fixed generation of buggy test, corrected DISPLAY statements for errors

8 years agofixed ZSTD_refPrefix with Multithread-enabled CCtx
Yann Collet [Wed, 28 Jun 2017 18:09:43 +0000 (11:09 -0700)] 
fixed ZSTD_refPrefix with Multithread-enabled CCtx

8 years agofixed zstreamtest
Yann Collet [Wed, 28 Jun 2017 16:57:59 +0000 (09:57 -0700)] 
fixed zstreamtest

modifying compression parameters is not allowed after ZSTD_CCtx_loadDictionary()
but it is still allowed after ZSTD_refPrefix()

8 years agoMerge remote-tracking branch 'upstream/dev' into dev
Paul Cruz [Wed, 28 Jun 2017 16:45:54 +0000 (09:45 -0700)] 
Merge remote-tracking branch 'upstream/dev' into dev

8 years agocontrolled dictMode
Yann Collet [Wed, 28 Jun 2017 00:09:12 +0000 (17:09 -0700)] 
controlled dictMode

8 years agoimplemented ZSTD_refPrefix()
Yann Collet [Tue, 27 Jun 2017 22:49:12 +0000 (15:49 -0700)] 
implemented ZSTD_refPrefix()

8 years agoexposed ZSTD_MAGIC_DICTIONARY in zstd.h
Yann Collet [Tue, 27 Jun 2017 20:50:34 +0000 (13:50 -0700)] 
exposed ZSTD_MAGIC_DICTIONARY in zstd.h

makes it easier to explain ZSTD_dictMode

8 years agoadded parameter ZSTD_p_refDictContent
Yann Collet [Tue, 27 Jun 2017 18:46:39 +0000 (11:46 -0700)] 
added parameter ZSTD_p_refDictContent

8 years agoMerge pull request #735 from terrelln/xz-default
Yann Collet [Tue, 27 Jun 2017 16:42:02 +0000 (09:42 -0700)] 
Merge pull request #735 from terrelln/xz-default

[zstdcli] Support xz by default when liblzma is available

8 years ago[tests] Fix HAVE_LZMA flag 735/head
Nick Terrell [Tue, 27 Jun 2017 01:57:04 +0000 (18:57 -0700)] 
[tests] Fix HAVE_LZMA flag