]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
8 years agoremove unused variable, add documentation for context fields 753/head
Paul Cruz [Thu, 27 Jul 2017 00:02:47 +0000 (17:02 -0700)] 
remove unused variable, add documentation for context fields

8 years agofix leaky abstraction regarding measuring completion
Paul Cruz [Wed, 26 Jul 2017 23:40:05 +0000 (16:40 -0700)] 
fix leaky abstraction regarding measuring completion

8 years agoadded definitions for conversion constants, moved forced compression check to top...
Paul Cruz [Wed, 26 Jul 2017 22:52:15 +0000 (15:52 -0700)] 
added definitions for conversion constants, moved forced compression check to top of adaptCompressionLevel, used ZSTD_BLOCKSIZE_MAX

8 years agoset the window log value before performing compression
Paul Cruz [Wed, 26 Jul 2017 21:29:59 +0000 (14:29 -0700)] 
set the window log value before performing compression

8 years agomoved reset of completion to right after wait
Paul Cruz [Wed, 26 Jul 2017 17:34:48 +0000 (10:34 -0700)] 
moved reset of completion to right after wait

8 years agochange to >= convergence counter
Paul Cruz [Wed, 26 Jul 2017 17:20:29 +0000 (10:20 -0700)] 
change to >= convergence counter

8 years agodecrease completion requirements for change, move create thread wait, merge cases...
Paul Cruz [Wed, 26 Jul 2017 17:05:10 +0000 (10:05 -0700)] 
decrease completion requirements for change, move create thread wait, merge cases where compression thread should wait

8 years agobuilding on readme, added another help tip in the menu
Paul Cruz [Wed, 26 Jul 2017 00:47:02 +0000 (17:47 -0700)] 
building on readme, added another help tip in the menu

8 years agoadding more to readme
Paul Cruz [Tue, 25 Jul 2017 23:55:16 +0000 (16:55 -0700)] 
adding more to readme

8 years agoupdated progress bar with better representation of time, added const
Paul Cruz [Tue, 25 Jul 2017 23:03:43 +0000 (16:03 -0700)] 
updated progress bar with better representation of time, added const

8 years agochanging time units to seconds
Paul Cruz [Tue, 25 Jul 2017 22:26:26 +0000 (15:26 -0700)] 
changing time units to seconds

8 years agoupdated const values, added more comments
Paul Cruz [Tue, 25 Jul 2017 21:53:40 +0000 (14:53 -0700)] 
updated const values, added more comments

8 years agoremoved old debug statements no longer being used
Paul Cruz [Tue, 25 Jul 2017 21:31:48 +0000 (14:31 -0700)] 
removed old debug statements no longer being used

8 years agoprogress bar -- don't print num jobs, time elapsed shown in seconds
Paul Cruz [Tue, 25 Jul 2017 21:26:55 +0000 (14:26 -0700)] 
progress bar -- don't print num jobs, time elapsed shown in seconds

8 years agomoved debug statements to a compiler flag
Paul Cruz [Tue, 25 Jul 2017 21:08:39 +0000 (14:08 -0700)] 
moved debug statements to a compiler flag

8 years agostarted using decrease cooldown so that compression level would not decrease several...
Paul Cruz [Tue, 25 Jul 2017 18:16:27 +0000 (11:16 -0700)] 
started using decrease cooldown so that compression level would not decrease several times in a row

8 years agocreated independent function for controlling how completion relates to compression...
Paul Cruz [Tue, 25 Jul 2017 17:32:14 +0000 (10:32 -0700)] 
created independent function for controlling how completion relates to compression level change

8 years agoadded mechanism for getting rid of spikes
Paul Cruz [Tue, 25 Jul 2017 17:01:10 +0000 (10:01 -0700)] 
added mechanism for getting rid of spikes

8 years agoadded help statement for -p, switched it to hide progress bar now that progress bar...
Paul Cruz [Mon, 24 Jul 2017 23:26:20 +0000 (16:26 -0700)] 
added help statement for -p, switched it to hide progress bar now that progress bar is default

8 years agoadd quiet option, make progress bar default
Paul Cruz [Mon, 24 Jul 2017 23:19:07 +0000 (16:19 -0700)] 
add quiet option, make progress bar default

8 years agocompression thread should take measurements independently based on whether or not...
Paul Cruz [Mon, 24 Jul 2017 22:14:58 +0000 (15:14 -0700)] 
compression thread should take measurements independently based on whether or not the create/write thread will actually bottleneck performance

8 years agoadding more debug
Paul Cruz [Mon, 24 Jul 2017 22:06:11 +0000 (15:06 -0700)] 
adding more debug

8 years agoupdating debug statements again
Paul Cruz [Mon, 24 Jul 2017 21:40:23 +0000 (14:40 -0700)] 
updating debug statements again

8 years agochanging position of endline for debug
Paul Cruz [Mon, 24 Jul 2017 20:47:39 +0000 (13:47 -0700)] 
changing position of endline for debug

8 years agoupdated comments and debug statements
Paul Cruz [Mon, 24 Jul 2017 18:01:36 +0000 (11:01 -0700)] 
updated comments and debug statements

8 years agoreduced competition for completion mutex by separating mutex use based on which value...
Paul Cruz [Sun, 23 Jul 2017 21:09:16 +0000 (14:09 -0700)] 
reduced competition for completion mutex by separating mutex use based on which values is updated

8 years agochange how completion is measured in compression thread
Paul Cruz [Sun, 23 Jul 2017 17:18:54 +0000 (10:18 -0700)] 
change how completion is measured in compression thread

8 years agoremoved useless measurements
Paul Cruz [Sat, 22 Jul 2017 01:02:55 +0000 (18:02 -0700)] 
removed useless measurements

8 years agoswitched over to model where reading only waits on compression thread
Paul Cruz [Sat, 22 Jul 2017 00:49:39 +0000 (17:49 -0700)] 
switched over to model where reading only waits on compression thread

8 years agotaking the maximum of the completion level reads in order to determine which one...
Paul Cruz [Fri, 21 Jul 2017 23:05:01 +0000 (16:05 -0700)] 
taking the maximum of the completion level reads in order to determine which one was waiting more

8 years agoupdating debug statements
Paul Cruz [Fri, 21 Jul 2017 21:06:24 +0000 (14:06 -0700)] 
updating debug statements

8 years agomeasure multiple completion levels during each wait
Paul Cruz [Fri, 21 Jul 2017 20:38:24 +0000 (13:38 -0700)] 
measure multiple completion levels during each wait

8 years agoadded bounding to compression level change
Paul Cruz [Fri, 21 Jul 2017 16:30:24 +0000 (09:30 -0700)] 
added bounding to compression level change

8 years agoadded priority decision making for adapt compression level
Paul Cruz [Fri, 21 Jul 2017 16:26:35 +0000 (09:26 -0700)] 
added priority decision making for adapt compression level

8 years agosemi working version that stabilizes
Paul Cruz [Fri, 21 Jul 2017 01:45:33 +0000 (18:45 -0700)] 
semi working version that stabilizes

8 years agofixed bug where writeSize could be zero
Paul Cruz [Thu, 20 Jul 2017 23:38:02 +0000 (16:38 -0700)] 
fixed bug where writeSize could be zero

8 years agoreworked adaptCompressionLevel to only account for completion information
Paul Cruz [Thu, 20 Jul 2017 23:19:16 +0000 (16:19 -0700)] 
reworked adaptCompressionLevel to only account for completion information

8 years agochanged how completion is actually sampled
Paul Cruz [Thu, 20 Jul 2017 17:53:51 +0000 (10:53 -0700)] 
changed how completion is actually sampled

8 years agomake adaptCompressionLevel oscillate less
Paul Cruz [Wed, 19 Jul 2017 23:36:33 +0000 (16:36 -0700)] 
make adaptCompressionLevel oscillate less

8 years agocall ZSTD_compressBegin() once
Paul Cruz [Wed, 19 Jul 2017 23:00:54 +0000 (16:00 -0700)] 
call ZSTD_compressBegin() once

8 years agofixing error when file size is multiple of job size (in which case, the srcSize of...
Paul Cruz [Wed, 19 Jul 2017 21:54:15 +0000 (14:54 -0700)] 
fixing error when file size is multiple of job size (in which case, the srcSize of the last job is 0)

8 years agoadded some debug statements, adjusted end condition
Paul Cruz [Wed, 19 Jul 2017 20:30:07 +0000 (13:30 -0700)] 
added some debug statements, adjusted end condition

8 years agoremoved previous version of completion for compression
Paul Cruz [Wed, 19 Jul 2017 18:51:50 +0000 (11:51 -0700)] 
removed previous version of completion for compression

8 years agoset up new calculations compression completion progress
Paul Cruz [Wed, 19 Jul 2017 18:47:17 +0000 (11:47 -0700)] 
set up new calculations compression completion progress

8 years agosplit compression into smaller blocks
Paul Cruz [Wed, 19 Jul 2017 18:23:40 +0000 (11:23 -0700)] 
split compression into smaller blocks

8 years agomoved compression adapt to avoid warning
Paul Cruz [Wed, 19 Jul 2017 17:23:46 +0000 (10:23 -0700)] 
moved compression adapt to avoid warning

8 years agochange compression level only right before actually performing compression. When...
Paul Cruz [Wed, 19 Jul 2017 17:14:00 +0000 (10:14 -0700)] 
change compression level only right before actually performing compression. When waiting, only update waiting statistics.

8 years agoadded mechanism for measuring how much of a job has been created
Paul Cruz [Wed, 19 Jul 2017 17:10:47 +0000 (10:10 -0700)] 
added mechanism for measuring how much of a job has been created

8 years agosplit up read process into smaller chunks
Paul Cruz [Wed, 19 Jul 2017 16:59:17 +0000 (09:59 -0700)] 
split up read process into smaller chunks

8 years agoadded additional print for help menu
Paul Cruz [Wed, 19 Jul 2017 16:43:17 +0000 (09:43 -0700)] 
added additional print for help menu

8 years agochanged createCCtx() to split into initialization and creation
Paul Cruz [Wed, 19 Jul 2017 00:32:36 +0000 (17:32 -0700)] 
changed createCCtx() to split into initialization and creation

8 years agoadded mutex for stats struct
Paul Cruz [Tue, 18 Jul 2017 22:55:58 +0000 (15:55 -0700)] 
added mutex for stats struct

8 years agoadded progress check for filewriting, put important shared data behind mutex when...
Paul Cruz [Tue, 18 Jul 2017 22:23:11 +0000 (15:23 -0700)] 
added progress check for filewriting, put important shared data behind mutex when being read from/written to

8 years agosetting up basic readme
Paul Cruz [Tue, 18 Jul 2017 20:31:02 +0000 (13:31 -0700)] 
setting up basic readme

8 years agorename completion variable, split up fwrite operations in order to track progress
Paul Cruz [Tue, 18 Jul 2017 20:30:29 +0000 (13:30 -0700)] 
rename completion variable, split up fwrite operations in order to track progress

8 years agochanged test cases to use -s setting on the diffs
Paul Cruz [Tue, 18 Jul 2017 19:58:50 +0000 (12:58 -0700)] 
changed test cases to use -s setting on the diffs

8 years agochange parameters for compression level adapt
Paul Cruz [Tue, 18 Jul 2017 00:59:50 +0000 (17:59 -0700)] 
change parameters for compression level adapt

8 years agoadded signal to other threads whenever error occurs
Paul Cruz [Mon, 17 Jul 2017 22:34:58 +0000 (15:34 -0700)] 
added signal to other threads whenever error occurs

8 years agoswap buffers instead of copying memory over
Paul Cruz [Mon, 17 Jul 2017 21:39:10 +0000 (14:39 -0700)] 
swap buffers instead of copying memory over

8 years agoopen file outside of adaptCCtx, pass to the output thread
Paul Cruz [Mon, 17 Jul 2017 21:01:13 +0000 (14:01 -0700)] 
open file outside of adaptCCtx, pass to the output thread

8 years agoremoved freeCCtx() calls from createCCtx() so that it is not called twice during...
Paul Cruz [Mon, 17 Jul 2017 18:19:23 +0000 (11:19 -0700)] 
removed freeCCtx() calls from createCCtx() so that it is not called twice during errors

8 years agoadded error detection for pthread initialization, added compression completion measur...
Paul Cruz [Mon, 17 Jul 2017 17:12:44 +0000 (10:12 -0700)] 
added error detection for pthread initialization, added compression completion measurement, fixed const values

8 years agoupdated tests to use different seeds when executing different tests
Paul Cruz [Fri, 14 Jul 2017 23:29:29 +0000 (16:29 -0700)] 
updated tests to use different seeds when executing different tests

8 years agoremoved goto statements for the most part
Paul Cruz [Thu, 13 Jul 2017 23:38:20 +0000 (16:38 -0700)] 
removed goto statements for the most part

8 years agoadded tests for forced compression level
Paul Cruz [Thu, 13 Jul 2017 21:57:24 +0000 (14:57 -0700)] 
added tests for forced compression level

8 years agoadded additional tests for performance, allowed force compression level for testing...
Paul Cruz [Thu, 13 Jul 2017 21:46:54 +0000 (14:46 -0700)] 
added additional tests for performance, allowed force compression level for testing purposes

8 years agoadded some tests for correctness, time, and compression ratio
Paul Cruz [Thu, 13 Jul 2017 20:50:23 +0000 (13:50 -0700)] 
added some tests for correctness, time, and compression ratio

8 years agoadded altering dictionary size depending on compression level
Paul Cruz [Thu, 13 Jul 2017 17:15:27 +0000 (10:15 -0700)] 
added altering dictionary size depending on compression level

8 years agochanged to stderr
Paul Cruz [Thu, 13 Jul 2017 00:28:53 +0000 (17:28 -0700)] 
changed to stderr

8 years agochanged to malloc, added comment about adaptive compression level, and changed ternar...
Paul Cruz [Thu, 13 Jul 2017 00:10:58 +0000 (17:10 -0700)] 
changed to malloc, added comment about adaptive compression level, and changed ternary operators

8 years agofixed up freeCCtx() removed BYTE since it wasn't being used
Paul Cruz [Wed, 12 Jul 2017 23:50:43 +0000 (16:50 -0700)] 
fixed up freeCCtx() removed BYTE since it wasn't being used

8 years agoadded copyright header, removed clean from makefile
Paul Cruz [Wed, 12 Jul 2017 23:40:24 +0000 (16:40 -0700)] 
added copyright header, removed clean from makefile

8 years agopasses tests with adaptive compression level
Paul Cruz [Wed, 12 Jul 2017 23:18:41 +0000 (16:18 -0700)] 
passes tests with adaptive compression level

8 years agoworking with fixed compression level and fixed dictionary size
Paul Cruz [Wed, 12 Jul 2017 23:02:20 +0000 (16:02 -0700)] 
working with fixed compression level and fixed dictionary size

8 years agoworking with flush job->src.size and fixed cLevel
Paul Cruz [Wed, 12 Jul 2017 19:21:21 +0000 (12:21 -0700)] 
working with flush job->src.size and fixed cLevel

8 years agoadded debug statement
Paul Cruz [Tue, 11 Jul 2017 23:50:50 +0000 (16:50 -0700)] 
added debug statement

8 years agochanged dictionary size, added debugging statements
Paul Cruz [Tue, 11 Jul 2017 22:49:52 +0000 (15:49 -0700)] 
changed dictionary size, added debugging statements

8 years agoupdated DEBUG statements
Paul Cruz [Tue, 11 Jul 2017 22:15:41 +0000 (15:15 -0700)] 
updated DEBUG statements

8 years agoadded error message, updated copying dictionary into the input buffer
Paul Cruz [Tue, 11 Jul 2017 22:00:52 +0000 (15:00 -0700)] 
added error message, updated copying dictionary into the input buffer

8 years agochanged to using ZSTD_compressBegin_usingDict() and fixed strange issue with ZSTD_com...
Paul Cruz [Tue, 11 Jul 2017 18:50:00 +0000 (11:50 -0700)] 
changed to using ZSTD_compressBegin_usingDict() and fixed strange issue with ZSTD_compressContinue()

8 years agofixed an error where -c argument wasn't working for single files
Paul Cruz [Tue, 11 Jul 2017 17:23:25 +0000 (10:23 -0700)] 
fixed an error where -c argument wasn't working for single files

8 years agomade some progress on improving compression ratio, but problems exist with speed...
Paul Cruz [Tue, 11 Jul 2017 01:16:42 +0000 (18:16 -0700)] 
made some progress on improving compression ratio, but problems exist with speed limits, and for some reason higher compression levels are really slow

8 years agochanged how the detection of the last job works
Paul Cruz [Mon, 10 Jul 2017 23:27:58 +0000 (16:27 -0700)] 
changed how the detection of the last job works

8 years agodst buffer should use ZSTD_compressBound to determine how much space it needs
Paul Cruz [Mon, 10 Jul 2017 23:10:19 +0000 (16:10 -0700)] 
dst buffer should use ZSTD_compressBound to determine how much space it needs

8 years agofixed memory leak that was happening when creating jobs
Paul Cruz [Mon, 10 Jul 2017 23:03:09 +0000 (16:03 -0700)] 
fixed memory leak that was happening when creating jobs

8 years agomade input buffer an internal part of the compression context
Paul Cruz [Mon, 10 Jul 2017 22:37:14 +0000 (15:37 -0700)] 
made input buffer an internal part of the compression context

8 years agosmall changes
Paul Cruz [Mon, 10 Jul 2017 18:10:11 +0000 (11:10 -0700)] 
small changes

8 years agochanged name
Paul Cruz [Mon, 10 Jul 2017 18:05:37 +0000 (11:05 -0700)] 
changed name

8 years agoremoved single from Makefile
Paul Cruz [Mon, 10 Jul 2017 17:58:03 +0000 (10:58 -0700)] 
removed single from Makefile

8 years agoremoved scripts
Paul Cruz [Mon, 10 Jul 2017 17:53:02 +0000 (10:53 -0700)] 
removed scripts

8 years agoremoved single.c
Paul Cruz [Mon, 10 Jul 2017 17:51:50 +0000 (10:51 -0700)] 
removed single.c

8 years agoupdated error checking in each thread
Paul Cruz [Mon, 10 Jul 2017 16:36:22 +0000 (09:36 -0700)] 
updated error checking in each thread

8 years agoadded ability to compress without specifying out filename
Paul Cruz [Sat, 8 Jul 2017 00:07:05 +0000 (17:07 -0700)] 
added ability to compress without specifying out filename

8 years agoplaying around with adapt param
Paul Cruz [Fri, 7 Jul 2017 22:56:00 +0000 (15:56 -0700)] 
playing around with adapt param

8 years agorewrote time elapsed with UTIL
Paul Cruz [Fri, 7 Jul 2017 22:42:20 +0000 (15:42 -0700)] 
rewrote time elapsed with UTIL

8 years agochanged to using compressCCtx
Paul Cruz [Fri, 7 Jul 2017 22:13:40 +0000 (15:13 -0700)] 
changed to using compressCCtx

8 years agochanged completed -> compressed
Paul Cruz [Fri, 7 Jul 2017 20:55:38 +0000 (13:55 -0700)] 
changed completed -> compressed

8 years agochanged completed variables to compressed for clarity
Paul Cruz [Fri, 7 Jul 2017 20:18:55 +0000 (13:18 -0700)] 
changed completed variables to compressed for clarity

8 years agoremoved unnecessary comments, uncommented DEBUGLOG for later use
Paul Cruz [Fri, 7 Jul 2017 18:47:16 +0000 (11:47 -0700)] 
removed unnecessary comments, uncommented DEBUGLOG for later use

8 years agoadded ability to force output to stdout, wrote an additional test for this functionality
Paul Cruz [Fri, 7 Jul 2017 18:32:14 +0000 (11:32 -0700)] 
added ability to force output to stdout, wrote an additional test for this functionality