]>
git.ipfire.org Git - thirdparty/zstd.git/log
Paul Cruz [Mon, 31 Jul 2017 16:47:09 +0000 (09:47 -0700)]
print defaults and range, remove EXT
Paul Cruz [Sat, 29 Jul 2017 00:46:51 +0000 (17:46 -0700)]
removed ternary operation, added assert statement, check to make sure initial compression level is within bounds
Paul Cruz [Sat, 29 Jul 2017 00:28:25 +0000 (17:28 -0700)]
delete empty line
Paul Cruz [Sat, 29 Jul 2017 00:27:36 +0000 (17:27 -0700)]
remove exe extension from makefile, reinclude pthread flag
Paul Cruz [Fri, 28 Jul 2017 23:12:58 +0000 (16:12 -0700)]
add flags for multithreading
Paul Cruz [Fri, 28 Jul 2017 22:55:02 +0000 (15:55 -0700)]
add tests for compression bounds, fix another warning
Paul Cruz [Fri, 28 Jul 2017 22:30:46 +0000 (15:30 -0700)]
patched style errors, add ability to bound compression level variation
Paul Cruz [Thu, 27 Jul 2017 00:02:47 +0000 (17:02 -0700)]
remove unused variable, add documentation for context fields
Paul Cruz [Wed, 26 Jul 2017 23:40:05 +0000 (16:40 -0700)]
fix leaky abstraction regarding measuring completion
Paul Cruz [Wed, 26 Jul 2017 22:52:15 +0000 (15:52 -0700)]
added definitions for conversion constants, moved forced compression check to top of adaptCompressionLevel, used ZSTD_BLOCKSIZE_MAX
Paul Cruz [Wed, 26 Jul 2017 21:29:59 +0000 (14:29 -0700)]
set the window log value before performing compression
Paul Cruz [Wed, 26 Jul 2017 17:34:48 +0000 (10:34 -0700)]
moved reset of completion to right after wait
Paul Cruz [Wed, 26 Jul 2017 17:20:29 +0000 (10:20 -0700)]
change to >= convergence counter
Paul Cruz [Wed, 26 Jul 2017 17:05:10 +0000 (10:05 -0700)]
decrease completion requirements for change, move create thread wait, merge cases where compression thread should wait
Paul Cruz [Wed, 26 Jul 2017 00:47:02 +0000 (17:47 -0700)]
building on readme, added another help tip in the menu
Paul Cruz [Tue, 25 Jul 2017 23:55:16 +0000 (16:55 -0700)]
adding more to readme
Paul Cruz [Tue, 25 Jul 2017 23:03:43 +0000 (16:03 -0700)]
updated progress bar with better representation of time, added const
Paul Cruz [Tue, 25 Jul 2017 22:26:26 +0000 (15:26 -0700)]
changing time units to seconds
Paul Cruz [Tue, 25 Jul 2017 21:53:40 +0000 (14:53 -0700)]
updated const values, added more comments
Paul Cruz [Tue, 25 Jul 2017 21:31:48 +0000 (14:31 -0700)]
removed old debug statements no longer being used
Paul Cruz [Tue, 25 Jul 2017 21:26:55 +0000 (14:26 -0700)]
progress bar -- don't print num jobs, time elapsed shown in seconds
Paul Cruz [Tue, 25 Jul 2017 21:08:39 +0000 (14:08 -0700)]
moved debug statements to a compiler flag
Paul Cruz [Tue, 25 Jul 2017 18:16:27 +0000 (11:16 -0700)]
started using decrease cooldown so that compression level would not decrease several times in a row
Paul Cruz [Tue, 25 Jul 2017 17:32:14 +0000 (10:32 -0700)]
created independent function for controlling how completion relates to compression level change
Paul Cruz [Tue, 25 Jul 2017 17:01:10 +0000 (10:01 -0700)]
added mechanism for getting rid of spikes
Paul Cruz [Mon, 24 Jul 2017 23:26:20 +0000 (16:26 -0700)]
added help statement for -p, switched it to hide progress bar now that progress bar is default
Paul Cruz [Mon, 24 Jul 2017 23:19:07 +0000 (16:19 -0700)]
add quiet option, make progress bar default
Paul Cruz [Mon, 24 Jul 2017 22:14:58 +0000 (15:14 -0700)]
compression thread should take measurements independently based on whether or not the create/write thread will actually bottleneck performance
Paul Cruz [Mon, 24 Jul 2017 22:06:11 +0000 (15:06 -0700)]
adding more debug
Paul Cruz [Mon, 24 Jul 2017 21:40:23 +0000 (14:40 -0700)]
updating debug statements again
Paul Cruz [Mon, 24 Jul 2017 20:47:39 +0000 (13:47 -0700)]
changing position of endline for debug
Paul Cruz [Mon, 24 Jul 2017 18:01:36 +0000 (11:01 -0700)]
updated comments and debug statements
Paul Cruz [Sun, 23 Jul 2017 21:09:16 +0000 (14:09 -0700)]
reduced competition for completion mutex by separating mutex use based on which values is updated
Paul Cruz [Sun, 23 Jul 2017 17:18:54 +0000 (10:18 -0700)]
change how completion is measured in compression thread
Paul Cruz [Sat, 22 Jul 2017 01:02:55 +0000 (18:02 -0700)]
removed useless measurements
Paul Cruz [Sat, 22 Jul 2017 00:49:39 +0000 (17:49 -0700)]
switched over to model where reading only waits on compression thread
Paul Cruz [Fri, 21 Jul 2017 23:05:01 +0000 (16:05 -0700)]
taking the maximum of the completion level reads in order to determine which one was waiting more
Paul Cruz [Fri, 21 Jul 2017 21:06:24 +0000 (14:06 -0700)]
updating debug statements
Paul Cruz [Fri, 21 Jul 2017 20:38:24 +0000 (13:38 -0700)]
measure multiple completion levels during each wait
Paul Cruz [Fri, 21 Jul 2017 16:30:24 +0000 (09:30 -0700)]
added bounding to compression level change
Paul Cruz [Fri, 21 Jul 2017 16:26:35 +0000 (09:26 -0700)]
added priority decision making for adapt compression level
Paul Cruz [Fri, 21 Jul 2017 01:45:33 +0000 (18:45 -0700)]
semi working version that stabilizes
Paul Cruz [Thu, 20 Jul 2017 23:38:02 +0000 (16:38 -0700)]
fixed bug where writeSize could be zero
Paul Cruz [Thu, 20 Jul 2017 23:19:16 +0000 (16:19 -0700)]
reworked adaptCompressionLevel to only account for completion information
Paul Cruz [Thu, 20 Jul 2017 17:53:51 +0000 (10:53 -0700)]
changed how completion is actually sampled
Paul Cruz [Wed, 19 Jul 2017 23:36:33 +0000 (16:36 -0700)]
make adaptCompressionLevel oscillate less
Paul Cruz [Wed, 19 Jul 2017 23:00:54 +0000 (16:00 -0700)]
call ZSTD_compressBegin() once
Paul Cruz [Wed, 19 Jul 2017 21:54:15 +0000 (14:54 -0700)]
fixing error when file size is multiple of job size (in which case, the srcSize of the last job is 0)
Paul Cruz [Wed, 19 Jul 2017 20:30:07 +0000 (13:30 -0700)]
added some debug statements, adjusted end condition
Paul Cruz [Wed, 19 Jul 2017 18:51:50 +0000 (11:51 -0700)]
removed previous version of completion for compression
Paul Cruz [Wed, 19 Jul 2017 18:47:17 +0000 (11:47 -0700)]
set up new calculations compression completion progress
Paul Cruz [Wed, 19 Jul 2017 18:23:40 +0000 (11:23 -0700)]
split compression into smaller blocks
Paul Cruz [Wed, 19 Jul 2017 17:23:46 +0000 (10:23 -0700)]
moved compression adapt to avoid warning
Paul Cruz [Wed, 19 Jul 2017 17:14:00 +0000 (10:14 -0700)]
change compression level only right before actually performing compression. When waiting, only update waiting statistics.
Paul Cruz [Wed, 19 Jul 2017 17:10:47 +0000 (10:10 -0700)]
added mechanism for measuring how much of a job has been created
Paul Cruz [Wed, 19 Jul 2017 16:59:17 +0000 (09:59 -0700)]
split up read process into smaller chunks
Paul Cruz [Wed, 19 Jul 2017 16:43:17 +0000 (09:43 -0700)]
added additional print for help menu
Paul Cruz [Wed, 19 Jul 2017 00:32:36 +0000 (17:32 -0700)]
changed createCCtx() to split into initialization and creation
Paul Cruz [Tue, 18 Jul 2017 22:55:58 +0000 (15:55 -0700)]
added mutex for stats struct
Paul Cruz [Tue, 18 Jul 2017 22:23:11 +0000 (15:23 -0700)]
added progress check for filewriting, put important shared data behind mutex when being read from/written to
Paul Cruz [Tue, 18 Jul 2017 20:31:02 +0000 (13:31 -0700)]
setting up basic readme
Paul Cruz [Tue, 18 Jul 2017 20:30:29 +0000 (13:30 -0700)]
rename completion variable, split up fwrite operations in order to track progress
Paul Cruz [Tue, 18 Jul 2017 19:58:50 +0000 (12:58 -0700)]
changed test cases to use -s setting on the diffs
Paul Cruz [Tue, 18 Jul 2017 00:59:50 +0000 (17:59 -0700)]
change parameters for compression level adapt
Paul Cruz [Mon, 17 Jul 2017 22:34:58 +0000 (15:34 -0700)]
added signal to other threads whenever error occurs
Paul Cruz [Mon, 17 Jul 2017 21:39:10 +0000 (14:39 -0700)]
swap buffers instead of copying memory over
Paul Cruz [Mon, 17 Jul 2017 21:01:13 +0000 (14:01 -0700)]
open file outside of adaptCCtx, pass to the output thread
Paul Cruz [Mon, 17 Jul 2017 18:19:23 +0000 (11:19 -0700)]
removed freeCCtx() calls from createCCtx() so that it is not called twice during errors
Paul Cruz [Mon, 17 Jul 2017 17:12:44 +0000 (10:12 -0700)]
added error detection for pthread initialization, added compression completion measurement, fixed const values
Paul Cruz [Fri, 14 Jul 2017 23:29:29 +0000 (16:29 -0700)]
updated tests to use different seeds when executing different tests
Paul Cruz [Thu, 13 Jul 2017 23:38:20 +0000 (16:38 -0700)]
removed goto statements for the most part
Paul Cruz [Thu, 13 Jul 2017 21:57:24 +0000 (14:57 -0700)]
added tests for forced compression level
Paul Cruz [Thu, 13 Jul 2017 21:46:54 +0000 (14:46 -0700)]
added additional tests for performance, allowed force compression level for testing purposes
Paul Cruz [Thu, 13 Jul 2017 20:50:23 +0000 (13:50 -0700)]
added some tests for correctness, time, and compression ratio
Paul Cruz [Thu, 13 Jul 2017 17:15:27 +0000 (10:15 -0700)]
added altering dictionary size depending on compression level
Paul Cruz [Thu, 13 Jul 2017 00:28:53 +0000 (17:28 -0700)]
changed to stderr
Paul Cruz [Thu, 13 Jul 2017 00:10:58 +0000 (17:10 -0700)]
changed to malloc, added comment about adaptive compression level, and changed ternary operators
Paul Cruz [Wed, 12 Jul 2017 23:50:43 +0000 (16:50 -0700)]
fixed up freeCCtx() removed BYTE since it wasn't being used
Paul Cruz [Wed, 12 Jul 2017 23:40:24 +0000 (16:40 -0700)]
added copyright header, removed clean from makefile
Paul Cruz [Wed, 12 Jul 2017 23:18:41 +0000 (16:18 -0700)]
passes tests with adaptive compression level
Paul Cruz [Wed, 12 Jul 2017 23:02:20 +0000 (16:02 -0700)]
working with fixed compression level and fixed dictionary size
Paul Cruz [Wed, 12 Jul 2017 19:21:21 +0000 (12:21 -0700)]
working with flush job->src.size and fixed cLevel
Paul Cruz [Tue, 11 Jul 2017 23:50:50 +0000 (16:50 -0700)]
added debug statement
Paul Cruz [Tue, 11 Jul 2017 22:49:52 +0000 (15:49 -0700)]
changed dictionary size, added debugging statements
Paul Cruz [Tue, 11 Jul 2017 22:15:41 +0000 (15:15 -0700)]
updated DEBUG statements
Paul Cruz [Tue, 11 Jul 2017 22:00:52 +0000 (15:00 -0700)]
added error message, updated copying dictionary into the input buffer
Paul Cruz [Tue, 11 Jul 2017 18:50:00 +0000 (11:50 -0700)]
changed to using ZSTD_compressBegin_usingDict() and fixed strange issue with ZSTD_compressContinue()
Paul Cruz [Tue, 11 Jul 2017 17:23:25 +0000 (10:23 -0700)]
fixed an error where -c argument wasn't working for single files
Paul Cruz [Tue, 11 Jul 2017 01:16:42 +0000 (18:16 -0700)]
made some progress on improving compression ratio, but problems exist with speed limits, and for some reason higher compression levels are really slow
Paul Cruz [Mon, 10 Jul 2017 23:27:58 +0000 (16:27 -0700)]
changed how the detection of the last job works
Paul Cruz [Mon, 10 Jul 2017 23:10:19 +0000 (16:10 -0700)]
dst buffer should use ZSTD_compressBound to determine how much space it needs
Paul Cruz [Mon, 10 Jul 2017 23:03:09 +0000 (16:03 -0700)]
fixed memory leak that was happening when creating jobs
Paul Cruz [Mon, 10 Jul 2017 22:37:14 +0000 (15:37 -0700)]
made input buffer an internal part of the compression context
Paul Cruz [Mon, 10 Jul 2017 18:10:11 +0000 (11:10 -0700)]
small changes
Paul Cruz [Mon, 10 Jul 2017 18:05:37 +0000 (11:05 -0700)]
changed name
Paul Cruz [Mon, 10 Jul 2017 17:58:03 +0000 (10:58 -0700)]
removed single from Makefile
Paul Cruz [Mon, 10 Jul 2017 17:53:02 +0000 (10:53 -0700)]
removed scripts
Paul Cruz [Mon, 10 Jul 2017 17:51:50 +0000 (10:51 -0700)]
removed single.c
Paul Cruz [Mon, 10 Jul 2017 16:36:22 +0000 (09:36 -0700)]
updated error checking in each thread
Paul Cruz [Sat, 8 Jul 2017 00:07:05 +0000 (17:07 -0700)]
added ability to compress without specifying out filename