]>
git.ipfire.org Git - thirdparty/zstd.git/log
George Lu [Mon, 13 Aug 2018 20:56:18 +0000 (13:56 -0700)]
Default lvl 1
MB to 2^20
George Lu [Thu, 9 Aug 2018 23:38:32 +0000 (16:38 -0700)]
Reorder declaration
George Lu [Thu, 9 Aug 2018 19:07:57 +0000 (12:07 -0700)]
Remove ctx from benchMem
George Lu [Thu, 9 Aug 2018 18:38:09 +0000 (11:38 -0700)]
Add consts
+ fix gcc-8 warnings
George Lu [Tue, 7 Aug 2018 18:56:14 +0000 (11:56 -0700)]
argument parsing cleanup
+ clarifying comment
George Lu [Tue, 7 Aug 2018 01:37:55 +0000 (18:37 -0700)]
Readability improvements, renaming
George Lu [Tue, 7 Aug 2018 01:00:36 +0000 (18:00 -0700)]
const srcPtrs
George Lu [Tue, 7 Aug 2018 00:13:36 +0000 (17:13 -0700)]
Change speed representation from floating point to integral
George Lu [Mon, 30 Jul 2018 18:30:38 +0000 (11:30 -0700)]
Update Documentation
Change comment // to /* */
Add more description of what functions do
Remove outdated comments
George Lu [Fri, 27 Jul 2018 15:49:25 +0000 (08:49 -0700)]
Renaming / Style fixes
George Lu [Fri, 20 Jul 2018 21:35:09 +0000 (14:35 -0700)]
Separate capacity vs size
Also:
Make suggested fixes
-varInds_t
-reorder some arguments
-remove code duplication
-update README / -h
-Fix memory leaks
George Lu [Tue, 17 Jul 2018 01:22:04 +0000 (18:22 -0700)]
Fix windows implicit casting bugs
George Lu [Tue, 17 Jul 2018 01:04:57 +0000 (18:04 -0700)]
Add Levels
George Lu [Mon, 16 Jul 2018 23:16:31 +0000 (16:16 -0700)]
BenchMem with block compressed sizes passed back up
George Lu [Fri, 13 Jul 2018 00:30:39 +0000 (17:30 -0700)]
Total Changes:
Add different constraint types (decompression speed, compression memory, parameter constraints)
Separate search space by strategy + strategy selection
Memoize results
Real random restarts
Support multiple files
Support Dictionary inputs
Debug Macro for extra printing
George Lu [Tue, 10 Jul 2018 01:37:54 +0000 (18:37 -0700)]
Dictionary + Multiple file Loading
George Lu [Mon, 9 Jul 2018 20:44:01 +0000 (13:44 -0700)]
Not crashing
George Lu [Mon, 18 Jun 2018 18:59:45 +0000 (11:59 -0700)]
Working V1
George Lu [Wed, 6 Jun 2018 23:19:09 +0000 (16:19 -0700)]
Parses additional parameters
Additional constraint checking
Minor fixes
more param parsing
Add Memory
Change paramVariation
work on feasibility
reformat bench
Changed Paramgrill to use bench.c benchmarking
customlevel macro
Printing Flag
Minor changes
Explicit casting
Makefile fix
casting, type fix
Printing Flag
Minor Changes
comments, helper fn's
Yann Collet [Wed, 8 Aug 2018 21:56:00 +0000 (14:56 -0700)]
Merge pull request #1272 from facebook/travisTest
gcc-8 travis test
Yann Collet [Wed, 8 Aug 2018 21:48:51 +0000 (14:48 -0700)]
Merge pull request #1271 from felixhandte/circleci-2.0-config
Migrate Config to CircleCI 2.0
W. Felix Handte [Wed, 8 Aug 2018 21:09:12 +0000 (14:09 -0700)]
Preserve Commented-Out Longer Tests
Yann Collet [Wed, 8 Aug 2018 19:37:08 +0000 (12:37 -0700)]
some errors may only happen when optimizations are enabled
W. Felix Handte [Wed, 8 Aug 2018 19:31:37 +0000 (12:31 -0700)]
Remove Old CircleCI Config
W. Felix Handte [Wed, 8 Aug 2018 19:32:55 +0000 (12:32 -0700)]
Fix Path
W. Felix Handte [Wed, 8 Aug 2018 17:28:22 +0000 (10:28 -0700)]
Add an Auto-Gen'ed CircleCI 2.0 Config
Built via the cci-config-generator.sh script.
Yann Collet [Wed, 8 Aug 2018 17:26:54 +0000 (10:26 -0700)]
try adding gcc-8 compilation tests
Yann Collet [Wed, 8 Aug 2018 17:22:19 +0000 (10:22 -0700)]
try to improve some travis test speed
Yann Collet [Wed, 8 Aug 2018 17:18:02 +0000 (10:18 -0700)]
Merge pull request #1243 from facebook/fix1241
fix #1241
Yann Collet [Wed, 8 Aug 2018 16:25:40 +0000 (09:25 -0700)]
Merge pull request #1269 from felixhandte/fix-fix1241
Fix fix1241: Fix CDict Attachment to Handle CDicts with Non-Zero Starts
W. Felix Handte [Wed, 8 Aug 2018 00:05:05 +0000 (17:05 -0700)]
Fix CDict Attachment to Handle CDicts with Non-Zero Starts
CDicts were previously guaranteed to be generated with `lowLimit=dictLimit=0`.
This is no longer true, and so the old length and index calculations are no
longer valid. This diff fixes them to handle non-zero start indices in CDicts.
Yann Collet [Fri, 3 Aug 2018 23:08:33 +0000 (16:08 -0700)]
Merge branch 'dev' into fix1241
Yann Collet [Fri, 3 Aug 2018 22:57:22 +0000 (15:57 -0700)]
Merge pull request #1263 from facebook/travisTest
Fix Makefile on Linux and ZSTD_NOBENCH
Yann Collet [Fri, 3 Aug 2018 15:30:01 +0000 (08:30 -0700)]
fix unused variable warning
Yann Collet [Fri, 3 Aug 2018 14:59:33 +0000 (07:59 -0700)]
fix .travis.yml
Yann Collet [Fri, 3 Aug 2018 14:54:29 +0000 (07:54 -0700)]
fix : zstd cli can be built with build macro ZSTD_NOBENCH
which disables bench.c module
Yann Collet [Thu, 2 Aug 2018 18:53:46 +0000 (11:53 -0700)]
Merge branch 'dev' into travisTest
Yann Collet [Thu, 2 Aug 2018 18:52:12 +0000 (11:52 -0700)]
Merge branch 'travisTest' of github.com:facebook/zstd into travisTest
Yann Collet [Thu, 2 Aug 2018 18:48:56 +0000 (11:48 -0700)]
Merge pull request #1255 from terrelln/norm-fix
[FSE] Fix division by zero
Nick Terrell [Thu, 2 Aug 2018 18:12:17 +0000 (11:12 -0700)]
Disallow tableLog == srcLog
Jennifer Liu [Wed, 1 Aug 2018 18:06:16 +0000 (11:06 -0700)]
Add non-optimize FASTCOVER (#1260)
* Add non-optimize FASTCOVER
* Minor fix
* Pass param as value instead of pointer
Nick Terrell [Tue, 31 Jul 2018 21:31:05 +0000 (14:31 -0700)]
Merge pull request #1258 from jennifermliu/fastCover
Use CDict instead of CCtx in analyzeEntropy
Jennifer Liu [Tue, 31 Jul 2018 20:58:54 +0000 (13:58 -0700)]
Refactoring
Jennifer Liu [Tue, 31 Jul 2018 17:36:45 +0000 (10:36 -0700)]
Use CDict instead of CCtx in analyzeEntropy
Nick Terrell [Mon, 30 Jul 2018 23:03:18 +0000 (16:03 -0700)]
Merge pull request #1257 from jennifermliu/fastCover
Increment frequency for every dmer occurence within same sample
Nick Terrell [Mon, 30 Jul 2018 19:57:11 +0000 (12:57 -0700)]
[FSE] Add division by zero test
Jennifer Liu [Mon, 30 Jul 2018 19:54:22 +0000 (12:54 -0700)]
Increment frequency for every dmer occurence within same sample instead of at most once per sample
cyan4973 [Mon, 30 Jul 2018 15:08:40 +0000 (17:08 +0200)]
speed up appveyor tests
cyan4973 [Mon, 30 Jul 2018 14:56:18 +0000 (16:56 +0200)]
fix %zu support under minGW
and relevant test on Appveyor
cyan4973 [Mon, 30 Jul 2018 14:44:20 +0000 (16:44 +0200)]
ensure appveyor test fails due to formatting error
to catch %zu incompatibility
cyan4973 [Mon, 30 Jul 2018 14:30:35 +0000 (16:30 +0200)]
Merge branch 'dev' into fix1241
cyan4973 [Mon, 30 Jul 2018 14:29:20 +0000 (16:29 +0200)]
support %zu under mingw
Nick Terrell [Sat, 28 Jul 2018 01:22:52 +0000 (18:22 -0700)]
Merge pull request #1254 from jennifermliu/fastCover
Save segmentFreqs in ctx instead of malloc and memset in SelectSegment
Jennifer Liu [Sat, 28 Jul 2018 00:31:33 +0000 (17:31 -0700)]
Delete old benchmarking result
Nick Terrell [Sat, 28 Jul 2018 00:30:03 +0000 (17:30 -0700)]
[FSE] Fix division by zero
When the primary normalization method fails, and
`(1 << tableLog) == (maxSymbolValue + 1)`, and every symbol gets assigned
normalized weight 1 or -1 in the first loop, then the next division can
raise `SIGFPE`.
Jennifer Liu [Fri, 27 Jul 2018 23:56:50 +0000 (16:56 -0700)]
Undo deleting clean in make
Jennifer Liu [Fri, 27 Jul 2018 23:54:05 +0000 (16:54 -0700)]
Revert test.sh
Jennifer Liu [Fri, 27 Jul 2018 23:51:38 +0000 (16:51 -0700)]
Save segmentFreqs in ctx instead of malloc and memset in SelectSegment
Nick Terrell [Fri, 27 Jul 2018 22:11:57 +0000 (15:11 -0700)]
Merge pull request #1250 from jennifermliu/fastCover
Add Fast Cover Dictionary Builder
Jennifer Liu [Fri, 27 Jul 2018 20:39:19 +0000 (13:39 -0700)]
Use same param after optimizing cover and fastCover and record k and d for benchmarking
Jennifer Liu [Fri, 27 Jul 2018 02:03:01 +0000 (19:03 -0700)]
Rerun cover and fastCover with optimized values
Jennifer Liu [Thu, 26 Jul 2018 23:24:13 +0000 (16:24 -0700)]
Benchmark different f values
Nick Terrell [Thu, 26 Jul 2018 23:12:15 +0000 (16:12 -0700)]
Merge pull request #1252 from GeorgeLu97/bench-quiet-display-fix
Fixes bug
George Lu [Thu, 26 Jul 2018 22:17:58 +0000 (15:17 -0700)]
no zero
Jennifer Liu [Thu, 26 Jul 2018 20:53:13 +0000 (13:53 -0700)]
Add array to keep track of frequency within active segment, fix malloc bug, update benchmarking result
Jennifer Liu [Thu, 26 Jul 2018 01:10:09 +0000 (18:10 -0700)]
Allow d=6
Jennifer Liu [Thu, 26 Jul 2018 00:53:38 +0000 (17:53 -0700)]
Benchmark fast cover optimize vs k=200
Jennifer Liu [Thu, 26 Jul 2018 00:05:54 +0000 (17:05 -0700)]
Initial benchmarking result for fastCover
Jennifer Liu [Wed, 25 Jul 2018 23:54:08 +0000 (16:54 -0700)]
Make hash value const
Jennifer Liu [Wed, 25 Jul 2018 23:34:07 +0000 (16:34 -0700)]
Add Fast Cover Dictionary Builder
Nick Terrell [Sat, 21 Jul 2018 01:09:31 +0000 (18:09 -0700)]
Merge pull request #1246 from jennifermliu/benchmark
Benchmark dictionary builders
Jennifer Liu [Sat, 21 Jul 2018 00:41:22 +0000 (17:41 -0700)]
Minor fix
Jennifer Liu [Sat, 21 Jul 2018 00:03:47 +0000 (17:03 -0700)]
Refactoring and benchmark without dictionary
Jennifer Liu [Fri, 20 Jul 2018 18:32:39 +0000 (11:32 -0700)]
Benchmark dictionary builders
Nick Terrell [Thu, 19 Jul 2018 22:32:53 +0000 (15:32 -0700)]
Merge pull request #1245 from terrelln/disable-arm
Revert "attempt to re-enable arm64 tests"
Nick Terrell [Thu, 19 Jul 2018 21:35:27 +0000 (14:35 -0700)]
Revert "attempt to re-enable arm64 tests"
This reverts commit
9c277f137cbcaa385ff5b95ec4cbdce50675541d .
Nick Terrell [Thu, 19 Jul 2018 20:52:15 +0000 (13:52 -0700)]
Merge pull request #1238 from jennifermliu/random
Add random dictionary builder
Jennifer Liu [Thu, 19 Jul 2018 20:44:27 +0000 (13:44 -0700)]
Update Makefile
Jennifer Liu [Wed, 18 Jul 2018 19:15:49 +0000 (12:15 -0700)]
Rename cleanup
Jennifer Liu [Wed, 18 Jul 2018 17:40:13 +0000 (10:40 -0700)]
Add cleanup to trainfromFiles and move RANDOM_segment_t declaration
Yann Collet [Wed, 18 Jul 2018 14:34:10 +0000 (16:34 +0200)]
Merge pull request #1230 from terrelln/train-out
zstdcli: Allow -o before --train
Yann Collet [Wed, 18 Jul 2018 14:33:30 +0000 (16:33 +0200)]
Merge pull request #1237 from terrelln/init-cstream-adv
Set requestedParams in ZSTD_initCStream*()
cyan4973 [Wed, 18 Jul 2018 14:10:23 +0000 (16:10 +0200)]
fix minor conversion warning
Yann Collet [Wed, 18 Jul 2018 10:23:07 +0000 (12:23 +0200)]
Merge pull request #1242 from facebook/mingw_traces
zstdmt debug traces compatibles with mingw
Yann Collet [Wed, 18 Jul 2018 10:22:41 +0000 (12:22 +0200)]
Merge pull request #1244 from terrelln/ferror
fileio: Error in compression on read errors
Jennifer Liu [Tue, 17 Jul 2018 23:13:40 +0000 (16:13 -0700)]
Update freeSampleInfo
Jennifer Liu [Tue, 17 Jul 2018 23:01:44 +0000 (16:01 -0700)]
Fix deallocation problem and add documentation
Nick Terrell [Tue, 17 Jul 2018 21:57:27 +0000 (14:57 -0700)]
fileio: Error in compression on read errors
We can write a corrupted file if the input file errors during a read.
We should return a non-zero error code in this case.
Jennifer Liu [Tue, 17 Jul 2018 19:42:53 +0000 (12:42 -0700)]
Make test PHONY target
Jennifer Liu [Tue, 17 Jul 2018 19:35:09 +0000 (12:35 -0700)]
Move file loading functions to new file for access by benchmarking tool
cyan4973 [Tue, 17 Jul 2018 17:19:48 +0000 (19:19 +0200)]
fix make test on Linux
MOREFLAGS+= doesn't work on Linux
cyan4973 [Tue, 17 Jul 2018 17:02:17 +0000 (19:02 +0200)]
added a test to be played on travis
to check a make variable construction
cyan4973 [Tue, 17 Jul 2018 16:52:57 +0000 (18:52 +0200)]
fix #1241
Ensure that first input position is valid for a match
even during first usage of context
by starting reference at 1
(avoiding the problematic 0).
cyan4973 [Tue, 17 Jul 2018 12:39:44 +0000 (14:39 +0200)]
zstdmt debug traces compatibles with mingw
since mingw does not have `sys/times.h`,
remove this path when detecting mingw compilation.
Jennifer Liu [Tue, 17 Jul 2018 01:59:18 +0000 (18:59 -0700)]
Remove CLevel cli option which was accidentally added back in the last commit
Jennifer Liu [Mon, 16 Jul 2018 23:31:59 +0000 (16:31 -0700)]
Fix spacing and Edit Makefile (now run with make instead of make run)
Jennifer Liu [Mon, 16 Jul 2018 23:03:04 +0000 (16:03 -0700)]
Refactor RANDOM
Nick Terrell [Tue, 10 Jul 2018 01:24:07 +0000 (18:24 -0700)]
zstdcli: Allow -o before --train
Only set the default value if `outFileName` is unset.
Fixes #1227.
Yann Collet [Mon, 16 Jul 2018 10:26:58 +0000 (03:26 -0700)]
Merge pull request #1234 from codecat/add-premake
Added premake4/GENie script to contrib folder
Yann Collet [Mon, 16 Jul 2018 10:14:12 +0000 (03:14 -0700)]
Merge pull request #1233 from terrelln/doc-fiz
Small fixes to zstd specification