]>
git.ipfire.org Git - thirdparty/zstd.git/log
George Lu [Mon, 9 Jul 2018 20:44:01 +0000 (13:44 -0700)]
Not crashing
George Lu [Mon, 18 Jun 2018 18:59:45 +0000 (11:59 -0700)]
Working V1
George Lu [Wed, 6 Jun 2018 23:19:09 +0000 (16:19 -0700)]
Parses additional parameters
Additional constraint checking
Minor fixes
more param parsing
Add Memory
Change paramVariation
work on feasibility
reformat bench
Changed Paramgrill to use bench.c benchmarking
customlevel macro
Printing Flag
Minor changes
Explicit casting
Makefile fix
casting, type fix
Printing Flag
Minor Changes
comments, helper fn's
Yann Collet [Wed, 8 Aug 2018 21:56:00 +0000 (14:56 -0700)]
Merge pull request #1272 from facebook/travisTest
gcc-8 travis test
Yann Collet [Wed, 8 Aug 2018 21:48:51 +0000 (14:48 -0700)]
Merge pull request #1271 from felixhandte/circleci-2.0-config
Migrate Config to CircleCI 2.0
W. Felix Handte [Wed, 8 Aug 2018 21:09:12 +0000 (14:09 -0700)]
Preserve Commented-Out Longer Tests
Yann Collet [Wed, 8 Aug 2018 19:37:08 +0000 (12:37 -0700)]
some errors may only happen when optimizations are enabled
W. Felix Handte [Wed, 8 Aug 2018 19:31:37 +0000 (12:31 -0700)]
Remove Old CircleCI Config
W. Felix Handte [Wed, 8 Aug 2018 19:32:55 +0000 (12:32 -0700)]
Fix Path
W. Felix Handte [Wed, 8 Aug 2018 17:28:22 +0000 (10:28 -0700)]
Add an Auto-Gen'ed CircleCI 2.0 Config
Built via the cci-config-generator.sh script.
Yann Collet [Wed, 8 Aug 2018 17:26:54 +0000 (10:26 -0700)]
try adding gcc-8 compilation tests
Yann Collet [Wed, 8 Aug 2018 17:22:19 +0000 (10:22 -0700)]
try to improve some travis test speed
Yann Collet [Wed, 8 Aug 2018 17:18:02 +0000 (10:18 -0700)]
Merge pull request #1243 from facebook/fix1241
fix #1241
Yann Collet [Wed, 8 Aug 2018 16:25:40 +0000 (09:25 -0700)]
Merge pull request #1269 from felixhandte/fix-fix1241
Fix fix1241: Fix CDict Attachment to Handle CDicts with Non-Zero Starts
W. Felix Handte [Wed, 8 Aug 2018 00:05:05 +0000 (17:05 -0700)]
Fix CDict Attachment to Handle CDicts with Non-Zero Starts
CDicts were previously guaranteed to be generated with `lowLimit=dictLimit=0`.
This is no longer true, and so the old length and index calculations are no
longer valid. This diff fixes them to handle non-zero start indices in CDicts.
Yann Collet [Fri, 3 Aug 2018 23:08:33 +0000 (16:08 -0700)]
Merge branch 'dev' into fix1241
Yann Collet [Fri, 3 Aug 2018 22:57:22 +0000 (15:57 -0700)]
Merge pull request #1263 from facebook/travisTest
Fix Makefile on Linux and ZSTD_NOBENCH
Yann Collet [Fri, 3 Aug 2018 15:30:01 +0000 (08:30 -0700)]
fix unused variable warning
Yann Collet [Fri, 3 Aug 2018 14:59:33 +0000 (07:59 -0700)]
fix .travis.yml
Yann Collet [Fri, 3 Aug 2018 14:54:29 +0000 (07:54 -0700)]
fix : zstd cli can be built with build macro ZSTD_NOBENCH
which disables bench.c module
Yann Collet [Thu, 2 Aug 2018 18:53:46 +0000 (11:53 -0700)]
Merge branch 'dev' into travisTest
Yann Collet [Thu, 2 Aug 2018 18:52:12 +0000 (11:52 -0700)]
Merge branch 'travisTest' of github.com:facebook/zstd into travisTest
Yann Collet [Thu, 2 Aug 2018 18:48:56 +0000 (11:48 -0700)]
Merge pull request #1255 from terrelln/norm-fix
[FSE] Fix division by zero
Nick Terrell [Thu, 2 Aug 2018 18:12:17 +0000 (11:12 -0700)]
Disallow tableLog == srcLog
Jennifer Liu [Wed, 1 Aug 2018 18:06:16 +0000 (11:06 -0700)]
Add non-optimize FASTCOVER (#1260)
* Add non-optimize FASTCOVER
* Minor fix
* Pass param as value instead of pointer
Nick Terrell [Tue, 31 Jul 2018 21:31:05 +0000 (14:31 -0700)]
Merge pull request #1258 from jennifermliu/fastCover
Use CDict instead of CCtx in analyzeEntropy
Jennifer Liu [Tue, 31 Jul 2018 20:58:54 +0000 (13:58 -0700)]
Refactoring
Jennifer Liu [Tue, 31 Jul 2018 17:36:45 +0000 (10:36 -0700)]
Use CDict instead of CCtx in analyzeEntropy
Nick Terrell [Mon, 30 Jul 2018 23:03:18 +0000 (16:03 -0700)]
Merge pull request #1257 from jennifermliu/fastCover
Increment frequency for every dmer occurence within same sample
Nick Terrell [Mon, 30 Jul 2018 19:57:11 +0000 (12:57 -0700)]
[FSE] Add division by zero test
Jennifer Liu [Mon, 30 Jul 2018 19:54:22 +0000 (12:54 -0700)]
Increment frequency for every dmer occurence within same sample instead of at most once per sample
cyan4973 [Mon, 30 Jul 2018 15:08:40 +0000 (17:08 +0200)]
speed up appveyor tests
cyan4973 [Mon, 30 Jul 2018 14:56:18 +0000 (16:56 +0200)]
fix %zu support under minGW
and relevant test on Appveyor
cyan4973 [Mon, 30 Jul 2018 14:44:20 +0000 (16:44 +0200)]
ensure appveyor test fails due to formatting error
to catch %zu incompatibility
cyan4973 [Mon, 30 Jul 2018 14:30:35 +0000 (16:30 +0200)]
Merge branch 'dev' into fix1241
cyan4973 [Mon, 30 Jul 2018 14:29:20 +0000 (16:29 +0200)]
support %zu under mingw
Nick Terrell [Sat, 28 Jul 2018 01:22:52 +0000 (18:22 -0700)]
Merge pull request #1254 from jennifermliu/fastCover
Save segmentFreqs in ctx instead of malloc and memset in SelectSegment
Jennifer Liu [Sat, 28 Jul 2018 00:31:33 +0000 (17:31 -0700)]
Delete old benchmarking result
Nick Terrell [Sat, 28 Jul 2018 00:30:03 +0000 (17:30 -0700)]
[FSE] Fix division by zero
When the primary normalization method fails, and
`(1 << tableLog) == (maxSymbolValue + 1)`, and every symbol gets assigned
normalized weight 1 or -1 in the first loop, then the next division can
raise `SIGFPE`.
Jennifer Liu [Fri, 27 Jul 2018 23:56:50 +0000 (16:56 -0700)]
Undo deleting clean in make
Jennifer Liu [Fri, 27 Jul 2018 23:54:05 +0000 (16:54 -0700)]
Revert test.sh
Jennifer Liu [Fri, 27 Jul 2018 23:51:38 +0000 (16:51 -0700)]
Save segmentFreqs in ctx instead of malloc and memset in SelectSegment
Nick Terrell [Fri, 27 Jul 2018 22:11:57 +0000 (15:11 -0700)]
Merge pull request #1250 from jennifermliu/fastCover
Add Fast Cover Dictionary Builder
Jennifer Liu [Fri, 27 Jul 2018 20:39:19 +0000 (13:39 -0700)]
Use same param after optimizing cover and fastCover and record k and d for benchmarking
Jennifer Liu [Fri, 27 Jul 2018 02:03:01 +0000 (19:03 -0700)]
Rerun cover and fastCover with optimized values
Jennifer Liu [Thu, 26 Jul 2018 23:24:13 +0000 (16:24 -0700)]
Benchmark different f values
Nick Terrell [Thu, 26 Jul 2018 23:12:15 +0000 (16:12 -0700)]
Merge pull request #1252 from GeorgeLu97/bench-quiet-display-fix
Fixes bug
George Lu [Thu, 26 Jul 2018 22:17:58 +0000 (15:17 -0700)]
no zero
Jennifer Liu [Thu, 26 Jul 2018 20:53:13 +0000 (13:53 -0700)]
Add array to keep track of frequency within active segment, fix malloc bug, update benchmarking result
Jennifer Liu [Thu, 26 Jul 2018 01:10:09 +0000 (18:10 -0700)]
Allow d=6
Jennifer Liu [Thu, 26 Jul 2018 00:53:38 +0000 (17:53 -0700)]
Benchmark fast cover optimize vs k=200
Jennifer Liu [Thu, 26 Jul 2018 00:05:54 +0000 (17:05 -0700)]
Initial benchmarking result for fastCover
Jennifer Liu [Wed, 25 Jul 2018 23:54:08 +0000 (16:54 -0700)]
Make hash value const
Jennifer Liu [Wed, 25 Jul 2018 23:34:07 +0000 (16:34 -0700)]
Add Fast Cover Dictionary Builder
Nick Terrell [Sat, 21 Jul 2018 01:09:31 +0000 (18:09 -0700)]
Merge pull request #1246 from jennifermliu/benchmark
Benchmark dictionary builders
Jennifer Liu [Sat, 21 Jul 2018 00:41:22 +0000 (17:41 -0700)]
Minor fix
Jennifer Liu [Sat, 21 Jul 2018 00:03:47 +0000 (17:03 -0700)]
Refactoring and benchmark without dictionary
Jennifer Liu [Fri, 20 Jul 2018 18:32:39 +0000 (11:32 -0700)]
Benchmark dictionary builders
Nick Terrell [Thu, 19 Jul 2018 22:32:53 +0000 (15:32 -0700)]
Merge pull request #1245 from terrelln/disable-arm
Revert "attempt to re-enable arm64 tests"
Nick Terrell [Thu, 19 Jul 2018 21:35:27 +0000 (14:35 -0700)]
Revert "attempt to re-enable arm64 tests"
This reverts commit
9c277f137cbcaa385ff5b95ec4cbdce50675541d .
Nick Terrell [Thu, 19 Jul 2018 20:52:15 +0000 (13:52 -0700)]
Merge pull request #1238 from jennifermliu/random
Add random dictionary builder
Jennifer Liu [Thu, 19 Jul 2018 20:44:27 +0000 (13:44 -0700)]
Update Makefile
Jennifer Liu [Wed, 18 Jul 2018 19:15:49 +0000 (12:15 -0700)]
Rename cleanup
Jennifer Liu [Wed, 18 Jul 2018 17:40:13 +0000 (10:40 -0700)]
Add cleanup to trainfromFiles and move RANDOM_segment_t declaration
Yann Collet [Wed, 18 Jul 2018 14:34:10 +0000 (16:34 +0200)]
Merge pull request #1230 from terrelln/train-out
zstdcli: Allow -o before --train
Yann Collet [Wed, 18 Jul 2018 14:33:30 +0000 (16:33 +0200)]
Merge pull request #1237 from terrelln/init-cstream-adv
Set requestedParams in ZSTD_initCStream*()
cyan4973 [Wed, 18 Jul 2018 14:10:23 +0000 (16:10 +0200)]
fix minor conversion warning
Yann Collet [Wed, 18 Jul 2018 10:23:07 +0000 (12:23 +0200)]
Merge pull request #1242 from facebook/mingw_traces
zstdmt debug traces compatibles with mingw
Yann Collet [Wed, 18 Jul 2018 10:22:41 +0000 (12:22 +0200)]
Merge pull request #1244 from terrelln/ferror
fileio: Error in compression on read errors
Jennifer Liu [Tue, 17 Jul 2018 23:13:40 +0000 (16:13 -0700)]
Update freeSampleInfo
Jennifer Liu [Tue, 17 Jul 2018 23:01:44 +0000 (16:01 -0700)]
Fix deallocation problem and add documentation
Nick Terrell [Tue, 17 Jul 2018 21:57:27 +0000 (14:57 -0700)]
fileio: Error in compression on read errors
We can write a corrupted file if the input file errors during a read.
We should return a non-zero error code in this case.
Jennifer Liu [Tue, 17 Jul 2018 19:42:53 +0000 (12:42 -0700)]
Make test PHONY target
Jennifer Liu [Tue, 17 Jul 2018 19:35:09 +0000 (12:35 -0700)]
Move file loading functions to new file for access by benchmarking tool
cyan4973 [Tue, 17 Jul 2018 17:19:48 +0000 (19:19 +0200)]
fix make test on Linux
MOREFLAGS+= doesn't work on Linux
cyan4973 [Tue, 17 Jul 2018 17:02:17 +0000 (19:02 +0200)]
added a test to be played on travis
to check a make variable construction
cyan4973 [Tue, 17 Jul 2018 16:52:57 +0000 (18:52 +0200)]
fix #1241
Ensure that first input position is valid for a match
even during first usage of context
by starting reference at 1
(avoiding the problematic 0).
cyan4973 [Tue, 17 Jul 2018 12:39:44 +0000 (14:39 +0200)]
zstdmt debug traces compatibles with mingw
since mingw does not have `sys/times.h`,
remove this path when detecting mingw compilation.
Jennifer Liu [Tue, 17 Jul 2018 01:59:18 +0000 (18:59 -0700)]
Remove CLevel cli option which was accidentally added back in the last commit
Jennifer Liu [Mon, 16 Jul 2018 23:31:59 +0000 (16:31 -0700)]
Fix spacing and Edit Makefile (now run with make instead of make run)
Jennifer Liu [Mon, 16 Jul 2018 23:03:04 +0000 (16:03 -0700)]
Refactor RANDOM
Nick Terrell [Tue, 10 Jul 2018 01:24:07 +0000 (18:24 -0700)]
zstdcli: Allow -o before --train
Only set the default value if `outFileName` is unset.
Fixes #1227.
Yann Collet [Mon, 16 Jul 2018 10:26:58 +0000 (03:26 -0700)]
Merge pull request #1234 from codecat/add-premake
Added premake4/GENie script to contrib folder
Yann Collet [Mon, 16 Jul 2018 10:14:12 +0000 (03:14 -0700)]
Merge pull request #1233 from terrelln/doc-fiz
Small fixes to zstd specification
Codecat [Sat, 14 Jul 2018 10:34:03 +0000 (12:34 +0200)]
Fix wrong conditions
Codecat [Sat, 14 Jul 2018 10:27:42 +0000 (12:27 +0200)]
Update zstd.lua
Jennifer Liu [Sat, 14 Jul 2018 00:41:09 +0000 (17:41 -0700)]
Update README
Jennifer Liu [Sat, 14 Jul 2018 00:38:53 +0000 (17:38 -0700)]
Remove clevel and update documentation
Jennifer Liu [Fri, 13 Jul 2018 23:05:14 +0000 (16:05 -0700)]
Add random dictionary builder
Nick Terrell [Fri, 13 Jul 2018 20:26:15 +0000 (13:26 -0700)]
Merge pull request #1225 from jennifermliu/dev
Split samples when building dictionary for COVER
Nick Terrell [Fri, 13 Jul 2018 00:56:58 +0000 (17:56 -0700)]
Set requestedParams in ZSTD_initCStream*()
The correct parameters are used once, but once `ZSTD_resetCStream()` is
called the default parameters (level 3) are used. Fix this by setting
`requestedParams` in the `ZSTD_initCStream*()` functions.
The added tests both fail before this patch and pass after.
Nick Terrell [Thu, 12 Jul 2018 23:56:54 +0000 (16:56 -0700)]
Merge pull request #1235 from ldv-alt/dev
tests: use /dev/zero instead of /dev/random on all systems except GNU/Hurd
Jennifer Liu [Wed, 11 Jul 2018 22:50:28 +0000 (15:50 -0700)]
Add explanation for split=100
Codecat [Wed, 11 Jul 2018 16:02:18 +0000 (18:02 +0200)]
Added premake4/GENie script to contrib folder
Dmitry V. Levin [Wed, 11 Jul 2018 12:41:50 +0000 (12:41 +0000)]
tests: use /dev/zero instead of /dev/random on all systems except GNU/Hurd
https://github.com/facebook/zstd/pull/1124 broke the test suite
on Linux. Looks like GNU/Hurd is the only operating system where
/dev/random is available for writing by unprivileged processes.
https://github.com/facebook/zstd/pull/1222 reverted the change
introduced by https://github.com/facebook/zstd/pull/1124 for OpenBSD
only, other operating systems need that change to be reverted, too.
Fixes: 2dde9d5abaad ("Write to /dev/random for test")
Complements:
276988f7948d ("OpenBSD is unable to write to /dev/zero")
Nick Terrell [Tue, 10 Jul 2018 22:07:36 +0000 (15:07 -0700)]
Small fixes to zstd specification
Update to keep in sync with the RFC.
Jennifer Liu [Tue, 10 Jul 2018 18:19:33 +0000 (11:19 -0700)]
Change default splitPoint to 100
Jennifer Liu [Mon, 9 Jul 2018 20:53:25 +0000 (13:53 -0700)]
Change back to splitPoint<=0
Jennifer Liu [Mon, 9 Jul 2018 19:26:53 +0000 (12:26 -0700)]
Only make 0.0 default splitPoint
Yann Collet [Sat, 7 Jul 2018 00:56:35 +0000 (17:56 -0700)]
Merge pull request #1226 from facebook/noPrefetch
add build macro NO_PREFETCH