]>
git.ipfire.org Git - thirdparty/zstd.git/log
Bimba Shrestha [Tue, 2 Jun 2020 16:15:24 +0000 (09:15 -0700)]
excluding ls | grep warning
Bimba Shrestha [Tue, 2 Jun 2020 16:12:50 +0000 (09:12 -0700)]
[shellcheck] setting if unset
Bimba Shrestha [Tue, 2 Jun 2020 16:12:13 +0000 (09:12 -0700)]
[shellcheck] adding quotes to expansion
Bimba Shrestha [Tue, 2 Jun 2020 16:08:16 +0000 (09:08 -0700)]
adding shellcheck bourne test
Bimba Shrestha [Tue, 2 Jun 2020 16:07:45 +0000 (09:07 -0700)]
newline lints (ignore)
Yann Collet [Fri, 29 May 2020 20:49:38 +0000 (13:49 -0700)]
Merge pull request #2181 from facebook/makejall
fixed double-compilation of lib with make -j all
Yann Collet [Fri, 29 May 2020 19:40:59 +0000 (12:40 -0700)]
added comment on $(Q)
Yann Collet [Fri, 29 May 2020 19:09:51 +0000 (12:09 -0700)]
fixed double-compilation of lib with make -j all
also implemented verbose mode (make V=1)
Felix Handte [Thu, 28 May 2020 17:07:18 +0000 (13:07 -0400)]
Merge pull request #2133 from felixhandte/single-size-calculation
Consolidate CCtx Size Estimation Code
Bimba Shrestha [Tue, 26 May 2020 21:30:11 +0000 (16:30 -0500)]
Merge pull request #2180 from facebook/generic-release
[actions] Migrating 2nd batch of tests from Travis to Github Actions
Yann Collet [Tue, 26 May 2020 20:15:35 +0000 (13:15 -0700)]
minor markdown formatting fix
Bimba Shrestha [Tue, 26 May 2020 20:12:00 +0000 (15:12 -0500)]
Create generic-release.yml
Bimba Shrestha [Tue, 26 May 2020 18:03:17 +0000 (13:03 -0500)]
Merge pull request #2137 from facebook/generic-dev
[actions] Migrating 1st batch of tests from Travis to Github Actions
Bimba Shrestha [Tue, 26 May 2020 17:26:22 +0000 (12:26 -0500)]
Merge pull request #2178 from bimbashrestha/quick-fix
Change --patch-from limit from 4gb to 2gb
Bimba Shrestha [Tue, 26 May 2020 16:23:26 +0000 (09:23 -0700)]
Using ZSTD_MAX_WINDOWLOG instead of INT_MAX
Yann Collet [Tue, 26 May 2020 15:55:34 +0000 (08:55 -0700)]
Merge pull request #2176 from facebook/make_implicit
fixed default rule for lib/Makefile
Yann Collet [Tue, 26 May 2020 15:54:10 +0000 (08:54 -0700)]
Merge pull request #2177 from facebook/dictID0
updated spec on dictID==0
Bimba Shrestha [Tue, 26 May 2020 13:52:30 +0000 (06:52 -0700)]
Change --patch-from limit from 4gb to 2gb
Yann Collet [Mon, 25 May 2020 15:15:09 +0000 (08:15 -0700)]
updated spec on dictID==0
Specified decoder behavior on receiving a frame with dictID=0.
Pushed paragraph on reserved DictID ranges into the Dictionary Format section.
Yann Collet [Mon, 25 May 2020 13:50:45 +0000 (06:50 -0700)]
fixed default rule for lib/Makefile
default rule is `lib-release`
`lib-release` wasn't working : it was just skipped.
Removing `lib-release` from the list of .PHONY targets fixes it.
Same for `lib-mt`.
Nick Terrell [Sat, 23 May 2020 06:38:27 +0000 (23:38 -0700)]
Merge pull request #2167 from terrelln/pzstd-ms-fix
[pzstd] Fix compilation error in MinGW
Nick Terrell [Sat, 23 May 2020 05:26:02 +0000 (22:26 -0700)]
[pzstd] Fix compilation error in MinGW
Yann Collet [Sat, 23 May 2020 00:16:23 +0000 (17:16 -0700)]
Merge pull request #2166 from facebook/donotinstall_zbuffh
do not install zbuff.h
Yann Collet [Fri, 22 May 2020 22:35:54 +0000 (15:35 -0700)]
do not install zbuff.h
this API is deprecated, for a loong time now,
all related symbols will be removed in a future version (likely v1.5.0)
and the header file `zbuff.h` doesn't compile from `include/` anyway,
because it needs to be positioned one directory below `zstd.h`.
Also removed `cover.h` from `cmake` installer,
as it should have never been part of this list to begin with.
Yann Collet [Fri, 22 May 2020 16:55:17 +0000 (09:55 -0700)]
Merge pull request #2163 from orivej/fix-legacy-build
Fix legacy build after #2103
Orivej Desh [Fri, 22 May 2020 12:48:02 +0000 (12:48 +0000)]
Fix legacy build after #2103
Yann Collet [Fri, 22 May 2020 03:50:50 +0000 (20:50 -0700)]
Merge pull request #2159 from facebook/visual_playTests
Fix playTests.sh
Yann Collet [Fri, 22 May 2020 01:06:43 +0000 (18:06 -0700)]
fixed environment variables
Yann Collet [Thu, 21 May 2020 23:45:02 +0000 (16:45 -0700)]
Merge branch 'dev' into visual_playTests
Yann Collet [Thu, 21 May 2020 23:07:56 +0000 (16:07 -0700)]
Merge pull request #2158 from facebook/meson_fix
fix meson playTests.sh
Yann Collet [Thu, 21 May 2020 21:19:28 +0000 (14:19 -0700)]
fix meson playTests.sh
Yann Collet [Thu, 21 May 2020 17:26:40 +0000 (10:26 -0700)]
try to fix PPC64 Qemu tests
Yann Collet [Thu, 21 May 2020 16:44:52 +0000 (09:44 -0700)]
Merge pull request #2155 from facebook/fix_zbufftest
fixed zbuff test
Yann Collet [Thu, 21 May 2020 05:56:25 +0000 (22:56 -0700)]
fixed appveyor long tests
playTests changed variable name
Yann Collet [Thu, 21 May 2020 07:22:52 +0000 (00:22 -0700)]
fixed zbuff test
error introduced in https://github.com/facebook/zstd/blame/
3b39ce6b527c5cfe395a187c75b77baf5cc7de02 /.travis.yml#L192
Yann Collet [Wed, 20 May 2020 00:41:51 +0000 (17:41 -0700)]
Merge pull request #2153 from terrelln/ldm-dict-reset
[ldm][mt] Fix loadedDictEnd
Nick Terrell [Tue, 19 May 2020 23:14:14 +0000 (16:14 -0700)]
[test] Update the ldm loadedDictEnd test to cover zstdmt
Nick Terrell [Tue, 19 May 2020 22:55:03 +0000 (15:55 -0700)]
[ldm][mt] Fix loadedDictEnd
Nick Terrell [Tue, 19 May 2020 19:56:11 +0000 (12:56 -0700)]
Merge pull request #2152 from terrelln/simple-rt-bound
[fuzz] Expand the allowedExpansion
Nick Terrell [Tue, 19 May 2020 18:42:53 +0000 (11:42 -0700)]
[fuzz] Expand the allowedExpansion
Yann Collet [Tue, 19 May 2020 04:05:10 +0000 (21:05 -0700)]
fix 22294 (#2151)
Nick Terrell [Tue, 19 May 2020 01:33:01 +0000 (18:33 -0700)]
Merge pull request #2150 from terrelln/ldm-dict-reset
[ldm] Reset loadedDictEnd when the context is reset
Nick Terrell [Mon, 18 May 2020 22:11:02 +0000 (15:11 -0700)]
[test] Test that the ldm dictionary gets invalidated on reset
Nick Terrell [Mon, 18 May 2020 19:56:34 +0000 (12:56 -0700)]
[test] Improve LDM forceMaxWindow test
Felix Handte [Mon, 18 May 2020 19:47:17 +0000 (15:47 -0400)]
Merge pull request #2148 from felixhandte/fix-2144
Don't Use `[[` in Shell Scripts
Nick Terrell [Mon, 18 May 2020 19:35:44 +0000 (12:35 -0700)]
[ldm] Reset loadedDictEnd when the context is reset
W. Felix Handte [Mon, 18 May 2020 18:54:06 +0000 (14:54 -0400)]
Don't Use `[[` in Shell Scripts
Felix Handte [Mon, 18 May 2020 15:53:28 +0000 (11:53 -0400)]
Merge pull request #2146 from cwoffenden/combine-script-fixes
Reduced single file lib size on macOS
Carl Woffenden [Mon, 18 May 2020 10:33:44 +0000 (12:33 +0200)]
Minor tidy
Carl Woffenden [Mon, 18 May 2020 08:12:02 +0000 (10:12 +0200)]
Reduced generated sized on macOS (and other envs where realpath is missing)
Added Python fallback for when realpath fails.
Yann Collet [Sat, 16 May 2020 00:19:00 +0000 (17:19 -0700)]
updated CHANGELOG for v1.4.5
Bimba Shrestha [Fri, 15 May 2020 20:33:31 +0000 (15:33 -0500)]
[fuzz] Adding dictionary_stream_round_trip fuzzer (#2140)
* Adding dictionary_stream_round_trip
* fixing memory leak
Yann Collet [Fri, 15 May 2020 00:44:58 +0000 (17:44 -0700)]
Merge pull request #2141 from terrelln/regression
[test][regression] Update results.csv
Nick Terrell [Fri, 15 May 2020 00:06:39 +0000 (17:06 -0700)]
[test][regression] Update results.csv
Yann Collet [Thu, 14 May 2020 23:17:03 +0000 (16:17 -0700)]
updated documentation for v1.4.5
API manual and man pages
Nick Terrell [Thu, 14 May 2020 20:32:00 +0000 (13:32 -0700)]
Merge pull request #2138 from terrelln/ldm-fix
[lib] Fix bug in loading LDM dictionary in MT mode
Nick Terrell [Thu, 14 May 2020 19:06:55 +0000 (12:06 -0700)]
[test] Expose the LDM+MT+dict bug in a unit test
Nick Terrell [Thu, 14 May 2020 18:50:48 +0000 (11:50 -0700)]
[lib] Fix bug in loading LDM dictionary in MT mode
Exposed when loading a dictionary < LDM minMatch bytes in MT mode.
Test Plan:
```
CC=clang make -j zstreamtest MOREFLAGS="-O0 -fsanitize=address"
./zstreamtest -vv -i100000000 -t1 --newapi -s7065 -t3925297
```
TODO: Add an explicit test that loads a small dictionary in MT mode
W. Felix Handte [Thu, 14 May 2020 17:50:53 +0000 (13:50 -0400)]
Fix Size Estimate for LDM Seq Space
Bimba Shrestha [Thu, 14 May 2020 17:35:37 +0000 (12:35 -0500)]
Migrating first batch of tests from travis
# Dev PR jobs that still have to be migrated from travis
#
# icc (need self-hosted)
# arm/qemu-arm (need self-hosted)
# versionTag
# valgrindTest (keeps failing for some reason. need investigation)
# staticAnalyze (need trusty so need self-hosted)
# pcc-fuzz: (need trusty so need self-hosted)
# arm-build-test (need self-hosted)
Bimba Shrestha [Wed, 13 May 2020 21:08:59 +0000 (16:08 -0500)]
Merge pull request #2135 from bimbashrestha/grep
Revert to old zstdgrep because of potential license issue
Bimba Shrestha [Wed, 13 May 2020 20:22:07 +0000 (15:22 -0500)]
reverting docs and test
Bimba Shrestha [Wed, 13 May 2020 20:12:14 +0000 (15:12 -0500)]
Revert to old zstdgrep
Yann Collet [Wed, 13 May 2020 03:49:10 +0000 (20:49 -0700)]
Merge pull request #2134 from terrelln/align-lazy
[greedy] Fix performance instability
Nick Terrell [Wed, 13 May 2020 00:51:16 +0000 (17:51 -0700)]
[greedy] Fix performance instability
Nick Terrell [Wed, 13 May 2020 00:44:31 +0000 (17:44 -0700)]
Merge pull request #2131 from terrelln/raw-dict-fuzzer
Fix rare scenario with lazy parser, dictionary, and repcodes
W. Felix Handte [Tue, 12 May 2020 22:03:31 +0000 (18:03 -0400)]
Nit: Fix Size Type for 32-bit
Nick Terrell [Tue, 12 May 2020 21:33:59 +0000 (14:33 -0700)]
[lib] Fix assertion when dictionary is prefix
W. Felix Handte [Tue, 12 May 2020 20:52:22 +0000 (16:52 -0400)]
Assert We Allocated Approximately What We Expected To
W. Felix Handte [Tue, 12 May 2020 20:52:12 +0000 (16:52 -0400)]
Minor Refactor
W. Felix Handte [Tue, 12 May 2020 20:27:45 +0000 (16:27 -0400)]
Handle Non-Static CCtxes in Estimation
Yann Collet [Tue, 12 May 2020 20:49:38 +0000 (13:49 -0700)]
Merge pull request #2132 from bimbashrestha/grep-rm-test
[build] removing -f test (grep usage not supported on mac)
Yann Collet [Tue, 12 May 2020 20:48:23 +0000 (13:48 -0700)]
Merge pull request #2125 from Artoria2e5/patch-2
programs/Makefile: make it actually work with clang
W. Felix Handte [Tue, 12 May 2020 18:18:23 +0000 (14:18 -0400)]
Consolidate CCtx Size Estimation Code
This commit pulls out the internals of `ZSTD_estimateCCtxSize_usingCCtxParams`
into a helper. It then migrates two other callsites to use that helper,
a small optimization for `ZSTD_estimateCStreamSize_usingCCtxParams`, which
folds the buffer sizing into the helper, and then `ZSTD_resetCCtx_internal`,
which is more invasive.
This attempts to guarantee that the estimates returned to users are always
correct.
Bimba Shrestha [Tue, 12 May 2020 20:18:43 +0000 (15:18 -0500)]
removing -f test (grep usage not supported on mac)
Nick Terrell [Tue, 12 May 2020 19:25:06 +0000 (12:25 -0700)]
[lib] Fix lazy repcode validity checks
Yann Collet [Tue, 12 May 2020 19:03:22 +0000 (12:03 -0700)]
Merge pull request #2130 from facebook/initStatic_fix
Fix for initStatic
Nick Terrell [Tue, 12 May 2020 18:57:15 +0000 (11:57 -0700)]
[lib] Fix repcode validation in no dict mode
Nick Terrell [Tue, 12 May 2020 05:27:34 +0000 (22:27 -0700)]
[lib] Fix dictionary + repcodes + optimal parser
Nick Terrell [Tue, 12 May 2020 02:05:42 +0000 (19:05 -0700)]
[lib][fuzz] Assert sequences are valid in round trip tests
Yann Collet [Tue, 12 May 2020 03:35:47 +0000 (20:35 -0700)]
fixed asan test
Yann Collet [Tue, 12 May 2020 02:29:36 +0000 (19:29 -0700)]
blindfix for VS macro redefinition
Yann Collet [Tue, 12 May 2020 02:21:50 +0000 (19:21 -0700)]
updated documentation for ZSTD_estimate*()
make it clearer that tighter memory estimation
can be provided using advanced functions
on the condition of a defined input size bound.
Nick Terrell [Tue, 12 May 2020 02:04:30 +0000 (19:04 -0700)]
[lib] Fix lazy parser with dictionary + repcodes
Nick Terrell [Tue, 12 May 2020 02:03:33 +0000 (19:03 -0700)]
[fuzz] Add raw dictionary content fuzzer
Nick Terrell [Tue, 12 May 2020 02:00:52 +0000 (19:00 -0700)]
[fuzz] Fix compress bound for dictionary_round_trip
Bimba Shrestha [Tue, 12 May 2020 01:55:01 +0000 (20:55 -0500)]
[doc] measuring performance docs (#2117)
* performance measuring docs
* spelling
* combining advanced and simple section
* zstd benchmark title change
Yann Collet [Tue, 12 May 2020 01:54:22 +0000 (18:54 -0700)]
Merge pull request #2124 from facebook/initStatic_tests
re-inforced tests for initStaticCCtx
Yann Collet [Tue, 12 May 2020 01:54:07 +0000 (18:54 -0700)]
Merge pull request #2123 from facebook/zstd_help
updated `zstd -h`
Yann Collet [Tue, 12 May 2020 01:50:10 +0000 (18:50 -0700)]
updated initStatic tests
differentiate small CCtx for small inputs
from full CCtx
from CStream contexts.
Ensure allocation & resize tests are more precise.
Yann Collet [Tue, 12 May 2020 01:16:38 +0000 (18:16 -0700)]
fixed context downsize with initStatic
When context is created using initStatic,
no resize is possible.
fix : only bump oversizeDuration when !initStatic
Yann Collet [Mon, 11 May 2020 23:51:13 +0000 (16:51 -0700)]
Merge branch 'dev' into initStatic_tests
Yann Collet [Mon, 11 May 2020 23:36:46 +0000 (16:36 -0700)]
Merge pull request #2129 from felixhandte/fix-cctx-size-estimate
Fix ZSTD_estimateCCtxSize() Under ASAN
W. Felix Handte [Mon, 11 May 2020 22:53:32 +0000 (18:53 -0400)]
Fix ZSTD_estimateCCtxSize() Under ASAN
`ZSTD_estimateCCtxSize()` provides estimates for one-shot compression, which
is guaranteed not to buffer inputs or outputs. So it ignores the sizes of the
buffers, assuming they'll be zero. However, the actual workspace allocation
logic always allocates those buffers, and when running under ASAN, the
workspace surrounds every allocation with 256 bytes of redzone. So the 0-sized
buffers end up consuming 512 bytes of space, which is accounted for in the
actual allocation path through the use of `ZSTD_cwksp_alloc_size()` but isn't
in the estimation path, since it ignores the buffers entirely.
This commit fixes this.
Nick Terrell [Mon, 11 May 2020 20:53:18 +0000 (13:53 -0700)]
Merge pull request #2128 from terrelln/benches
Update benchmarks and add fast mode
Nick Terrell [Mon, 11 May 2020 19:29:03 +0000 (12:29 -0700)]
Update benchmarks and add fast mode
Bimba Shrestha [Mon, 11 May 2020 17:51:35 +0000 (12:51 -0500)]
Merge pull request #2127 from bimbashrestha/docs1
[doc] documenting non-supported grep options for zstdgrep to README
Bimba Shrestha [Mon, 11 May 2020 17:22:45 +0000 (12:22 -0500)]
documenting non-supported grep options for zstdgrep
Yann Collet [Mon, 11 May 2020 16:42:33 +0000 (09:42 -0700)]
Merge pull request #2120 from facebook/clevel_doc
updated zstd CLI documentation
Mingye Wang [Sun, 10 May 2020 08:36:08 +0000 (16:36 +0800)]
programs/Makefile: make it actually work with clang
Recent versions of clang seem to require a step of conversion from the profraw file to a "compiler-readable" profdata file to let PGO work.