]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
5 years agoFix ZSTD_f_zstd1_magicless for small data 1837/head
Nick Terrell [Tue, 22 Oct 2019 02:42:14 +0000 (19:42 -0700)] 
Fix ZSTD_f_zstd1_magicless for small data

* Fix `ZSTD_FRAMEHEADERSIZE_PREFIX` and `ZSTD_FRAMEHEADERSIZE_MIN` to
  take a `format` parameter, so it is impossible to get the wrong size.
* Fix the places that called `ZSTD_FRAMEHEADERSIZE_PREFIX` without
  taking the format into account, which is now impossible by design.
* Call `ZSTD_frameHeaderSize_internal()` with `dctx->format`.
* The added tests catch both bugs in `ZSTD_decompressFrame()`.

Fixes #1813.

5 years agoMerge pull request #1831 from terrelln/zstdmt-bad-memset
Nick Terrell [Mon, 21 Oct 2019 22:53:57 +0000 (15:53 -0700)] 
Merge pull request #1831 from terrelln/zstdmt-bad-memset

[zstdmt] Don't memset the jobDescription

5 years agoMerge pull request #1834 from facebook/winFix
Yann Collet [Mon, 21 Oct 2019 20:45:17 +0000 (13:45 -0700)] 
Merge pull request #1834 from facebook/winFix

Windows fixes

5 years agoturned off zlib tests during msan 1834/head
Yann Collet [Mon, 21 Oct 2019 19:55:39 +0000 (12:55 -0700)] 
turned off zlib tests during msan

since the local zlib library is not msan-instrumented

5 years agominor refactor of FIO_compressGzFrame()
Yann Collet [Mon, 21 Oct 2019 19:14:59 +0000 (12:14 -0700)] 
minor refactor of FIO_compressGzFrame()

mostly narrowing variables lifetime and mutability.

5 years agoMerge pull request #1795 from felixhandte/workspace-asan
Felix Handte [Mon, 21 Oct 2019 16:15:17 +0000 (12:15 -0400)] 
Merge pull request #1795 from felixhandte/workspace-asan

Add Poisoned Redzones to the Workspace When Compiling with ASAN

5 years agoMerge pull request #1835 from facebook/format034
Yann Collet [Sat, 19 Oct 2019 12:24:42 +0000 (05:24 -0700)] 
Merge pull request #1835 from facebook/format034

clarifications for the FSE decoding table

5 years agoclarifications for the FSE decoding table 1835/head
Yann Collet [Sat, 19 Oct 2019 00:48:12 +0000 (17:48 -0700)] 
clarifications for the FSE decoding table

requested in #1782

5 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Sat, 19 Oct 2019 00:23:39 +0000 (17:23 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

5 years agoadded mode documentation on ZSTD_CLEVEL
Yann Collet [Sat, 19 Oct 2019 00:22:45 +0000 (17:22 -0700)] 
added mode documentation on ZSTD_CLEVEL

providing range restriction [1-19] explicitly
partially answering #1829

5 years agofixed visual defined test
Yann Collet [Sat, 19 Oct 2019 00:08:52 +0000 (17:08 -0700)] 
fixed visual defined test

5 years agoremoved Visual warning
Yann Collet [Sat, 19 Oct 2019 00:05:42 +0000 (17:05 -0700)] 
removed Visual warning

for pointer casts

5 years agoMerge pull request #1832 from terrelln/fuzz-stream-fix
Nick Terrell [Fri, 18 Oct 2019 23:35:23 +0000 (16:35 -0700)] 
Merge pull request #1832 from terrelln/fuzz-stream-fix

[fuzz] Increase output buffer size of stream_round_trip

5 years agofix function cast warning on Windows with gcc9
Yann Collet [Fri, 18 Oct 2019 22:45:31 +0000 (15:45 -0700)] 
fix function cast warning on Windows with gcc9

5 years agoupdated windows binary resources
Yann Collet [Fri, 18 Oct 2019 22:41:12 +0000 (15:41 -0700)] 
updated windows binary resources

5 years agovalidated 'make test' for mingw environment
Yann Collet [Fri, 18 Oct 2019 22:37:07 +0000 (15:37 -0700)] 
validated 'make test' for mingw environment

5 years agomade `make check` faster
Yann Collet [Fri, 18 Oct 2019 22:21:50 +0000 (15:21 -0700)] 
made `make check` faster

for shorter feedback loop

5 years ago[zstdmt] Don't memset the jobDescription 1831/head
Nick Terrell [Fri, 18 Oct 2019 17:59:15 +0000 (10:59 -0700)] 
[zstdmt] Don't memset the jobDescription

5 years ago[threading] Add debug utilities
Nick Terrell [Fri, 18 Oct 2019 19:33:45 +0000 (12:33 -0700)] 
[threading] Add debug utilities

5 years agominor appveyor test script fix
Yann Collet [Fri, 18 Oct 2019 22:02:30 +0000 (15:02 -0700)] 
minor appveyor test script fix

5 years agoattempt to run 'make check' tests on Appveyor
Yann Collet [Fri, 18 Oct 2019 21:52:16 +0000 (14:52 -0700)] 
attempt to run 'make check' tests on Appveyor

for mingw builds

5 years agofix test on windows
Yann Collet [Fri, 18 Oct 2019 21:28:34 +0000 (14:28 -0700)] 
fix test on windows

isDirectory() doesn't work on Windows
if directory name is followed by '/'

5 years ago[fuzz] Increase output buffer size of stream_round_trip 1832/head
Nick Terrell [Fri, 18 Oct 2019 20:34:35 +0000 (13:34 -0700)] 
[fuzz] Increase output buffer size of stream_round_trip

Fixes OSS-Fuzz crash.
Credit to OSS-Fuzz

5 years agorewrite FIO_createFilename_fromOutDir()
Yann Collet [Fri, 18 Oct 2019 18:15:10 +0000 (11:15 -0700)] 
rewrite FIO_createFilename_fromOutDir()

5 years agofix : no output file opened in test mode
Yann Collet [Thu, 17 Oct 2019 23:58:49 +0000 (16:58 -0700)] 
fix : no output file opened in test mode

also : redistributed error code within fileio.c
for more precise diagnosis.

5 years agoremoved regular file test on Windows
Yann Collet [Thu, 17 Oct 2019 23:39:47 +0000 (16:39 -0700)] 
removed regular file test on Windows

since it does not work well on this platform
(tested with MinGW).

Note : could be an issue within UTIL_isRegularFile()

5 years agoimproved test mode `-t`
Yann Collet [Thu, 17 Oct 2019 23:09:53 +0000 (16:09 -0700)] 
improved test mode `-t`

The test mode do no longer open a file `/dev/null` nor write anything to output.

This is supposed to be more efficient than writing to `/dev/null`,
and more universal too : the previous method was failing on Windows.

5 years agorefactored FIO_compressMultipleFilenames() prototype
Yann Collet [Thu, 17 Oct 2019 22:32:03 +0000 (15:32 -0700)] 
refactored FIO_compressMultipleFilenames() prototype

for consistency

5 years agofixed multiple implicit casts
Yann Collet [Thu, 17 Oct 2019 22:27:25 +0000 (15:27 -0700)] 
fixed multiple implicit casts

5 years agotests: can override isTerminal with environment variable
Yann Collet [Thu, 17 Oct 2019 22:07:47 +0000 (15:07 -0700)] 
tests: can override isTerminal with environment variable

5 years agofixed isSameFile()
Yann Collet [Thu, 17 Oct 2019 21:31:42 +0000 (14:31 -0700)] 
fixed isSameFile()

5 years agofix harness test
Yann Collet [Thu, 17 Oct 2019 21:29:48 +0000 (14:29 -0700)] 
fix harness test

5 years agofixed dict ptr init
Yann Collet [Thu, 17 Oct 2019 21:15:00 +0000 (14:15 -0700)] 
fixed dict ptr init

5 years agominor refactoring of harness
Yann Collet [Thu, 17 Oct 2019 21:11:54 +0000 (14:11 -0700)] 
minor refactoring of harness

5 years agominor: DIFF determination
Yann Collet [Thu, 17 Oct 2019 21:03:20 +0000 (14:03 -0700)] 
minor: DIFF determination

use gdiff on SunOS

5 years agoforce compression during tests
Yann Collet [Thu, 17 Oct 2019 20:01:18 +0000 (13:01 -0700)] 
force compression during tests

to erase potentially remaining artifacts from previous runs

5 years agofix several cast
Yann Collet [Thu, 17 Oct 2019 18:01:20 +0000 (11:01 -0700)] 
fix several cast

5 years agofix incorrect dictName/FileName comparison on Windows
Yann Collet [Thu, 17 Oct 2019 17:56:14 +0000 (10:56 -0700)] 
fix incorrect dictName/FileName comparison on Windows

inode identification does not seem to work on Windows,
even with on a msys2 posix layer.

5 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Thu, 17 Oct 2019 17:50:58 +0000 (10:50 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

5 years agoignore build artifact from educational decoder test
Yann Collet [Thu, 17 Oct 2019 17:50:39 +0000 (10:50 -0700)] 
ignore build artifact from educational decoder test

5 years agoMerge pull request #1827 from facebook/dm_Dct
Yann Collet [Thu, 17 Oct 2019 17:30:58 +0000 (10:30 -0700)] 
Merge pull request #1827 from facebook/dm_Dct

updated erroneous comments using ZSTD_dm_*

5 years agoremoved UNALIGNED() macro from educational decoder
Yann Collet [Thu, 17 Oct 2019 00:27:03 +0000 (17:27 -0700)] 
removed UNALIGNED() macro from educational decoder

as this name collides with existing macro in mingw64+clang9.

5 years agoMerge pull request #1828 from bimbashrestha/education_decoder_check
Yann Collet [Thu, 17 Oct 2019 00:21:47 +0000 (17:21 -0700)] 
Merge pull request #1828 from bimbashrestha/education_decoder_check

Removing unnecessary check on education decoder

5 years agoMerge pull request #1815 from facebook/zlibwrap
Yann Collet [Wed, 16 Oct 2019 23:45:15 +0000 (16:45 -0700)] 
Merge pull request #1815 from facebook/zlibwrap

make zlibWrapper strict ISO-C90 compatible

5 years agoMerge pull request #1826 from facebook/noWild8
Yann Collet [Wed, 16 Oct 2019 23:43:36 +0000 (16:43 -0700)] 
Merge pull request #1826 from facebook/noWild8

removed wildcopy8()

5 years agoRemoving unnecessary check from decode side 1828/head
Bimba Shrestha [Wed, 16 Oct 2019 23:26:46 +0000 (16:26 -0700)] 
Removing unnecessary check from decode side

5 years agoupdated erroneous comments using ZSTD_dm_* 1827/head
Yann Collet [Wed, 16 Oct 2019 23:14:04 +0000 (16:14 -0700)] 
updated erroneous comments using ZSTD_dm_*

instead of the current ZSTD_dct_*,
reported by @nigeltao (#1822)

5 years agoremoved wildcopy8() 1826/head
Yann Collet [Wed, 16 Oct 2019 21:51:33 +0000 (14:51 -0700)] 
removed wildcopy8()

which is no longer used,
noticed by @davidbolvansky

5 years agominor comments & refactoring
Yann Collet [Tue, 15 Oct 2019 23:09:18 +0000 (16:09 -0700)] 
minor comments & refactoring

5 years agoMerge pull request #1731 from chungy/stdin_nochmod
Yann Collet [Mon, 14 Oct 2019 16:34:56 +0000 (09:34 -0700)] 
Merge pull request #1731 from chungy/stdin_nochmod

[programs] don’t do chmod when coming from stdin or multiple files

5 years agoMerge pull request #1792 from dmitri-shubin/dev
Yann Collet [Mon, 14 Oct 2019 16:27:25 +0000 (09:27 -0700)] 
Merge pull request #1792 from dmitri-shubin/dev

Don't hardcode installation directories in CMakeLists.txt

5 years agoMerge pull request #1812 from senhuang42/output-dir-flat
Yann Collet [Mon, 14 Oct 2019 16:25:05 +0000 (09:25 -0700)] 
Merge pull request #1812 from senhuang42/output-dir-flat

Support for --output-dir-flat: output into a directory

5 years agoMerge pull request #1823 from vangyzen/fwrite_errno
Yann Collet [Mon, 14 Oct 2019 16:20:18 +0000 (09:20 -0700)] 
Merge pull request #1823 from vangyzen/fwrite_errno

Include errno in all fwrite error messages in fileio.c

5 years agoMerge pull request #1760 from bimbashrestha/extract_sequences_api
Yann Collet [Thu, 10 Oct 2019 20:11:18 +0000 (13:11 -0700)] 
Merge pull request #1760 from bimbashrestha/extract_sequences_api

Adding api for extracting sequences from seqstore

5 years agoFix CCtx Size Estimation 1795/head
W. Felix Handte [Thu, 10 Oct 2019 19:02:08 +0000 (15:02 -0400)] 
Fix CCtx Size Estimation

5 years agoExpand Default Redzone Size
W. Felix Handte [Thu, 10 Oct 2019 17:45:55 +0000 (13:45 -0400)] 
Expand Default Redzone Size

5 years agoCheck if CCtx in Workspace after Null Check
W. Felix Handte [Tue, 17 Sep 2019 15:35:49 +0000 (11:35 -0400)] 
Check if CCtx in Workspace after Null Check

5 years agoDeclare the ASAN Functions We Need, Don't Include the Header
W. Felix Handte [Mon, 16 Sep 2019 23:04:05 +0000 (19:04 -0400)] 
Declare the ASAN Functions We Need, Don't Include the Header

5 years agoStop Allocating Extra Space for Table Redzones
W. Felix Handte [Mon, 16 Sep 2019 22:06:16 +0000 (18:06 -0400)] 
Stop Allocating Extra Space for Table Redzones

5 years agoDon't Try to Redzone the Tables
W. Felix Handte [Mon, 16 Sep 2019 21:56:28 +0000 (17:56 -0400)] 
Don't Try to Redzone the Tables

5 years agoFix Workspace Size Calculation
W. Felix Handte [Mon, 16 Sep 2019 21:47:29 +0000 (17:47 -0400)] 
Fix Workspace Size Calculation

5 years agoFix ZSTD_sizeof_matchState() Calculation
W. Felix Handte [Mon, 16 Sep 2019 21:45:40 +0000 (17:45 -0400)] 
Fix ZSTD_sizeof_matchState() Calculation

5 years agoAvoid ASAN Failure in ZSTD_cwksp_free()
W. Felix Handte [Mon, 16 Sep 2019 21:43:55 +0000 (17:43 -0400)] 
Avoid ASAN Failure in ZSTD_cwksp_free()

5 years agoRefactor Freeing CCtxes / CDicts Inside Workspaces
W. Felix Handte [Mon, 16 Sep 2019 21:43:05 +0000 (17:43 -0400)] 
Refactor Freeing CCtxes / CDicts Inside Workspaces

5 years agoSurround Workspace Allocs with Dead Zone
W. Felix Handte [Thu, 12 Sep 2019 23:41:45 +0000 (19:41 -0400)] 
Surround Workspace Allocs with Dead Zone

5 years agoAdd `ZSTD_cwksp_alloc_size()` to Help Calculate Needed Workspace Size
W. Felix Handte [Thu, 12 Sep 2019 23:40:38 +0000 (19:40 -0400)] 
Add `ZSTD_cwksp_alloc_size()` to Help Calculate Needed Workspace Size

5 years agoStop Assuming Tables are Adjacent
W. Felix Handte [Thu, 12 Sep 2019 22:39:46 +0000 (18:39 -0400)] 
Stop Assuming Tables are Adjacent

5 years agoPoison Unused Workspace Memory
W. Felix Handte [Thu, 12 Sep 2019 22:33:00 +0000 (18:33 -0400)] 
Poison Unused Workspace Memory

5 years agoDetect Whether We're Being Compiled with ASAN
W. Felix Handte [Thu, 12 Sep 2019 22:32:22 +0000 (18:32 -0400)] 
Detect Whether We're Being Compiled with ASAN

5 years agoRemove Unused MEM_SKIP_MSAN Macro
W. Felix Handte [Thu, 12 Sep 2019 22:24:44 +0000 (18:24 -0400)] 
Remove Unused MEM_SKIP_MSAN Macro

5 years agoInclude errno in all fwrite error messages in fileio.c 1823/head
Eric van Gyzen [Thu, 10 Oct 2019 14:21:29 +0000 (09:21 -0500)] 
Include errno in all fwrite error messages in fileio.c

5 years agoOnly check for filename collisions when using --output-dir-flat 1812/head
Sen Huang [Wed, 9 Oct 2019 13:39:52 +0000 (09:39 -0400)] 
Only check for filename collisions when using --output-dir-flat

5 years agoMerge pull request #1820 from mhlakhani/dev
Nick Terrell [Tue, 8 Oct 2019 21:58:16 +0000 (17:58 -0400)] 
Merge pull request #1820 from mhlakhani/dev

Add OSS-Fuzz fuzzing badge

5 years agoAdd OSS-Fuzz fuzzing badge 1820/head
Hasnain Lakhani [Tue, 8 Oct 2019 21:13:45 +0000 (14:13 -0700)] 
Add OSS-Fuzz fuzzing badge

This is basically redoing https://github.com/facebook/zstd/pull/1818 by @inferno-chromium from the OSS-Fuzz team

5 years agoCasting to void* to avoid C4090 warnings
Sen Huang [Tue, 8 Oct 2019 13:54:59 +0000 (09:54 -0400)] 
Casting to void* to avoid C4090 warnings

5 years agoSuppress C4090 warning
Sen Huang [Tue, 8 Oct 2019 13:44:24 +0000 (09:44 -0400)] 
Suppress C4090 warning

5 years agoHopefully fix VS compiler warning
Sen Huang [Tue, 8 Oct 2019 04:15:28 +0000 (00:15 -0400)] 
Hopefully fix VS compiler warning

5 years agofixed init warning 1815/head
Yann Collet [Fri, 4 Oct 2019 22:09:52 +0000 (15:09 -0700)] 
fixed init warning

5 years agoMerge pull request #1 from facebook/dev
Bimba Shrestha [Fri, 4 Oct 2019 17:29:29 +0000 (10:29 -0700)] 
Merge pull request #1 from facebook/dev

Merging main dev

5 years agoChanged function name, fix test
Sen Huang [Thu, 3 Oct 2019 19:23:49 +0000 (15:23 -0400)] 
Changed function name, fix test

5 years agoNow constructs final destination path without allocating new table
Sen Huang [Thu, 3 Oct 2019 17:53:04 +0000 (13:53 -0400)] 
Now constructs final destination path without allocating new table

5 years agoManually moving instead of memcpy on decoder and using genBuffer() 1760/head
Bimba Shrestha [Thu, 3 Oct 2019 16:26:51 +0000 (09:26 -0700)] 
Manually moving instead of memcpy on decoder and using genBuffer()

5 years agoCleaning sequence parsing logic
Bimba Shrestha [Thu, 3 Oct 2019 13:42:40 +0000 (06:42 -0700)] 
Cleaning sequence parsing logic

5 years agozlibwrapper : fixed flag-variable name
Yann Collet [Thu, 3 Oct 2019 00:41:19 +0000 (17:41 -0700)] 
zlibwrapper : fixed flag-variable name

release doesn't use specific std/debug flags

5 years agoupdated tests for zlibwrapper C90 strict compatibility
Yann Collet [Thu, 3 Oct 2019 00:32:19 +0000 (17:32 -0700)] 
updated tests for zlibwrapper C90 strict compatibility

5 years agoAddressed comments on malloc
Sen Huang [Wed, 2 Oct 2019 22:34:42 +0000 (18:34 -0400)] 
Addressed comments on malloc

5 years agoStatic analyze fix
Sen Huang [Wed, 2 Oct 2019 19:30:24 +0000 (15:30 -0400)] 
Static analyze fix

5 years agoCI Tests fix
Sen Huang [Wed, 2 Oct 2019 15:29:34 +0000 (11:29 -0400)] 
CI Tests fix

5 years agoRemoved strdup() dependency
Sen Huang [Wed, 2 Oct 2019 15:18:14 +0000 (11:18 -0400)] 
Removed strdup() dependency

5 years agoModified message
Sen Huang [Wed, 2 Oct 2019 15:11:35 +0000 (11:11 -0400)] 
Modified message

5 years agoAdd support for --output-dir-flat
Sen Huang [Wed, 2 Oct 2019 15:08:20 +0000 (11:08 -0400)] 
Add support for --output-dir-flat

New flag to specify output directory destination for multiple files.

5 years agoTypo fix
Bimba Shrestha [Fri, 27 Sep 2019 14:20:20 +0000 (07:20 -0700)] 
Typo fix

5 years agoFixing appveyor test
Bimba Shrestha [Thu, 26 Sep 2019 23:21:57 +0000 (16:21 -0700)] 
Fixing appveyor test

5 years agoFixing shortest failure
Bimba Shrestha [Thu, 26 Sep 2019 23:07:34 +0000 (16:07 -0700)] 
Fixing shortest failure

5 years agoAdding more realistic test for get sequences
Bimba Shrestha [Thu, 26 Sep 2019 22:38:31 +0000 (15:38 -0700)] 
Adding more realistic test for get sequences

5 years agosimplified Makefile
Yann Collet [Thu, 26 Sep 2019 22:01:29 +0000 (15:01 -0700)] 
simplified Makefile

and fixed a few c++-compat issues

5 years agoadded c++-compat build flag
Yann Collet [Thu, 26 Sep 2019 20:08:25 +0000 (13:08 -0700)] 
added c++-compat build flag

ensure code can be compiled "as is" in C++ mode

also : restructured flags so that they can be individually changed / disabled on command line

5 years agoenforce C90 compatibility for zlibWrapper
Yann Collet [Wed, 25 Sep 2019 00:50:58 +0000 (17:50 -0700)] 
enforce C90 compatibility for zlibWrapper

5 years agobump version number to v1.4.4
Yann Collet [Tue, 24 Sep 2019 22:15:33 +0000 (15:15 -0700)] 
bump version number to v1.4.4

so that future reports on `dev` branch use this number instead

5 years agoReplacing assert with memory_allocation error code throw
Bimba Shrestha [Mon, 23 Sep 2019 22:42:16 +0000 (15:42 -0700)] 
Replacing assert with memory_allocation error code throw