]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
5 years agoadding some functional tests 1844/head
Ahmed Abdellah [Fri, 25 Oct 2019 14:54:52 +0000 (15:54 +0100)] 
adding some functional tests

5 years agofixing free const char** filenamesTable
Ahmed Abdellah [Thu, 24 Oct 2019 19:54:40 +0000 (20:54 +0100)] 
fixing free const char** filenamesTable

5 years agofixing type conversion error
Ahmed Abdellah [Thu, 24 Oct 2019 15:20:58 +0000 (16:20 +0100)] 
fixing type conversion error

5 years agofixing AppVeyor errors
Ahmed Abdellah [Thu, 24 Oct 2019 14:25:48 +0000 (15:25 +0100)] 
fixing AppVeyor errors

5 years agofixing some warning
Ahmed Abdellah [Thu, 24 Oct 2019 13:42:37 +0000 (14:42 +0100)] 
fixing some warning

5 years agofixing some warning
Ahmed Abdellah [Thu, 24 Oct 2019 13:21:01 +0000 (14:21 +0100)] 
fixing some warning

5 years agofixing newTable issues and some warnings
Ahmed Abdellah [Thu, 24 Oct 2019 12:51:12 +0000 (13:51 +0100)] 
fixing newTable issues and some warnings

5 years agoremoving extra logs
Ahmed Abdellah [Thu, 24 Oct 2019 10:35:26 +0000 (11:35 +0100)] 
removing extra  logs

5 years agofixing continuous integeration errors and removing a lot of logs
Ahmed Abdellah [Thu, 24 Oct 2019 10:10:13 +0000 (11:10 +0100)] 
fixing continuous integeration errors and removing a lot of logs

5 years agofixing c90 issue in util.c cont.
Ahmed Abdellah [Thu, 24 Oct 2019 09:30:05 +0000 (10:30 +0100)] 
fixing c90 issue in util.c cont.

5 years agofixing c90 issue in util.c cont. again
Ahmed Abdellah [Thu, 24 Oct 2019 09:23:36 +0000 (10:23 +0100)] 
fixing c90 issue in util.c cont. again

5 years agofixing c90 issue in util.c cont.
Ahmed Abdellah [Thu, 24 Oct 2019 09:17:31 +0000 (10:17 +0100)] 
fixing c90 issue in util.c cont.

5 years agofixing c90 issue in util.c
Ahmed Abdellah [Thu, 24 Oct 2019 09:12:51 +0000 (10:12 +0100)] 
fixing c90 issue in util.c

5 years agofixing memory leak issue and removing c90 issue
Ahmed Abdellah [Thu, 24 Oct 2019 08:39:16 +0000 (09:39 +0100)] 
fixing memory leak issue and removing c90 issue

5 years agosolving the rest of C90 issues in defining local variables in middle of code and...
Ahmed Abdellah [Wed, 23 Oct 2019 19:22:07 +0000 (20:22 +0100)] 
solving the rest of  C90 issues in defining local variables in middle of code and comparing uncompatible types

5 years agosolving C90 issues in defining local variables in middle of code and comparing uncomp...
Ahmed Abdellah [Wed, 23 Oct 2019 19:14:48 +0000 (20:14 +0100)] 
solving C90 issues in defining local variables in middle of code and comparing uncompatible types

5 years agoMerge branch 'dev' into adding_read_files_from_file_feature
AhmedAbdellah19 [Wed, 23 Oct 2019 18:29:01 +0000 (20:29 +0200)] 
Merge branch 'dev' into adding_read_files_from_file_feature

5 years agoMerge pull request #1840 from terrelln/regression-fix
Nick Terrell [Wed, 23 Oct 2019 00:58:31 +0000 (17:58 -0700)] 
Merge pull request #1840 from terrelln/regression-fix

[regression] Fix the old streaming regression test

5 years agoadded documentation on DYNAMIC_BMI2 build macro
Yann Collet [Wed, 23 Oct 2019 00:43:09 +0000 (17:43 -0700)] 
added documentation on DYNAMIC_BMI2 build macro

5 years agoMerge pull request #1838 from facebook/fixAdvanced
Yann Collet [Tue, 22 Oct 2019 23:22:55 +0000 (16:22 -0700)] 
Merge pull request #1838 from facebook/fixAdvanced

fix initCStream_advanced() for fast strategies

5 years ago[regression] Fix the old streaming regression test 1840/head
Nick Terrell [Tue, 22 Oct 2019 22:29:48 +0000 (15:29 -0700)] 
[regression] Fix the old streaming regression test

* A copy-paste error made it so we weren't running the advanced/cdict
  streaming tests with the old API.
* Clean up the old streaming tests to skip incompatible configs.
* Update `results.csv`.

The tests now catch the bug in #1787.

5 years agoMerge pull request #1836 from facebook/dirFlat2
Yann Collet [Tue, 22 Oct 2019 22:19:04 +0000 (15:19 -0700)] 
Merge pull request #1836 from facebook/dirFlat2

Added --output-dir-flat=

5 years agofix initCStream_advanced() for fast strategies 1838/head
Yann Collet [Tue, 22 Oct 2019 21:57:15 +0000 (14:57 -0700)] 
fix initCStream_advanced() for fast strategies

Compression ratio of fast strategies (levels 1 & 2)
was seriously reduced, due to accidental disabling of Literals compression.

Credit to @QrczakMK, which perfectly described the issue, and implementation details,
making the fix straightforward.

Example : initCStream with level 1 on synthetic sample P50 :
Before : 5,273,976 bytes
After  : 3,154,678 bytes
ZSTD_compress (for comparison) : 3,154,550

Fix #1787.

To follow : refactor the test which was supposed to catch this issue (and failed)

5 years agoupdate documentation on deprecated functions
Yann Collet [Tue, 22 Oct 2019 20:51:18 +0000 (13:51 -0700)] 
update documentation on deprecated functions

mostly : note that these functions will soon generate deprecation warnings

5 years agoMerge pull request #1837 from terrelln/magic-isnt-real
Nick Terrell [Tue, 22 Oct 2019 17:50:14 +0000 (10:50 -0700)] 
Merge pull request #1837 from terrelln/magic-isnt-real

Fix ZSTD_f_zstd1_magicless for small data

5 years agoFix ZSTD_f_zstd1_magicless for small data 1837/head
Nick Terrell [Tue, 22 Oct 2019 02:42:14 +0000 (19:42 -0700)] 
Fix ZSTD_f_zstd1_magicless for small data

* Fix `ZSTD_FRAMEHEADERSIZE_PREFIX` and `ZSTD_FRAMEHEADERSIZE_MIN` to
  take a `format` parameter, so it is impossible to get the wrong size.
* Fix the places that called `ZSTD_FRAMEHEADERSIZE_PREFIX` without
  taking the format into account, which is now impossible by design.
* Call `ZSTD_frameHeaderSize_internal()` with `dctx->format`.
* The added tests catch both bugs in `ZSTD_decompressFrame()`.

Fixes #1813.

5 years agoMerge pull request #1831 from terrelln/zstdmt-bad-memset
Nick Terrell [Mon, 21 Oct 2019 22:53:57 +0000 (15:53 -0700)] 
Merge pull request #1831 from terrelln/zstdmt-bad-memset

[zstdmt] Don't memset the jobDescription

5 years agoAdded --output-dir-flat= 1836/head
Yann Collet [Mon, 21 Oct 2019 21:33:50 +0000 (14:33 -0700)] 
Added --output-dir-flat=

which is a preferred construction when applicable.

Also, added --output-dir-flat into man page.

5 years agoMerge pull request #1834 from facebook/winFix
Yann Collet [Mon, 21 Oct 2019 20:45:17 +0000 (13:45 -0700)] 
Merge pull request #1834 from facebook/winFix

Windows fixes

5 years agoturned off zlib tests during msan 1834/head
Yann Collet [Mon, 21 Oct 2019 19:55:39 +0000 (12:55 -0700)] 
turned off zlib tests during msan

since the local zlib library is not msan-instrumented

5 years agominor refactor of FIO_compressGzFrame()
Yann Collet [Mon, 21 Oct 2019 19:14:59 +0000 (12:14 -0700)] 
minor refactor of FIO_compressGzFrame()

mostly narrowing variables lifetime and mutability.

5 years agoMerge pull request #1795 from felixhandte/workspace-asan
Felix Handte [Mon, 21 Oct 2019 16:15:17 +0000 (12:15 -0400)] 
Merge pull request #1795 from felixhandte/workspace-asan

Add Poisoned Redzones to the Workspace When Compiling with ASAN

5 years agoMerge pull request #1835 from facebook/format034
Yann Collet [Sat, 19 Oct 2019 12:24:42 +0000 (05:24 -0700)] 
Merge pull request #1835 from facebook/format034

clarifications for the FSE decoding table

5 years agoclarifications for the FSE decoding table 1835/head
Yann Collet [Sat, 19 Oct 2019 00:48:12 +0000 (17:48 -0700)] 
clarifications for the FSE decoding table

requested in #1782

5 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Sat, 19 Oct 2019 00:23:39 +0000 (17:23 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

5 years agoadded mode documentation on ZSTD_CLEVEL
Yann Collet [Sat, 19 Oct 2019 00:22:45 +0000 (17:22 -0700)] 
added mode documentation on ZSTD_CLEVEL

providing range restriction [1-19] explicitly
partially answering #1829

5 years agofixed visual defined test
Yann Collet [Sat, 19 Oct 2019 00:08:52 +0000 (17:08 -0700)] 
fixed visual defined test

5 years agoremoved Visual warning
Yann Collet [Sat, 19 Oct 2019 00:05:42 +0000 (17:05 -0700)] 
removed Visual warning

for pointer casts

5 years agoMerge pull request #1832 from terrelln/fuzz-stream-fix
Nick Terrell [Fri, 18 Oct 2019 23:35:23 +0000 (16:35 -0700)] 
Merge pull request #1832 from terrelln/fuzz-stream-fix

[fuzz] Increase output buffer size of stream_round_trip

5 years agofix function cast warning on Windows with gcc9
Yann Collet [Fri, 18 Oct 2019 22:45:31 +0000 (15:45 -0700)] 
fix function cast warning on Windows with gcc9

5 years agoupdated windows binary resources
Yann Collet [Fri, 18 Oct 2019 22:41:12 +0000 (15:41 -0700)] 
updated windows binary resources

5 years agovalidated 'make test' for mingw environment
Yann Collet [Fri, 18 Oct 2019 22:37:07 +0000 (15:37 -0700)] 
validated 'make test' for mingw environment

5 years agomade `make check` faster
Yann Collet [Fri, 18 Oct 2019 22:21:50 +0000 (15:21 -0700)] 
made `make check` faster

for shorter feedback loop

5 years ago[zstdmt] Don't memset the jobDescription 1831/head
Nick Terrell [Fri, 18 Oct 2019 17:59:15 +0000 (10:59 -0700)] 
[zstdmt] Don't memset the jobDescription

5 years ago[threading] Add debug utilities
Nick Terrell [Fri, 18 Oct 2019 19:33:45 +0000 (12:33 -0700)] 
[threading] Add debug utilities

5 years agominor appveyor test script fix
Yann Collet [Fri, 18 Oct 2019 22:02:30 +0000 (15:02 -0700)] 
minor appveyor test script fix

5 years agoattempt to run 'make check' tests on Appveyor
Yann Collet [Fri, 18 Oct 2019 21:52:16 +0000 (14:52 -0700)] 
attempt to run 'make check' tests on Appveyor

for mingw builds

5 years agofix test on windows
Yann Collet [Fri, 18 Oct 2019 21:28:34 +0000 (14:28 -0700)] 
fix test on windows

isDirectory() doesn't work on Windows
if directory name is followed by '/'

5 years ago[fuzz] Increase output buffer size of stream_round_trip 1832/head
Nick Terrell [Fri, 18 Oct 2019 20:34:35 +0000 (13:34 -0700)] 
[fuzz] Increase output buffer size of stream_round_trip

Fixes OSS-Fuzz crash.
Credit to OSS-Fuzz

5 years agorewrite FIO_createFilename_fromOutDir()
Yann Collet [Fri, 18 Oct 2019 18:15:10 +0000 (11:15 -0700)] 
rewrite FIO_createFilename_fromOutDir()

5 years agofix : no output file opened in test mode
Yann Collet [Thu, 17 Oct 2019 23:58:49 +0000 (16:58 -0700)] 
fix : no output file opened in test mode

also : redistributed error code within fileio.c
for more precise diagnosis.

5 years agoremoved regular file test on Windows
Yann Collet [Thu, 17 Oct 2019 23:39:47 +0000 (16:39 -0700)] 
removed regular file test on Windows

since it does not work well on this platform
(tested with MinGW).

Note : could be an issue within UTIL_isRegularFile()

5 years agoimproved test mode `-t`
Yann Collet [Thu, 17 Oct 2019 23:09:53 +0000 (16:09 -0700)] 
improved test mode `-t`

The test mode do no longer open a file `/dev/null` nor write anything to output.

This is supposed to be more efficient than writing to `/dev/null`,
and more universal too : the previous method was failing on Windows.

5 years agorefactored FIO_compressMultipleFilenames() prototype
Yann Collet [Thu, 17 Oct 2019 22:32:03 +0000 (15:32 -0700)] 
refactored FIO_compressMultipleFilenames() prototype

for consistency

5 years agofixed multiple implicit casts
Yann Collet [Thu, 17 Oct 2019 22:27:25 +0000 (15:27 -0700)] 
fixed multiple implicit casts

5 years agotests: can override isTerminal with environment variable
Yann Collet [Thu, 17 Oct 2019 22:07:47 +0000 (15:07 -0700)] 
tests: can override isTerminal with environment variable

5 years agofixed isSameFile()
Yann Collet [Thu, 17 Oct 2019 21:31:42 +0000 (14:31 -0700)] 
fixed isSameFile()

5 years agofix harness test
Yann Collet [Thu, 17 Oct 2019 21:29:48 +0000 (14:29 -0700)] 
fix harness test

5 years agofixed dict ptr init
Yann Collet [Thu, 17 Oct 2019 21:15:00 +0000 (14:15 -0700)] 
fixed dict ptr init

5 years agominor refactoring of harness
Yann Collet [Thu, 17 Oct 2019 21:11:54 +0000 (14:11 -0700)] 
minor refactoring of harness

5 years agominor: DIFF determination
Yann Collet [Thu, 17 Oct 2019 21:03:20 +0000 (14:03 -0700)] 
minor: DIFF determination

use gdiff on SunOS

5 years agoforce compression during tests
Yann Collet [Thu, 17 Oct 2019 20:01:18 +0000 (13:01 -0700)] 
force compression during tests

to erase potentially remaining artifacts from previous runs

5 years agofix several cast
Yann Collet [Thu, 17 Oct 2019 18:01:20 +0000 (11:01 -0700)] 
fix several cast

5 years agofix incorrect dictName/FileName comparison on Windows
Yann Collet [Thu, 17 Oct 2019 17:56:14 +0000 (10:56 -0700)] 
fix incorrect dictName/FileName comparison on Windows

inode identification does not seem to work on Windows,
even with on a msys2 posix layer.

5 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Thu, 17 Oct 2019 17:50:58 +0000 (10:50 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

5 years agoignore build artifact from educational decoder test
Yann Collet [Thu, 17 Oct 2019 17:50:39 +0000 (10:50 -0700)] 
ignore build artifact from educational decoder test

5 years agoMerge pull request #1827 from facebook/dm_Dct
Yann Collet [Thu, 17 Oct 2019 17:30:58 +0000 (10:30 -0700)] 
Merge pull request #1827 from facebook/dm_Dct

updated erroneous comments using ZSTD_dm_*

5 years agoremoved UNALIGNED() macro from educational decoder
Yann Collet [Thu, 17 Oct 2019 00:27:03 +0000 (17:27 -0700)] 
removed UNALIGNED() macro from educational decoder

as this name collides with existing macro in mingw64+clang9.

5 years agoMerge pull request #1828 from bimbashrestha/education_decoder_check
Yann Collet [Thu, 17 Oct 2019 00:21:47 +0000 (17:21 -0700)] 
Merge pull request #1828 from bimbashrestha/education_decoder_check

Removing unnecessary check on education decoder

5 years agoMerge pull request #1815 from facebook/zlibwrap
Yann Collet [Wed, 16 Oct 2019 23:45:15 +0000 (16:45 -0700)] 
Merge pull request #1815 from facebook/zlibwrap

make zlibWrapper strict ISO-C90 compatible

5 years agoMerge pull request #1826 from facebook/noWild8
Yann Collet [Wed, 16 Oct 2019 23:43:36 +0000 (16:43 -0700)] 
Merge pull request #1826 from facebook/noWild8

removed wildcopy8()

5 years agoRemoving unnecessary check from decode side 1828/head
Bimba Shrestha [Wed, 16 Oct 2019 23:26:46 +0000 (16:26 -0700)] 
Removing unnecessary check from decode side

5 years agoupdated erroneous comments using ZSTD_dm_* 1827/head
Yann Collet [Wed, 16 Oct 2019 23:14:04 +0000 (16:14 -0700)] 
updated erroneous comments using ZSTD_dm_*

instead of the current ZSTD_dct_*,
reported by @nigeltao (#1822)

5 years agoremoved wildcopy8() 1826/head
Yann Collet [Wed, 16 Oct 2019 21:51:33 +0000 (14:51 -0700)] 
removed wildcopy8()

which is no longer used,
noticed by @davidbolvansky

5 years agominor comments & refactoring
Yann Collet [Tue, 15 Oct 2019 23:09:18 +0000 (16:09 -0700)] 
minor comments & refactoring

5 years agoAdding --file=FILE feature
Ahmed Abdellah [Tue, 15 Oct 2019 06:49:13 +0000 (07:49 +0100)] 
Adding --file=FILE feature

5 years agoMerge pull request #1731 from chungy/stdin_nochmod
Yann Collet [Mon, 14 Oct 2019 16:34:56 +0000 (09:34 -0700)] 
Merge pull request #1731 from chungy/stdin_nochmod

[programs] don’t do chmod when coming from stdin or multiple files

5 years agoMerge pull request #1792 from dmitri-shubin/dev
Yann Collet [Mon, 14 Oct 2019 16:27:25 +0000 (09:27 -0700)] 
Merge pull request #1792 from dmitri-shubin/dev

Don't hardcode installation directories in CMakeLists.txt

5 years agoMerge pull request #1812 from senhuang42/output-dir-flat
Yann Collet [Mon, 14 Oct 2019 16:25:05 +0000 (09:25 -0700)] 
Merge pull request #1812 from senhuang42/output-dir-flat

Support for --output-dir-flat: output into a directory

5 years agoMerge pull request #1823 from vangyzen/fwrite_errno
Yann Collet [Mon, 14 Oct 2019 16:20:18 +0000 (09:20 -0700)] 
Merge pull request #1823 from vangyzen/fwrite_errno

Include errno in all fwrite error messages in fileio.c

5 years agoMerge pull request #1760 from bimbashrestha/extract_sequences_api
Yann Collet [Thu, 10 Oct 2019 20:11:18 +0000 (13:11 -0700)] 
Merge pull request #1760 from bimbashrestha/extract_sequences_api

Adding api for extracting sequences from seqstore

5 years agoFix CCtx Size Estimation 1795/head
W. Felix Handte [Thu, 10 Oct 2019 19:02:08 +0000 (15:02 -0400)] 
Fix CCtx Size Estimation

5 years agoExpand Default Redzone Size
W. Felix Handte [Thu, 10 Oct 2019 17:45:55 +0000 (13:45 -0400)] 
Expand Default Redzone Size

5 years agoCheck if CCtx in Workspace after Null Check
W. Felix Handte [Tue, 17 Sep 2019 15:35:49 +0000 (11:35 -0400)] 
Check if CCtx in Workspace after Null Check

5 years agoDeclare the ASAN Functions We Need, Don't Include the Header
W. Felix Handte [Mon, 16 Sep 2019 23:04:05 +0000 (19:04 -0400)] 
Declare the ASAN Functions We Need, Don't Include the Header

5 years agoStop Allocating Extra Space for Table Redzones
W. Felix Handte [Mon, 16 Sep 2019 22:06:16 +0000 (18:06 -0400)] 
Stop Allocating Extra Space for Table Redzones

5 years agoDon't Try to Redzone the Tables
W. Felix Handte [Mon, 16 Sep 2019 21:56:28 +0000 (17:56 -0400)] 
Don't Try to Redzone the Tables

5 years agoFix Workspace Size Calculation
W. Felix Handte [Mon, 16 Sep 2019 21:47:29 +0000 (17:47 -0400)] 
Fix Workspace Size Calculation

5 years agoFix ZSTD_sizeof_matchState() Calculation
W. Felix Handte [Mon, 16 Sep 2019 21:45:40 +0000 (17:45 -0400)] 
Fix ZSTD_sizeof_matchState() Calculation

5 years agoAvoid ASAN Failure in ZSTD_cwksp_free()
W. Felix Handte [Mon, 16 Sep 2019 21:43:55 +0000 (17:43 -0400)] 
Avoid ASAN Failure in ZSTD_cwksp_free()

5 years agoRefactor Freeing CCtxes / CDicts Inside Workspaces
W. Felix Handte [Mon, 16 Sep 2019 21:43:05 +0000 (17:43 -0400)] 
Refactor Freeing CCtxes / CDicts Inside Workspaces

5 years agoSurround Workspace Allocs with Dead Zone
W. Felix Handte [Thu, 12 Sep 2019 23:41:45 +0000 (19:41 -0400)] 
Surround Workspace Allocs with Dead Zone

5 years agoAdd `ZSTD_cwksp_alloc_size()` to Help Calculate Needed Workspace Size
W. Felix Handte [Thu, 12 Sep 2019 23:40:38 +0000 (19:40 -0400)] 
Add `ZSTD_cwksp_alloc_size()` to Help Calculate Needed Workspace Size

5 years agoStop Assuming Tables are Adjacent
W. Felix Handte [Thu, 12 Sep 2019 22:39:46 +0000 (18:39 -0400)] 
Stop Assuming Tables are Adjacent

5 years agoPoison Unused Workspace Memory
W. Felix Handte [Thu, 12 Sep 2019 22:33:00 +0000 (18:33 -0400)] 
Poison Unused Workspace Memory

5 years agoDetect Whether We're Being Compiled with ASAN
W. Felix Handte [Thu, 12 Sep 2019 22:32:22 +0000 (18:32 -0400)] 
Detect Whether We're Being Compiled with ASAN

5 years agoRemove Unused MEM_SKIP_MSAN Macro
W. Felix Handte [Thu, 12 Sep 2019 22:24:44 +0000 (18:24 -0400)] 
Remove Unused MEM_SKIP_MSAN Macro

5 years agoInclude errno in all fwrite error messages in fileio.c 1823/head
Eric van Gyzen [Thu, 10 Oct 2019 14:21:29 +0000 (09:21 -0500)] 
Include errno in all fwrite error messages in fileio.c

5 years agoOnly check for filename collisions when using --output-dir-flat 1812/head
Sen Huang [Wed, 9 Oct 2019 13:39:52 +0000 (09:39 -0400)] 
Only check for filename collisions when using --output-dir-flat

5 years agoMerge pull request #1820 from mhlakhani/dev
Nick Terrell [Tue, 8 Oct 2019 21:58:16 +0000 (17:58 -0400)] 
Merge pull request #1820 from mhlakhani/dev

Add OSS-Fuzz fuzzing badge