]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
6 years agoFix #1861: Restrict overlapLog Parameter When Not Built With Multithreading 1873/head
W. Felix Handte [Wed, 6 Nov 2019 21:05:02 +0000 (16:05 -0500)] 
Fix #1861: Restrict overlapLog Parameter When Not Built With Multithreading

This parameter is unused in single-threaded compression. We should make it
behave like the other multithread-only parameters, for which we only accept
zero when we are not built with multithreading.

6 years agoupdated pzstd and largeNbDicts to use the new FileNamesTable* abstraction
Yann Collet [Wed, 6 Nov 2019 17:10:05 +0000 (09:10 -0800)] 
updated pzstd and largeNbDicts to use the new FileNamesTable* abstraction

6 years ago'date -r FILE' is non-portable. 1870/head
Björn Ketelaars [Wed, 6 Nov 2019 11:16:02 +0000 (12:16 +0100)] 
'date -r FILE' is non-portable.

date(1) is used to display the last modification time of a file, which
is not supported on OpenBSD, FreeBSD and Darwin. Instead use stat(1).

Tested on OpenBSD.

6 years ago'head -c BYTES' is non-portable. 1869/head
Björn Ketelaars [Wed, 6 Nov 2019 10:39:59 +0000 (11:39 +0100)] 
'head -c BYTES' is non-portable.

Similar to #1321: The '-c' option for 'head' is non-portable (not in
POSIX).

6 years agoupdated zwrapbench to use FileNamesTable* abstraction
Yann Collet [Wed, 6 Nov 2019 01:25:20 +0000 (17:25 -0800)] 
updated zwrapbench to use FileNamesTable* abstraction

6 years agorefactor code to only use FileNamesTable*
Yann Collet [Wed, 6 Nov 2019 01:02:43 +0000 (17:02 -0800)] 
refactor code to only use FileNamesTable*

6 years agorefactoring (simplification) of util.h public API
Yann Collet [Tue, 5 Nov 2019 22:59:45 +0000 (14:59 -0800)] 
refactoring (simplification) of util.h public API

6 years agoMerge branch 'dev' into ahmed_file
Yann Collet [Tue, 5 Nov 2019 22:44:12 +0000 (14:44 -0800)] 
Merge branch 'dev' into ahmed_file

6 years agoFix FUZZ_rand32() bug
Sen Huang [Tue, 5 Nov 2019 21:43:24 +0000 (16:43 -0500)] 
Fix FUZZ_rand32() bug

6 years agoFix frame argument to compression
Sen Huang [Tue, 5 Nov 2019 21:15:55 +0000 (16:15 -0500)] 
Fix frame argument to compression

6 years agoFix more merge conflicts
Sen Huang [Tue, 5 Nov 2019 20:54:05 +0000 (15:54 -0500)] 
Fix more merge conflicts

6 years agoFix merge conflicts
Sen Huang [Tue, 5 Nov 2019 20:51:25 +0000 (15:51 -0500)] 
Fix merge conflicts

6 years agoMerge pull request #1867 from bimbashrestha/dict_load_fuzz_err
Yann Collet [Tue, 5 Nov 2019 20:24:54 +0000 (12:24 -0800)] 
Merge pull request #1867 from bimbashrestha/dict_load_fuzz_err

[clean up] Replacing some literals with constants in zstd_compress_literals.c

6 years agoReplacing some literals with constants 1867/head
Bimba Shrestha [Tue, 5 Nov 2019 18:26:57 +0000 (10:26 -0800)] 
Replacing some literals with constants

6 years agoMerge pull request #15 from facebook/dev
Bimba Shrestha [Mon, 4 Nov 2019 19:23:44 +0000 (11:23 -0800)] 
Merge pull request #15 from facebook/dev

Merging facebook/dev into bimbashrestha/dev

6 years agoupdate table benchmark with zstd v1.4.4
Yann Collet [Mon, 4 Nov 2019 18:59:59 +0000 (10:59 -0800)] 
update table benchmark with zstd v1.4.4

6 years agoMerge pull request #1865 from facebook/dev v1.4.4
Yann Collet [Mon, 4 Nov 2019 17:54:32 +0000 (09:54 -0800)] 
Merge pull request #1865 from facebook/dev

fix dictionary edge case

6 years agoMerge pull request #1864 from terrelln/dict-fix 1865/head
Nick Terrell [Sat, 2 Nov 2019 03:01:12 +0000 (20:01 -0700)] 
Merge pull request #1864 from terrelln/dict-fix

Fix 2 bugs in dictionary loading

6 years agoFix 2 bugs in dictionary loading 1864/head
Nick Terrell [Fri, 1 Nov 2019 22:33:39 +0000 (15:33 -0700)] 
Fix 2 bugs in dictionary loading

* Silently skip dictionaries less than 8 bytes, unless using `ZSTD_dct_fullDict`.
  This changes the compressor, which silently skips dictionaries <= 8 bytes.
* Allow repcodes that are equal to the dictionary content size, since it is in bounds.

6 years ago[fuzz] Add dictionary_loader fuzzer
Nick Terrell [Fri, 1 Nov 2019 22:16:24 +0000 (15:16 -0700)] 
[fuzz] Add dictionary_loader fuzzer

* Adds the fuzzer
* Adds an additional `InputType` for the fuzzer

I ran the fuzzer for about 10 minutes and it found 2 bugs:

* Catches the original bug without any help
* Catches an additional bug with 8-byte dictionaries

6 years agoMerge pull request #1859 from facebook/dev
Yann Collet [Thu, 31 Oct 2019 22:02:55 +0000 (15:02 -0700)] 
Merge pull request #1859 from facebook/dev

v1.4.4

6 years agofixed zlibwrapper build script 1859/head
Yann Collet [Thu, 31 Oct 2019 17:47:06 +0000 (10:47 -0700)] 
fixed zlibwrapper build script

6 years agoMerge pull request #1860 from senhuang42/streaming_compression_using_cdict
Yann Collet [Wed, 30 Oct 2019 23:27:58 +0000 (16:27 -0700)] 
Merge pull request #1860 from senhuang42/streaming_compression_using_cdict

Disable reloading dictionary when there is no known srcSize

6 years agoMake sure contentsize is known 1860/head
Sen Huang [Wed, 30 Oct 2019 20:03:58 +0000 (16:03 -0400)] 
Make sure contentsize is known

6 years agoMerge pull request #1857 from 0x123456789A/link-shared
Felix Handte [Wed, 30 Oct 2019 19:43:11 +0000 (15:43 -0400)] 
Merge pull request #1857 from 0x123456789A/link-shared

Add CMake flag for linking programs dynamically

6 years agoMerge pull request #1850 from bimbashrestha/named_pipes
Yann Collet [Wed, 30 Oct 2019 19:18:58 +0000 (12:18 -0700)] 
Merge pull request #1850 from bimbashrestha/named_pipes

Gating named pipe support on windows

6 years agoupdated CHANGELOG for v1.4.4
Yann Collet [Wed, 30 Oct 2019 19:16:45 +0000 (12:16 -0700)] 
updated CHANGELOG for v1.4.4

6 years agoMerge pull request #1855 from shashank0791/shtavi-filter-precompressed-files
Yann Collet [Wed, 30 Oct 2019 19:14:41 +0000 (12:14 -0700)] 
Merge pull request #1855 from shashank0791/shtavi-filter-precompressed-files

Added "--exclude-compressed" flag feature

6 years agoRemoved the optimization check 1855/head
Shashank Tavildar [Tue, 29 Oct 2019 22:59:20 +0000 (15:59 -0700)] 
Removed the optimization check

6 years agoChanged extension comparision logic, added new test cases
Shashank Tavildar [Tue, 29 Oct 2019 20:36:09 +0000 (13:36 -0700)] 
Changed extension comparision logic, added new test cases

6 years agoAdded check to perform comparison only if extension is present
Shashank Tavildar [Tue, 29 Oct 2019 19:56:04 +0000 (12:56 -0700)] 
Added check to perform comparison only if extension is present

6 years agoCreated utility function to extract extension from filename, fixed tests
Shashank Tavildar [Tue, 29 Oct 2019 19:27:54 +0000 (12:27 -0700)] 
Created utility function to extract extension from filename, fixed tests

6 years agoDeleting test directory before creation to pass travis-ci test
Shashank Tavildar [Tue, 29 Oct 2019 16:54:54 +0000 (09:54 -0700)] 
Deleting test directory before creation to pass travis-ci test

6 years agoMerge branch 'named_pipes' of https://github.com/bimbashrestha/zstd into named_pipes 1850/head
Bimba Shrestha [Tue, 29 Oct 2019 16:46:28 +0000 (09:46 -0700)] 
Merge branch 'named_pipes' of https://github.com/bimbashrestha/zstd into named_pipes

6 years agoRemoving merge side effect
Bimba Shrestha [Tue, 29 Oct 2019 16:45:28 +0000 (09:45 -0700)] 
Removing merge side effect

6 years agoFixed check for building programs statically 1857/head
0x123456789A [Tue, 29 Oct 2019 13:41:32 +0000 (14:41 +0100)] 
Fixed check for building programs statically

6 years agoConsider ZSTD_PROGRAMS_LINK_SHARED
0x123456789A [Tue, 29 Oct 2019 13:33:50 +0000 (14:33 +0100)] 
Consider ZSTD_PROGRAMS_LINK_SHARED

Actually consider ZSTD_PROGRAMS_LINK_SHARED in programs CMakeLists

6 years agoIntroduce ZSTD_PROGRAMS_LINK_SHARED
0x123456789A [Tue, 29 Oct 2019 13:31:02 +0000 (14:31 +0100)] 
Introduce ZSTD_PROGRAMS_LINK_SHARED

The CMake variable ZSTD_PROGRAMS_LINK_SHARED indicactes wether or not to link the zstd programs dynamically or statically.

6 years agoMinor fixes in test
Shashank Tavildar [Tue, 29 Oct 2019 05:24:01 +0000 (22:24 -0700)] 
Minor fixes in test

6 years agoMerge branch 'dev' into named_pipes
Bimba Shrestha [Tue, 29 Oct 2019 05:17:13 +0000 (01:17 -0400)] 
Merge branch 'dev' into named_pipes

6 years agoRemoving Visual08 and Visual10 tests
Bimba Shrestha [Tue, 29 Oct 2019 05:09:34 +0000 (22:09 -0700)] 
Removing Visual08 and Visual10 tests

6 years agoMerge pull request #1856 from terrelln/assert-fix
Nick Terrell [Tue, 29 Oct 2019 04:44:22 +0000 (21:44 -0700)] 
Merge pull request #1856 from terrelln/assert-fix

Fix assert in ZSTD_safecopy

6 years agoAddressing comments, removing cyclic dependency with header file, updating tests
Shashank Tavildar [Tue, 29 Oct 2019 01:21:47 +0000 (18:21 -0700)] 
Addressing comments, removing cyclic dependency with header file, updating tests

6 years agoFix assert in ZSTD_safecopy 1856/head
Nick Terrell [Tue, 29 Oct 2019 00:51:17 +0000 (17:51 -0700)] 
Fix assert in ZSTD_safecopy

In the case that `op >= oend_w` it is possible that `diff < 8` because
the two buffers could be adjacent.

Credit to OSS-Fuzz, which found the bug. It isn't reproducible because
it depends on the memory layout.

6 years agoadded test which can overflow internal list of filenames
Yann Collet [Mon, 28 Oct 2019 23:05:42 +0000 (16:05 -0700)] 
added test which can overflow internal list of filenames

6 years agoFixing tests and moving flag to advanced usage 1852/head
Shashank Tavildar [Mon, 28 Oct 2019 22:22:26 +0000 (15:22 -0700)] 
Fixing tests and moving flag to advanced usage

6 years agoupdated UTIL_createFileNamesTable() inline documentation
Yann Collet [Mon, 28 Oct 2019 22:20:40 +0000 (15:20 -0700)] 
updated UTIL_createFileNamesTable() inline documentation

6 years agoadded symlink test for --filelist=FILE
Yann Collet [Mon, 28 Oct 2019 22:15:26 +0000 (15:15 -0700)] 
added symlink test for --filelist=FILE

6 years agoResolving local merge conflicts
Shashank Tavildar [Mon, 28 Oct 2019 22:15:13 +0000 (15:15 -0700)] 
Resolving local merge conflicts

6 years agoreturn final `\0` directly from readLine()
Yann Collet [Mon, 28 Oct 2019 22:03:32 +0000 (15:03 -0700)] 
return final `\0` directly from readLine()

6 years agoAddressing comments: -Created a list of extensions defined in fileio.h, -Updated...
Shashank Tavildar [Mon, 28 Oct 2019 21:54:54 +0000 (14:54 -0700)] 
Addressing comments: -Created a list of extensions defined in fileio.h, -Updated test

6 years agoAdded --exclude-compressed flag feature that skips compression of precompressed files
Shashank Tavildar [Fri, 25 Oct 2019 22:49:11 +0000 (15:49 -0700)] 
Added --exclude-compressed flag feature that skips compression of precompressed files

6 years agochange command name to `--filelist=`
Yann Collet [Mon, 28 Oct 2019 20:54:36 +0000 (13:54 -0700)] 
change command name to `--filelist=`

updated documentation and man page

6 years agoMerge branch 'dev' into ahmed_file
Yann Collet [Mon, 28 Oct 2019 20:43:28 +0000 (13:43 -0700)] 
Merge branch 'dev' into ahmed_file

6 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Mon, 28 Oct 2019 19:57:23 +0000 (12:57 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

6 years agoupdated CHANGELOG for v1.4.4
Yann Collet [Mon, 28 Oct 2019 19:57:05 +0000 (12:57 -0700)] 
updated CHANGELOG for v1.4.4

6 years agoMerge pull request #1851 from felixhandte/pkg-config-prefix-fix
Felix Handte [Mon, 28 Oct 2019 18:24:56 +0000 (14:24 -0400)] 
Merge pull request #1851 from felixhandte/pkg-config-prefix-fix

In pkg-config File, Derive Lib and Include Dir from Prefix at Use-Time

6 years agoupdated API inline doc and manual
Yann Collet [Mon, 28 Oct 2019 18:15:41 +0000 (11:15 -0700)] 
updated API inline doc and manual

regarding ZSTD_CDict created without a dictBuffer.

6 years agoMerge pull request #1848 from felixhandte/tzst-ext-tmp
Yann Collet [Mon, 28 Oct 2019 17:08:20 +0000 (10:08 -0700)] 
Merge pull request #1848 from felixhandte/tzst-ext-tmp

Support Decompressing Short Tar Extensions

6 years agoyet another minor visual conversion warning
Yann Collet [Sat, 26 Oct 2019 07:27:32 +0000 (00:27 -0700)] 
yet another minor visual conversion warning

this time for 32-bit systems

6 years agofixed another minor conversion warning on Visual
Yann Collet [Sat, 26 Oct 2019 07:01:11 +0000 (00:01 -0700)] 
fixed another minor conversion warning on Visual

and made CONTROL() use exit() instead of abort().

6 years agofix minor conversion warning on 32-bit
Yann Collet [Sat, 26 Oct 2019 01:26:30 +0000 (18:26 -0700)] 
fix minor conversion warning on 32-bit

6 years agominor cosmetic refactoring
Yann Collet [Sat, 26 Oct 2019 01:16:45 +0000 (18:16 -0700)] 
minor cosmetic refactoring

6 years agoMerge pull request #1847 from facebook/zlibwrap_visual
Yann Collet [Sat, 26 Oct 2019 00:42:42 +0000 (17:42 -0700)] 
Merge pull request #1847 from facebook/zlibwrap_visual

fix zlibWrapper for Visual Studio

6 years agono need to track tableBuf
Yann Collet [Sat, 26 Oct 2019 00:34:29 +0000 (17:34 -0700)] 
no need to track tableBuf

free() is compatible with NULL,
let's free() unconditionnally

6 years agotest resilience on garbage file
Yann Collet [Sat, 26 Oct 2019 00:01:26 +0000 (17:01 -0700)] 
test resilience on garbage file

and clean traces

6 years agoimproved --file=FILE implementation
Yann Collet [Fri, 25 Oct 2019 23:36:59 +0000 (16:36 -0700)] 
improved --file=FILE implementation

pass basic tests

6 years agoAdded --exclude-compressed flag feature that skips compression of precompressed files
Shashank Tavildar [Fri, 25 Oct 2019 22:49:11 +0000 (15:49 -0700)] 
Added --exclude-compressed flag feature that skips compression of precompressed files

6 years agoMerge branch 'master' of https://github.com/bimbashrestha/zstd into named_pipes
Bimba Shrestha [Fri, 25 Oct 2019 22:43:41 +0000 (15:43 -0700)] 
Merge branch 'master' of https://github.com/bimbashrestha/zstd into named_pipes

6 years agoGating named pipe support in hedaer file
Bimba Shrestha [Fri, 25 Oct 2019 22:15:28 +0000 (15:15 -0700)] 
Gating named pipe support in hedaer file

6 years agoCleaning up gate and adding comment to flag
Bimba Shrestha [Fri, 25 Oct 2019 21:06:50 +0000 (14:06 -0700)] 
Cleaning up gate and adding comment to flag

6 years agoIn pkg-config File, Derive Lib and Include Dir from Prefix at Use-Time 1851/head
W. Felix Handte [Fri, 25 Oct 2019 19:05:20 +0000 (15:05 -0400)] 
In pkg-config File, Derive Lib and Include Dir from Prefix at Use-Time

Addresses #1794. Instead of deriving the lib dir and include dir at
build-time, let's do it like everyone else does at pkg-config run-time.

This has the disadvantage that we can no longer override LIBDIR and
INCLUDEDIR in the Makefile and have that reflected in the .pc file.

6 years agoMerge pull request #8 from bimbashrestha/appveyorTest
Bimba Shrestha [Fri, 25 Oct 2019 19:07:05 +0000 (12:07 -0700)] 
Merge pull request #8 from bimbashrestha/appveyorTest

Appveyor test

6 years agoRunning playtests.sh on PRs too
Bimba Shrestha [Fri, 25 Oct 2019 19:04:54 +0000 (12:04 -0700)] 
Running playtests.sh on PRs too

6 years agoGating named file support on windows
Bimba Shrestha [Fri, 25 Oct 2019 18:32:38 +0000 (11:32 -0700)] 
Gating named file support on windows

6 years agoMinor Fixes 1848/head
W. Felix Handte [Fri, 25 Oct 2019 17:58:58 +0000 (13:58 -0400)] 
Minor Fixes

6 years agoMerge pull request #1844 from AhmedAbdellah19/adding_read_files_from_file_feature
Yann Collet [Fri, 25 Oct 2019 17:11:47 +0000 (10:11 -0700)] 
Merge pull request #1844 from AhmedAbdellah19/adding_read_files_from_file_feature

Adding --file=FILE feature

6 years agoMerge pull request #1845 from facebook/zbuff
Yann Collet [Fri, 25 Oct 2019 16:59:00 +0000 (09:59 -0700)] 
Merge pull request #1845 from facebook/zbuff

improve deprecation warning macro

6 years agoadding some functional tests 1844/head
Ahmed Abdellah [Fri, 25 Oct 2019 14:54:52 +0000 (15:54 +0100)] 
adding some functional tests

6 years agoAdd Tests
W. Felix Handte [Fri, 25 Oct 2019 00:19:10 +0000 (20:19 -0400)] 
Add Tests

6 years agoFix Build; Refactor
W. Felix Handte [Fri, 25 Oct 2019 00:18:57 +0000 (20:18 -0400)] 
Fix Build; Refactor

6 years agofix zlibWrapper for Visual Studio 1847/head
Yann Collet [Thu, 24 Oct 2019 22:19:05 +0000 (15:19 -0700)] 
fix zlibWrapper for Visual Studio

As per https://github.com/facebook/zstd/issues/1800#issuecomment-545945050,
Visual does not support `ssize_t` type,
which is an issue for `gzread.c`.

Added a work around, suggested by @bluenlive

Note : I have not been able to confirm the problem,
so this is a blind fix.
This seems safe outside of Visual, since it is gated by _MSC_VER macro.

6 years agoMerge pull request #1790 from stokito/tzst-ext
Felix Handte [Thu, 24 Oct 2019 21:50:22 +0000 (17:50 -0400)] 
Merge pull request #1790 from stokito/tzst-ext

Add short tar's extensions .tgz (.tar.gz), .txz (.tar.xz), .tzst (.tar.zst)

6 years agoMerge branch 'tzst-ext-tmp' into tzst-ext 1790/head
Felix Handte [Thu, 24 Oct 2019 21:49:34 +0000 (17:49 -0400)] 
Merge branch 'tzst-ext-tmp' into tzst-ext

6 years agoMerge pull request #1841 from bimbashrestha/travis
Yann Collet [Thu, 24 Oct 2019 19:58:50 +0000 (12:58 -0700)] 
Merge pull request #1841 from bimbashrestha/travis

Adding arm64 make check to travis.ci

6 years agofixing free const char** filenamesTable
Ahmed Abdellah [Thu, 24 Oct 2019 19:54:40 +0000 (20:54 +0100)] 
fixing free const char** filenamesTable

6 years agoMerge pull request #1839 from bimbashrestha/named_pipes
Yann Collet [Thu, 24 Oct 2019 17:53:12 +0000 (10:53 -0700)] 
Merge pull request #1839 from bimbashrestha/named_pipes

Allowing named pipes to go through in zstdcli

6 years agofixing type conversion error
Ahmed Abdellah [Thu, 24 Oct 2019 15:20:58 +0000 (16:20 +0100)] 
fixing type conversion error

6 years agofixing AppVeyor errors
Ahmed Abdellah [Thu, 24 Oct 2019 14:25:48 +0000 (15:25 +0100)] 
fixing AppVeyor errors

6 years agofixing some warning
Ahmed Abdellah [Thu, 24 Oct 2019 13:42:37 +0000 (14:42 +0100)] 
fixing some warning

6 years agofixing some warning
Ahmed Abdellah [Thu, 24 Oct 2019 13:21:01 +0000 (14:21 +0100)] 
fixing some warning

6 years agofixing newTable issues and some warnings
Ahmed Abdellah [Thu, 24 Oct 2019 12:51:12 +0000 (13:51 +0100)] 
fixing newTable issues and some warnings

6 years agoremoving extra logs
Ahmed Abdellah [Thu, 24 Oct 2019 10:35:26 +0000 (11:35 +0100)] 
removing extra  logs

6 years agofixing continuous integeration errors and removing a lot of logs
Ahmed Abdellah [Thu, 24 Oct 2019 10:10:13 +0000 (11:10 +0100)] 
fixing continuous integeration errors and removing a lot of logs

6 years agofixing c90 issue in util.c cont.
Ahmed Abdellah [Thu, 24 Oct 2019 09:30:05 +0000 (10:30 +0100)] 
fixing c90 issue in util.c cont.

6 years agofixing c90 issue in util.c cont. again
Ahmed Abdellah [Thu, 24 Oct 2019 09:23:36 +0000 (10:23 +0100)] 
fixing c90 issue in util.c cont. again

6 years agofixing c90 issue in util.c cont.
Ahmed Abdellah [Thu, 24 Oct 2019 09:17:31 +0000 (10:17 +0100)] 
fixing c90 issue in util.c cont.

6 years agofixing c90 issue in util.c
Ahmed Abdellah [Thu, 24 Oct 2019 09:12:51 +0000 (10:12 +0100)] 
fixing c90 issue in util.c

6 years agofixing memory leak issue and removing c90 issue
Ahmed Abdellah [Thu, 24 Oct 2019 08:39:16 +0000 (09:39 +0100)] 
fixing memory leak issue and removing c90 issue

6 years agosolving the rest of C90 issues in defining local variables in middle of code and...
Ahmed Abdellah [Wed, 23 Oct 2019 19:22:07 +0000 (20:22 +0100)] 
solving the rest of  C90 issues in defining local variables in middle of code and comparing uncompatible types