]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
8 years agoCMake: don't modify global C_FLAGS and CXX_FLAGS 669/head
Michael Maltese [Thu, 20 Apr 2017 22:55:48 +0000 (15:55 -0700)] 
CMake: don't modify global C_FLAGS and CXX_FLAGS

8 years agoCMake: don't recheck compile flags every time
Michael Maltese [Thu, 20 Apr 2017 22:54:17 +0000 (15:54 -0700)] 
CMake: don't recheck compile flags every time

Doesn't cause a problem when embedded within a larger project, but is
annoying.

8 years agoCMake: various configure_file fixes to use CMAKE_CURRENT_SOURCE_DIR
Michael Maltese [Thu, 20 Apr 2017 22:47:31 +0000 (15:47 -0700)] 
CMake: various configure_file fixes to use CMAKE_CURRENT_SOURCE_DIR

8 years agoCMake: namespace modules and set CMAKE_MODULE_PATH
Michael Maltese [Thu, 20 Apr 2017 22:46:44 +0000 (15:46 -0700)] 
CMake: namespace modules and set CMAKE_MODULE_PATH

8 years agoCMake: Set ZSTD_SOURCE_DIR from CMAKE_CURRENT_SOURCE_DIR
Michael Maltese [Thu, 20 Apr 2017 22:35:56 +0000 (15:35 -0700)] 
CMake: Set ZSTD_SOURCE_DIR from CMAKE_CURRENT_SOURCE_DIR

Instead of CMAKE_SOURCE_DIR, which is not correct when embedding Zstd
within a larger project.

8 years agodisable assert when compiling paramgrill
Yann Collet [Thu, 20 Apr 2017 19:50:02 +0000 (12:50 -0700)] 
disable assert when compiling paramgrill

paramgrill is a benchmark calibration function.
Speed accuracy is critical, it cannot be altered by assert.

8 years agoMerge pull request #658 from facebook/compressionFlow
Yann Collet [Thu, 20 Apr 2017 19:03:12 +0000 (12:03 -0700)] 
Merge pull request #658 from facebook/compressionFlow

Compression flow

8 years agoMerge branch 'dev' into compressionFlow 658/head
Yann Collet [Thu, 20 Apr 2017 18:16:40 +0000 (11:16 -0700)] 
Merge branch 'dev' into compressionFlow

8 years agominor long line reformatting
Yann Collet [Thu, 20 Apr 2017 18:14:13 +0000 (11:14 -0700)] 
minor long line reformatting

8 years agoMerge pull request #668 from Majlen/cmake-improvement
Yann Collet [Wed, 19 Apr 2017 20:56:16 +0000 (13:56 -0700)] 
Merge pull request #668 from Majlen/cmake-improvement

Add zlib, lzma, pkg-config support to cmake build system

8 years agoChange all SET_TARGET_PROPERTIES to SET_PROPERTY 668/head
Milan Ševčík [Wed, 19 Apr 2017 18:16:11 +0000 (20:16 +0200)] 
Change all SET_TARGET_PROPERTIES to SET_PROPERTY

SET_PROPERTY function can append to lists, whereas previously used
SET_TARGET_PROPERTIES cannot.

8 years agoTest new cmake branches with Circle CI
Milan Ševčík [Wed, 19 Apr 2017 17:25:53 +0000 (19:25 +0200)] 
Test new cmake branches with Circle CI

8 years agoCreate and install pkg-config file with cmake
Milan Ševčík [Wed, 19 Apr 2017 17:25:29 +0000 (19:25 +0200)] 
Create and install pkg-config file with cmake

8 years agoCopy files during build phase, custom targets instead of commands
Milan Ševčík [Wed, 19 Apr 2017 17:22:17 +0000 (19:22 +0200)] 
Copy files during build phase, custom targets instead of commands

Previously some files were copied only during configure phase.
Custom targets seem nicer.

8 years agoAdd lzma and zlib support to cmake build system
Milan Ševčík [Wed, 19 Apr 2017 17:20:27 +0000 (19:20 +0200)] 
Add lzma and zlib support to cmake build system

cmake 2.8.9 needed for FindLibLZMA

8 years agoslightly refined README comments on lib-mt
Yann Collet [Wed, 19 Apr 2017 06:15:28 +0000 (23:15 -0700)] 
slightly refined README comments on lib-mt

8 years agoMerge pull request #666 from iburinoc/zstdmt-default
Yann Collet [Wed, 19 Apr 2017 06:07:41 +0000 (23:07 -0700)] 
Merge pull request #666 from iburinoc/zstdmt-default

Add MT enabled targets for libzstd

8 years agofixed ZSTDMT_initCStream_advanced()
Yann Collet [Wed, 19 Apr 2017 05:52:41 +0000 (22:52 -0700)] 
fixed ZSTDMT_initCStream_advanced()

Must use the new ZSTD_compressBegin_usingCDict_advanced()
to enforce correct frame parameters

8 years agoUpdate README 666/head
Sean Purcell [Wed, 19 Apr 2017 00:03:37 +0000 (17:03 -0700)] 
Update README

8 years agoadded test for ZSTD_initCStream_advanced()
Yann Collet [Tue, 18 Apr 2017 22:08:52 +0000 (15:08 -0700)] 
added test for ZSTD_initCStream_advanced()

when params.fParams.contentSizeFlags = 1
and pledgedSrcSize = 0
then srcSize should be considered 0 (empty), and not "unknown"

8 years agoadded ZSTD_copyCCtx_internal()
Yann Collet [Tue, 18 Apr 2017 21:54:54 +0000 (14:54 -0700)] 
added ZSTD_copyCCtx_internal()

which respects provided fParams.

8 years agoadded make list
Yann Collet [Tue, 18 Apr 2017 21:34:24 +0000 (14:34 -0700)] 
added make list

8 years agoAdd MT enabled targets for libzstd
Sean Purcell [Tue, 18 Apr 2017 21:13:01 +0000 (14:13 -0700)] 
Add MT enabled targets for libzstd

8 years agoChanged ZSTD_resetCCtx_advanced() into ZSTD_resetCCtx_internal()
Yann Collet [Tue, 18 Apr 2017 21:08:50 +0000 (14:08 -0700)] 
Changed ZSTD_resetCCtx_advanced() into ZSTD_resetCCtx_internal()

for naming consistency :
_advanced() can be invoked
while _internal() are strictly static

8 years agoMerge pull request #665 from iburinoc/fixmsg
Yann Collet [Tue, 18 Apr 2017 21:04:28 +0000 (14:04 -0700)] 
Merge pull request #665 from iburinoc/fixmsg

Fix no thread message

8 years agocreated ZSTD_compressBegin_usingCDict_advanced()
Yann Collet [Tue, 18 Apr 2017 20:55:53 +0000 (13:55 -0700)] 
created ZSTD_compressBegin_usingCDict_advanced()

8 years agoFix no thread message 665/head
Sean Purcell [Tue, 18 Apr 2017 20:52:00 +0000 (13:52 -0700)] 
Fix no thread message

8 years agoMerge branch 'dev' into compressionFlow
Yann Collet [Tue, 18 Apr 2017 10:18:34 +0000 (03:18 -0700)] 
Merge branch 'dev' into compressionFlow

8 years agoImproved code comments for block functions
Yann Collet [Tue, 18 Apr 2017 10:17:44 +0000 (03:17 -0700)] 
Improved code comments for block functions

8 years agoMerge pull request #663 from iburinoc/zstdmt-default
Yann Collet [Tue, 18 Apr 2017 09:59:54 +0000 (02:59 -0700)] 
Merge pull request #663 from iburinoc/zstdmt-default

Compile CLI using files instead of objs

8 years agoMerge pull request #662 from iburinoc/man-mt
Yann Collet [Tue, 18 Apr 2017 09:59:44 +0000 (02:59 -0700)] 
Merge pull request #662 from iburinoc/man-mt

Add zstdmt and -T0 to man page

8 years agoclarified frame parameters for ZSTD_compress*_usingCDict()
Yann Collet [Tue, 18 Apr 2017 00:57:35 +0000 (17:57 -0700)] 
clarified frame parameters for ZSTD_compress*_usingCDict()

created ZSTD_compressBegin_usingCDict_internal(),
which gives direct control to frame Parameters.
ZSTD_resetCStream_internal() now points into it.

8 years agoCompile CLI using files instead of objs 663/head
Sean Purcell [Tue, 18 Apr 2017 00:13:44 +0000 (17:13 -0700)] 
Compile CLI using files instead of objs

This avoids conflicts between how the library was
configured and how the CLI was configured.

8 years agoUpdate -T0 comment in man page 662/head
Sean Purcell [Tue, 18 Apr 2017 00:11:33 +0000 (17:11 -0700)] 
Update -T0 comment in man page

8 years agoMerge branch 'dev' into compressionFlow
Yann Collet [Mon, 17 Apr 2017 23:33:09 +0000 (16:33 -0700)] 
Merge branch 'dev' into compressionFlow

8 years agoMerge pull request #660 from iburinoc/zstdmt-test
Yann Collet [Mon, 17 Apr 2017 23:19:46 +0000 (16:19 -0700)] 
Merge pull request #660 from iburinoc/zstdmt-test

Add multithreading tests to playTests.sh

8 years agoproper evaluation of Huffman CTable size
Yann Collet [Mon, 17 Apr 2017 23:14:21 +0000 (16:14 -0700)] 
proper evaluation of Huffman CTable size

8 years agoAdd zstdmt and -T0 to man page
Sean Purcell [Mon, 17 Apr 2017 23:05:20 +0000 (16:05 -0700)] 
Add zstdmt and -T0 to man page

8 years agoMerge branch 'dev' into compressionFlow
Yann Collet [Mon, 17 Apr 2017 22:48:13 +0000 (15:48 -0700)] 
Merge branch 'dev' into compressionFlow

8 years agoMerge pull request #661 from iburinoc/zstdmt-default
Yann Collet [Mon, 17 Apr 2017 22:43:59 +0000 (15:43 -0700)] 
Merge pull request #661 from iburinoc/zstdmt-default

Make zstd compile with mt by default

8 years agoMerge branch 'dev' into compressionFlow
Yann Collet [Mon, 17 Apr 2017 21:51:05 +0000 (14:51 -0700)] 
Merge branch 'dev' into compressionFlow

8 years agoInstall zstdmt even without threading support 661/head
Sean Purcell [Mon, 17 Apr 2017 19:21:11 +0000 (12:21 -0700)] 
Install zstdmt even without threading support

8 years agoFix input size too small to trigger zstdmt 660/head
Sean Purcell [Mon, 17 Apr 2017 19:10:58 +0000 (12:10 -0700)] 
Fix input size too small to trigger zstdmt

8 years agoMake zstd compile with mt by default
Sean Purcell [Fri, 14 Apr 2017 18:33:04 +0000 (11:33 -0700)] 
Make zstd compile with mt by default

8 years agoAdd multithreading tests to playTests.sh
Sean Purcell [Mon, 17 Apr 2017 18:38:53 +0000 (11:38 -0700)] 
Add multithreading tests to playTests.sh

8 years agoMerge pull request #659 from bapt/bsd-multithread
Yann Collet [Mon, 17 Apr 2017 06:14:10 +0000 (23:14 -0700)] 
Merge pull request #659 from bapt/bsd-multithread

Enable multithreading on BSD

8 years agoEnable multithreading on BSD 659/head
Baptiste Daroussin [Sat, 15 Apr 2017 14:25:08 +0000 (16:25 +0200)] 
Enable multithreading on BSD

8 years agoMerge branch 'dev' into compressionFlow
Yann Collet [Fri, 14 Apr 2017 22:08:31 +0000 (15:08 -0700)] 
Merge branch 'dev' into compressionFlow

8 years agofixed : memory leak in fuzzer test
Yann Collet [Fri, 14 Apr 2017 05:46:41 +0000 (22:46 -0700)] 
fixed : memory leak in fuzzer test

8 years agoMerge pull request #656 from iburinoc/core-count
Yann Collet [Fri, 14 Apr 2017 03:29:41 +0000 (20:29 -0700)] 
Merge pull request #656 from iburinoc/core-count

Make -T0 mean "number of physical cores"

8 years agoMerge pull request #657 from iburinoc/appveyor
Yann Collet [Thu, 13 Apr 2017 23:36:53 +0000 (16:36 -0700)] 
Merge pull request #657 from iburinoc/appveyor

Make appveyor small tests use new mingw as well

8 years agoAdd 0 initializers to static variables 656/head
Sean Purcell [Thu, 13 Apr 2017 23:34:28 +0000 (16:34 -0700)] 
Add 0 initializers to static variables

8 years agoChange ifndef's to undef's
Sean Purcell [Thu, 13 Apr 2017 22:35:05 +0000 (15:35 -0700)] 
Change ifndef's to undef's

8 years agoMake appveyor small tests use new mingw as well 657/head
Sean Purcell [Thu, 13 Apr 2017 21:40:06 +0000 (14:40 -0700)] 
Make appveyor small tests use new mingw as well

8 years agoFix clang linux compilation
Sean Purcell [Thu, 13 Apr 2017 21:06:40 +0000 (14:06 -0700)] 
Fix clang linux compilation

8 years agoFix compilation on windows
Sean Purcell [Thu, 13 Apr 2017 21:03:56 +0000 (14:03 -0700)] 
Fix compilation on windows

8 years agoFix compilation on macOS
Sean Purcell [Thu, 13 Apr 2017 19:33:45 +0000 (12:33 -0700)] 
Fix compilation on macOS

8 years ago-T0 detects number of physical cores
Sean Purcell [Thu, 13 Apr 2017 19:28:28 +0000 (12:28 -0700)] 
-T0 detects number of physical cores

8 years agoMerge pull request #655 from iburinoc/large-data
Yann Collet [Wed, 12 Apr 2017 20:54:54 +0000 (13:54 -0700)] 
Merge pull request #655 from iburinoc/large-data

Test large files on-disk in playTests.sh

8 years agoremoved srcSize control from CStream
Yann Collet [Wed, 12 Apr 2017 07:51:24 +0000 (00:51 -0700)] 
removed srcSize control from CStream

since it's already done from lower bufferless API level

8 years agocontent size is controlled at bufferless level
Yann Collet [Wed, 12 Apr 2017 01:34:02 +0000 (18:34 -0700)] 
content size is controlled at bufferless level

so it's active for all entry points

Also : added relevant test (wrong content size) in fuzzer

8 years agoMerge branch 'dev' into compressionFlow
Yann Collet [Wed, 12 Apr 2017 00:42:15 +0000 (17:42 -0700)] 
Merge branch 'dev' into compressionFlow

8 years agoFix message 655/head
Sean Purcell [Wed, 12 Apr 2017 00:33:26 +0000 (17:33 -0700)] 
Fix message

8 years agoAdd test of file > 4GB to playTests
Sean Purcell [Wed, 12 Apr 2017 00:15:13 +0000 (17:15 -0700)] 
Add test of file > 4GB to playTests

8 years agocli : better status display for zstdmt in 1-thread mode
Yann Collet [Tue, 11 Apr 2017 23:57:32 +0000 (16:57 -0700)] 
cli : better status display for zstdmt in 1-thread mode

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Tue, 11 Apr 2017 21:42:46 +0000 (14:42 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agocli : FIO_createDictBuffer() replaces FIO_loadFile()
Yann Collet [Tue, 11 Apr 2017 21:41:02 +0000 (14:41 -0700)] 
cli : FIO_createDictBuffer() replaces FIO_loadFile()

makes it more explicit that it allocates a buffer
and that it's meant to be used for dictionary.

Also : simplified function a bit,
now only works for dictionaries up to DICTSIZE_MAX

8 years agoMerge pull request #653 from terrelln/dev
Yann Collet [Tue, 11 Apr 2017 20:46:40 +0000 (13:46 -0700)] 
Merge pull request #653 from terrelln/dev

Update linux kernel patch

8 years agoAdd BtrFS benchmarks 653/head
Nick Terrell [Tue, 11 Apr 2017 19:40:53 +0000 (12:40 -0700)] 
Add BtrFS benchmarks

8 years agoforce contentSizeFlag=0 when using ZSTD_initCStream_usingCDict()
Yann Collet [Tue, 11 Apr 2017 18:59:44 +0000 (11:59 -0700)] 
force contentSizeFlag=0 when using ZSTD_initCStream_usingCDict()

because by definition srcSize is not known when using this prototype.
added relevant test

Note : this use was already working, because at a later stage
(both ZSTD_compressBegin_usingCDict() and ZSTD_copyCCtx())
pledgedSrcSize=0 is translated into "unknown", no matter the frame parameter.
This is not correct, but of little importance,
as the medium term plan is to no longer set fParams within CDict

8 years agoAdd BtrFS patch for 4.10 kernel
Nick Terrell [Tue, 11 Apr 2017 18:35:36 +0000 (11:35 -0700)] 
Add BtrFS patch for 4.10 kernel

8 years agosimplified call graph
Yann Collet [Tue, 11 Apr 2017 17:46:20 +0000 (10:46 -0700)] 
simplified call graph

by calling ZSTD_compressBegin_internal() instead of ZSTD_compressBegin_advanced()

8 years agosimplified ZSTD_initCStream*() flow
Yann Collet [Tue, 11 Apr 2017 05:24:02 +0000 (22:24 -0700)] 
simplified ZSTD_initCStream*() flow

all variants converge towards ZSTD_initCStream_stage2()

8 years agoIntroduce ZSTD_initCStream_internal()
Yann Collet [Tue, 11 Apr 2017 00:50:44 +0000 (17:50 -0700)] 
Introduce ZSTD_initCStream_internal()

This is now the regroup point for ZSTD_initCStream*() functions

ZSTD_initCStream_advanced() now properly checks for parameters validity.

Also : added <assert.h> usage inside zstd_compress.c
Needs ZSTD_DEBUG=1 macro to be triggered.
Will be triggered by default from `tests` directory

8 years agoSwitch comments to kernel style + limit to 80 cols
Nick Terrell [Mon, 10 Apr 2017 21:50:03 +0000 (14:50 -0700)] 
Switch comments to kernel style + limit to 80 cols

8 years agoRemove ZSTDLIB_API from decompress.c
Nick Terrell [Mon, 10 Apr 2017 21:49:34 +0000 (14:49 -0700)] 
Remove ZSTDLIB_API from decompress.c

8 years agoMerge pull request #648 from facebook/zstdmt
Yann Collet [Fri, 7 Apr 2017 13:09:52 +0000 (06:09 -0700)] 
Merge pull request #648 from facebook/zstdmt

improved zstreamtest --mt to trap bug #644

8 years agoMerge pull request #650 from iburinoc/ro-overwrite
Yann Collet [Fri, 7 Apr 2017 13:09:25 +0000 (06:09 -0700)] 
Merge pull request #650 from iburinoc/ro-overwrite

Make zstd overwrite destination files even when it is read only

8 years agoAdd refuse to overwrite test and fix format 650/head
Sean Purcell [Fri, 7 Apr 2017 00:06:30 +0000 (17:06 -0700)] 
Add refuse to overwrite test and fix format

8 years agoMerge pull request #649 from iburinoc/win-release
Yann Collet [Thu, 6 Apr 2017 23:53:28 +0000 (16:53 -0700)] 
Merge pull request #649 from iburinoc/win-release

Don't build zstd release binary with debug symbols

8 years agoAdd test for overwriting read-only
Sean Purcell [Thu, 6 Apr 2017 19:58:49 +0000 (12:58 -0700)] 
Add test for overwriting read-only

8 years agoLet zstd overwrite read-only files
Sean Purcell [Thu, 6 Apr 2017 19:56:40 +0000 (12:56 -0700)] 
Let zstd overwrite read-only files

8 years agoPush both artifacts without debug symbols 649/head
Sean Purcell [Thu, 6 Apr 2017 17:34:09 +0000 (10:34 -0700)] 
Push both artifacts without debug symbols

8 years agoDon't build zstd release binary with debug symbols
Sean Purcell [Thu, 6 Apr 2017 17:15:32 +0000 (10:15 -0700)] 
Don't build zstd release binary with debug symbols

8 years agoensure cctx internal buffer is correctly sized in case of memory error
Yann Collet [Thu, 6 Apr 2017 08:25:26 +0000 (01:25 -0700)] 
ensure cctx internal buffer is correctly sized in case of memory error

8 years agoupdated comments for ZSTD_resetCStream()
Yann Collet [Thu, 6 Apr 2017 05:06:21 +0000 (22:06 -0700)] 
updated comments for ZSTD_resetCStream()

8 years agoimproved zstreamtest --mt to trap bug #644 648/head
Yann Collet [Wed, 5 Apr 2017 23:34:09 +0000 (16:34 -0700)] 
improved zstreamtest --mt to trap bug #644

8 years agoDStream : ensure correct size of internal buffers in case of error
Yann Collet [Wed, 5 Apr 2017 22:28:56 +0000 (15:28 -0700)] 
DStream : ensure correct size of internal buffers in case of error

8 years agoensure correct size of internal buffers in case of error
Yann Collet [Wed, 5 Apr 2017 21:53:51 +0000 (14:53 -0700)] 
ensure correct size of internal buffers in case of error

8 years agoMerge pull request #647 from terrelln/linux
Yann Collet [Wed, 5 Apr 2017 14:35:48 +0000 (07:35 -0700)] 
Merge pull request #647 from terrelln/linux

Add linux kernel modules to contrib/

8 years agoImprove comments and ordering 647/head
Nick Terrell [Wed, 5 Apr 2017 01:49:07 +0000 (18:49 -0700)] 
Improve comments and ordering

8 years agoAdd a README
Nick Terrell [Wed, 5 Apr 2017 01:39:22 +0000 (18:39 -0700)] 
Add a README

8 years agoAdd Kconfig and Makefile diffs
Nick Terrell [Wed, 5 Apr 2017 01:37:55 +0000 (18:37 -0700)] 
Add Kconfig and Makefile diffs

8 years agoMerge pull request #646 from terrelln/dev
Yann Collet [Wed, 5 Apr 2017 01:18:53 +0000 (18:18 -0700)] 
Merge pull request #646 from terrelln/dev

Switch call of FSE_count() to FSE_count_wksp()

8 years agofix gitignore
Nick Terrell [Wed, 5 Apr 2017 01:12:40 +0000 (18:12 -0700)] 
fix gitignore

8 years agoRename zstd_(de)compress.c to (de)compress.c
Nick Terrell [Wed, 5 Apr 2017 01:09:02 +0000 (18:09 -0700)] 
Rename zstd_(de)compress.c to (de)compress.c

8 years agoUndef current if defined
Nick Terrell [Wed, 5 Apr 2017 00:21:49 +0000 (17:21 -0700)] 
Undef current if defined

8 years agoFix up some old names
Nick Terrell [Wed, 5 Apr 2017 00:03:48 +0000 (17:03 -0700)] 
Fix up some old names

8 years agoReally move the makefile
Nick Terrell [Wed, 5 Apr 2017 00:02:28 +0000 (17:02 -0700)] 
Really move the makefile

8 years agoMove Makefile to lib/zstd
Nick Terrell [Wed, 5 Apr 2017 00:00:12 +0000 (17:00 -0700)] 
Move Makefile to lib/zstd