]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
8 years agoadded test for ZSTD_estimateCStreamSize() 689/head
Yann Collet [Wed, 10 May 2017 18:30:19 +0000 (11:30 -0700)] 
added test for ZSTD_estimateCStreamSize()

8 years agochanged variable name, for clarity
Yann Collet [Wed, 10 May 2017 18:14:08 +0000 (11:14 -0700)] 
changed variable name, for clarity

fhiPtr -> zfhPtr
https://github.com/facebook/zstd/pull/689#discussion_r115638676

8 years agofixed ZSTD_estimateCStreamSize()
Yann Collet [Wed, 10 May 2017 18:08:00 +0000 (11:08 -0700)] 
fixed ZSTD_estimateCStreamSize()

https://github.com/facebook/zstd/pull/689#discussion_r115637721

8 years agoshortened ZSTD_createCStream_Advanced()
Yann Collet [Wed, 10 May 2017 18:06:06 +0000 (11:06 -0700)] 
shortened ZSTD_createCStream_Advanced()

https://github.com/facebook/zstd/pull/689#discussion_r115637613

8 years agofixed symbols test
Yann Collet [Tue, 9 May 2017 23:53:09 +0000 (16:53 -0700)] 
fixed symbols test

8 years agoadded ZSTD_estimateDStreamSize()
Yann Collet [Tue, 9 May 2017 23:18:17 +0000 (16:18 -0700)] 
added ZSTD_estimateDStreamSize()

8 years agochanged name frameParams into frameHeader
Yann Collet [Tue, 9 May 2017 22:46:07 +0000 (15:46 -0700)] 
changed name frameParams into frameHeader

ZSTD_frameParams => ZSTD_frameHeader
ZSTD_getFrameParams() -> ZSTD_getFrameHeader()

The new naming is more distinctive from ZSTD_frameParameters,
which is used during compression.

ZSTD_frameHeader is clearer in its intention to described frame header content.
It also implies we are decoding a ZSTD frame, hence we are at decoding stage.

8 years agoregroup memory usage function declarations
Yann Collet [Tue, 9 May 2017 22:11:30 +0000 (15:11 -0700)] 
regroup memory usage function declarations

in a single paragraph in zstd.h, for clarity

8 years agoseparated ZSTD_estimateCStreamSize() from ZSTD_estimateCCtxSize()
Yann Collet [Tue, 9 May 2017 01:24:16 +0000 (18:24 -0700)] 
separated ZSTD_estimateCStreamSize() from ZSTD_estimateCCtxSize()

for clarity

8 years agobumped version number
Yann Collet [Tue, 9 May 2017 00:52:46 +0000 (17:52 -0700)] 
bumped version number

8 years agoadded ZSTD_estimateCDictSize() and ZSTD_estimateDDictSize()
Yann Collet [Tue, 9 May 2017 00:51:49 +0000 (17:51 -0700)] 
added ZSTD_estimateCDictSize() and ZSTD_estimateDDictSize()

it complements ZSTD_estimateCCtxSize()
for the special case of ZSTD_initCStream_usingDict()

8 years agoUpdated ZSTD_freeCCtx()
Yann Collet [Tue, 9 May 2017 00:15:00 +0000 (17:15 -0700)] 
Updated ZSTD_freeCCtx()

which can also contain streaming buffers now.
Redirected ZSTD_freeCStream() towards it.

8 years agoupdated ZSTD_estimateCCtxSize()
Yann Collet [Tue, 9 May 2017 00:07:59 +0000 (17:07 -0700)] 
updated ZSTD_estimateCCtxSize()

added a parameter streaming,
to estimate memory allocation size
when the CCtx is used for streaming (CStream).

Note : this function is not able to estimate
memory cost of a potential internal CDict
which can only happen when starting with ZSTD_initCStream_usingDict()

8 years agoUpdated ZSTD_sizeof_CCtx()
Yann Collet [Mon, 8 May 2017 23:17:30 +0000 (16:17 -0700)] 
Updated ZSTD_sizeof_CCtx()

can now contain buffers if object used as CStream.
ZSTD_sizeof_CStream() is now just a thin wrapper of ZSTD_sizeof_CCtx().

8 years agomerged CCtx and CStream as a single same object
Yann Collet [Mon, 8 May 2017 23:08:01 +0000 (16:08 -0700)] 
merged CCtx and CStream as a single same object

To be changed : ZSTD_sizeof_CCtx(), ZSTD_estimateCCtxSize()

8 years agoMerge pull request #687 from facebook/permissiveTest
Yann Collet [Mon, 8 May 2017 18:38:01 +0000 (11:38 -0700)] 
Merge pull request #687 from facebook/permissiveTest

cli : -d and -t do not stop after a failed decompression

8 years agocli : -d and -t do not stop after a failed decompression 687/head
Yann Collet [Sat, 6 May 2017 02:15:24 +0000 (19:15 -0700)] 
cli : -d and -t do not stop after a failed decompression

The problematic srcfile will be named on console/log,
but decompression/test will continue onto next file in the list.

8 years agoadded dev branch CircleCI badge
Yann Collet [Fri, 5 May 2017 22:55:03 +0000 (15:55 -0700)] 
added dev branch CircleCI badge

8 years agoadded dev branch Appveyor badge
Yann Collet [Fri, 5 May 2017 22:48:42 +0000 (15:48 -0700)] 
added dev branch Appveyor badge

8 years agokeep dev branch status only
Yann Collet [Fri, 5 May 2017 22:41:23 +0000 (15:41 -0700)] 
keep dev branch status only

master branch status is removed, due to misattribution during cron jobs

8 years agocreates a binary archive without the `programs` directory
Yann Collet [Fri, 5 May 2017 00:40:40 +0000 (17:40 -0700)] 
creates a binary archive without the `programs` directory

also improves compression ratio to -mx9

8 years agoAppveyor build artefact creates zipped cli binary
Yann Collet [Fri, 5 May 2017 00:30:37 +0000 (17:30 -0700)] 
Appveyor build artefact creates zipped cli binary

8 years agoremoved zstdmt generation from Appveyor artefact build
Yann Collet [Fri, 5 May 2017 00:26:58 +0000 (17:26 -0700)] 
removed zstdmt generation from Appveyor artefact build

8 years agoremoved -g from DEBUGFLAGS
Yann Collet [Fri, 5 May 2017 00:24:29 +0000 (17:24 -0700)] 
removed -g from DEBUGFLAGS

It inflates binary sizes, which is negative for the Windows build.
It also makes it impossible to check if 2 different source codes
get nonetheless compiled to the same binary,
since checksum will be different, due to integrated source code.

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev 686/head
Yann Collet [Wed, 3 May 2017 21:33:39 +0000 (14:33 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoupdated dict graphs to 2D mode
Yann Collet [Wed, 3 May 2017 21:32:33 +0000 (14:32 -0700)] 
updated dict graphs to 2D mode

8 years agoMerge pull request #685 from terrelln/squashfs-bench
Yann Collet [Wed, 3 May 2017 18:42:31 +0000 (11:42 -0700)] 
Merge pull request #685 from terrelln/squashfs-bench

[kernel] Update README with SquashFS patch

8 years ago[kernel] Update README with SquashFS patch 685/head
Nick Terrell [Wed, 3 May 2017 18:07:39 +0000 (11:07 -0700)] 
[kernel] Update README with SquashFS patch

Take patch from PR #682 by @iburinoc and update benchmarks.

8 years agoupdated programs/README.md, to introduce compilation variables
Yann Collet [Wed, 3 May 2017 00:18:24 +0000 (17:18 -0700)] 
updated programs/README.md, to introduce compilation variables

make it possible to enable/disable features individually

8 years agoreorganized Makefile for multiple targets
Yann Collet [Tue, 2 May 2017 23:55:57 +0000 (16:55 -0700)] 
reorganized Makefile for multiple targets

8 years agoadded xzstd4 target
Yann Collet [Tue, 2 May 2017 23:38:37 +0000 (16:38 -0700)] 
added xzstd4 target

support for all formats, xz/lzma/lz4 included

8 years agofixed xzstd
Yann Collet [Tue, 2 May 2017 22:40:42 +0000 (15:40 -0700)] 
fixed xzstd

--format=xz was missing a break, making the execution continue into lz4 error message

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Tue, 2 May 2017 21:39:42 +0000 (14:39 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoupdated DSpeed chart to remove 3D effect (#589)
Yann Collet [Tue, 2 May 2017 21:39:03 +0000 (14:39 -0700)] 
updated DSpeed chart to remove 3D effect (#589)

8 years agoMerge pull request #684 from terrelln/btrfs-init
Yann Collet [Tue, 2 May 2017 21:07:52 +0000 (14:07 -0700)] 
Merge pull request #684 from terrelln/btrfs-init

[btrfs] Update patch to use ZSTD_init{C,D}Stream()

8 years ago[btrfs] Fix typo in pr_warn() message 684/head
Nick Terrell [Tue, 2 May 2017 20:57:40 +0000 (13:57 -0700)] 
[btrfs] Fix typo in pr_warn() message

8 years ago[btrfs] Update patch to use ZSTD_init{C,D}Stream()
Nick Terrell [Tue, 2 May 2017 20:41:57 +0000 (13:41 -0700)] 
[btrfs] Update patch to use ZSTD_init{C,D}Stream()

8 years agoupdated NEWS for v1.2.0
Yann Collet [Tue, 2 May 2017 19:14:12 +0000 (12:14 -0700)] 
updated NEWS for v1.2.0

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Tue, 2 May 2017 19:13:52 +0000 (12:13 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoMerge pull request #683 from terrelln/odev
Yann Collet [Tue, 2 May 2017 19:13:23 +0000 (12:13 -0700)] 
Merge pull request #683 from terrelln/odev

[CLI] Make cover the default dictionary builder

8 years ago[CLI] Switch dictionary builder on CLI to cover 683/head
Nick Terrell [Tue, 2 May 2017 06:40:20 +0000 (23:40 -0700)] 
[CLI] Switch dictionary builder on CLI to cover

8 years ago[cover] Make optimization faster
Nick Terrell [Tue, 2 May 2017 04:26:33 +0000 (21:26 -0700)] 
[cover] Make optimization faster

8 years ago[cover] Optimize case where d <= 8
Nick Terrell [Mon, 1 May 2017 17:25:49 +0000 (10:25 -0700)] 
[cover] Optimize case where d <= 8

8 years agoFix typo in zdict.h
Nick Terrell [Mon, 1 May 2017 17:14:15 +0000 (10:14 -0700)] 
Fix typo in zdict.h

8 years agoFix LZ4_MSG in xzstd
Nick Terrell [Mon, 1 May 2017 17:13:56 +0000 (10:13 -0700)] 
Fix LZ4_MSG in xzstd

8 years agominor code refactoring for clarity
Yann Collet [Mon, 1 May 2017 18:22:24 +0000 (11:22 -0700)] 
minor code refactoring for clarity

8 years agofixed const in prototype, that Visual doesn't accept
Yann Collet [Mon, 1 May 2017 18:12:30 +0000 (11:12 -0700)] 
fixed const in prototype, that Visual doesn't accept

8 years agosync bitstream.h from fse library
Yann Collet [Mon, 1 May 2017 16:56:03 +0000 (09:56 -0700)] 
sync bitstream.h from fse library

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Sat, 29 Apr 2017 00:00:46 +0000 (17:00 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agosync bitstream from FSE project
Yann Collet [Fri, 28 Apr 2017 23:56:39 +0000 (16:56 -0700)] 
sync bitstream from FSE project

add assert into unsafe *_fast() variants

8 years agominor code refactoring
Yann Collet [Fri, 28 Apr 2017 23:52:36 +0000 (16:52 -0700)] 
minor code refactoring

clearer tables

8 years agoadded HUF_PUBLIC_API macro to huf.h
Yann Collet [Fri, 28 Apr 2017 19:46:48 +0000 (12:46 -0700)] 
added HUF_PUBLIC_API macro to huf.h

to make it possible to control symbol visibility.
Also : better separation and comments between "public" and "static" sections

8 years agoMerge pull request #680 from iburinoc/sqfs-kernel
Yann Collet [Fri, 28 Apr 2017 17:27:42 +0000 (10:27 -0700)] 
Merge pull request #680 from iburinoc/sqfs-kernel

SquashFS linux kernel patch

8 years agoMerge pull request #678 from facebook/apiChange
Yann Collet [Fri, 28 Apr 2017 17:02:45 +0000 (10:02 -0700)] 
Merge pull request #678 from facebook/apiChange

Breaking API Change around CDict

8 years agominor release note update
Yann Collet [Fri, 28 Apr 2017 15:54:13 +0000 (08:54 -0700)] 
minor release note update

8 years agoChanged default level 18 (large input)
Yann Collet [Fri, 28 Apr 2017 00:44:01 +0000 (17:44 -0700)] 
Changed default level 18 (large input)

Previous -18 : 4.7 MB/s, R:3.833
New -18 : 5.1 MB/s. R:3.825

It's a better fit within -17 (6.8 MB/s) and -19 (4.0 MB/s)
The new level 18 also uses significantly less memory.
And, it makes a good transition between level 17 (mml5)
and level 19 (mml3).
Up to now, there was no level with mml4.

(note : minmatch setting can have a large impact on some (specific) datasets)

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Fri, 28 Apr 2017 00:29:52 +0000 (17:29 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agotests : -g is part of DEBUGFLAGS
Yann Collet [Fri, 28 Apr 2017 00:28:32 +0000 (17:28 -0700)] 
tests : -g is part of DEBUGFLAGS

8 years agoFix missing squashfs_finish_page's 680/head
Sean Purcell [Fri, 28 Apr 2017 00:19:20 +0000 (17:19 -0700)] 
Fix missing squashfs_finish_page's

8 years agoFix case where pages run out before end of stream
Sean Purcell [Thu, 27 Apr 2017 23:54:05 +0000 (16:54 -0700)] 
Fix case where pages run out before end of stream

8 years agoMerge pull request #679 from terrelln/dev
Yann Collet [Thu, 27 Apr 2017 23:31:03 +0000 (16:31 -0700)] 
Merge pull request #679 from terrelln/dev

[kernel] Rename ZSTD_create*() to ZSTD_init*()

8 years agoshortened Appveyor release tests
Yann Collet [Thu, 27 Apr 2017 23:24:53 +0000 (16:24 -0700)] 
shortened Appveyor release tests

fuzzer supports time suffix `s` for "seconds"

8 years agoAdded a secondary test, checking dictID presence after setting noDictIdFLag=1 678/head
Yann Collet [Thu, 27 Apr 2017 22:08:56 +0000 (15:08 -0700)] 
Added a secondary test, checking dictID presence after setting noDictIdFLag=1

8 years agoSquashFS linux kernel patch
Sean Purcell [Thu, 27 Apr 2017 22:04:31 +0000 (15:04 -0700)] 
SquashFS linux kernel patch

8 years agoadded test for ZSTD_initCStream_usingCDict_advanced()
Yann Collet [Thu, 27 Apr 2017 21:48:34 +0000 (14:48 -0700)] 
added test for ZSTD_initCStream_usingCDict_advanced()

8 years agoadded test for ZSTD_compress_usingCDict_advanced()
Yann Collet [Thu, 27 Apr 2017 21:39:39 +0000 (14:39 -0700)] 
added test for ZSTD_compress_usingCDict_advanced()

8 years agoremoved C4204
Yann Collet [Thu, 27 Apr 2017 21:29:35 +0000 (14:29 -0700)] 
removed C4204

8 years agofixed another VS2008 init error
Yann Collet [Thu, 27 Apr 2017 21:19:34 +0000 (14:19 -0700)] 
fixed another VS2008 init error

8 years agofixed init error on Visual 2008
Yann Collet [Thu, 27 Apr 2017 19:57:11 +0000 (12:57 -0700)] 
fixed init error on Visual 2008

8 years agobumped version number to v1.2.0
Yann Collet [Thu, 27 Apr 2017 19:50:20 +0000 (12:50 -0700)] 
bumped version number to v1.2.0

8 years agoupdated NEWS
Yann Collet [Thu, 27 Apr 2017 19:49:22 +0000 (12:49 -0700)] 
updated NEWS

8 years agoMerge pull request #677 from terrelln/pzstd-tests
Yann Collet [Thu, 27 Apr 2017 19:05:00 +0000 (12:05 -0700)] 
Merge pull request #677 from terrelln/pzstd-tests

[pzstd] Add logging statements to tests

8 years agoadded ZSTD_initCStream_usingCDict_advanced()
Yann Collet [Thu, 27 Apr 2017 18:43:04 +0000 (11:43 -0700)] 
added ZSTD_initCStream_usingCDict_advanced()

8 years agocreated ZSTD_compress_usingCDict_advanced()
Yann Collet [Thu, 27 Apr 2017 18:31:55 +0000 (11:31 -0700)] 
created ZSTD_compress_usingCDict_advanced()

8 years ago[pzstd] Add logging statements to tests 677/head
Nick Terrell [Thu, 27 Apr 2017 16:55:19 +0000 (09:55 -0700)] 
[pzstd] Add logging statements to tests

8 years agofixed compilation warning : declaration-after-statement
Yann Collet [Thu, 27 Apr 2017 08:10:36 +0000 (01:10 -0700)] 
fixed compilation warning : declaration-after-statement

8 years agoChanged ZSTD_createCDict_advanced()
Yann Collet [Thu, 27 Apr 2017 07:29:04 +0000 (00:29 -0700)] 
Changed ZSTD_createCDict_advanced()

It now only uses compressionParameters as argument.
It produces many changes throughout user code,
though hopefully they tend to be simple :
just provide the cParams part from existing ZSTD_parameters.

Some programs might depend on ZSTD_createCDict_advanced() to pass frame parameters.
This change will force them to revisit this strategy and fix it,
since frame parameters are effectively silently ignored in current version.

8 years agochanged ZSTD_compressBegin_usingCDict()
Yann Collet [Wed, 26 Apr 2017 22:42:10 +0000 (15:42 -0700)] 
changed ZSTD_compressBegin_usingCDict()

No longer takes `pledgedSrcSize` as argument
this is in line with similar functions ZSTD_compress_usingCDict()
and ZSTD_initCStream_usingCDict().

8 years agoMerge pull request #670 from facebook/smallCCtx
Yann Collet [Wed, 26 Apr 2017 21:03:26 +0000 (14:03 -0700)] 
Merge pull request #670 from facebook/smallCCtx

Small cctx

8 years agoMerge pull request #675 from iburinoc/lz4
Yann Collet [Wed, 26 Apr 2017 20:13:24 +0000 (13:13 -0700)] 
Merge pull request #675 from iburinoc/lz4

Fix LZ4 wrapper deprecation warnings

8 years agoRename ZSTD_create*() to ZSTD_init*() 679/head
Nick Terrell [Wed, 26 Apr 2017 20:06:38 +0000 (13:06 -0700)] 
Rename ZSTD_create*() to ZSTD_init*()

8 years agoComply with suggested comments by @terrelln 670/head
Yann Collet [Wed, 26 Apr 2017 18:39:35 +0000 (11:39 -0700)] 
Comply with suggested comments by @terrelln

created FSE_CTABLE_SIZE() and FSE_DTABLE_SIZE()

8 years agoFix LZ4 wrapper deprecation warnings 675/head
Sean Purcell [Wed, 26 Apr 2017 17:17:38 +0000 (10:17 -0700)] 
Fix LZ4 wrapper deprecation warnings

8 years agoMerge pull request #674 from niXman/dev
Yann Collet [Wed, 26 Apr 2017 16:45:36 +0000 (09:45 -0700)] 
Merge pull request #674 from niXman/dev

unchecked argv[idx] access

8 years agoMerge pull request #673 from iburinoc/lz4
Yann Collet [Wed, 26 Apr 2017 16:32:16 +0000 (09:32 -0700)] 
Merge pull request #673 from iburinoc/lz4

Add LZ4 compress/decompress support to CLI

8 years agounchecked argv[idx] access 674/head
niXman [Wed, 26 Apr 2017 10:04:04 +0000 (13:04 +0300)] 
unchecked argv[idx] access

8 years agoMake lz4 compression/decompression compatible with library r123 673/head
Sean Purcell [Tue, 25 Apr 2017 18:00:54 +0000 (11:00 -0700)] 
Make lz4 compression/decompression compatible with library r123

8 years agoAdd LZ4 compress/decompress support to CLI
Sean Purcell [Mon, 24 Apr 2017 23:48:25 +0000 (16:48 -0700)] 
Add LZ4 compress/decompress support to CLI

8 years agocli : add support for --threads=# command
Yann Collet [Fri, 21 Apr 2017 18:38:13 +0000 (11:38 -0700)] 
cli : add support for --threads=# command

updated documentation
add relevant test case

8 years agoignore more cmake build artefacts
Yann Collet [Fri, 21 Apr 2017 17:59:36 +0000 (10:59 -0700)] 
ignore more cmake build artefacts

8 years agoMerge pull request #669 from ligfx/friendlycmake
Yann Collet [Fri, 21 Apr 2017 06:43:41 +0000 (23:43 -0700)] 
Merge pull request #669 from ligfx/friendlycmake

CMake improvements when embedding in another project

8 years agotransferred entropy scratch space from CCtx into workSpace
Yann Collet [Fri, 21 Apr 2017 06:21:19 +0000 (23:21 -0700)] 
transferred entropy scratch space from CCtx into workSpace

Saved 6 KB

8 years agomade some room for entropy scratch space
Yann Collet [Fri, 21 Apr 2017 06:09:39 +0000 (23:09 -0700)] 
made some room for entropy scratch space

8 years agotransferred FSE tables from CCtx into workspace
Yann Collet [Fri, 21 Apr 2017 06:03:38 +0000 (23:03 -0700)] 
transferred FSE tables from CCtx into workspace

Saved 5 KB from CCtx

8 years agomade room in workspace for FSE tables
Yann Collet [Fri, 21 Apr 2017 05:54:54 +0000 (22:54 -0700)] 
made room in workspace for FSE tables

still need to be transferred from CCtx into workspace

8 years agoCMake: don't modify global C_FLAGS and CXX_FLAGS 669/head
Michael Maltese [Thu, 20 Apr 2017 22:55:48 +0000 (15:55 -0700)] 
CMake: don't modify global C_FLAGS and CXX_FLAGS

8 years agoCMake: don't recheck compile flags every time
Michael Maltese [Thu, 20 Apr 2017 22:54:17 +0000 (15:54 -0700)] 
CMake: don't recheck compile flags every time

Doesn't cause a problem when embedded within a larger project, but is
annoying.

8 years agoCMake: various configure_file fixes to use CMAKE_CURRENT_SOURCE_DIR
Michael Maltese [Thu, 20 Apr 2017 22:47:31 +0000 (15:47 -0700)] 
CMake: various configure_file fixes to use CMAKE_CURRENT_SOURCE_DIR

8 years agoCMake: namespace modules and set CMAKE_MODULE_PATH
Michael Maltese [Thu, 20 Apr 2017 22:46:44 +0000 (15:46 -0700)] 
CMake: namespace modules and set CMAKE_MODULE_PATH

8 years agochanged size evaluation of entropy tables
Yann Collet [Fri, 21 Apr 2017 01:17:58 +0000 (18:17 -0700)] 
changed size evaluation of entropy tables

so that memcpy() does no longer depends on fse pointer being a static table