]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
9 years agoPush both artifacts without debug symbols 649/head
Sean Purcell [Thu, 6 Apr 2017 17:34:09 +0000 (10:34 -0700)] 
Push both artifacts without debug symbols

9 years agoDon't build zstd release binary with debug symbols
Sean Purcell [Thu, 6 Apr 2017 17:15:32 +0000 (10:15 -0700)] 
Don't build zstd release binary with debug symbols

9 years agoensure cctx internal buffer is correctly sized in case of memory error
Yann Collet [Thu, 6 Apr 2017 08:25:26 +0000 (01:25 -0700)] 
ensure cctx internal buffer is correctly sized in case of memory error

9 years agoupdated comments for ZSTD_resetCStream()
Yann Collet [Thu, 6 Apr 2017 05:06:21 +0000 (22:06 -0700)] 
updated comments for ZSTD_resetCStream()

9 years agoDStream : ensure correct size of internal buffers in case of error
Yann Collet [Wed, 5 Apr 2017 22:28:56 +0000 (15:28 -0700)] 
DStream : ensure correct size of internal buffers in case of error

9 years agoensure correct size of internal buffers in case of error
Yann Collet [Wed, 5 Apr 2017 21:53:51 +0000 (14:53 -0700)] 
ensure correct size of internal buffers in case of error

9 years agoMerge pull request #647 from terrelln/linux
Yann Collet [Wed, 5 Apr 2017 14:35:48 +0000 (07:35 -0700)] 
Merge pull request #647 from terrelln/linux

Add linux kernel modules to contrib/

9 years agoImprove comments and ordering 647/head
Nick Terrell [Wed, 5 Apr 2017 01:49:07 +0000 (18:49 -0700)] 
Improve comments and ordering

9 years agoAdd a README
Nick Terrell [Wed, 5 Apr 2017 01:39:22 +0000 (18:39 -0700)] 
Add a README

9 years agoAdd Kconfig and Makefile diffs
Nick Terrell [Wed, 5 Apr 2017 01:37:55 +0000 (18:37 -0700)] 
Add Kconfig and Makefile diffs

9 years agoMerge pull request #646 from terrelln/dev
Yann Collet [Wed, 5 Apr 2017 01:18:53 +0000 (18:18 -0700)] 
Merge pull request #646 from terrelln/dev

Switch call of FSE_count() to FSE_count_wksp()

9 years agofix gitignore
Nick Terrell [Wed, 5 Apr 2017 01:12:40 +0000 (18:12 -0700)] 
fix gitignore

9 years agoRename zstd_(de)compress.c to (de)compress.c
Nick Terrell [Wed, 5 Apr 2017 01:09:02 +0000 (18:09 -0700)] 
Rename zstd_(de)compress.c to (de)compress.c

9 years agoUndef current if defined
Nick Terrell [Wed, 5 Apr 2017 00:21:49 +0000 (17:21 -0700)] 
Undef current if defined

9 years agoFix up some old names
Nick Terrell [Wed, 5 Apr 2017 00:03:48 +0000 (17:03 -0700)] 
Fix up some old names

9 years agoReally move the makefile
Nick Terrell [Wed, 5 Apr 2017 00:02:28 +0000 (17:02 -0700)] 
Really move the makefile

9 years agoMove Makefile to lib/zstd
Nick Terrell [Wed, 5 Apr 2017 00:00:12 +0000 (17:00 -0700)] 
Move Makefile to lib/zstd

9 years agoAdd fs/btrfs/zstd.c
Nick Terrell [Tue, 4 Apr 2017 23:56:52 +0000 (16:56 -0700)] 
Add fs/btrfs/zstd.c

9 years agoparamgrill : results from optimizer use cli format
Yann Collet [Tue, 4 Apr 2017 23:54:33 +0000 (16:54 -0700)] 
paramgrill : results from optimizer use cli format

Best found configuration is displayed
using documented cli advanced parameter syntax.

9 years agofix paramgrill -O#
Yann Collet [Tue, 4 Apr 2017 23:41:11 +0000 (16:41 -0700)] 
fix paramgrill -O#

ensure proposed config does not require more memory than necessary

9 years agoExplicitly convert scratchBuffer to unsigned*
Nick Terrell [Tue, 4 Apr 2017 23:38:13 +0000 (16:38 -0700)] 
Explicitly convert scratchBuffer to unsigned*

9 years agoExplicitly convert scratchBuffer to unsigned* 646/head
Nick Terrell [Tue, 4 Apr 2017 23:35:31 +0000 (16:35 -0700)] 
Explicitly convert scratchBuffer to unsigned*

9 years agofixed paramgrill -O#
Yann Collet [Tue, 4 Apr 2017 23:31:17 +0000 (16:31 -0700)] 
fixed paramgrill -O#

find optimal settings for a minimum speed

9 years agoMove sources to lib/zstd/
Nick Terrell [Tue, 4 Apr 2017 23:30:11 +0000 (16:30 -0700)] 
Move sources to lib/zstd/

9 years agoRemove unused FSE/HUF functions
Nick Terrell [Tue, 4 Apr 2017 23:22:58 +0000 (16:22 -0700)] 
Remove unused FSE/HUF functions

9 years agoSwitch call of FSE_count() to FSE_count_wksp()
Nick Terrell [Tue, 4 Apr 2017 23:17:21 +0000 (16:17 -0700)] 
Switch call of FSE_count() to FSE_count_wksp()

9 years agoRemove more restrict
Nick Terrell [Tue, 4 Apr 2017 22:55:48 +0000 (15:55 -0700)] 
Remove more restrict

9 years agoFix up xxhash
Nick Terrell [Tue, 4 Apr 2017 22:54:39 +0000 (15:54 -0700)] 
Fix up xxhash

9 years agoSwitch intptr_t to ptrdiff_t
Nick Terrell [Tue, 4 Apr 2017 22:49:38 +0000 (15:49 -0700)] 
Switch intptr_t to ptrdiff_t

9 years agoMove zstd.h to linux/zstd.h
Nick Terrell [Tue, 4 Apr 2017 22:41:24 +0000 (15:41 -0700)] 
Move zstd.h to linux/zstd.h

9 years agofixed bench.c : optional advanced parameters applied
Yann Collet [Tue, 4 Apr 2017 22:35:06 +0000 (15:35 -0700)] 
fixed bench.c : optional advanced parameters applied

before creating cdict

9 years agominor bench.c adjustments
Yann Collet [Tue, 4 Apr 2017 22:21:09 +0000 (15:21 -0700)] 
minor bench.c adjustments

shorter debug messages
no need to check decompressedLength==0 twice

9 years agoTest module macros
Nick Terrell [Tue, 4 Apr 2017 19:56:44 +0000 (12:56 -0700)] 
Test module macros

9 years agoAdd module macros
Nick Terrell [Tue, 4 Apr 2017 19:56:35 +0000 (12:56 -0700)] 
Add module macros

9 years agoProtects ZSTD_compressBegin_usingCDict() vs NULL cdict dereference
Yann Collet [Tue, 4 Apr 2017 19:38:14 +0000 (12:38 -0700)] 
Protects ZSTD_compressBegin_usingCDict() vs NULL cdict dereference

Will issue an error (GENERIC) is cdict==NULL

9 years agoAdd zstd kernel module Makefile
Nick Terrell [Tue, 4 Apr 2017 19:10:47 +0000 (12:10 -0700)] 
Add zstd kernel module Makefile

9 years agoAdd userland test with mock kernel headers
Nick Terrell [Tue, 4 Apr 2017 18:53:22 +0000 (11:53 -0700)] 
Add userland test with mock kernel headers

9 years agoFix ZSTD_createCStream_usingCDict() and ZSTD_compress_usingCDict()
Nick Terrell [Tue, 4 Apr 2017 18:52:49 +0000 (11:52 -0700)] 
Fix ZSTD_createCStream_usingCDict() and ZSTD_compress_usingCDict()

9 years agoMerge pull request #645 from terrelln/cdict
Yann Collet [Tue, 4 Apr 2017 14:12:15 +0000 (07:12 -0700)] 
Merge pull request #645 from terrelln/cdict

Fix ZSTD_initCStream_usingCDict() and ZSTD_compress_usingCDict()

9 years agoRemove unnecessary dictID store 645/head
Nick Terrell [Tue, 4 Apr 2017 04:46:28 +0000 (21:46 -0700)] 
Remove unnecessary dictID store

9 years agoMake ZSTD_compress_usingCDict() respect contentSizeFlag
Nick Terrell [Tue, 4 Apr 2017 04:00:44 +0000 (21:00 -0700)] 
Make ZSTD_compress_usingCDict() respect contentSizeFlag

9 years agoFix ZSTD_initCStream_usingCDict() to use dictionary
Nick Terrell [Tue, 4 Apr 2017 03:56:39 +0000 (20:56 -0700)] 
Fix ZSTD_initCStream_usingCDict() to use dictionary

9 years agoMerge pull request #643 from facebook/zstdmt
Yann Collet [Tue, 4 Apr 2017 00:25:05 +0000 (17:25 -0700)] 
Merge pull request #643 from facebook/zstdmt

Optimize ZSTDMT_compress() memory usage

9 years agoFix compilation errors
Nick Terrell [Mon, 3 Apr 2017 23:08:20 +0000 (16:08 -0700)] 
Fix compilation errors

9 years agoPreallocate workSpace for cctx and combine create and init for cstream
Nick Terrell [Mon, 3 Apr 2017 22:23:09 +0000 (15:23 -0700)] 
Preallocate workSpace for cctx and combine create and init for cstream

9 years agominor man update, for `overlapSize` 643/head
Yann Collet [Mon, 3 Apr 2017 21:57:24 +0000 (14:57 -0700)] 
minor man update, for `overlapSize`

9 years agoupdated documentation on multithreading modes
Yann Collet [Sat, 1 Apr 2017 07:36:31 +0000 (00:36 -0700)] 
updated documentation on multithreading modes

9 years agooptimize ZSTDMT_compress() memory usage
Yann Collet [Sat, 1 Apr 2017 01:27:03 +0000 (18:27 -0700)] 
optimize ZSTDMT_compress() memory usage

does no longer allocate temporary buffers
when there is enough room in dstBuffer to decompress directly there.
(previous method would skip that for 1st chunk only).

Also : fix ZSTD_compressBound() for small srcSize

9 years agoWorking on API
Nick Terrell [Fri, 31 Mar 2017 22:01:41 +0000 (15:01 -0700)] 
Working on API

9 years agoChanged ZSTD_compressBound()
Yann Collet [Sat, 1 Apr 2017 00:11:38 +0000 (17:11 -0700)] 
Changed ZSTD_compressBound()

required so that if Total = A+B
compressBound(Total) <= compressBound(A) + compressBound(B)
under condition of a minimum size for A and B

Will help for ZSTDMT_compress() memory allocation

9 years agoMerge branch 'dev' into zstdmt
Yann Collet [Fri, 31 Mar 2017 23:22:33 +0000 (16:22 -0700)] 
Merge branch 'dev' into zstdmt

9 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Fri, 31 Mar 2017 23:19:52 +0000 (16:19 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

9 years agoMerge pull request #642 from terrelln/no-sparse
Yann Collet [Fri, 31 Mar 2017 23:19:46 +0000 (16:19 -0700)] 
Merge pull request #642 from terrelln/no-sparse

Turn off sparse mode for OS X by default

9 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Fri, 31 Mar 2017 23:19:33 +0000 (16:19 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

9 years agominor typo fixes in specification
Yann Collet [Fri, 31 Mar 2017 23:19:04 +0000 (16:19 -0700)] 
minor typo fixes in specification

9 years agoMerge pull request #640 from facebook/memAccess
Yann Collet [Fri, 31 Mar 2017 22:49:12 +0000 (15:49 -0700)] 
Merge pull request #640 from facebook/memAccess

Changed memory strategy to __packed for gcc

9 years agonumerous typos and clarifications in format specification
Yann Collet [Fri, 31 Mar 2017 17:54:45 +0000 (10:54 -0700)] 
numerous typos and clarifications in format specification

fix limit values of Window_Size
bump version to 0.2.5

9 years agoClean up default sparse logic 642/head
Nick Terrell [Fri, 31 Mar 2017 22:20:50 +0000 (15:20 -0700)] 
Clean up default sparse logic

9 years agoTurn off sparse mode for OS X by default
Nick Terrell [Fri, 31 Mar 2017 22:16:43 +0000 (15:16 -0700)] 
Turn off sparse mode for OS X by default

9 years agofixed minor warnings in debug code
Yann Collet [Thu, 30 Mar 2017 23:47:19 +0000 (16:47 -0700)] 
fixed minor warnings in debug code

9 years agooverlap at full windowSize for max compression level
Yann Collet [Thu, 30 Mar 2017 23:23:22 +0000 (16:23 -0700)] 
overlap at full windowSize for max compression level

as it provides max compression ratio

9 years agoimproved ZSTDMT_compress()
Yann Collet [Thu, 30 Mar 2017 22:51:58 +0000 (15:51 -0700)] 
improved ZSTDMT_compress()

Use a bit more threads by default.
Uses overlap segments to boost compression ratio (like the streaming variant)

9 years agoRemove STATIC_LINKING_ONLY defines
Nick Terrell [Thu, 30 Mar 2017 21:33:59 +0000 (14:33 -0700)] 
Remove STATIC_LINKING_ONLY defines

9 years agoUse <asm/unaligned.h> for unaligned memory access
Nick Terrell [Thu, 30 Mar 2017 19:11:19 +0000 (12:11 -0700)] 
Use <asm/unaligned.h> for unaligned memory access

9 years agoChange stdlib includes to linux includes
Nick Terrell [Thu, 30 Mar 2017 18:40:05 +0000 (11:40 -0700)] 
Change stdlib includes to linux includes

9 years agoRemove platform specific macros
Nick Terrell [Thu, 30 Mar 2017 03:26:07 +0000 (20:26 -0700)] 
Remove platform specific macros

9 years agoConvert all spaces to tabs
Nick Terrell [Thu, 30 Mar 2017 02:57:22 +0000 (19:57 -0700)] 
Convert all spaces to tabs

9 years agospaces to tabs
Nick Terrell [Thu, 30 Mar 2017 01:47:23 +0000 (18:47 -0700)] 
spaces to tabs

9 years agoCopy files into contrib/linux-kernel/
Nick Terrell [Thu, 30 Mar 2017 01:35:21 +0000 (18:35 -0700)] 
Copy files into contrib/linux-kernel/

9 years agoMake pzstd and cmake use gcc/g++
Sean Purcell [Wed, 29 Mar 2017 21:40:11 +0000 (14:40 -0700)] 
Make pzstd and cmake use gcc/g++

9 years agoBuild windows releases on appveyor as artifacts
Sean Purcell [Wed, 29 Mar 2017 20:08:10 +0000 (13:08 -0700)] 
Build windows releases on appveyor as artifacts

9 years agoMerge pull request #637 from facebook/zstdmt
Yann Collet [Thu, 30 Mar 2017 21:18:37 +0000 (14:18 -0700)] 
Merge pull request #637 from facebook/zstdmt

Zstdmt

9 years agoChanged memory strategy to __packed for gcc 640/head
Yann Collet [Thu, 30 Mar 2017 19:52:14 +0000 (12:52 -0700)] 
Changed memory strategy to __packed for gcc

Method 1 __packed is always as good or better than memcpy().
But it's not portable, as it depends on compiler extension.

For gcc, __pakced directive works fine.
Furthermore, gcc has serious performance issues with memcpy() on ARM 32 bits.
See #620

9 years agocreated contrib/cleanTabs
Yann Collet [Thu, 30 Mar 2017 19:42:44 +0000 (12:42 -0700)] 
created contrib/cleanTabs

9 years agoMerge pull request #638 from terrelln/tabs
Yann Collet [Thu, 30 Mar 2017 19:32:40 +0000 (12:32 -0700)] 
Merge pull request #638 from terrelln/tabs

Convert all tabs to spaces

9 years agofixed Visual fuzzer project 637/head
Yann Collet [Thu, 30 Mar 2017 19:28:09 +0000 (12:28 -0700)] 
fixed Visual fuzzer project

9 years agofixed Visual Studio projects
Yann Collet [Thu, 30 Mar 2017 05:03:27 +0000 (22:03 -0700)] 
fixed Visual Studio projects

9 years agoConvert all tabs to spaces 638/head
Nick Terrell [Thu, 30 Mar 2017 01:51:58 +0000 (18:51 -0700)] 
Convert all tabs to spaces

9 years agore-added patch ...
Yann Collet [Thu, 30 Mar 2017 00:15:27 +0000 (17:15 -0700)] 
re-added patch ...

9 years agofixed #634 : ZSTDMT_compressCCtx() doesn't provide frame content size in header
Yann Collet [Thu, 30 Mar 2017 00:09:59 +0000 (17:09 -0700)] 
fixed #634 : ZSTDMT_compressCCtx() doesn't provide frame content size in header

9 years agoMerge pull request #636 from iburinoc/appveyor
Yann Collet [Thu, 30 Mar 2017 00:01:24 +0000 (17:01 -0700)] 
Merge pull request #636 from iburinoc/appveyor

Build windows releases on appveyor as artifacts

9 years agoadded ZSTD_getFrameContentSize() to ZSTDMT unit test in fuzzer
Yann Collet [Wed, 29 Mar 2017 23:58:57 +0000 (16:58 -0700)] 
added ZSTD_getFrameContentSize() to ZSTDMT unit test in fuzzer

Now tests fail, because ZSTDMT_compress() doesn't fill frame content size correctly.

9 years agoremoved unnecessary restriction on minmatchLength
Yann Collet [Wed, 29 Mar 2017 23:02:47 +0000 (16:02 -0700)] 
removed unnecessary restriction on minmatchLength

it's now transparently translated to nearest value when unsupported
(7->6) (3->4)

9 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Wed, 29 Mar 2017 22:21:30 +0000 (15:21 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

9 years agoMake pzstd and cmake use gcc/g++ 636/head
Sean Purcell [Wed, 29 Mar 2017 21:40:11 +0000 (14:40 -0700)] 
Make pzstd and cmake use gcc/g++

9 years agofix : minmatch 7 conversion
Yann Collet [Wed, 29 Mar 2017 21:32:15 +0000 (14:32 -0700)] 
fix : minmatch 7 conversion

minmatch 7 now converted to minmatch 6 for strategies which do not support 7
Used to folded into "default", which applied minmatch 4

9 years agoBuild windows releases on appveyor as artifacts
Sean Purcell [Wed, 29 Mar 2017 20:08:10 +0000 (13:08 -0700)] 
Build windows releases on appveyor as artifacts

9 years agoMerge pull request #635 from iburinoc/skipmagic
Yann Collet [Wed, 29 Mar 2017 19:16:53 +0000 (12:16 -0700)] 
Merge pull request #635 from iburinoc/skipmagic

Remove extra 'F' from skippable magic mask

9 years agofix : bench automatically adapts parameters to srcSize
Yann Collet [Wed, 29 Mar 2017 19:10:38 +0000 (12:10 -0700)] 
fix : bench automatically adapts parameters to srcSize

9 years agoRemove extra 'F' from skippable magic mask 635/head
Sean Purcell [Wed, 29 Mar 2017 18:46:57 +0000 (11:46 -0700)] 
Remove extra 'F' from skippable magic mask

9 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Mon, 27 Mar 2017 21:43:53 +0000 (14:43 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

9 years agoMerge pull request #631 from facebook/LegacyDictBuilder
Yann Collet [Mon, 27 Mar 2017 21:42:52 +0000 (14:42 -0700)] 
Merge pull request #631 from facebook/LegacyDictBuilder

Legacy dict builder

9 years agoMerge pull request #633 from iburinoc/isatty
Yann Collet [Mon, 27 Mar 2017 21:32:21 +0000 (14:32 -0700)] 
Merge pull request #633 from iburinoc/isatty

Fix IS_CONSOLE returning 1 for NUL on windows

9 years agoFix inline compile errors 633/head
Sean Purcell [Mon, 27 Mar 2017 19:26:40 +0000 (12:26 -0700)] 
Fix inline compile errors

9 years agoFix IS_CONSOLE returning 1 for NUL on windows
Sean Purcell [Mon, 27 Mar 2017 19:19:30 +0000 (12:19 -0700)] 
Fix IS_CONSOLE returning 1 for NUL on windows

9 years agoImproved speed tests 632/head
Yann Collet [Mon, 27 Mar 2017 06:52:19 +0000 (23:52 -0700)] 
Improved speed tests

Better compatibility with Mac OS-X
Force attribution to a selected core # (Linux)

9 years agorestored bonus rule 631/head
Yann Collet [Sun, 26 Mar 2017 21:51:00 +0000 (14:51 -0700)] 
restored bonus rule

9 years agoMerge branch 'dev' into LegacyDictBuilder
Yann Collet [Sun, 26 Mar 2017 21:39:13 +0000 (14:39 -0700)] 
Merge branch 'dev' into LegacyDictBuilder

9 years agominor refactor
Yann Collet [Sun, 26 Mar 2017 09:59:13 +0000 (02:59 -0700)] 
minor refactor

add const
changed if for easier to add new conditions

9 years agofixed dictBuilder issue
Yann Collet [Sun, 26 Mar 2017 09:50:00 +0000 (02:50 -0700)] 
fixed dictBuilder issue

dictionary loading would fail during entropy analysis