]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
8 years agoPush both artifacts without debug symbols 649/head
Sean Purcell [Thu, 6 Apr 2017 17:34:09 +0000 (10:34 -0700)] 
Push both artifacts without debug symbols

8 years agoDon't build zstd release binary with debug symbols
Sean Purcell [Thu, 6 Apr 2017 17:15:32 +0000 (10:15 -0700)] 
Don't build zstd release binary with debug symbols

8 years agoensure cctx internal buffer is correctly sized in case of memory error
Yann Collet [Thu, 6 Apr 2017 08:25:26 +0000 (01:25 -0700)] 
ensure cctx internal buffer is correctly sized in case of memory error

8 years agoupdated comments for ZSTD_resetCStream()
Yann Collet [Thu, 6 Apr 2017 05:06:21 +0000 (22:06 -0700)] 
updated comments for ZSTD_resetCStream()

8 years agoDStream : ensure correct size of internal buffers in case of error
Yann Collet [Wed, 5 Apr 2017 22:28:56 +0000 (15:28 -0700)] 
DStream : ensure correct size of internal buffers in case of error

8 years agoensure correct size of internal buffers in case of error
Yann Collet [Wed, 5 Apr 2017 21:53:51 +0000 (14:53 -0700)] 
ensure correct size of internal buffers in case of error

8 years agoMerge pull request #647 from terrelln/linux
Yann Collet [Wed, 5 Apr 2017 14:35:48 +0000 (07:35 -0700)] 
Merge pull request #647 from terrelln/linux

Add linux kernel modules to contrib/

8 years agoImprove comments and ordering 647/head
Nick Terrell [Wed, 5 Apr 2017 01:49:07 +0000 (18:49 -0700)] 
Improve comments and ordering

8 years agoAdd a README
Nick Terrell [Wed, 5 Apr 2017 01:39:22 +0000 (18:39 -0700)] 
Add a README

8 years agoAdd Kconfig and Makefile diffs
Nick Terrell [Wed, 5 Apr 2017 01:37:55 +0000 (18:37 -0700)] 
Add Kconfig and Makefile diffs

8 years agoMerge pull request #646 from terrelln/dev
Yann Collet [Wed, 5 Apr 2017 01:18:53 +0000 (18:18 -0700)] 
Merge pull request #646 from terrelln/dev

Switch call of FSE_count() to FSE_count_wksp()

8 years agofix gitignore
Nick Terrell [Wed, 5 Apr 2017 01:12:40 +0000 (18:12 -0700)] 
fix gitignore

8 years agoRename zstd_(de)compress.c to (de)compress.c
Nick Terrell [Wed, 5 Apr 2017 01:09:02 +0000 (18:09 -0700)] 
Rename zstd_(de)compress.c to (de)compress.c

8 years agoUndef current if defined
Nick Terrell [Wed, 5 Apr 2017 00:21:49 +0000 (17:21 -0700)] 
Undef current if defined

8 years agoFix up some old names
Nick Terrell [Wed, 5 Apr 2017 00:03:48 +0000 (17:03 -0700)] 
Fix up some old names

8 years agoReally move the makefile
Nick Terrell [Wed, 5 Apr 2017 00:02:28 +0000 (17:02 -0700)] 
Really move the makefile

8 years agoMove Makefile to lib/zstd
Nick Terrell [Wed, 5 Apr 2017 00:00:12 +0000 (17:00 -0700)] 
Move Makefile to lib/zstd

8 years agoAdd fs/btrfs/zstd.c
Nick Terrell [Tue, 4 Apr 2017 23:56:52 +0000 (16:56 -0700)] 
Add fs/btrfs/zstd.c

8 years agoparamgrill : results from optimizer use cli format
Yann Collet [Tue, 4 Apr 2017 23:54:33 +0000 (16:54 -0700)] 
paramgrill : results from optimizer use cli format

Best found configuration is displayed
using documented cli advanced parameter syntax.

8 years agofix paramgrill -O#
Yann Collet [Tue, 4 Apr 2017 23:41:11 +0000 (16:41 -0700)] 
fix paramgrill -O#

ensure proposed config does not require more memory than necessary

8 years agoExplicitly convert scratchBuffer to unsigned*
Nick Terrell [Tue, 4 Apr 2017 23:38:13 +0000 (16:38 -0700)] 
Explicitly convert scratchBuffer to unsigned*

8 years agoExplicitly convert scratchBuffer to unsigned* 646/head
Nick Terrell [Tue, 4 Apr 2017 23:35:31 +0000 (16:35 -0700)] 
Explicitly convert scratchBuffer to unsigned*

8 years agofixed paramgrill -O#
Yann Collet [Tue, 4 Apr 2017 23:31:17 +0000 (16:31 -0700)] 
fixed paramgrill -O#

find optimal settings for a minimum speed

8 years agoMove sources to lib/zstd/
Nick Terrell [Tue, 4 Apr 2017 23:30:11 +0000 (16:30 -0700)] 
Move sources to lib/zstd/

8 years agoRemove unused FSE/HUF functions
Nick Terrell [Tue, 4 Apr 2017 23:22:58 +0000 (16:22 -0700)] 
Remove unused FSE/HUF functions

8 years agoSwitch call of FSE_count() to FSE_count_wksp()
Nick Terrell [Tue, 4 Apr 2017 23:17:21 +0000 (16:17 -0700)] 
Switch call of FSE_count() to FSE_count_wksp()

8 years agoRemove more restrict
Nick Terrell [Tue, 4 Apr 2017 22:55:48 +0000 (15:55 -0700)] 
Remove more restrict

8 years agoFix up xxhash
Nick Terrell [Tue, 4 Apr 2017 22:54:39 +0000 (15:54 -0700)] 
Fix up xxhash

8 years agoSwitch intptr_t to ptrdiff_t
Nick Terrell [Tue, 4 Apr 2017 22:49:38 +0000 (15:49 -0700)] 
Switch intptr_t to ptrdiff_t

8 years agoMove zstd.h to linux/zstd.h
Nick Terrell [Tue, 4 Apr 2017 22:41:24 +0000 (15:41 -0700)] 
Move zstd.h to linux/zstd.h

8 years agofixed bench.c : optional advanced parameters applied
Yann Collet [Tue, 4 Apr 2017 22:35:06 +0000 (15:35 -0700)] 
fixed bench.c : optional advanced parameters applied

before creating cdict

8 years agominor bench.c adjustments
Yann Collet [Tue, 4 Apr 2017 22:21:09 +0000 (15:21 -0700)] 
minor bench.c adjustments

shorter debug messages
no need to check decompressedLength==0 twice

8 years agoTest module macros
Nick Terrell [Tue, 4 Apr 2017 19:56:44 +0000 (12:56 -0700)] 
Test module macros

8 years agoAdd module macros
Nick Terrell [Tue, 4 Apr 2017 19:56:35 +0000 (12:56 -0700)] 
Add module macros

8 years agoProtects ZSTD_compressBegin_usingCDict() vs NULL cdict dereference
Yann Collet [Tue, 4 Apr 2017 19:38:14 +0000 (12:38 -0700)] 
Protects ZSTD_compressBegin_usingCDict() vs NULL cdict dereference

Will issue an error (GENERIC) is cdict==NULL

8 years agoAdd zstd kernel module Makefile
Nick Terrell [Tue, 4 Apr 2017 19:10:47 +0000 (12:10 -0700)] 
Add zstd kernel module Makefile

8 years agoAdd userland test with mock kernel headers
Nick Terrell [Tue, 4 Apr 2017 18:53:22 +0000 (11:53 -0700)] 
Add userland test with mock kernel headers

8 years agoFix ZSTD_createCStream_usingCDict() and ZSTD_compress_usingCDict()
Nick Terrell [Tue, 4 Apr 2017 18:52:49 +0000 (11:52 -0700)] 
Fix ZSTD_createCStream_usingCDict() and ZSTD_compress_usingCDict()

8 years agoMerge pull request #645 from terrelln/cdict
Yann Collet [Tue, 4 Apr 2017 14:12:15 +0000 (07:12 -0700)] 
Merge pull request #645 from terrelln/cdict

Fix ZSTD_initCStream_usingCDict() and ZSTD_compress_usingCDict()

8 years agoRemove unnecessary dictID store 645/head
Nick Terrell [Tue, 4 Apr 2017 04:46:28 +0000 (21:46 -0700)] 
Remove unnecessary dictID store

8 years agoMake ZSTD_compress_usingCDict() respect contentSizeFlag
Nick Terrell [Tue, 4 Apr 2017 04:00:44 +0000 (21:00 -0700)] 
Make ZSTD_compress_usingCDict() respect contentSizeFlag

8 years agoFix ZSTD_initCStream_usingCDict() to use dictionary
Nick Terrell [Tue, 4 Apr 2017 03:56:39 +0000 (20:56 -0700)] 
Fix ZSTD_initCStream_usingCDict() to use dictionary

8 years agoMerge pull request #643 from facebook/zstdmt
Yann Collet [Tue, 4 Apr 2017 00:25:05 +0000 (17:25 -0700)] 
Merge pull request #643 from facebook/zstdmt

Optimize ZSTDMT_compress() memory usage

8 years agoFix compilation errors
Nick Terrell [Mon, 3 Apr 2017 23:08:20 +0000 (16:08 -0700)] 
Fix compilation errors

8 years agoPreallocate workSpace for cctx and combine create and init for cstream
Nick Terrell [Mon, 3 Apr 2017 22:23:09 +0000 (15:23 -0700)] 
Preallocate workSpace for cctx and combine create and init for cstream

8 years agominor man update, for `overlapSize` 643/head
Yann Collet [Mon, 3 Apr 2017 21:57:24 +0000 (14:57 -0700)] 
minor man update, for `overlapSize`

8 years agoupdated documentation on multithreading modes
Yann Collet [Sat, 1 Apr 2017 07:36:31 +0000 (00:36 -0700)] 
updated documentation on multithreading modes

8 years agooptimize ZSTDMT_compress() memory usage
Yann Collet [Sat, 1 Apr 2017 01:27:03 +0000 (18:27 -0700)] 
optimize ZSTDMT_compress() memory usage

does no longer allocate temporary buffers
when there is enough room in dstBuffer to decompress directly there.
(previous method would skip that for 1st chunk only).

Also : fix ZSTD_compressBound() for small srcSize

8 years agoWorking on API
Nick Terrell [Fri, 31 Mar 2017 22:01:41 +0000 (15:01 -0700)] 
Working on API

8 years agoChanged ZSTD_compressBound()
Yann Collet [Sat, 1 Apr 2017 00:11:38 +0000 (17:11 -0700)] 
Changed ZSTD_compressBound()

required so that if Total = A+B
compressBound(Total) <= compressBound(A) + compressBound(B)
under condition of a minimum size for A and B

Will help for ZSTDMT_compress() memory allocation

8 years agoMerge branch 'dev' into zstdmt
Yann Collet [Fri, 31 Mar 2017 23:22:33 +0000 (16:22 -0700)] 
Merge branch 'dev' into zstdmt

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Fri, 31 Mar 2017 23:19:52 +0000 (16:19 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoMerge pull request #642 from terrelln/no-sparse
Yann Collet [Fri, 31 Mar 2017 23:19:46 +0000 (16:19 -0700)] 
Merge pull request #642 from terrelln/no-sparse

Turn off sparse mode for OS X by default

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Fri, 31 Mar 2017 23:19:33 +0000 (16:19 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agominor typo fixes in specification
Yann Collet [Fri, 31 Mar 2017 23:19:04 +0000 (16:19 -0700)] 
minor typo fixes in specification

8 years agoMerge pull request #640 from facebook/memAccess
Yann Collet [Fri, 31 Mar 2017 22:49:12 +0000 (15:49 -0700)] 
Merge pull request #640 from facebook/memAccess

Changed memory strategy to __packed for gcc

8 years agonumerous typos and clarifications in format specification
Yann Collet [Fri, 31 Mar 2017 17:54:45 +0000 (10:54 -0700)] 
numerous typos and clarifications in format specification

fix limit values of Window_Size
bump version to 0.2.5

8 years agoClean up default sparse logic 642/head
Nick Terrell [Fri, 31 Mar 2017 22:20:50 +0000 (15:20 -0700)] 
Clean up default sparse logic

8 years agoTurn off sparse mode for OS X by default
Nick Terrell [Fri, 31 Mar 2017 22:16:43 +0000 (15:16 -0700)] 
Turn off sparse mode for OS X by default

8 years agofixed minor warnings in debug code
Yann Collet [Thu, 30 Mar 2017 23:47:19 +0000 (16:47 -0700)] 
fixed minor warnings in debug code

8 years agooverlap at full windowSize for max compression level
Yann Collet [Thu, 30 Mar 2017 23:23:22 +0000 (16:23 -0700)] 
overlap at full windowSize for max compression level

as it provides max compression ratio

8 years agoimproved ZSTDMT_compress()
Yann Collet [Thu, 30 Mar 2017 22:51:58 +0000 (15:51 -0700)] 
improved ZSTDMT_compress()

Use a bit more threads by default.
Uses overlap segments to boost compression ratio (like the streaming variant)

8 years agoRemove STATIC_LINKING_ONLY defines
Nick Terrell [Thu, 30 Mar 2017 21:33:59 +0000 (14:33 -0700)] 
Remove STATIC_LINKING_ONLY defines

8 years agoUse <asm/unaligned.h> for unaligned memory access
Nick Terrell [Thu, 30 Mar 2017 19:11:19 +0000 (12:11 -0700)] 
Use <asm/unaligned.h> for unaligned memory access

8 years agoChange stdlib includes to linux includes
Nick Terrell [Thu, 30 Mar 2017 18:40:05 +0000 (11:40 -0700)] 
Change stdlib includes to linux includes

8 years agoRemove platform specific macros
Nick Terrell [Thu, 30 Mar 2017 03:26:07 +0000 (20:26 -0700)] 
Remove platform specific macros

8 years agoConvert all spaces to tabs
Nick Terrell [Thu, 30 Mar 2017 02:57:22 +0000 (19:57 -0700)] 
Convert all spaces to tabs

8 years agospaces to tabs
Nick Terrell [Thu, 30 Mar 2017 01:47:23 +0000 (18:47 -0700)] 
spaces to tabs

8 years agoCopy files into contrib/linux-kernel/
Nick Terrell [Thu, 30 Mar 2017 01:35:21 +0000 (18:35 -0700)] 
Copy files into contrib/linux-kernel/

8 years agoMake pzstd and cmake use gcc/g++
Sean Purcell [Wed, 29 Mar 2017 21:40:11 +0000 (14:40 -0700)] 
Make pzstd and cmake use gcc/g++

8 years agoBuild windows releases on appveyor as artifacts
Sean Purcell [Wed, 29 Mar 2017 20:08:10 +0000 (13:08 -0700)] 
Build windows releases on appveyor as artifacts

8 years agoMerge pull request #637 from facebook/zstdmt
Yann Collet [Thu, 30 Mar 2017 21:18:37 +0000 (14:18 -0700)] 
Merge pull request #637 from facebook/zstdmt

Zstdmt

8 years agoChanged memory strategy to __packed for gcc 640/head
Yann Collet [Thu, 30 Mar 2017 19:52:14 +0000 (12:52 -0700)] 
Changed memory strategy to __packed for gcc

Method 1 __packed is always as good or better than memcpy().
But it's not portable, as it depends on compiler extension.

For gcc, __pakced directive works fine.
Furthermore, gcc has serious performance issues with memcpy() on ARM 32 bits.
See #620

8 years agocreated contrib/cleanTabs
Yann Collet [Thu, 30 Mar 2017 19:42:44 +0000 (12:42 -0700)] 
created contrib/cleanTabs

8 years agoMerge pull request #638 from terrelln/tabs
Yann Collet [Thu, 30 Mar 2017 19:32:40 +0000 (12:32 -0700)] 
Merge pull request #638 from terrelln/tabs

Convert all tabs to spaces

8 years agofixed Visual fuzzer project 637/head
Yann Collet [Thu, 30 Mar 2017 19:28:09 +0000 (12:28 -0700)] 
fixed Visual fuzzer project

8 years agofixed Visual Studio projects
Yann Collet [Thu, 30 Mar 2017 05:03:27 +0000 (22:03 -0700)] 
fixed Visual Studio projects

8 years agoConvert all tabs to spaces 638/head
Nick Terrell [Thu, 30 Mar 2017 01:51:58 +0000 (18:51 -0700)] 
Convert all tabs to spaces

8 years agore-added patch ...
Yann Collet [Thu, 30 Mar 2017 00:15:27 +0000 (17:15 -0700)] 
re-added patch ...

8 years agofixed #634 : ZSTDMT_compressCCtx() doesn't provide frame content size in header
Yann Collet [Thu, 30 Mar 2017 00:09:59 +0000 (17:09 -0700)] 
fixed #634 : ZSTDMT_compressCCtx() doesn't provide frame content size in header

8 years agoMerge pull request #636 from iburinoc/appveyor
Yann Collet [Thu, 30 Mar 2017 00:01:24 +0000 (17:01 -0700)] 
Merge pull request #636 from iburinoc/appveyor

Build windows releases on appveyor as artifacts

8 years agoadded ZSTD_getFrameContentSize() to ZSTDMT unit test in fuzzer
Yann Collet [Wed, 29 Mar 2017 23:58:57 +0000 (16:58 -0700)] 
added ZSTD_getFrameContentSize() to ZSTDMT unit test in fuzzer

Now tests fail, because ZSTDMT_compress() doesn't fill frame content size correctly.

8 years agoremoved unnecessary restriction on minmatchLength
Yann Collet [Wed, 29 Mar 2017 23:02:47 +0000 (16:02 -0700)] 
removed unnecessary restriction on minmatchLength

it's now transparently translated to nearest value when unsupported
(7->6) (3->4)

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Wed, 29 Mar 2017 22:21:30 +0000 (15:21 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoMake pzstd and cmake use gcc/g++ 636/head
Sean Purcell [Wed, 29 Mar 2017 21:40:11 +0000 (14:40 -0700)] 
Make pzstd and cmake use gcc/g++

8 years agofix : minmatch 7 conversion
Yann Collet [Wed, 29 Mar 2017 21:32:15 +0000 (14:32 -0700)] 
fix : minmatch 7 conversion

minmatch 7 now converted to minmatch 6 for strategies which do not support 7
Used to folded into "default", which applied minmatch 4

8 years agoBuild windows releases on appveyor as artifacts
Sean Purcell [Wed, 29 Mar 2017 20:08:10 +0000 (13:08 -0700)] 
Build windows releases on appveyor as artifacts

8 years agoMerge pull request #635 from iburinoc/skipmagic
Yann Collet [Wed, 29 Mar 2017 19:16:53 +0000 (12:16 -0700)] 
Merge pull request #635 from iburinoc/skipmagic

Remove extra 'F' from skippable magic mask

8 years agofix : bench automatically adapts parameters to srcSize
Yann Collet [Wed, 29 Mar 2017 19:10:38 +0000 (12:10 -0700)] 
fix : bench automatically adapts parameters to srcSize

8 years agoRemove extra 'F' from skippable magic mask 635/head
Sean Purcell [Wed, 29 Mar 2017 18:46:57 +0000 (11:46 -0700)] 
Remove extra 'F' from skippable magic mask

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Mon, 27 Mar 2017 21:43:53 +0000 (14:43 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoMerge pull request #631 from facebook/LegacyDictBuilder
Yann Collet [Mon, 27 Mar 2017 21:42:52 +0000 (14:42 -0700)] 
Merge pull request #631 from facebook/LegacyDictBuilder

Legacy dict builder

8 years agoMerge pull request #633 from iburinoc/isatty
Yann Collet [Mon, 27 Mar 2017 21:32:21 +0000 (14:32 -0700)] 
Merge pull request #633 from iburinoc/isatty

Fix IS_CONSOLE returning 1 for NUL on windows

8 years agoFix inline compile errors 633/head
Sean Purcell [Mon, 27 Mar 2017 19:26:40 +0000 (12:26 -0700)] 
Fix inline compile errors

8 years agoFix IS_CONSOLE returning 1 for NUL on windows
Sean Purcell [Mon, 27 Mar 2017 19:19:30 +0000 (12:19 -0700)] 
Fix IS_CONSOLE returning 1 for NUL on windows

8 years agoImproved speed tests 632/head
Yann Collet [Mon, 27 Mar 2017 06:52:19 +0000 (23:52 -0700)] 
Improved speed tests

Better compatibility with Mac OS-X
Force attribution to a selected core # (Linux)

8 years agorestored bonus rule 631/head
Yann Collet [Sun, 26 Mar 2017 21:51:00 +0000 (14:51 -0700)] 
restored bonus rule

8 years agoMerge branch 'dev' into LegacyDictBuilder
Yann Collet [Sun, 26 Mar 2017 21:39:13 +0000 (14:39 -0700)] 
Merge branch 'dev' into LegacyDictBuilder

8 years agominor refactor
Yann Collet [Sun, 26 Mar 2017 09:59:13 +0000 (02:59 -0700)] 
minor refactor

add const
changed if for easier to add new conditions

8 years agofixed dictBuilder issue
Yann Collet [Sun, 26 Mar 2017 09:50:00 +0000 (02:50 -0700)] 
fixed dictBuilder issue

dictionary loading would fail during entropy analysis