]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
8 years agoRemove unnecessary dictID store 645/head
Nick Terrell [Tue, 4 Apr 2017 04:46:28 +0000 (21:46 -0700)] 
Remove unnecessary dictID store

8 years agoMake ZSTD_compress_usingCDict() respect contentSizeFlag
Nick Terrell [Tue, 4 Apr 2017 04:00:44 +0000 (21:00 -0700)] 
Make ZSTD_compress_usingCDict() respect contentSizeFlag

8 years agoFix ZSTD_initCStream_usingCDict() to use dictionary
Nick Terrell [Tue, 4 Apr 2017 03:56:39 +0000 (20:56 -0700)] 
Fix ZSTD_initCStream_usingCDict() to use dictionary

8 years agoMerge pull request #643 from facebook/zstdmt
Yann Collet [Tue, 4 Apr 2017 00:25:05 +0000 (17:25 -0700)] 
Merge pull request #643 from facebook/zstdmt

Optimize ZSTDMT_compress() memory usage

8 years agominor man update, for `overlapSize` 643/head
Yann Collet [Mon, 3 Apr 2017 21:57:24 +0000 (14:57 -0700)] 
minor man update, for `overlapSize`

8 years agoupdated documentation on multithreading modes
Yann Collet [Sat, 1 Apr 2017 07:36:31 +0000 (00:36 -0700)] 
updated documentation on multithreading modes

8 years agooptimize ZSTDMT_compress() memory usage
Yann Collet [Sat, 1 Apr 2017 01:27:03 +0000 (18:27 -0700)] 
optimize ZSTDMT_compress() memory usage

does no longer allocate temporary buffers
when there is enough room in dstBuffer to decompress directly there.
(previous method would skip that for 1st chunk only).

Also : fix ZSTD_compressBound() for small srcSize

8 years agoChanged ZSTD_compressBound()
Yann Collet [Sat, 1 Apr 2017 00:11:38 +0000 (17:11 -0700)] 
Changed ZSTD_compressBound()

required so that if Total = A+B
compressBound(Total) <= compressBound(A) + compressBound(B)
under condition of a minimum size for A and B

Will help for ZSTDMT_compress() memory allocation

8 years agoMerge branch 'dev' into zstdmt
Yann Collet [Fri, 31 Mar 2017 23:22:33 +0000 (16:22 -0700)] 
Merge branch 'dev' into zstdmt

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Fri, 31 Mar 2017 23:19:52 +0000 (16:19 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoMerge pull request #642 from terrelln/no-sparse
Yann Collet [Fri, 31 Mar 2017 23:19:46 +0000 (16:19 -0700)] 
Merge pull request #642 from terrelln/no-sparse

Turn off sparse mode for OS X by default

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Fri, 31 Mar 2017 23:19:33 +0000 (16:19 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agominor typo fixes in specification
Yann Collet [Fri, 31 Mar 2017 23:19:04 +0000 (16:19 -0700)] 
minor typo fixes in specification

8 years agoMerge pull request #640 from facebook/memAccess
Yann Collet [Fri, 31 Mar 2017 22:49:12 +0000 (15:49 -0700)] 
Merge pull request #640 from facebook/memAccess

Changed memory strategy to __packed for gcc

8 years agonumerous typos and clarifications in format specification
Yann Collet [Fri, 31 Mar 2017 17:54:45 +0000 (10:54 -0700)] 
numerous typos and clarifications in format specification

fix limit values of Window_Size
bump version to 0.2.5

8 years agoClean up default sparse logic 642/head
Nick Terrell [Fri, 31 Mar 2017 22:20:50 +0000 (15:20 -0700)] 
Clean up default sparse logic

8 years agoTurn off sparse mode for OS X by default
Nick Terrell [Fri, 31 Mar 2017 22:16:43 +0000 (15:16 -0700)] 
Turn off sparse mode for OS X by default

8 years agofixed minor warnings in debug code
Yann Collet [Thu, 30 Mar 2017 23:47:19 +0000 (16:47 -0700)] 
fixed minor warnings in debug code

8 years agooverlap at full windowSize for max compression level
Yann Collet [Thu, 30 Mar 2017 23:23:22 +0000 (16:23 -0700)] 
overlap at full windowSize for max compression level

as it provides max compression ratio

8 years agoimproved ZSTDMT_compress()
Yann Collet [Thu, 30 Mar 2017 22:51:58 +0000 (15:51 -0700)] 
improved ZSTDMT_compress()

Use a bit more threads by default.
Uses overlap segments to boost compression ratio (like the streaming variant)

8 years agoMerge pull request #637 from facebook/zstdmt
Yann Collet [Thu, 30 Mar 2017 21:18:37 +0000 (14:18 -0700)] 
Merge pull request #637 from facebook/zstdmt

Zstdmt

8 years agoChanged memory strategy to __packed for gcc 640/head
Yann Collet [Thu, 30 Mar 2017 19:52:14 +0000 (12:52 -0700)] 
Changed memory strategy to __packed for gcc

Method 1 __packed is always as good or better than memcpy().
But it's not portable, as it depends on compiler extension.

For gcc, __pakced directive works fine.
Furthermore, gcc has serious performance issues with memcpy() on ARM 32 bits.
See #620

8 years agocreated contrib/cleanTabs
Yann Collet [Thu, 30 Mar 2017 19:42:44 +0000 (12:42 -0700)] 
created contrib/cleanTabs

8 years agoMerge pull request #638 from terrelln/tabs
Yann Collet [Thu, 30 Mar 2017 19:32:40 +0000 (12:32 -0700)] 
Merge pull request #638 from terrelln/tabs

Convert all tabs to spaces

8 years agofixed Visual fuzzer project 637/head
Yann Collet [Thu, 30 Mar 2017 19:28:09 +0000 (12:28 -0700)] 
fixed Visual fuzzer project

8 years agofixed Visual Studio projects
Yann Collet [Thu, 30 Mar 2017 05:03:27 +0000 (22:03 -0700)] 
fixed Visual Studio projects

8 years agoConvert all tabs to spaces 638/head
Nick Terrell [Thu, 30 Mar 2017 01:51:58 +0000 (18:51 -0700)] 
Convert all tabs to spaces

8 years agore-added patch ...
Yann Collet [Thu, 30 Mar 2017 00:15:27 +0000 (17:15 -0700)] 
re-added patch ...

8 years agofixed #634 : ZSTDMT_compressCCtx() doesn't provide frame content size in header
Yann Collet [Thu, 30 Mar 2017 00:09:59 +0000 (17:09 -0700)] 
fixed #634 : ZSTDMT_compressCCtx() doesn't provide frame content size in header

8 years agoMerge pull request #636 from iburinoc/appveyor
Yann Collet [Thu, 30 Mar 2017 00:01:24 +0000 (17:01 -0700)] 
Merge pull request #636 from iburinoc/appveyor

Build windows releases on appveyor as artifacts

8 years agoadded ZSTD_getFrameContentSize() to ZSTDMT unit test in fuzzer
Yann Collet [Wed, 29 Mar 2017 23:58:57 +0000 (16:58 -0700)] 
added ZSTD_getFrameContentSize() to ZSTDMT unit test in fuzzer

Now tests fail, because ZSTDMT_compress() doesn't fill frame content size correctly.

8 years agoremoved unnecessary restriction on minmatchLength
Yann Collet [Wed, 29 Mar 2017 23:02:47 +0000 (16:02 -0700)] 
removed unnecessary restriction on minmatchLength

it's now transparently translated to nearest value when unsupported
(7->6) (3->4)

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Wed, 29 Mar 2017 22:21:30 +0000 (15:21 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoMake pzstd and cmake use gcc/g++ 636/head
Sean Purcell [Wed, 29 Mar 2017 21:40:11 +0000 (14:40 -0700)] 
Make pzstd and cmake use gcc/g++

8 years agofix : minmatch 7 conversion
Yann Collet [Wed, 29 Mar 2017 21:32:15 +0000 (14:32 -0700)] 
fix : minmatch 7 conversion

minmatch 7 now converted to minmatch 6 for strategies which do not support 7
Used to folded into "default", which applied minmatch 4

8 years agoBuild windows releases on appveyor as artifacts
Sean Purcell [Wed, 29 Mar 2017 20:08:10 +0000 (13:08 -0700)] 
Build windows releases on appveyor as artifacts

8 years agoMerge pull request #635 from iburinoc/skipmagic
Yann Collet [Wed, 29 Mar 2017 19:16:53 +0000 (12:16 -0700)] 
Merge pull request #635 from iburinoc/skipmagic

Remove extra 'F' from skippable magic mask

8 years agofix : bench automatically adapts parameters to srcSize
Yann Collet [Wed, 29 Mar 2017 19:10:38 +0000 (12:10 -0700)] 
fix : bench automatically adapts parameters to srcSize

8 years agoRemove extra 'F' from skippable magic mask 635/head
Sean Purcell [Wed, 29 Mar 2017 18:46:57 +0000 (11:46 -0700)] 
Remove extra 'F' from skippable magic mask

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Mon, 27 Mar 2017 21:43:53 +0000 (14:43 -0700)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agoMerge pull request #631 from facebook/LegacyDictBuilder
Yann Collet [Mon, 27 Mar 2017 21:42:52 +0000 (14:42 -0700)] 
Merge pull request #631 from facebook/LegacyDictBuilder

Legacy dict builder

8 years agoMerge pull request #633 from iburinoc/isatty
Yann Collet [Mon, 27 Mar 2017 21:32:21 +0000 (14:32 -0700)] 
Merge pull request #633 from iburinoc/isatty

Fix IS_CONSOLE returning 1 for NUL on windows

8 years agoFix inline compile errors 633/head
Sean Purcell [Mon, 27 Mar 2017 19:26:40 +0000 (12:26 -0700)] 
Fix inline compile errors

8 years agoFix IS_CONSOLE returning 1 for NUL on windows
Sean Purcell [Mon, 27 Mar 2017 19:19:30 +0000 (12:19 -0700)] 
Fix IS_CONSOLE returning 1 for NUL on windows

8 years agoImproved speed tests 632/head
Yann Collet [Mon, 27 Mar 2017 06:52:19 +0000 (23:52 -0700)] 
Improved speed tests

Better compatibility with Mac OS-X
Force attribution to a selected core # (Linux)

8 years agorestored bonus rule 631/head
Yann Collet [Sun, 26 Mar 2017 21:51:00 +0000 (14:51 -0700)] 
restored bonus rule

8 years agoMerge branch 'dev' into LegacyDictBuilder
Yann Collet [Sun, 26 Mar 2017 21:39:13 +0000 (14:39 -0700)] 
Merge branch 'dev' into LegacyDictBuilder

8 years agominor refactor
Yann Collet [Sun, 26 Mar 2017 09:59:13 +0000 (02:59 -0700)] 
minor refactor

add const
changed if for easier to add new conditions

8 years agofixed dictBuilder issue
Yann Collet [Sun, 26 Mar 2017 09:50:00 +0000 (02:50 -0700)] 
fixed dictBuilder issue

dictionary loading would fail during entropy analysis

8 years agofixed conversion warnings
Yann Collet [Sun, 26 Mar 2017 07:59:14 +0000 (00:59 -0700)] 
fixed conversion warnings

8 years agoMerge pull request #630 from facebook/advancedCliCommands
Yann Collet [Sun, 26 Mar 2017 07:13:35 +0000 (00:13 -0700)] 
Merge pull request #630 from facebook/advancedCliCommands

changed advanced commands --maxdict= and --dictID=

8 years agoMerge pull request #629 from iburinoc/exematch
Yann Collet [Sat, 25 Mar 2017 03:41:56 +0000 (20:41 -0700)] 
Merge pull request #629 from iburinoc/exematch

Ignore extension in command name matching

8 years agochanged test for new syntax 630/head
Yann Collet [Sat, 25 Mar 2017 01:36:56 +0000 (18:36 -0700)] 
changed test for new syntax

--dictID= and --maxdict=

8 years agominor improvement : remove duplicates with 1 char prefix difference
Yann Collet [Sat, 25 Mar 2017 00:56:45 +0000 (17:56 -0700)] 
minor improvement : remove duplicates with 1 char prefix difference

8 years agoMerge pull request #628 from facebook/dictBuilder_limits
Yann Collet [Sat, 25 Mar 2017 00:54:42 +0000 (17:54 -0700)] 
Merge pull request #628 from facebook/dictBuilder_limits

Ensure all limits derived from same constants

8 years agoIgnore extension in command name matching 629/head
Sean Purcell [Sat, 25 Mar 2017 00:06:09 +0000 (17:06 -0700)] 
Ignore extension in command name matching

8 years agoMerge pull request #627 from iburinoc/appveyor
Yann Collet [Fri, 24 Mar 2017 23:06:29 +0000 (16:06 -0700)] 
Merge pull request #627 from iburinoc/appveyor

Statically build and link zlib on appveyor

8 years agoMerge pull request #625 from facebook/loadCDict
Yann Collet [Fri, 24 Mar 2017 23:06:20 +0000 (16:06 -0700)] 
Merge pull request #625 from facebook/loadCDict

limited CDict acceptation criteria to be the same as DDict

8 years agochanged advanced commands --maxdict= and --dictID=
Yann Collet [Fri, 24 Mar 2017 23:04:29 +0000 (16:04 -0700)] 
changed advanced commands --maxdict= and --dictID=

now works with the `=` variant, which is the recommended one.
Old variant `--dictID #` still works, for compatibility with existing scripts.
Long term objective is to remove the old variant..

8 years agoEnsure all limits derived from same constants 628/head
Yann Collet [Fri, 24 Mar 2017 22:02:09 +0000 (15:02 -0700)] 
Ensure all limits derived from same constants

Now uses ZDICT_DICTSIZE_MIN and ZDICT_CONTENTSIZE_MIN
from zdict.h.

Also : reduced values to 256 and 128 respectively

8 years agoMerge pull request #626 from facebook/stricterDictBuilder
Yann Collet [Fri, 24 Mar 2017 21:27:28 +0000 (14:27 -0700)] 
Merge pull request #626 from facebook/stricterDictBuilder

dictBuilder fails to create dictionary on certain input

8 years agoStatically build and link zlib on appveyor 627/head
Sean Purcell [Fri, 24 Mar 2017 18:45:02 +0000 (11:45 -0700)] 
Statically build and link zlib on appveyor

8 years agofixed ZSTD_loadZstdDictionary() 625/head
Yann Collet [Fri, 24 Mar 2017 19:46:46 +0000 (12:46 -0700)] 
fixed ZSTD_loadZstdDictionary()

forgot to add the dictionary content
(tests were not failing, just compressing less).

Also : added size protections when adding dict content
since hc/bt table filling would fail if size < 8

8 years agofixed ERROR_GENERIC on dstSize_tooSmall
Yann Collet [Fri, 24 Mar 2017 00:59:50 +0000 (17:59 -0700)] 
fixed ERROR_GENERIC on dstSize_tooSmall

required by users which depends on this error code to size dest buffer

8 years agodictBuilder fails to create dictionary on certain input 626/head
Yann Collet [Thu, 23 Mar 2017 23:24:02 +0000 (16:24 -0700)] 
dictBuilder fails to create dictionary on certain input

Properly expressed with an error code (see zstd_errors.h)
and a cli return code != 0

8 years agolimited CDict acceptation criteria to be the same as DDict
Yann Collet [Thu, 23 Mar 2017 01:09:11 +0000 (18:09 -0700)] 
limited CDict acceptation criteria to be the same as DDict

8 years agoMerge pull request #623 from iburinoc/educational
Yann Collet [Thu, 23 Mar 2017 21:52:50 +0000 (14:52 -0700)] 
Merge pull request #623 from iburinoc/educational

Educational decoder polish updates

8 years agoMerge pull request #622 from iburinoc/symlink
Yann Collet [Thu, 23 Mar 2017 21:52:09 +0000 (14:52 -0700)] 
Merge pull request #622 from iburinoc/symlink

Match gzip behaviour on symbolic links and change g_displayLevel to int

8 years agoEducational decoder polish updates 623/head
Sean Purcell [Thu, 23 Mar 2017 21:33:38 +0000 (14:33 -0700)] 
Educational decoder polish updates

8 years agoAdd symbolic link checking to pzstd 622/head
Sean Purcell [Thu, 23 Mar 2017 19:41:51 +0000 (12:41 -0700)] 
Add symbolic link checking to pzstd

8 years agoFix displayLevel redefinition issues
Sean Purcell [Thu, 23 Mar 2017 19:09:35 +0000 (12:09 -0700)] 
Fix displayLevel redefinition issues

8 years agoIgnore symbolic links unless --force specified
Sean Purcell [Thu, 23 Mar 2017 18:52:09 +0000 (11:52 -0700)] 
Ignore symbolic links unless --force specified

8 years agoChange g_displayLevel to int and fix DISPLAYUPDATE flush
Sean Purcell [Thu, 23 Mar 2017 18:13:52 +0000 (11:13 -0700)] 
Change g_displayLevel to int and fix DISPLAYUPDATE flush

8 years agoMerge pull request #621 from terrelln/zlib-flags
Yann Collet [Wed, 22 Mar 2017 22:33:29 +0000 (15:33 -0700)] 
Merge pull request #621 from terrelln/zlib-flags

Add $(FLAGS) when testing for zlib/lzma support.

8 years agoAdd $(EXT) to binary to fix zlib detection for some MinGW versions 621/head
Nick Terrell [Wed, 22 Mar 2017 20:24:52 +0000 (13:24 -0700)] 
Add $(EXT) to binary to fix zlib detection for some MinGW versions

8 years agoAdd $(FLAGS) when testing for zlib/lzma support.
Nick Terrell [Wed, 22 Mar 2017 19:33:08 +0000 (12:33 -0700)] 
Add $(FLAGS) when testing for zlib/lzma support.

* If zlib/lzma isn't in the usual spot, it won't be used,
  even if `$CFLAGS` and `$LDFLAGS` add the location it is in.
* Update the test code snippets to not trigger any warnings.

8 years agoMerge pull request #619 from iburinoc/educational
Yann Collet [Wed, 22 Mar 2017 17:28:52 +0000 (10:28 -0700)] 
Merge pull request #619 from iburinoc/educational

Educational decoder: Clarify IO_rewind_bits

8 years agoMerge pull request #614 from iburinoc/appveyor
Yann Collet [Wed, 22 Mar 2017 17:28:33 +0000 (10:28 -0700)] 
Merge pull request #614 from iburinoc/appveyor

Update appveyor.yml to have short and long tests

8 years agoupdated .gitignore for new cmake script
Yann Collet [Wed, 22 Mar 2017 00:52:42 +0000 (17:52 -0700)] 
updated .gitignore for new cmake script

8 years agoEducational decoder: Some more minor clarity fixes 619/head
Sean Purcell [Wed, 22 Mar 2017 00:01:51 +0000 (17:01 -0700)] 
Educational decoder: Some more minor clarity fixes

8 years agoEducational decoder: Clarify IO_rewind_bits
Sean Purcell [Tue, 21 Mar 2017 22:03:23 +0000 (15:03 -0700)] 
Educational decoder: Clarify IO_rewind_bits

8 years agoMerge pull request #618 from terrelln/zero-buffers
Yann Collet [Tue, 21 Mar 2017 21:28:13 +0000 (14:28 -0700)] 
Merge pull request #618 from terrelln/zero-buffers

Zero pointers after freeing

8 years agoAttempt to fix FUZZERTEST variable set and remove appveyor_old.yml 614/head
Sean Purcell [Tue, 21 Mar 2017 21:21:00 +0000 (14:21 -0700)] 
Attempt to fix FUZZERTEST variable set and remove appveyor_old.yml

8 years agoMerge pull request #616 from iburinoc/cmake
Yann Collet [Tue, 21 Mar 2017 21:01:42 +0000 (14:01 -0700)] 
Merge pull request #616 from iburinoc/cmake

CMake: Fix version parsing and allow Unix flags on Clang

8 years agoCMake: Fix version parsing and allow Unix flags on Clang 616/head
Sean Purcell [Tue, 21 Mar 2017 20:44:33 +0000 (13:44 -0700)] 
CMake: Fix version parsing and allow Unix flags on Clang

8 years agoZero pointers after freeing 618/head
Nick Terrell [Tue, 21 Mar 2017 20:20:59 +0000 (13:20 -0700)] 
Zero pointers after freeing

8 years agobump version number
Yann Collet [Tue, 21 Mar 2017 19:18:28 +0000 (12:18 -0700)] 
bump version number

8 years agoMerge pull request #611 from Majlen/cmake-improvement
Yann Collet [Tue, 21 Mar 2017 18:23:27 +0000 (11:23 -0700)] 
Merge pull request #611 from Majlen/cmake-improvement

Further cmake improvement

8 years agoFix msvc fuzzer test runtime
Sean Purcell [Tue, 21 Mar 2017 18:19:48 +0000 (11:19 -0700)] 
Fix msvc fuzzer test runtime

8 years agoMerge remote-tracking branch 'origin/dev' into appveyor
Sean Purcell [Tue, 21 Mar 2017 17:59:54 +0000 (10:59 -0700)] 
Merge remote-tracking branch 'origin/dev' into appveyor

8 years agoRemove multithreading support by default on non UNIX platforms 611/head
Milan Ševčík [Tue, 21 Mar 2017 12:00:05 +0000 (13:00 +0100)] 
Remove multithreading support by default on non UNIX platforms

8 years agoInstall zstdcat and unzstd symlinks by cmake
Milan Ševčík [Mon, 20 Mar 2017 21:58:02 +0000 (22:58 +0100)] 
Install zstdcat and unzstd symlinks by cmake

8 years agoAdd build of new cmake branches to Makefile
Milan Ševčík [Mon, 20 Mar 2017 14:57:08 +0000 (15:57 +0100)] 
Add build of new cmake branches to Makefile

8 years agoAdded options for building programs, static library and tests
Milan Ševčík [Mon, 20 Mar 2017 14:47:28 +0000 (15:47 +0100)] 
Added options for building programs, static library and tests

8 years agoInstall forgotten zstdmt tool and zstd.1 man page
Milan Ševčík [Mon, 20 Mar 2017 14:47:02 +0000 (15:47 +0100)] 
Install forgotten zstdmt tool and zstd.1 man page

8 years agoAdd_extra_compilation_flags macro needs to run before adding sources
Milan Ševčík [Fri, 17 Mar 2017 14:36:37 +0000 (15:36 +0100)] 
Add_extra_compilation_flags macro needs to run before adding sources

Also adding comments in the top-level CMakeLists.txt

8 years agoTest new cmake stuff
Milan Ševčík [Fri, 17 Mar 2017 13:42:44 +0000 (14:42 +0100)] 
Test new cmake stuff

8 years agoCheck for pthreads library
Milan Ševčík [Fri, 17 Mar 2017 13:27:01 +0000 (14:27 +0100)] 
Check for pthreads library

8 years agoMuch easier way of installing libraries with correct names
Milan Ševčík [Fri, 17 Mar 2017 13:14:46 +0000 (14:14 +0100)] 
Much easier way of installing libraries with correct names

8 years agoInstall everything, not only libraries
Milan Ševčík [Fri, 17 Mar 2017 13:13:47 +0000 (14:13 +0100)] 
Install everything, not only libraries