]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
9 years agoExpose function to add entropy tables to pre-built dictionary. 194/head
Giuseppe Ottaviano [Tue, 31 May 2016 01:49:58 +0000 (18:49 -0700)] 
Expose function to add entropy tables to pre-built dictionary.

In some cases a custom dictionary building algorithm tailored for a specific
input can be more effective than the one produced by `ZDICT_trainFromBuffer`,
but with the current API it's not possible encode the entropy tables into the
custom-built dictionary.

This commit extracts the logic to add entropy tables to a dictionary from
`ZDICT_trainFromBuffer` and exposes it as a function
`ZDICT_addEntropyTablesFromBuffer`.

9 years agoAdded : ability to create compressed frames without dictID
Yann Collet [Tue, 31 May 2016 00:29:45 +0000 (02:29 +0200)] 
Added : ability to create compressed frames without dictID

9 years agofixed minor conversion warning
Yann Collet [Mon, 30 May 2016 20:29:45 +0000 (22:29 +0200)] 
fixed minor conversion warning

9 years agoAdded : ability to manually select the dictionary ID of a newly created dictionary
Yann Collet [Mon, 30 May 2016 19:18:52 +0000 (21:18 +0200)] 
Added : ability to manually select the dictionary ID of a newly created dictionary

9 years agoadded `cmake --version` to check cmake version on Travis
Yann Collet [Mon, 30 May 2016 16:57:39 +0000 (18:57 +0200)] 
added `cmake --version` to check cmake version on Travis

9 years agofixed cmaketest
Yann Collet [Mon, 30 May 2016 16:50:28 +0000 (18:50 +0200)] 
fixed cmaketest

9 years agoFixed visual projects
cyan [Mon, 30 May 2016 16:20:46 +0000 (18:20 +0200)] 
Fixed visual projects

Signed-off-by: Yann Collet <yann.collet.73@gmail.com>
9 years agofuzzer tests dictBuilder.
Yann Collet [Mon, 30 May 2016 14:17:33 +0000 (16:17 +0200)] 
fuzzer tests dictBuilder.
Added : ability to not store dictID during compression; decompression doesn't check dictID then

9 years agominor refactoring
Yann Collet [Mon, 30 May 2016 13:10:09 +0000 (15:10 +0200)] 
minor refactoring

9 years agoMerge branch 'dev' into dev070
Yann Collet [Mon, 30 May 2016 12:06:44 +0000 (14:06 +0200)] 
Merge branch 'dev' into dev070

9 years agoUpdated NEWS with @inikep's work
Yann Collet [Mon, 30 May 2016 12:05:44 +0000 (14:05 +0200)] 
Updated NEWS with @inikep's work

9 years agominor code refactoring
Yann Collet [Sun, 29 May 2016 23:56:08 +0000 (01:56 +0200)] 
minor code refactoring

9 years agoadded fuzzer test for `ZSTD_compressBegin_advanced()`
Yann Collet [Sun, 29 May 2016 23:42:05 +0000 (01:42 +0200)] 
added fuzzer test for `ZSTD_compressBegin_advanced()`

9 years agocommented versionsTest, which won't succeed while legacy 0.6 is missing
Yann Collet [Sun, 29 May 2016 23:12:13 +0000 (01:12 +0200)] 
commented versionsTest, which won't succeed while legacy 0.6 is missing

9 years agofixed fuzzer dictionary test
Yann Collet [Sun, 29 May 2016 21:09:51 +0000 (23:09 +0200)] 
fixed fuzzer dictionary test

9 years agorestored zstdcli.c
Yann Collet [Sun, 29 May 2016 03:16:05 +0000 (05:16 +0200)] 
restored zstdcli.c

9 years agoadded dictionary ID (incomplete)
Yann Collet [Sun, 29 May 2016 03:01:04 +0000 (05:01 +0200)] 
added dictionary ID (incomplete)

9 years agofixed cmake
Yann Collet [Sun, 29 May 2016 00:02:24 +0000 (02:02 +0200)] 
fixed cmake
fixed playTests

9 years agoSimplified list of `*.c` files
Yann Collet [Sat, 28 May 2016 23:39:19 +0000 (01:39 +0200)] 
Simplified list of `*.c` files

9 years agomoved xxhash to lib/common
Yann Collet [Sat, 28 May 2016 23:06:30 +0000 (01:06 +0200)] 
moved xxhash to lib/common

9 years agoMerge pull request #192 from Cyan4973/dev
Yann Collet [Sat, 28 May 2016 22:41:36 +0000 (00:41 +0200)] 
Merge pull request #192 from Cyan4973/dev

updated xxhash

9 years agofixed makefile error in clean target 192/head
Yann Collet [Sat, 28 May 2016 14:06:29 +0000 (16:06 +0200)] 
fixed makefile error in clean target

9 years agoAdded : utility `roundTripCrash`
Yann Collet [Sat, 28 May 2016 13:30:01 +0000 (15:30 +0200)] 
Added : utility `roundTripCrash`
which generates a crash (double-free) on detecting a round-trip corruption

9 years agoupdated xxhash to latest "dev" version
Yann Collet [Sat, 28 May 2016 11:34:07 +0000 (13:34 +0200)] 
updated xxhash to latest "dev" version

9 years agoMerge branch 'dev' of github.com:Cyan4973/zstd into dev
Yann Collet [Wed, 25 May 2016 21:51:59 +0000 (23:51 +0200)] 
Merge branch 'dev' of github.com:Cyan4973/zstd into dev

9 years agoMerge pull request #191 from inikep/dev
Yann Collet [Wed, 25 May 2016 21:42:44 +0000 (23:42 +0200)] 
Merge pull request #191 from inikep/dev

AppVeyor tests

9 years agofixed Visual Studio warning 191/head
inikep [Wed, 25 May 2016 15:40:58 +0000 (17:40 +0200)] 
fixed Visual Studio warning

9 years agozstdcli: -r (operate recursively on directories) works with dictBuilder and compression
inikep [Wed, 25 May 2016 13:30:55 +0000 (15:30 +0200)] 
zstdcli: -r (operate recursively on directories) works with dictBuilder and compression

9 years agousage of fileno() only on POSIX and Windows
inikep [Wed, 25 May 2016 10:41:41 +0000 (12:41 +0200)] 
usage of fileno() only on POSIX and Windows

9 years agoZBUFF_createCCtx_advanced moved to zbuff_static.h
inikep [Wed, 25 May 2016 09:31:16 +0000 (11:31 +0200)] 
ZBUFF_createCCtx_advanced moved to zbuff_static.h

9 years agominor linter modifications
Yann Collet [Wed, 25 May 2016 08:58:11 +0000 (10:58 +0200)] 
minor linter modifications

9 years agoplayTests.sh joined with playTestsMSYS.sh
inikep [Wed, 25 May 2016 08:50:28 +0000 (10:50 +0200)] 
playTests.sh joined with playTestsMSYS.sh

9 years agocleaner versionsTest script and output
Yann Collet [Wed, 25 May 2016 08:12:39 +0000 (10:12 +0200)] 
cleaner versionsTest script and output

9 years agoplayTests updated with Pass-Through mode
inikep [Tue, 24 May 2016 16:22:38 +0000 (18:22 +0200)] 
playTests updated with Pass-Through mode

9 years agoCMake project moved to projects
inikep [Tue, 24 May 2016 15:44:14 +0000 (17:44 +0200)] 
CMake project moved to projects

9 years agoMerge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
inikep [Tue, 24 May 2016 15:15:04 +0000 (17:15 +0200)] 
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev

9 years agoMerge remote-tracking branch 'refs/remotes/origin/playTests' into dev
inikep [Tue, 24 May 2016 13:45:29 +0000 (15:45 +0200)] 
Merge remote-tracking branch 'refs/remotes/origin/playTests' into dev

9 years agoMerge remote-tracking branch 'refs/remotes/origin/playTests' into dev
inikep [Tue, 24 May 2016 13:38:52 +0000 (15:38 +0200)] 
Merge remote-tracking branch 'refs/remotes/origin/playTests' into dev

9 years agozstd_stats.h included only in debug mode
inikep [Tue, 24 May 2016 13:36:37 +0000 (15:36 +0200)] 
zstd_stats.h included only in debug mode

9 years agozbufftest.c: tests for ZBUFF_createCCtx_advanced/ZBUFF_createDCtx_advanced
inikep [Tue, 24 May 2016 13:35:48 +0000 (15:35 +0200)] 
zbufftest.c: tests for ZBUFF_createCCtx_advanced/ZBUFF_createDCtx_advanced

9 years agofullbench: tests for ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced
inikep [Tue, 24 May 2016 08:57:14 +0000 (10:57 +0200)] 
fullbench: tests for ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced

9 years agofixed minor conversion warning
Yann Collet [Mon, 23 May 2016 22:52:14 +0000 (00:52 +0200)] 
fixed minor conversion warning

9 years agoPass-Through mode support (using `-df`), for compatibility with gzip
Yann Collet [Mon, 23 May 2016 17:46:47 +0000 (19:46 +0200)] 
Pass-Through mode support (using `-df`), for compatibility with gzip

9 years agoAdded tests for Sparse mode support
Yann Collet [Mon, 23 May 2016 15:48:57 +0000 (17:48 +0200)] 
Added tests for Sparse mode support
Fixed : complex cli arg case involving a mix of `stdin` and `-o`

9 years agoadded ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced
inikep [Mon, 23 May 2016 15:04:23 +0000 (17:04 +0200)] 
added ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced

9 years agoAdded : Sparse write support
Yann Collet [Mon, 23 May 2016 14:56:56 +0000 (16:56 +0200)] 
Added : Sparse write support
--[no-]sparse command

9 years agoadded ZSTD_createDCtx_advanced
inikep [Mon, 23 May 2016 14:24:52 +0000 (16:24 +0200)] 
added ZSTD_createDCtx_advanced

9 years agoadded ZSTD_createCCtx_advanced
inikep [Mon, 23 May 2016 13:49:09 +0000 (15:49 +0200)] 
added ZSTD_createCCtx_advanced

9 years agomore portable DEVNULL definition
Yann Collet [Mon, 23 May 2016 13:43:17 +0000 (15:43 +0200)] 
more portable DEVNULL definition

9 years agocleaner script output
Yann Collet [Mon, 23 May 2016 13:04:14 +0000 (15:04 +0200)] 
cleaner script output

9 years agoAdded : new cross-version test : check new versions can decode older ones
Yann Collet [Mon, 23 May 2016 12:23:55 +0000 (14:23 +0200)] 
Added : new cross-version test : check new versions can decode older ones

9 years agoMerge pull request #189 from thatsafunnyname/patch-2
Yann Collet [Sat, 21 May 2016 13:21:21 +0000 (15:21 +0200)] 
Merge pull request #189 from thatsafunnyname/patch-2

Minor changes needed for OpenVMS

9 years agoMinor changes needed for OpenVMS 189/head
Peter (Stig) Edwards [Sat, 21 May 2016 11:15:48 +0000 (12:15 +0100)] 
Minor changes needed for OpenVMS

Define util sleep functions on VMS.
If PRIO_PROCESS is not defined then do not attempt to use it in the definition of SET_HIGH_PRIORITY.

9 years agozstd_stats.h updated to v0.6
inikep [Fri, 20 May 2016 17:42:20 +0000 (19:42 +0200)] 
zstd_stats.h updated to v0.6

9 years agohuff0 dynamic reduction
Yann Collet [Fri, 20 May 2016 12:36:36 +0000 (14:36 +0200)] 
huff0 dynamic reduction

9 years agoall programs use `ZSTD_VERSION_STRING` from `zstd.h` to display their version
Yann Collet [Fri, 20 May 2016 10:34:40 +0000 (12:34 +0200)] 
all programs use `ZSTD_VERSION_STRING` from `zstd.h` to display their version

9 years agochanged version to 0.6.2
Yann Collet [Fri, 20 May 2016 10:20:12 +0000 (12:20 +0200)] 
changed version to 0.6.2
removed make-controlled version (now used from zstd.h)
removed std=c99 by default
added : c90/gno90/c99/gnu99/c11 tests

9 years agominor refactoring
Yann Collet [Fri, 20 May 2016 09:44:43 +0000 (11:44 +0200)] 
minor refactoring

9 years agominor simplification
Yann Collet [Fri, 20 May 2016 09:24:35 +0000 (11:24 +0200)] 
minor simplification

9 years agoAppVeyor tests use playTests.bat
inikep [Thu, 19 May 2016 13:50:58 +0000 (15:50 +0200)] 
AppVeyor tests use playTests.bat

9 years agoadded datagen in Visual Studio project
inikep [Thu, 19 May 2016 10:16:14 +0000 (12:16 +0200)] 
added datagen in Visual Studio project

9 years agofixed compression with -c with multiple files on Windows
inikep [Thu, 19 May 2016 08:29:49 +0000 (10:29 +0200)] 
fixed compression with -c with multiple files on Windows

9 years agoadded playTests.bat
inikep [Wed, 18 May 2016 16:05:56 +0000 (18:05 +0200)] 
added playTests.bat

9 years agoupdate file permission
inikep [Wed, 18 May 2016 16:04:10 +0000 (18:04 +0200)] 
update file permission

9 years agochanged appveyor.yml
inikep [Wed, 18 May 2016 16:03:02 +0000 (18:03 +0200)] 
changed appveyor.yml

9 years agofixed minor conversion warnings
Yann Collet [Wed, 18 May 2016 15:26:23 +0000 (17:26 +0200)] 
fixed minor conversion warnings

9 years agoremoved msan tests
Yann Collet [Wed, 18 May 2016 15:18:48 +0000 (17:18 +0200)] 
removed msan tests

9 years agoadded playTestsMSYS.sh
inikep [Wed, 18 May 2016 14:38:36 +0000 (16:38 +0200)] 
added playTestsMSYS.sh

9 years agoadded memory sanitizer to travis CI
Yann Collet [Wed, 18 May 2016 12:16:49 +0000 (14:16 +0200)] 
added memory sanitizer to travis CI

9 years agoreverted default compression level to 1
Yann Collet [Wed, 18 May 2016 10:06:33 +0000 (12:06 +0200)] 
reverted default compression level to 1

9 years agoAppVeyor tests for mingw32, mingw64, clang
inikep [Wed, 18 May 2016 07:07:28 +0000 (09:07 +0200)] 
AppVeyor tests for mingw32, mingw64, clang

9 years agofixed Visual warning in debug mode
Yann Collet [Tue, 17 May 2016 12:30:19 +0000 (14:30 +0200)] 
fixed Visual warning in debug mode

9 years agoMerge branch 'dev' of github.com:Cyan4973/zstd into dev
Yann Collet [Tue, 17 May 2016 10:02:35 +0000 (12:02 +0200)] 
Merge branch 'dev' of github.com:Cyan4973/zstd into dev

9 years agoadded `ZSTDv05_getFrameParams()` to "zstd_v05.h"
Yann Collet [Tue, 17 May 2016 10:01:55 +0000 (12:01 +0200)] 
added `ZSTDv05_getFrameParams()` to "zstd_v05.h"

9 years agoMerge pull request #187 from ka7/spelling_fix
Yann Collet [Mon, 16 May 2016 22:56:18 +0000 (00:56 +0200)] 
Merge pull request #187 from ka7/spelling_fix

spelling-fixes, as of lintian.debian.org

9 years agospelling-fixes, as of lintian.debian.org 187/head
klemens [Mon, 16 May 2016 20:23:24 +0000 (22:23 +0200)] 
spelling-fixes, as of lintian.debian.org

9 years agofixed Win32 in AppVeyor
inikep [Mon, 16 May 2016 13:10:33 +0000 (15:10 +0200)] 
fixed Win32 in AppVeyor

9 years agoupdated .gitignore for Visual Studio
inikep [Mon, 16 May 2016 12:54:48 +0000 (14:54 +0200)] 
updated .gitignore for Visual Studio

9 years agoadded Visual Studio 2008 and 2010 projects
inikep [Mon, 16 May 2016 12:48:04 +0000 (14:48 +0200)] 
added Visual Studio 2008 and 2010 projects

9 years agoVisual Studio: remove MSVC*.DLL dependency from Release executables
inikep [Fri, 13 May 2016 11:04:27 +0000 (13:04 +0200)] 
Visual Studio: remove MSVC*.DLL dependency from Release executables

9 years agorestore openVMS support (detected by @thatsafunnyname) 186/head
Yann Collet [Fri, 13 May 2016 10:43:36 +0000 (12:43 +0200)] 
restore openVMS support (detected by @thatsafunnyname)

9 years agoMerge pull request #185 from inikep/dev
Yann Collet [Fri, 13 May 2016 10:40:02 +0000 (12:40 +0200)] 
Merge pull request #185 from inikep/dev

Dev

9 years agoMerge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 185/head
inikep [Fri, 13 May 2016 10:06:36 +0000 (12:06 +0200)] 
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev

9 years agoupdated NEWS for v0.6.1
Yann Collet [Fri, 13 May 2016 09:29:38 +0000 (11:29 +0200)] 
updated NEWS for v0.6.1

9 years agoadded common/entropy_common.c 184/head
inikep [Fri, 13 May 2016 09:27:56 +0000 (11:27 +0200)] 
added common/entropy_common.c

9 years agoMerge pull request #183 from inikep/dev
Yann Collet [Fri, 13 May 2016 09:24:14 +0000 (11:24 +0200)] 
Merge pull request #183 from inikep/dev

added zlibWrapper - zstd wrapper for zlib

9 years agoMerge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
inikep [Fri, 13 May 2016 09:05:35 +0000 (11:05 +0200)] 
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev

9 years agochanged definition of UTIL_createFileList 183/head
inikep [Fri, 13 May 2016 08:52:02 +0000 (10:52 +0200)] 
changed definition of UTIL_createFileList

9 years agoupdated zlibWrapper/README.md (2)
inikep [Thu, 12 May 2016 15:32:28 +0000 (17:32 +0200)] 
updated zlibWrapper/README.md (2)

9 years agoupdated zlibWrapper/README.md
inikep [Thu, 12 May 2016 15:28:57 +0000 (17:28 +0200)] 
updated zlibWrapper/README.md

9 years agoadded zlibWrapper - zstd wrapper for zlib
inikep [Thu, 12 May 2016 15:15:41 +0000 (17:15 +0200)] 
added zlibWrapper - zstd wrapper for zlib

9 years agoimproved decoding speed by inlining x_isError() functions
Yann Collet [Thu, 12 May 2016 13:55:26 +0000 (15:55 +0200)] 
improved decoding speed by inlining x_isError() functions

9 years agominor refactor : more accurate variable scope
Yann Collet [Thu, 12 May 2016 12:27:00 +0000 (14:27 +0200)] 
minor refactor : more accurate variable scope

9 years agorestored inline for better decompression speed
Yann Collet [Thu, 12 May 2016 12:06:31 +0000 (14:06 +0200)] 
restored inline for better decompression speed

9 years agorestored DStream init
Yann Collet [Thu, 12 May 2016 11:50:13 +0000 (13:50 +0200)] 
restored DStream init
due to strange speed regressions and warnins on gcc 5.3

9 years agofixed clang conversion warning
Yann Collet [Wed, 11 May 2016 16:55:27 +0000 (18:55 +0200)] 
fixed clang conversion warning

9 years agoupdate FSE library
Yann Collet [Wed, 11 May 2016 16:30:24 +0000 (18:30 +0200)] 
update FSE library

9 years agobetter big-endian / little-endian r/w support
Yann Collet [Wed, 11 May 2016 14:38:18 +0000 (16:38 +0200)] 
better big-endian / little-endian r/w support

9 years agodynamic memory allocation in UTIL_createFileList
inikep [Wed, 11 May 2016 12:11:00 +0000 (14:11 +0200)] 
dynamic memory allocation in UTIL_createFileList

9 years agodatagencli uses `mem.h`
Yann Collet [Wed, 11 May 2016 09:42:51 +0000 (11:42 +0200)] 
datagencli uses `mem.h`