]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
8 years agoecho replaced with printf 533/head
Przemyslaw Skibinski [Thu, 9 Feb 2017 16:01:17 +0000 (17:01 +0100)] 
echo replaced with printf

8 years agodon't use "echo -e"
Przemyslaw Skibinski [Thu, 9 Feb 2017 10:32:14 +0000 (11:32 +0100)] 
don't use "echo -e"

8 years agoMerge branch 'dev' into dev11
Przemyslaw Skibinski [Thu, 9 Feb 2017 08:42:16 +0000 (09:42 +0100)] 
Merge branch 'dev' into dev11

8 years agoMerge pull request #535 from terrelln/tests 539/head
Yann Collet [Thu, 9 Feb 2017 08:36:03 +0000 (00:36 -0800)] 
Merge pull request #535 from terrelln/tests

Remove test-longmatch from test target and only run it once

8 years agoremove redundant "ifeq ($(HAVE_ZLIB), 1)"
Przemyslaw Skibinski [Wed, 8 Feb 2017 20:11:18 +0000 (21:11 +0100)] 
remove redundant "ifeq ($(HAVE_ZLIB), 1)"

8 years agoRemove test-longmatch from test target and only run it once 535/head
Nick Terrell [Wed, 8 Feb 2017 20:00:21 +0000 (12:00 -0800)] 
Remove test-longmatch from test target and only run it once

8 years agofixed zlib detection with MinGW
Przemyslaw Skibinski [Wed, 8 Feb 2017 13:32:49 +0000 (14:32 +0100)] 
fixed zlib detection with MinGW

8 years agoturn off test-pool for qemu-ppc64-static
Przemyslaw Skibinski [Wed, 8 Feb 2017 12:58:04 +0000 (13:58 +0100)] 
turn off test-pool for qemu-ppc64-static

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Wed, 8 Feb 2017 12:49:35 +0000 (13:49 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agoadded description of "--priority=rt"
Przemyslaw Skibinski [Wed, 8 Feb 2017 12:49:06 +0000 (13:49 +0100)] 
added description of "--priority=rt"

8 years agoMerge pull request #526 from iburinoc/educational
Yann Collet [Tue, 7 Feb 2017 23:34:33 +0000 (15:34 -0800)] 
Merge pull request #526 from iburinoc/educational

Add educational decoder to /contrib

8 years agoMinor changes to educational decoder 526/head
Sean Purcell [Tue, 7 Feb 2017 22:44:11 +0000 (14:44 -0800)] 
Minor changes to educational decoder

8 years agocompleted NEWS for v1.1.3
Yann Collet [Tue, 7 Feb 2017 20:05:28 +0000 (12:05 -0800)] 
completed NEWS for v1.1.3

8 years agoMerge pull request #534 from terrelln/dev
Yann Collet [Tue, 7 Feb 2017 19:58:59 +0000 (11:58 -0800)] 
Merge pull request #534 from terrelln/dev

Attribute cover dictionary code

8 years agoAttribute cover dictionary code 534/head
Nick Terrell [Tue, 7 Feb 2017 19:35:07 +0000 (11:35 -0800)] 
Attribute cover dictionary code

8 years ago"--rt-prio" renamed to "--priority=rt"
Przemyslaw Skibinski [Tue, 7 Feb 2017 19:12:59 +0000 (20:12 +0100)] 
"--rt-prio" renamed to "--priority=rt"

8 years agoadded the "--rt-prio" option
Przemyslaw Skibinski [Tue, 7 Feb 2017 15:48:01 +0000 (16:48 +0100)] 
added the "--rt-prio" option

8 years agoSET_REALTIME_PRIORITY
Przemyslaw Skibinski [Tue, 7 Feb 2017 15:36:19 +0000 (16:36 +0100)] 
SET_REALTIME_PRIORITY

8 years agoMerge branch 'dev' of github.com:facebook/zstd into dev
Yann Collet [Tue, 7 Feb 2017 01:40:38 +0000 (17:40 -0800)] 
Merge branch 'dev' of github.com:facebook/zstd into dev

8 years agocorrected contributor's name
Yann Collet [Tue, 7 Feb 2017 01:39:54 +0000 (17:39 -0800)] 
corrected contributor's name

8 years agoMerge pull request #532 from terrelln/zlib
Yann Collet [Mon, 6 Feb 2017 22:44:23 +0000 (14:44 -0800)] 
Merge pull request #532 from terrelln/zlib

Change zlib include to be a system include

8 years agoEnsure <zlib.h> can be included in HAVE_ZLIB test 532/head
Nick Terrell [Mon, 6 Feb 2017 19:54:31 +0000 (11:54 -0800)] 
Ensure <zlib.h> can be included in HAVE_ZLIB test

8 years agoChange zlib include to be a system include
Nick Terrell [Mon, 6 Feb 2017 19:32:13 +0000 (11:32 -0800)] 
Change zlib include to be a system include

8 years agoplatform.h added to build_package.bat
Przemyslaw Skibinski [Mon, 6 Feb 2017 18:43:13 +0000 (19:43 +0100)] 
platform.h added to build_package.bat

8 years agochanged download URL for github_users sample set
Yann Collet [Mon, 6 Feb 2017 18:01:06 +0000 (10:01 -0800)] 
changed download URL for github_users sample set

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Mon, 6 Feb 2017 10:21:51 +0000 (11:21 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agoupdated NEWS for v1.1.3 531/head
Yann Collet [Mon, 6 Feb 2017 02:09:35 +0000 (18:09 -0800)] 
updated NEWS for v1.1.3

8 years agoMerge pull request #529 from facebook/gzstd_default
Yann Collet [Mon, 6 Feb 2017 02:03:36 +0000 (18:03 -0800)] 
Merge pull request #529 from facebook/gzstd_default

Gzstd default

8 years agofixed Mac OS-X specific directory in $(RM) list 529/head
Yann Collet [Sun, 5 Feb 2017 18:22:58 +0000 (10:22 -0800)] 
fixed Mac OS-X specific directory in $(RM) list

these directories are now removed with -r command

8 years agoSilence zlib detection routine
cyan4973 [Sun, 5 Feb 2017 07:36:12 +0000 (23:36 -0800)] 
Silence zlib detection routine

When it fails, $(CC) sends error message into stderr
redirected to /dev/null

8 years agoremoved gzstd test from travis
cyan4973 [Sun, 5 Feb 2017 05:39:41 +0000 (21:39 -0800)] 
removed gzstd test from travis

this target does no longer exist

8 years agoInlined portions of specification for clarity
Sean Purcell [Sat, 4 Feb 2017 02:04:00 +0000 (18:04 -0800)] 
Inlined portions of specification for clarity

8 years agoMerge pull request #530 from terrelln/cover-man
Yann Collet [Sat, 4 Feb 2017 01:10:06 +0000 (17:10 -0800)] 
Merge pull request #530 from terrelln/cover-man

Add cover dictionary training to zstd.1

8 years agoAdd cover dictionary training to zstd.1 530/head
Nick Terrell [Sat, 4 Feb 2017 00:42:07 +0000 (16:42 -0800)] 
Add cover dictionary training to zstd.1

Tested with `make install && man zstd` and visual inspection.

8 years agoSwitch IO to go through streams
Sean Purcell [Thu, 2 Feb 2017 01:05:45 +0000 (17:05 -0800)] 
Switch IO to go through streams

8 years agofixed zstdmt compilation under Windows minGW/MSYS2, by @inikep
Yann Collet [Fri, 3 Feb 2017 22:35:42 +0000 (14:35 -0800)] 
fixed zstdmt compilation under Windows minGW/MSYS2, by @inikep

8 years agoremove zlib detection artefact
Yann Collet [Fri, 3 Feb 2017 22:25:07 +0000 (14:25 -0800)] 
remove zlib detection artefact

result of compilation test is sent to /dev/null

8 years agofixed pointer conversion warnings (C++)
Yann Collet [Fri, 3 Feb 2017 16:43:06 +0000 (08:43 -0800)] 
fixed pointer conversion warnings (C++)

in gz module

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Fri, 3 Feb 2017 10:03:00 +0000 (11:03 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agorelease builds use less debug symbols and warnings
Yann Collet [Fri, 3 Feb 2017 04:54:14 +0000 (20:54 -0800)] 
release builds use less debug symbols and warnings

release build are triggered through either `make`,
or their specific target `make zstd-release` and `make lib-release`.

8 years agofixed silent conversion warnings in GZDECOMPRESS path
Yann Collet [Fri, 3 Feb 2017 01:12:50 +0000 (17:12 -0800)] 
fixed silent conversion warnings in GZDECOMPRESS path

8 years agoChanged Makefile to generate zstd with .gz support by default
Yann Collet [Fri, 3 Feb 2017 00:49:34 +0000 (16:49 -0800)] 
Changed Makefile to generate zstd with .gz support by default

.gz support is detected by a runtime test.

8 years agominor : fixed zstd-frugal
Yann Collet [Fri, 3 Feb 2017 00:19:09 +0000 (16:19 -0800)] 
minor : fixed zstd-frugal

fixed a minor unused variable warning when compiling zstd-frugal target

8 years agoremoved unused chart
Yann Collet [Thu, 2 Feb 2017 21:50:51 +0000 (13:50 -0800)] 
removed unused chart

8 years agoupdated dictionary compression paragraph
Yann Collet [Thu, 2 Feb 2017 21:50:07 +0000 (13:50 -0800)] 
updated dictionary compression paragraph

8 years agoMinor security fixes
Sean Purcell [Wed, 1 Feb 2017 18:41:04 +0000 (10:41 -0800)] 
Minor security fixes

8 years agoMerge pull request #527 from facebook/zstdmt
Yann Collet [Wed, 1 Feb 2017 00:36:46 +0000 (16:36 -0800)] 
Merge pull request #527 from facebook/zstdmt

zstdmt refinements

8 years agoMore const's and readability improvements
Sean Purcell [Tue, 31 Jan 2017 23:57:18 +0000 (15:57 -0800)] 
More const's and readability improvements

8 years agoRemoved circular buffer, matches access destination buffer directly
Sean Purcell [Tue, 31 Jan 2017 23:54:02 +0000 (15:54 -0800)] 
Removed circular buffer, matches access destination buffer directly

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Tue, 31 Jan 2017 22:59:17 +0000 (23:59 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agoMinor fixes according to comments
Sean Purcell [Mon, 30 Jan 2017 22:57:02 +0000 (14:57 -0800)] 
Minor fixes according to comments

- Add Facebook copyright notice
- Make max size macros more consistent
- Fix some unchecked malloc's

8 years agoAdded ZSTD_get_decompressed_size
Sean Purcell [Mon, 30 Jan 2017 22:42:21 +0000 (14:42 -0800)] 
Added ZSTD_get_decompressed_size

Since this implementation handles multiple concatenated frames,
to determine decompressed size we must traverse the entire input,
checking each frame's frame_content_size field

8 years agofixed overlapLog==0 => no overlap 527/head
Yann Collet [Mon, 30 Jan 2017 22:54:46 +0000 (14:54 -0800)] 
fixed overlapLog==0 => no overlap

8 years agofixed C constant restrictions
Yann Collet [Mon, 30 Jan 2017 22:37:08 +0000 (14:37 -0800)] 
fixed C constant restrictions

8 years agozstdmt : section size is set to be a minimum of overlapSize
Yann Collet [Mon, 30 Jan 2017 21:35:45 +0000 (13:35 -0800)] 
zstdmt : section size is set to be a minimum of overlapSize

the minimum size condition size is applied transparently (no warning, no error)
like previous minimum section size condition (1 KB) which still applies.

8 years agocli : added advanced parameter overlapLog
Yann Collet [Mon, 30 Jan 2017 21:07:24 +0000 (13:07 -0800)] 
cli : added advanced parameter overlapLog

as a hidden (undocumented) parameter for now

8 years agozstreamtest uses random section sizes for fuzzing
Yann Collet [Mon, 30 Jan 2017 20:50:31 +0000 (12:50 -0800)] 
zstreamtest uses random section sizes for fuzzing

8 years agozstreamtest uses random overlapLog for fuzzing
Yann Collet [Mon, 30 Jan 2017 20:46:35 +0000 (12:46 -0800)] 
zstreamtest uses random overlapLog for fuzzing

8 years agoAdd educational decoder to /contrib
Sean Purcell [Mon, 30 Jan 2017 19:42:45 +0000 (11:42 -0800)] 
Add educational decoder to /contrib

8 years agoadded command --block-size=
Yann Collet [Mon, 30 Jan 2017 19:17:26 +0000 (11:17 -0800)] 
added command --block-size=

for Multi-threading only.
alias : -B#

8 years agochanged advanced parameter overlapLog
Yann Collet [Mon, 30 Jan 2017 19:00:00 +0000 (11:00 -0800)] 
changed advanced parameter overlapLog

Follows a positive logic (increasing value => increasing overlap)
which is easier to use

8 years agofixed : legacy decoders v04 and v05
Yann Collet [Mon, 30 Jan 2017 18:45:58 +0000 (10:45 -0800)] 
fixed : legacy decoders v04 and v05

8 years agoMerge pull request #525 from terrelln/covermt
Yann Collet [Mon, 30 Jan 2017 18:15:33 +0000 (10:15 -0800)] 
Merge pull request #525 from terrelln/covermt

Multithreaded COVER dictionary training

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Mon, 30 Jan 2017 09:17:29 +0000 (10:17 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agoMerge pull request #523 from terrelln/buck
Yann Collet [Sun, 29 Jan 2017 03:17:58 +0000 (19:17 -0800)] 
Merge pull request #523 from terrelln/buck

Add BUCK files for Nuclide integration

8 years agoFix documentation about memory usage 525/head
Nick Terrell [Sat, 28 Jan 2017 02:43:05 +0000 (18:43 -0800)] 
Fix documentation about memory usage

8 years agoFix typos in VS2010 build config
Nick Terrell [Sat, 28 Jan 2017 01:32:16 +0000 (17:32 -0800)] 
Fix typos in VS2010 build config

8 years agoreport @terrelln patch to ST fuzzer tests
Yann Collet [Sat, 28 Jan 2017 01:25:07 +0000 (17:25 -0800)] 
report @terrelln patch to ST fuzzer tests

8 years agoMerge pull request #524 from terrelln/asan-failure
Yann Collet [Sat, 28 Jan 2017 00:50:16 +0000 (16:50 -0800)] 
Merge pull request #524 from terrelln/asan-failure

Fix segfault in zstreamtest MT

8 years agoAdd include guards and extern C
Nick Terrell [Sat, 28 Jan 2017 00:00:19 +0000 (16:00 -0800)] 
Add include guards and extern C

8 years agoreduced zstdmt latency when using small custom section sizes with high compression...
Yann Collet [Fri, 27 Jan 2017 23:55:30 +0000 (15:55 -0800)] 
reduced zstdmt latency when using small custom section sizes with high compression levels

Previous version was requiring a fairly large initial amount of input data
before starting to create compression jobs.
This new version starts the process much sooner.

8 years agoFix segfault in zstreamtest MT 524/head
Nick Terrell [Fri, 27 Jan 2017 23:42:36 +0000 (15:42 -0800)] 
Fix segfault in zstreamtest MT

It was reading beyond the end of the input buffer because no errors were
detected. Once that was fixed, it wasn't making forward progress because
no errors were detected and it was waiting for input.

8 years agoFix VS fuzzer build configs
Nick Terrell [Fri, 27 Jan 2017 21:56:41 +0000 (13:56 -0800)] 
Fix VS fuzzer build configs

8 years agoFixed status display for zstdmt
Yann Collet [Fri, 27 Jan 2017 21:30:18 +0000 (13:30 -0800)] 
Fixed status display for zstdmt

There is a large buffering effect when using zstdmt in MT mode.
Consequently, data is read first, pushed to workers,
and only later will the compressed result come out.
That means there is no longer immediate correlation
between amount of data read, and amount of data written.

This patch disables the displaying of % compression
when multi-threading is enabled.

It adds the displaying of total size when it can be determined
(it usually can be determined for files, but not for stdin)
so the user has a sense of "how far from the end" the compression compressed is.

There is no modification to decompression side,
since decompression is only single-threaded for now.

8 years agoRevert unnecessary change to Logging.h 523/head
Nick Terrell [Fri, 27 Jan 2017 21:26:44 +0000 (13:26 -0800)] 
Revert unnecessary change to Logging.h

8 years agoAdd threading and pool to build configs
Nick Terrell [Fri, 27 Jan 2017 20:29:27 +0000 (12:29 -0800)] 
Add threading and pool to build configs

8 years agochanged format specification version number
Yann Collet [Fri, 27 Jan 2017 20:16:16 +0000 (12:16 -0800)] 
changed format specification version number

8 years agoMerge branch 'dev' into buck
Nick Terrell [Fri, 27 Jan 2017 20:05:48 +0000 (12:05 -0800)] 
Merge branch 'dev' into buck

* dev:
  updated NEWS
  fixed MSAN warnings in legacy decoders
  Fix cmake build
  updated NEWS
  Edits as per comments, and change wildcard 'X' to '?'
  Fix Visual Studios project
  Fix pool.c threading.h import
  Fix zstdmt_compress.h include
  Fixed commented issues
  Updated format specification to be easier to understand
  improved #232 fix
  Fixed https://github.com/facebook/zstd/issues/232
  .travis.yml: different tests for "master" branch
  .travis.yml: optimized order of short tests
  .travis.yml: test jobs 12-15
  JOB_NUMBER -eq 9
  improved ZSTD_compressBlock_opt_extDict_generic

8 years agoAdd multithread support to COVER
Nick Terrell [Fri, 27 Jan 2017 19:56:02 +0000 (11:56 -0800)] 
Add multithread support to COVER

8 years agoMerge pull request #522 from terrelln/benchmt
Yann Collet [Fri, 27 Jan 2017 19:40:25 +0000 (11:40 -0800)] 
Merge pull request #522 from terrelln/benchmt

Fix some includes

8 years agoupdated NEWS
Yann Collet [Fri, 27 Jan 2017 19:27:34 +0000 (11:27 -0800)] 
updated NEWS

8 years agoMerge pull request #520 from iburinoc/spec
Yann Collet [Fri, 27 Jan 2017 19:26:38 +0000 (11:26 -0800)] 
Merge pull request #520 from iburinoc/spec

Updated format specification to be easier to understand

8 years agofixed MSAN warnings in legacy decoders
Yann Collet [Fri, 27 Jan 2017 18:44:03 +0000 (10:44 -0800)] 
fixed MSAN warnings in legacy decoders

In some extraordinary circumstances,
*Length field can be generated from reading a partially uninitialized memory segment.
Data is correctly identified as corrupted later on,
but the read taints some later pointer arithmetic operation.

8 years agoClean imports and shorten tests
Nick Terrell [Fri, 27 Jan 2017 04:47:59 +0000 (20:47 -0800)] 
Clean imports and shorten tests

8 years agoAdd BUCK files for Nuclide support
Nick Terrell [Thu, 26 Jan 2017 23:56:34 +0000 (15:56 -0800)] 
Add BUCK files for Nuclide support

8 years agoimproved #232 fix
Przemyslaw Skibinski [Wed, 25 Jan 2017 12:11:26 +0000 (13:11 +0100)] 
improved #232 fix

8 years agoFixed https://github.com/facebook/zstd/issues/232
Przemyslaw Skibinski [Wed, 25 Jan 2017 12:02:33 +0000 (13:02 +0100)] 
Fixed https://github.com/facebook/zstd/issues/232

8 years ago.travis.yml: different tests for "master" branch
Przemyslaw Skibinski [Wed, 25 Jan 2017 10:57:28 +0000 (11:57 +0100)] 
.travis.yml: different tests for "master" branch

8 years ago.travis.yml: optimized order of short tests
Przemyslaw Skibinski [Wed, 25 Jan 2017 10:19:35 +0000 (11:19 +0100)] 
.travis.yml: optimized order of short tests

8 years ago.travis.yml: test jobs 12-15
Przemyslaw Skibinski [Tue, 24 Jan 2017 16:42:28 +0000 (17:42 +0100)] 
.travis.yml: test jobs 12-15

8 years agoJOB_NUMBER -eq 9
Przemyslaw Skibinski [Tue, 24 Jan 2017 14:01:46 +0000 (15:01 +0100)] 
JOB_NUMBER -eq 9

8 years agoimproved ZSTD_compressBlock_opt_extDict_generic
Przemyslaw Skibinski [Tue, 24 Jan 2017 12:18:50 +0000 (13:18 +0100)] 
improved ZSTD_compressBlock_opt_extDict_generic

8 years agoFix cmake build 522/head
Nick Terrell [Fri, 27 Jan 2017 18:27:29 +0000 (10:27 -0800)] 
Fix cmake build

8 years agoupdated NEWS
Yann Collet [Fri, 27 Jan 2017 11:22:37 +0000 (03:22 -0800)] 
updated NEWS

8 years agoMerge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
Przemyslaw Skibinski [Fri, 27 Jan 2017 09:26:33 +0000 (10:26 +0100)] 
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11

8 years agoEdits as per comments, and change wildcard 'X' to '?' 520/head
Sean Purcell [Fri, 27 Jan 2017 00:58:25 +0000 (16:58 -0800)] 
Edits as per comments, and change wildcard 'X' to '?'

8 years agoFix Visual Studios project
Nick Terrell [Fri, 27 Jan 2017 00:07:59 +0000 (16:07 -0800)] 
Fix Visual Studios project

8 years agoFix pool.c threading.h import
Nick Terrell [Thu, 26 Jan 2017 23:29:10 +0000 (15:29 -0800)] 
Fix pool.c threading.h import

8 years agoFix zstdmt_compress.h include
Nick Terrell [Thu, 26 Jan 2017 23:25:32 +0000 (15:25 -0800)] 
Fix zstdmt_compress.h include

8 years agoMerge pull request #519 from inikep/dev11
Yann Collet [Thu, 26 Jan 2017 22:23:44 +0000 (14:23 -0800)] 
Merge pull request #519 from inikep/dev11

Dev11