]> git.ipfire.org Git - thirdparty/zstd.git/log
thirdparty/zstd.git
5 years ago[test] Test the bounds of ZSTD_c_srcSizeHint 1801/head
Nick Terrell [Wed, 18 Sep 2019 18:05:08 +0000 (11:05 -0700)] 
[test] Test the bounds of ZSTD_c_srcSizeHint

5 years agoMerge pull request #1798 from facebook/refac_fast
Yann Collet [Tue, 17 Sep 2019 21:54:23 +0000 (14:54 -0700)] 
Merge pull request #1798 from facebook/refac_fast

minor refactor of ZSTD_fast

5 years agominor refactor of ZSTD_fast 1798/head
Yann Collet [Tue, 17 Sep 2019 21:02:57 +0000 (14:02 -0700)] 
minor refactor of ZSTD_fast

- reduced variables lifetime
- more accurate code comments

5 years agoMerge pull request #1783 from felixhandte/mtime-nsec
Felix Handte [Tue, 17 Sep 2019 17:30:21 +0000 (13:30 -0400)] 
Merge pull request #1783 from felixhandte/mtime-nsec

Set Mod Time Nanoseconds

5 years agoMerge pull request #1780 from felixhandte/workspace-efficiency-3
Felix Handte [Mon, 16 Sep 2019 18:37:05 +0000 (14:37 -0400)] 
Merge pull request #1780 from felixhandte/workspace-efficiency-3

Avoid Clearing Tables Even When Changing CParams

5 years agoDon't Include `sanitizer/msan_interface.h`, Since Not All Platforms Provide It 1780/head
W. Felix Handte [Mon, 16 Sep 2019 16:08:03 +0000 (12:08 -0400)] 
Don't Include `sanitizer/msan_interface.h`, Since Not All Platforms Provide It

Instead, explicitly declare the functions we use.

5 years agoMerge pull request #1791 from terrelln/doc-up
Nick Terrell [Sun, 15 Sep 2019 21:50:55 +0000 (14:50 -0700)] 
Merge pull request #1791 from terrelln/doc-up

[libzstd] Improve advanced API docs

5 years ago[libzstd] Improve advanced API docs 1791/head
Nick Terrell [Sun, 15 Sep 2019 19:41:24 +0000 (12:41 -0700)] 
[libzstd] Improve advanced API docs

5 years agoMerge pull request #1789 from terrelln/larger-fuzz
Nick Terrell [Fri, 13 Sep 2019 21:13:34 +0000 (14:13 -0700)] 
Merge pull request #1789 from terrelln/larger-fuzz

[fuzz] Fix leak in block_round_trip

5 years ago[fuzz] Fix leak in block_round_trip 1789/head
Nick Terrell [Fri, 13 Sep 2019 17:32:38 +0000 (10:32 -0700)] 
[fuzz] Fix leak in block_round_trip

5 years agoMerge pull request #1784 from bimbashrestha/fse_block_bound_err
Yann Collet [Fri, 13 Sep 2019 02:09:27 +0000 (19:09 -0700)] 
Merge pull request #1784 from bimbashrestha/fse_block_bound_err

Rearranging assert and allowing 4 extra for FSE_BLOCKBOUND()

5 years agoMerge pull request #1785 from terrelln/larger-fuzz
Nick Terrell [Fri, 13 Sep 2019 00:21:10 +0000 (17:21 -0700)] 
Merge pull request #1785 from terrelln/larger-fuzz

[fuzz] Generate seed data up to 256KB

5 years agoAdded assert to BIT_flushBits() 1784/head
Bimba Shrestha [Thu, 12 Sep 2019 22:35:27 +0000 (15:35 -0700)] 
Added assert to BIT_flushBits()

5 years ago[fuzz] Generate seed data up to 256KB 1785/head
Nick Terrell [Thu, 12 Sep 2019 22:02:01 +0000 (15:02 -0700)] 
[fuzz] Generate seed data up to 256KB

5 years agoRearranging assert and allowing 4 extra for FSE_BLOCKBOUND()
Bimba Shrestha [Thu, 12 Sep 2019 21:43:50 +0000 (14:43 -0700)] 
Rearranging assert and allowing 4 extra for FSE_BLOCKBOUND()

5 years agoMerge pull request #1781 from darxsys/improvDataGen
Nick Terrell [Thu, 12 Sep 2019 21:27:58 +0000 (14:27 -0700)] 
Merge pull request #1781 from darxsys/improvDataGen

Improve data generation

5 years agoFormatting and Clean Up 1783/head
W. Felix Handte [Thu, 12 Sep 2019 20:27:05 +0000 (16:27 -0400)] 
Formatting and Clean Up

5 years agoMerge branch 'improvDataGen' of github.com:darxsys/zstd into improvDataGen 1781/head
Dario Pavlovic [Thu, 12 Sep 2019 20:11:02 +0000 (13:11 -0700)] 
Merge branch 'improvDataGen' of github.com:darxsys/zstd into improvDataGen

5 years agoIt's time for all of rng seed code to go. Goodbye
Dario Pavlovic [Thu, 12 Sep 2019 20:10:34 +0000 (13:10 -0700)] 
It's time for all of rng seed code to go. Goodbye

5 years agoUpdate tests/fuzz/fuzz_data_producer.h
Dario Pavlovic [Thu, 12 Sep 2019 19:45:28 +0000 (12:45 -0700)] 
Update tests/fuzz/fuzz_data_producer.h

5 years agoUse range instead of the generic uint32 method to use less bytes when generating...
Dario Pavlovic [Thu, 12 Sep 2019 19:40:12 +0000 (12:40 -0700)] 
Use range instead of the generic uint32 method to use less bytes when generating necessary numbers.

5 years agoignore dictionary artifacts
Yann Collet [Thu, 12 Sep 2019 16:39:15 +0000 (09:39 -0700)] 
ignore dictionary artifacts

5 years agoSet M-Time Nanoseconds
W. Felix Handte [Thu, 12 Sep 2019 15:48:46 +0000 (11:48 -0400)] 
Set M-Time Nanoseconds

5 years agoMerge pull request #1708 from neheb/dev
Felix Handte [Thu, 12 Sep 2019 15:44:31 +0000 (11:44 -0400)] 
Merge pull request #1708 from neheb/dev

zstd: Don't use utime on Linux

5 years agoShrink Table Valid End During Alloc Alignment / Phase Change
W. Felix Handte [Wed, 11 Sep 2019 21:03:09 +0000 (17:03 -0400)] 
Shrink Table Valid End During Alloc Alignment / Phase Change

5 years agoAdd Assertions to Confirm that Workspace Pointers are Correctly Ordered
W. Felix Handte [Wed, 11 Sep 2019 20:41:41 +0000 (16:41 -0400)] 
Add Assertions to Confirm that Workspace Pointers are Correctly Ordered

5 years ago`__msan_poison()` Workspace When Preparing for Re-Use
W. Felix Handte [Wed, 11 Sep 2019 20:40:29 +0000 (16:40 -0400)] 
`__msan_poison()` Workspace When Preparing for Re-Use

5 years agoFix Memory Leak in Test
W. Felix Handte [Wed, 11 Sep 2019 18:25:30 +0000 (14:25 -0400)] 
Fix Memory Leak in Test

5 years agoFix Compilation Error (`uint32_t` -> `size_t`)
W. Felix Handte [Wed, 11 Sep 2019 17:59:09 +0000 (13:59 -0400)] 
Fix Compilation Error (`uint32_t` -> `size_t`)

5 years agoSpeed Up Test a Little
W. Felix Handte [Wed, 11 Sep 2019 17:23:59 +0000 (13:23 -0400)] 
Speed Up Test a Little

5 years agoAdd Fuzzer Test Case for Index Reduction
W. Felix Handte [Wed, 11 Sep 2019 17:17:19 +0000 (13:17 -0400)] 
Add Fuzzer Test Case for Index Reduction

5 years agoZero `h3size` When `h3log` is 0
W. Felix Handte [Wed, 11 Sep 2019 17:14:26 +0000 (13:14 -0400)] 
Zero `h3size` When `h3log` is 0

This led to a nasty edgecase, where index reduction for modes that don't use
the h3 table would have a degenerate table (size 4) allocated and marked clean,
but which would not be re-indexed.

5 years agoCombining fuzz_data_producer restrict calls into a single function
Dario Pavlovic [Wed, 11 Sep 2019 17:09:29 +0000 (10:09 -0700)] 
Combining fuzz_data_producer restrict calls into a single function

5 years agoAlso Shrink Clean Table Area When Reducing Indices
W. Felix Handte [Wed, 11 Sep 2019 15:40:57 +0000 (11:40 -0400)] 
Also Shrink Clean Table Area When Reducing Indices

5 years agoUpdate DEBUGLOG Statements
W. Felix Handte [Wed, 11 Sep 2019 15:21:00 +0000 (11:21 -0400)] 
Update DEBUGLOG Statements

5 years agoShrink Clean Table Area When Copying Table Contents into Context
W. Felix Handte [Wed, 11 Sep 2019 15:18:45 +0000 (11:18 -0400)] 
Shrink Clean Table Area When Copying Table Contents into Context

The source matchState is potentially at a lower current index, which means
that any extra table space not overwritten by the copy may now contain
invalid indices. The simple solution is to unconditionally shrink the valid
table area to just the area overwritten.

5 years agoAll tests should give some portion of data to the producer and use the rest.
Dario Pavlovic [Tue, 10 Sep 2019 23:52:38 +0000 (16:52 -0700)] 
All tests should give some portion of data to the producer and use the rest.

5 years agoMerge branch 'dev' into improvDataGen
Dario Pavlovic [Tue, 10 Sep 2019 23:20:27 +0000 (16:20 -0700)] 
Merge branch 'dev' into improvDataGen

5 years ago[Fuzz] Improve data generation #1723
Dario Pavlovic [Tue, 10 Sep 2019 23:14:43 +0000 (16:14 -0700)] 
[Fuzz] Improve data generation #1723

Converting the rest of the tests to use the new data producer.

5 years agoComments
W. Felix Handte [Tue, 10 Sep 2019 22:02:22 +0000 (18:02 -0400)] 
Comments

5 years agoOnly Reset Indexing in `ZSTD_resetCCtx_internal()` When Necessary
W. Felix Handte [Tue, 10 Sep 2019 21:55:41 +0000 (17:55 -0400)] 
Only Reset Indexing in `ZSTD_resetCCtx_internal()` When Necessary

5 years agoRemove No-Longer-Used Continuation Functions
W. Felix Handte [Tue, 10 Sep 2019 21:59:45 +0000 (17:59 -0400)] 
Remove No-Longer-Used Continuation Functions

5 years agoRemove Fast Continue Path in `ZSTD_resetCCtx_internal()`
W. Felix Handte [Tue, 10 Sep 2019 21:54:11 +0000 (17:54 -0400)] 
Remove Fast Continue Path in `ZSTD_resetCCtx_internal()`

5 years ago`ZSTD_reset_matchState` Optionally Doesn't Restart Indexing
W. Felix Handte [Tue, 10 Sep 2019 21:43:35 +0000 (17:43 -0400)] 
`ZSTD_reset_matchState` Optionally Doesn't Restart Indexing

5 years agoRename `ZSTD_compResetPolicy_e` Values and Add Comment
W. Felix Handte [Tue, 10 Sep 2019 21:38:32 +0000 (17:38 -0400)] 
Rename `ZSTD_compResetPolicy_e` Values and Add Comment

5 years agoAccept `ZSTD_indexResetPolicy_e` Param in `ZSTD_reset_matchState()`
W. Felix Handte [Tue, 10 Sep 2019 21:28:52 +0000 (17:28 -0400)] 
Accept `ZSTD_indexResetPolicy_e` Param in `ZSTD_reset_matchState()`

5 years agoIntroduce `ZSTD_indexResetPolicy_e` Enum
W. Felix Handte [Tue, 10 Sep 2019 21:24:02 +0000 (17:24 -0400)] 
Introduce `ZSTD_indexResetPolicy_e` Enum

5 years agoTrack Usable Table Space in Compression Workspace
W. Felix Handte [Tue, 3 Sep 2019 17:08:24 +0000 (13:08 -0400)] 
Track Usable Table Space in Compression Workspace

5 years agoMerge pull request #1712 from felixhandte/workspace-efficiency-2
Yann Collet [Tue, 10 Sep 2019 22:20:29 +0000 (15:20 -0700)] 
Merge pull request #1712 from felixhandte/workspace-efficiency-2

Allocate Internal Buffers via Workspace Abstraction

5 years agoRemove Empty lib/compress/zstd_cwksp.c 1712/head
W. Felix Handte [Tue, 10 Sep 2019 20:03:13 +0000 (16:03 -0400)] 
Remove Empty lib/compress/zstd_cwksp.c

5 years agoMerge pull request #1775 from facebook/edufix
Yann Collet [Tue, 10 Sep 2019 19:12:08 +0000 (12:12 -0700)] 
Merge pull request #1775 from facebook/edufix

fix educational decoder

5 years agoMerge pull request #1777 from darxsys/improvDataGen
Nick Terrell [Tue, 10 Sep 2019 18:51:23 +0000 (11:51 -0700)] 
Merge pull request #1777 from darxsys/improvDataGen

[Fuzz] Improve data generation #1723

5 years agoMerge pull request #1773 from bimbashrestha/rle_first_block_decompression_fix
Yann Collet [Tue, 10 Sep 2019 18:17:29 +0000 (11:17 -0700)] 
Merge pull request #1773 from bimbashrestha/rle_first_block_decompression_fix

Removing redundant condition in decompression, making first block rle…

5 years agofix education decoder test 1775/head
Yann Collet [Tue, 10 Sep 2019 16:36:02 +0000 (09:36 -0700)] 
fix education decoder test

when `zstd` in not installed on local system
by allowing `ZSTD` variable to hold a custom location for the binary

5 years agoUsing a number instead of M prefix in head call 1773/head
Bimba Shrestha [Tue, 10 Sep 2019 16:30:37 +0000 (09:30 -0700)] 
Using a number instead of M prefix in head call

5 years agoAddressing nits 1777/head
Dario Pavlovic [Mon, 9 Sep 2019 23:13:24 +0000 (16:13 -0700)] 
Addressing nits

5 years agoForward Declare `ZSTD_cwksp_available_space` to Fix Build
W. Felix Handte [Mon, 9 Sep 2019 23:10:09 +0000 (19:10 -0400)] 
Forward Declare `ZSTD_cwksp_available_space` to Fix Build

5 years agoInline Workspace Functions
W. Felix Handte [Mon, 9 Sep 2019 22:30:53 +0000 (18:30 -0400)] 
Inline Workspace Functions

5 years agoFixing issues with double usage of data.
Dario Pavlovic [Mon, 9 Sep 2019 22:39:04 +0000 (15:39 -0700)] 
Fixing issues with double usage of data.

5 years agoForward resetCCtx Errors when Using CDict
W. Felix Handte [Tue, 3 Sep 2019 17:13:16 +0000 (13:13 -0400)] 
Forward resetCCtx Errors when Using CDict

5 years agoFix sizeof_CCtx and sizeof_CDict Calculations for Statically Init'ed Objects
W. Felix Handte [Mon, 9 Sep 2019 20:45:17 +0000 (16:45 -0400)] 
Fix sizeof_CCtx and sizeof_CDict Calculations for Statically Init'ed Objects

5 years agoFix workspaceTooSmall Calculation
W. Felix Handte [Mon, 9 Sep 2019 19:12:14 +0000 (15:12 -0400)] 
Fix workspaceTooSmall Calculation

5 years agoChanging test file directory names to be more descriptive
Bimba Shrestha [Mon, 9 Sep 2019 19:08:33 +0000 (12:08 -0700)] 
Changing test file directory names to be more descriptive

5 years agoShorten `&zc->workspace` -> `ws` in `ZSTD_resetCCtx_internal()`
W. Felix Handte [Mon, 9 Sep 2019 18:59:09 +0000 (14:59 -0400)] 
Shorten `&zc->workspace` -> `ws` in `ZSTD_resetCCtx_internal()`

5 years agoTesting first block decompression cli
Bimba Shrestha [Mon, 9 Sep 2019 18:54:43 +0000 (11:54 -0700)] 
Testing first block decompression cli

5 years agoClean Up TODOs and Comments pt. II
W. Felix Handte [Mon, 9 Sep 2019 18:04:39 +0000 (14:04 -0400)] 
Clean Up TODOs and Comments pt. II

5 years agoNit
W. Felix Handte [Tue, 3 Sep 2019 17:00:59 +0000 (13:00 -0400)] 
Nit

5 years agoPull Phase Advance Logic Out into Internal Function
W. Felix Handte [Tue, 3 Sep 2019 16:59:10 +0000 (12:59 -0400)] 
Pull Phase Advance Logic Out into Internal Function

5 years agoHide Workspace Movement Behind Helper Function
W. Felix Handte [Tue, 3 Sep 2019 16:48:45 +0000 (12:48 -0400)] 
Hide Workspace Movement Behind Helper Function

5 years agoFix DEBUGLOG Statement Levels
W. Felix Handte [Tue, 3 Sep 2019 16:41:35 +0000 (12:41 -0400)] 
Fix DEBUGLOG Statement Levels

5 years agoFix Rescale Continue Special Case
W. Felix Handte [Thu, 29 Aug 2019 20:33:45 +0000 (16:33 -0400)] 
Fix Rescale Continue Special Case

5 years agoRemove Unused noRealloc CRP Value
W. Felix Handte [Tue, 27 Aug 2019 19:21:59 +0000 (15:21 -0400)] 
Remove Unused noRealloc CRP Value

5 years agoRe-Implement Workspace Shrinking when Oversized
W. Felix Handte [Thu, 22 Aug 2019 20:09:00 +0000 (16:09 -0400)] 
Re-Implement Workspace Shrinking when Oversized

5 years agoAdd New File to Visual Studio Projects
W. Felix Handte [Tue, 20 Aug 2019 19:19:58 +0000 (15:19 -0400)] 
Add New File to Visual Studio Projects

5 years agoAdd New File to Meson Build
W. Felix Handte [Tue, 20 Aug 2019 19:14:12 +0000 (15:14 -0400)] 
Add New File to Meson Build

5 years agoCleanup from Move
W. Felix Handte [Tue, 20 Aug 2019 18:15:06 +0000 (14:15 -0400)] 
Cleanup from Move

5 years agoMove Workspace Functions to Their Own File
W. Felix Handte [Tue, 20 Aug 2019 18:02:50 +0000 (14:02 -0400)] 
Move Workspace Functions to Their Own File

5 years agoRename
W. Felix Handte [Thu, 15 Aug 2019 16:51:24 +0000 (12:51 -0400)] 
Rename

5 years agoClean Up TODOs and Comments
W. Felix Handte [Wed, 14 Aug 2019 21:11:16 +0000 (17:11 -0400)] 
Clean Up TODOs and Comments

5 years agoImprove Comments a Bit
W. Felix Handte [Wed, 14 Aug 2019 20:55:12 +0000 (16:55 -0400)] 
Improve Comments a Bit

5 years agoAllocate CDict in Workspace (Rather than in Separate Allocation)
W. Felix Handte [Wed, 14 Aug 2019 20:48:01 +0000 (16:48 -0400)] 
Allocate CDict in Workspace (Rather than in Separate Allocation)

5 years agoRewrite ZSTD_initStaticCCtx to Alloc CCtx in Workspace
W. Felix Handte [Wed, 14 Aug 2019 18:44:17 +0000 (14:44 -0400)] 
Rewrite ZSTD_initStaticCCtx to Alloc CCtx in Workspace

5 years agoOnly the CCtx Itself Needs to be Cleared during Static CCtx Init
W. Felix Handte [Wed, 14 Aug 2019 15:35:53 +0000 (11:35 -0400)] 
Only the CCtx Itself Needs to be Cleared during Static CCtx Init

5 years agoAlign Alloc Pointer When Transitioning from Buffers to Aligned Allocs
W. Felix Handte [Tue, 13 Aug 2019 15:57:20 +0000 (11:57 -0400)] 
Align Alloc Pointer When Transitioning from Buffers to Aligned Allocs

5 years agoRemove Overly-Restrictive Assert
W. Felix Handte [Tue, 13 Aug 2019 00:01:57 +0000 (20:01 -0400)] 
Remove Overly-Restrictive Assert

5 years agoWhen Loading Dict By Copy, Always Put it in the Workspace
W. Felix Handte [Mon, 12 Aug 2019 23:24:24 +0000 (19:24 -0400)] 
When Loading Dict By Copy, Always Put it in the Workspace

5 years agoAlloc Tables Separately
W. Felix Handte [Mon, 12 Aug 2019 22:36:48 +0000 (18:36 -0400)] 
Alloc Tables Separately

5 years agoBegin Introducing Phases
W. Felix Handte [Mon, 12 Aug 2019 18:22:54 +0000 (14:22 -0400)] 
Begin Introducing Phases

5 years agoTMP
W. Felix Handte [Mon, 15 Jul 2019 19:08:49 +0000 (15:08 -0400)] 
TMP

5 years agoDisambiguate 'workspace' and 'entropyWorkspace'
W. Felix Handte [Mon, 15 Jul 2019 21:14:51 +0000 (17:14 -0400)] 
Disambiguate 'workspace' and 'entropyWorkspace'

5 years agoNormalize Case 'workSpace' -> 'workspace'
W. Felix Handte [Mon, 15 Jul 2019 19:10:33 +0000 (15:10 -0400)] 
Normalize Case 'workSpace' -> 'workspace'

5 years ago[Fuzz] Improve data generation #1723
Dario Pavlovic [Mon, 9 Sep 2019 15:43:22 +0000 (08:43 -0700)] 
[Fuzz] Improve data generation #1723

5 years agoMerge pull request #1771 from vnair81/dev
Yann Collet [Sat, 7 Sep 2019 00:02:53 +0000 (17:02 -0700)] 
Merge pull request #1771 from vnair81/dev

Passing ZSTD_CCtx_params by const pointer

5 years agofix minor compilation condition
Yann Collet [Fri, 6 Sep 2019 23:51:16 +0000 (16:51 -0700)] 
fix minor compilation condition

harness.c is not designed to pass  -Wdeclaration-after-statement

5 years agoMentioning cli only in the comment as suggested
Bimba Shrestha [Fri, 6 Sep 2019 21:48:41 +0000 (14:48 -0700)] 
Mentioning cli only in the comment as suggested

5 years agofix eductional decoder
Yann Collet [Fri, 6 Sep 2019 21:30:13 +0000 (14:30 -0700)] 
fix eductional decoder

fix #1774
also :
- fix minor compilation warnings
- make sure the `test` is run during CI tests

5 years agoPut back omission for first rle block and updated comment as suggested
Bimba Shrestha [Fri, 6 Sep 2019 20:44:25 +0000 (13:44 -0700)] 
Put back omission for first rle block and updated comment as suggested

5 years agoRemoving redundant condition in decompression, making first block rles valid to deocm...
Bimba Shrestha [Fri, 6 Sep 2019 17:46:19 +0000 (10:46 -0700)] 
Removing redundant condition in decompression, making first block rles valid to deocmpress

5 years agoFixing assert and DEBUGLOG due to ZSTD_CCtx_params parameter change to const pointer 1771/head
Varun S Nair [Thu, 5 Sep 2019 10:17:17 +0000 (15:47 +0530)] 
Fixing assert and DEBUGLOG due to ZSTD_CCtx_params parameter change to const pointer

5 years agoPassing ZSTD_CCtx_params by const pointer
Varun S Nair [Thu, 5 Sep 2019 09:58:30 +0000 (15:28 +0530)] 
Passing ZSTD_CCtx_params by const pointer