]>
git.ipfire.org Git - thirdparty/zstd.git/log
Yann Collet [Tue, 28 Aug 2018 18:21:09 +0000 (11:21 -0700)]
timedFn : measurement delay is programmable
instead of hard-coded 1 second per measurement
Yann Collet [Tue, 28 Aug 2018 02:07:17 +0000 (19:07 -0700)]
paramgrill: removed useless tests
designed to compensate iter_mode,
but since only time_mode is available now,
all tests are guaranteed to last a minimum amount of time.
Yann Collet [Tue, 28 Aug 2018 01:46:42 +0000 (18:46 -0700)]
paramgrill: fixed a bunch of div-by-zero
they were pretty easy to trigger by the way,
just start an extended paramgrill session
to find a compression table based on any sample,
it would necessarily happen at some point.
Yann Collet [Tue, 28 Aug 2018 00:52:04 +0000 (17:52 -0700)]
restored assert() in paramgrill
assert() in paramgrill are not in the benchmark path.
They should remain active, as they don't impact measurements, and their runtime is insignificant.
Yann Collet [Mon, 27 Aug 2018 04:30:18 +0000 (21:30 -0700)]
bench: minor api update, for consistency
BMK_benchTimedFn()
BMK_isCompleted_TimedFn() uses TimedFnState
Yann Collet [Sat, 25 Aug 2018 04:38:09 +0000 (21:38 -0700)]
fixed minor warnings
valgrind: memory leak of a few bytes in fullbench
static analyzer: uninitialized data passed as result
Yann Collet [Sat, 25 Aug 2018 00:28:38 +0000 (17:28 -0700)]
bench: reduce nb of return type
runOutcome is enough
removed timedFnOutcome
Yann Collet [Fri, 24 Aug 2018 22:59:57 +0000 (15:59 -0700)]
fix minor warnings
gcc : prototype with 0 parameter must be labelled (void)
visual : const property must be identical in both declaration and implementation
Yann Collet [Fri, 24 Aug 2018 19:40:10 +0000 (12:40 -0700)]
fixed fullbench behavior
now same as v1.3.5
Yann Collet [Fri, 24 Aug 2018 01:04:50 +0000 (18:04 -0700)]
fixed zstd -b speed result
the benchmark was displaying the speed of last run
instead of the best of all previous runs.
Yann Collet [Fri, 24 Aug 2018 00:21:38 +0000 (17:21 -0700)]
fixed paramgrill
to work with new bench.c
Yann Collet [Thu, 23 Aug 2018 23:03:30 +0000 (16:03 -0700)]
introduced MB_UNIT
so that all benchmarking programs use the same speed scale
Yann Collet [Thu, 23 Aug 2018 21:28:51 +0000 (14:28 -0700)]
update fullbench.c to work with new bench.h
Yann Collet [Thu, 23 Aug 2018 21:21:18 +0000 (14:21 -0700)]
refactored bench.c
for clarity and safety, especially at interface level
Yann Collet [Wed, 22 Aug 2018 01:19:27 +0000 (18:19 -0700)]
bench: changed creation/reset function to timedFnState
for consistency
Yann Collet [Tue, 21 Aug 2018 21:48:50 +0000 (14:48 -0700)]
Merge pull request #1287 from tgurr/cmake-docdir
Use GNUInstallDirs DOCDIR for installing the manual
Yann Collet [Tue, 21 Aug 2018 20:18:44 +0000 (13:18 -0700)]
Merge pull request #1290 from edenzik/ezik/1119-safe-strcpy-in-fileio
Fixed unsafe string copy and concat in `fileio.c`.
Eden Zik [Tue, 21 Aug 2018 02:15:24 +0000 (22:15 -0400)]
Fixed unsafe string copy and concat in `fileio.c`.
Per warnings from flawfinder: "Does not check for buffer overflows when
copying to destination [MS-banned] (CWE-120). Consider using snprintf,
strcpy_s, or strlcpy (warning: strncpy easily misused).".
Replaced called to strcpy and strcat in `fileio.c` to calls with a
specified size (`strncpy` and `strncat`).
Tested the changes on OSX, Linux, Windows.
On OSX + Linux, changes were tested with ASAN. The following flags were
used: 'check_initialization_order=1:strict_init_order=1:detect_odr_violation=1:detect_stack_use_after_return=1'
To reproduce warning:
./flawfinder.py ./programs/fileio.c
Yann Collet [Fri, 17 Aug 2018 23:38:41 +0000 (16:38 -0700)]
Merge pull request #1285 from facebook/scanbuild
static analyzer tests
Timo Gurr [Fri, 17 Aug 2018 11:31:55 +0000 (13:31 +0200)]
Use GNUInstallDirs DOCDIR for installing the manual
Yann Collet [Fri, 17 Aug 2018 01:20:37 +0000 (18:20 -0700)]
Merge pull request #1284 from GeorgeLu97/negativeLvlDisplay
Fix negative lvl display value
George Lu [Fri, 17 Aug 2018 00:22:29 +0000 (17:22 -0700)]
Clarify README
George Lu [Thu, 16 Aug 2018 23:13:02 +0000 (16:13 -0700)]
Fix negative lvl display value
Also fix synthetic benchmark parameter setting
Yann Collet [Thu, 16 Aug 2018 22:41:56 +0000 (15:41 -0700)]
Makefile: added variable SCANBUILD
so that a different version of scan-build can be selected
Yann Collet [Thu, 16 Aug 2018 21:40:47 +0000 (14:40 -0700)]
fixed more issues detected by recent version of scan-build
test run on Linux
Yann Collet [Thu, 16 Aug 2018 00:56:45 +0000 (17:56 -0700)]
Merge pull request #1281 from GeorgeLu97/cleanUp
Clean up paramgrill code
Yann Collet [Thu, 16 Aug 2018 00:44:27 +0000 (17:44 -0700)]
added static analyzer tests to travis CI
Yann Collet [Thu, 16 Aug 2018 00:41:44 +0000 (17:41 -0700)]
fix scope of scan-build tests
exclude zlib code
Yann Collet [Wed, 15 Aug 2018 23:43:13 +0000 (16:43 -0700)]
ensure dependency for zlib wrapper
George Lu [Wed, 15 Aug 2018 22:01:03 +0000 (15:01 -0700)]
prune comments
George Lu [Wed, 15 Aug 2018 21:57:10 +0000 (14:57 -0700)]
Move Stuff around
Group similar functions together, remove outdated comments
George Lu [Wed, 15 Aug 2018 21:27:07 +0000 (14:27 -0700)]
consts
George Lu [Wed, 15 Aug 2018 21:00:57 +0000 (14:00 -0700)]
Remove unused stuff
Yann Collet [Wed, 15 Aug 2018 22:20:56 +0000 (15:20 -0700)]
Merge pull request #1280 from GeorgeLu97/betterDisplay
Better Paramgrill Display
Yann Collet [Wed, 15 Aug 2018 21:35:38 +0000 (14:35 -0700)]
fixed minor warnings issued by scan-build
George Lu [Wed, 15 Aug 2018 21:29:49 +0000 (14:29 -0700)]
clarify display README
George Lu [Wed, 15 Aug 2018 18:46:19 +0000 (11:46 -0700)]
Fix wraparound
George Lu [Wed, 15 Aug 2018 01:04:58 +0000 (18:04 -0700)]
silencing params
George Lu [Tue, 14 Aug 2018 23:51:39 +0000 (16:51 -0700)]
Clean up repetitive display
Add documentation
George Lu [Tue, 14 Aug 2018 22:54:07 +0000 (15:54 -0700)]
-q -v options
George Lu [Tue, 14 Aug 2018 21:24:05 +0000 (14:24 -0700)]
begin display changes
Yann Collet [Tue, 14 Aug 2018 23:56:07 +0000 (16:56 -0700)]
Merge branch 'dev' into scanbuild
Yann Collet [Wed, 15 Aug 2018 20:45:17 +0000 (13:45 -0700)]
Merge pull request #1277 from GeorgeLu97/mtoptions
memoTableOptions
George Lu [Mon, 13 Aug 2018 19:51:22 +0000 (12:51 -0700)]
Add memoTable options
-hashing memotable
-no memotable
Yann Collet [Tue, 14 Aug 2018 19:56:21 +0000 (12:56 -0700)]
fixed several minor issues detected by scan-build
only notable one :
writeNCount() resists better vs invalid distributions
(though it should never happen within zstd anyway)
Yann Collet [Tue, 14 Aug 2018 23:44:28 +0000 (16:44 -0700)]
Merge pull request #1279 from GeorgeLu97/benchSA
Fix scan-build warnings in bench.c
George Lu [Fri, 10 Aug 2018 23:14:12 +0000 (16:14 -0700)]
MAke it easier to add params
Make memoTable size limited
George Lu [Thu, 9 Aug 2018 23:36:34 +0000 (16:36 -0700)]
Temp fix perf regression
Yann Collet [Tue, 14 Aug 2018 23:06:18 +0000 (16:06 -0700)]
Merge pull request #1276 from GeorgeLu97/fadt
forceAttachDict
George Lu [Tue, 14 Aug 2018 21:44:47 +0000 (14:44 -0700)]
Fix scan-build warnings in bench.c
George Lu [Thu, 9 Aug 2018 17:42:35 +0000 (10:42 -0700)]
forceAttachDict
George Lu [Mon, 6 Aug 2018 23:52:17 +0000 (16:52 -0700)]
Add Time Checks
Fix double -> U64 display
George Lu [Mon, 6 Aug 2018 22:08:35 +0000 (15:08 -0700)]
Reduce Duplication
Change Defaults
Asserts actually disabled in paramgrill + fullbench
George Lu [Wed, 1 Aug 2018 01:47:27 +0000 (18:47 -0700)]
Doc Updates
Add option to pass in existing parameters in use
Yann Collet [Tue, 14 Aug 2018 21:17:28 +0000 (14:17 -0700)]
Merge pull request #1275 from GeorgeLu97/multilvl
MultiLvl
George Lu [Tue, 14 Aug 2018 18:57:15 +0000 (11:57 -0700)]
scan-build
George Lu [Mon, 13 Aug 2018 23:38:51 +0000 (16:38 -0700)]
rebase clevel
Yann Collet [Tue, 14 Aug 2018 01:38:05 +0000 (18:38 -0700)]
Merge pull request #1278 from edenzik/fb/ezik/better-cmake-support-1081
Cmake now builds with CMAKE_BUILD_TYPE=Release by default
Eden Zik [Tue, 14 Aug 2018 00:28:52 +0000 (20:28 -0400)]
Cmake now builds with CMAKE_BUILD_TYPE=Release by default, both while
being invoked from the main Makefile (via cmakebuild) or directly from
the build/cmake directory. Suggested by @pdknsk (#1081).
George Lu [Tue, 31 Jul 2018 18:13:44 +0000 (11:13 -0700)]
strategy switching
George Lu [Tue, 31 Jul 2018 00:42:46 +0000 (17:42 -0700)]
Update fulltable to use same interface
Add seperateFiles flag
George Lu [Fri, 27 Jul 2018 23:49:33 +0000 (16:49 -0700)]
Renames, Documentation Updates
George Lu [Fri, 27 Jul 2018 21:19:55 +0000 (14:19 -0700)]
Style Changes
Add single run dictionaries
Change MB to be consistent 1 << 20 rather than 1,000,000
George Lu [Fri, 27 Jul 2018 18:47:14 +0000 (11:47 -0700)]
Cleanup
George Lu [Fri, 27 Jul 2018 15:20:31 +0000 (08:20 -0700)]
Generalize, macro magic numbers
George Lu [Thu, 26 Jul 2018 23:45:00 +0000 (16:45 -0700)]
Perf improvements
try decay
strategy selection skipping
George Lu [Wed, 25 Jul 2018 18:55:09 +0000 (11:55 -0700)]
Better Display
George Lu [Wed, 25 Jul 2018 18:37:20 +0000 (11:37 -0700)]
Bugfixes, style changes
Complete euclidean distance climb
George Lu [Wed, 25 Jul 2018 00:55:17 +0000 (17:55 -0700)]
New climb
feas part 2 uses euclidean metric
George Lu [Wed, 25 Jul 2018 00:26:21 +0000 (17:26 -0700)]
Table
Compiling
+Euclidean Metric
George Lu [Mon, 13 Aug 2018 23:15:34 +0000 (16:15 -0700)]
Revert "Reorder declaration"
This reverts commit
3ac2c22485ab5508f47e3eab642b787af0e68b5f .
George Lu [Mon, 13 Aug 2018 23:13:46 +0000 (16:13 -0700)]
Revert "Default lvl 1"
This reverts commit
0cc75d6ee02efe9da7901848ce588a7f9f61b4f9 .
Yann Collet [Mon, 13 Aug 2018 22:44:50 +0000 (15:44 -0700)]
Merge pull request #1236 from GeorgeLu97/paramgrillconstraints
ParamgrillConstraints
George Lu [Mon, 13 Aug 2018 20:56:18 +0000 (13:56 -0700)]
Default lvl 1
MB to 2^20
George Lu [Thu, 9 Aug 2018 23:38:32 +0000 (16:38 -0700)]
Reorder declaration
Yann Collet [Thu, 9 Aug 2018 22:57:19 +0000 (15:57 -0700)]
fixed assert() condition
Yann Collet [Thu, 9 Aug 2018 22:16:31 +0000 (15:16 -0700)]
minor code comments improvements
Yann Collet [Thu, 9 Aug 2018 19:35:49 +0000 (12:35 -0700)]
Merge pull request #1273 from facebook/zstdgrep
added zstdgrep documentation
Yann Collet [Thu, 9 Aug 2018 19:28:25 +0000 (12:28 -0700)]
added zstdgrep documentation
presenting `zstdgrep` limit regarding dictionary compression
with workaround recommended by @tobwen (#1268)
George Lu [Thu, 9 Aug 2018 19:07:57 +0000 (12:07 -0700)]
Remove ctx from benchMem
George Lu [Thu, 9 Aug 2018 18:38:09 +0000 (11:38 -0700)]
Add consts
+ fix gcc-8 warnings
George Lu [Tue, 7 Aug 2018 18:56:14 +0000 (11:56 -0700)]
argument parsing cleanup
+ clarifying comment
George Lu [Tue, 7 Aug 2018 01:37:55 +0000 (18:37 -0700)]
Readability improvements, renaming
George Lu [Tue, 7 Aug 2018 01:00:36 +0000 (18:00 -0700)]
const srcPtrs
George Lu [Tue, 7 Aug 2018 00:13:36 +0000 (17:13 -0700)]
Change speed representation from floating point to integral
George Lu [Mon, 30 Jul 2018 18:30:38 +0000 (11:30 -0700)]
Update Documentation
Change comment // to /* */
Add more description of what functions do
Remove outdated comments
George Lu [Fri, 27 Jul 2018 15:49:25 +0000 (08:49 -0700)]
Renaming / Style fixes
George Lu [Fri, 20 Jul 2018 21:35:09 +0000 (14:35 -0700)]
Separate capacity vs size
Also:
Make suggested fixes
-varInds_t
-reorder some arguments
-remove code duplication
-update README / -h
-Fix memory leaks
George Lu [Tue, 17 Jul 2018 01:22:04 +0000 (18:22 -0700)]
Fix windows implicit casting bugs
George Lu [Tue, 17 Jul 2018 01:04:57 +0000 (18:04 -0700)]
Add Levels
George Lu [Mon, 16 Jul 2018 23:16:31 +0000 (16:16 -0700)]
BenchMem with block compressed sizes passed back up
George Lu [Fri, 13 Jul 2018 00:30:39 +0000 (17:30 -0700)]
Total Changes:
Add different constraint types (decompression speed, compression memory, parameter constraints)
Separate search space by strategy + strategy selection
Memoize results
Real random restarts
Support multiple files
Support Dictionary inputs
Debug Macro for extra printing
George Lu [Tue, 10 Jul 2018 01:37:54 +0000 (18:37 -0700)]
Dictionary + Multiple file Loading
George Lu [Mon, 9 Jul 2018 20:44:01 +0000 (13:44 -0700)]
Not crashing
George Lu [Mon, 18 Jun 2018 18:59:45 +0000 (11:59 -0700)]
Working V1
George Lu [Wed, 6 Jun 2018 23:19:09 +0000 (16:19 -0700)]
Parses additional parameters
Additional constraint checking
Minor fixes
more param parsing
Add Memory
Change paramVariation
work on feasibility
reformat bench
Changed Paramgrill to use bench.c benchmarking
customlevel macro
Printing Flag
Minor changes
Explicit casting
Makefile fix
casting, type fix
Printing Flag
Minor Changes
comments, helper fn's
Yann Collet [Wed, 8 Aug 2018 21:56:00 +0000 (14:56 -0700)]
Merge pull request #1272 from facebook/travisTest
gcc-8 travis test
Yann Collet [Wed, 8 Aug 2018 21:48:51 +0000 (14:48 -0700)]
Merge pull request #1271 from felixhandte/circleci-2.0-config
Migrate Config to CircleCI 2.0
W. Felix Handte [Wed, 8 Aug 2018 21:09:12 +0000 (14:09 -0700)]
Preserve Commented-Out Longer Tests
Yann Collet [Wed, 8 Aug 2018 19:37:08 +0000 (12:37 -0700)]
some errors may only happen when optimizations are enabled