]> git.ipfire.org Git - thirdparty/vectorscan.git/log
thirdparty/vectorscan.git
5 years agosmallwrite: add report dedupe check
Wang Xiang W [Fri, 3 Apr 2020 16:08:10 +0000 (12:08 -0400)] 
smallwrite: add report dedupe check

5 years agoLimex: fix acceleration path analysis
Wang Xiang W [Wed, 18 Mar 2020 13:36:51 +0000 (09:36 -0400)] 
Limex: fix acceleration path analysis

5 years agoNoodle: avoid an extra convert instruction
Wang Xiang W [Fri, 6 Mar 2020 08:24:07 +0000 (03:24 -0500)] 
Noodle: avoid an extra convert instruction

fixes github issue #221

5 years agogcc-9: fix CMake parsing of CPU architecture for non-English locale
Wang Xiang W [Mon, 17 Feb 2020 09:41:36 +0000 (04:41 -0500)] 
gcc-9: fix CMake parsing of CPU architecture for non-English locale

Fixes github issue #217

5 years agoProcessing VLAN packets in pcapCorpus.py
Nan Xiao [Tue, 7 Jan 2020 01:52:46 +0000 (09:52 +0800)] 
Processing VLAN packets in pcapCorpus.py

Signed-off-by: Nan Xiao <xiaonan830818@gmail.com>
5 years agoCyclic redundancy: change DFS termination condition into successors of cyclic vertex
Hong, Yang A [Mon, 6 Jan 2020 15:32:37 +0000 (15:32 +0000)] 
Cyclic redundancy: change DFS termination condition into successors of cyclic vertex

5 years agoFix platform compatibility check
Dmitry Yakovenko [Sat, 11 Jan 2020 21:35:37 +0000 (00:35 +0300)] 
Fix platform compatibility check

5 years agoUpdate compilation.rst
flip111 [Fri, 29 Nov 2019 14:59:42 +0000 (15:59 +0100)] 
Update compilation.rst

fixed two spelling mistakes

5 years agoA tiny cleanup
Pavel Shlyak [Sun, 18 Aug 2019 21:50:03 +0000 (00:50 +0300)] 
A tiny cleanup

5 years agoFix small typo
Frank Wessels [Thu, 1 Aug 2019 20:47:54 +0000 (13:47 -0700)] 
Fix small typo

5 years agoBump version number for release
Hong, Yang A [Mon, 14 Oct 2019 13:02:26 +0000 (13:02 +0000)] 
Bump version number for release

5 years agochangelog: updates for 5.2.1 release
Hong, Yang A [Mon, 14 Oct 2019 12:56:01 +0000 (12:56 +0000)] 
changelog: updates for 5.2.1 release

5 years agotools: fix compile issue for RELEASE_BUILD code
Hong, Yang A [Thu, 22 Aug 2019 13:54:54 +0000 (21:54 +0800)] 
tools: fix compile issue for RELEASE_BUILD code

Fixes github issue #186

5 years agogcc-9:disable redundant move check for older compiler versions
Wang, Xiang W [Thu, 5 Sep 2019 12:16:08 +0000 (08:16 -0400)] 
gcc-9:disable redundant move check for older compiler versions

5 years agoDoc changes in "pure negative" logical combination support.
Chang, Harry [Fri, 23 Aug 2019 02:50:22 +0000 (10:50 +0800)] 
Doc changes in "pure negative" logical combination support.

6 years agoBump version number for release
Hong, Yang A [Fri, 12 Jul 2019 15:01:00 +0000 (23:01 +0800)] 
Bump version number for release

6 years agochangelog: updates for 5.2.0 release
Hong, Yang A [Fri, 12 Jul 2019 14:55:44 +0000 (22:55 +0800)] 
changelog: updates for 5.2.0 release

6 years agoAdd windows DLL support
Bobby Martin [Wed, 27 Mar 2019 16:52:00 +0000 (09:52 -0700)] 
Add windows DLL support
(with AVX2 flag removed currently)

6 years agoScratch: fix scratch free issue when memory allocation fails
Wang, Xiang W [Wed, 10 Jul 2019 00:18:42 +0000 (20:18 -0400)] 
Scratch: fix scratch free issue when memory allocation fails

Fixes github issue #174

6 years agoChimera: don't disable single match flag when checking Hyperscan support
Wang, Xiang W [Wed, 3 Jul 2019 03:37:21 +0000 (23:37 -0400)] 
Chimera: don't disable single match flag when checking Hyperscan support

6 years agoLiteral API: update dev-reference
Hong, Yang A [Wed, 17 Jul 2019 15:45:59 +0000 (23:45 +0800)] 
Literal API: update dev-reference

6 years agoadd new Literal API for pure literal expressions:
Hong, Yang A [Wed, 17 Jul 2019 16:29:27 +0000 (00:29 +0800)] 
add new Literal API for pure literal expressions:

Design compile time api hs_compile_lit() and hs_compile_lit_multi()
to handle pure literal pattern sets. Corresponding option --literal-on
is added for hyperscan testing suites. Extended parameters and part of
flags are not supported for this api.

6 years agoDo not free stream unless hs_close_stream returns success.
Chang, Harry [Thu, 20 Jun 2019 00:59:18 +0000 (08:59 +0800)] 
Do not free stream unless hs_close_stream returns success.
(by unit-hyperscan HyperscanArgChecks.CloseStreamNoScratch)

6 years agoLogical combination: add purely negative match at EOD unit test
Chang, Harry [Sun, 31 Mar 2019 03:16:50 +0000 (11:16 +0800)] 
Logical combination: add purely negative match at EOD unit test
MultiCombPurelyNegativeUniSubEOD6.

6 years agoLogical combination: add streaming mode unit test MultiCombStream1.
Chang, Harry [Fri, 7 Jun 2019 03:38:37 +0000 (11:38 +0800)] 
Logical combination: add streaming mode unit test MultiCombStream1.

6 years agoLogical Combination: avoid corruption of pending combination report
Chang, Harry [Thu, 6 Jun 2019 07:12:24 +0000 (15:12 +0800)] 
Logical Combination: avoid corruption of pending combination report
in streaming mode.

Fixes github issue #165

6 years agoLogical combination: support EOD match from purely negative case.
Chang, Harry [Wed, 27 Mar 2019 07:19:14 +0000 (15:19 +0800)] 
Logical combination: support EOD match from purely negative case.

6 years agotools: hscollider FTBS in alpine linux
Carlo Marcelo Arenas Belón [Mon, 3 Jun 2019 22:32:38 +0000 (15:32 -0700)] 
tools: hscollider FTBS in alpine linux

alpine uses musl instead of glibc and therefore doesn't have backtrace()
as part of its libc.

POSIX mandates that _exit() be defined through unistd.h which used to be
included together with execinfo.h when backtrace() was detected and
therefore it happened to build fine for linux or freebsd (when using
libexecinfo from the system or ports).

since there was a macro already defined to test for unistd.h use that
instead and decouple this dependency, so that the code could be built
even when no backtrace() is provided (as expected also in OpenBSD)

6 years agounit: avoid UB by making integer literal explicitally unsigned
Carlo Marcelo Arenas Belón [Thu, 30 May 2019 18:31:29 +0000 (11:31 -0700)] 
unit: avoid UB by making integer literal explicitally unsigned

reported by cppcheck as:

[unit/internal/uniform_ops.cpp:78]: (error) Shifting signed 32-bit value by 31 bits is undefined behaviour
[unit/internal/uniform_ops.cpp:109]: (error) Shifting signed 32-bit value by 31 bits is undefined behaviour
[unit/internal/uniform_ops.cpp:127]: (error) Shifting signed 32-bit value by 31 bits is undefined behaviour
[unit/internal/uniform_ops.cpp:145]: (error) Shifting signed 32-bit value by 31 bits is undefined behaviour

6 years agoBUGFIX: fix Numerical result out of range error
Mostafa Nazari [Wed, 8 May 2019 05:12:48 +0000 (09:42 +0430)] 
BUGFIX: fix Numerical result out of range error

Fix Error errno=34,  fix Numerical result out of range error
issue: https://github.com/intel/hyperscan/issues/155

6 years agoFix uninitialized use of scatter_unit_uX due to padding
Derrick Lyndon Pallas [Mon, 22 Apr 2019 21:13:52 +0000 (21:13 +0000)] 
Fix uninitialized use of scatter_unit_uX due to padding

These non-packed structures are placed into a std::vector.  Later, they
contents of the vector are memcpy'd and the CRC of this space is taken.
Some compilers will zero the struct padding but GCC8.2 with -O2 at least
will not.  This means that the CRC is based on uninitialized memory.

Since it is expected that these bytes will be memcpy'd, zero in place once
they're in the std::vector.

Found by Valgrind.

Q.v. Issue #148

6 years agoAvoid array-bounds error when debug/fortify enabled
Derrick Lyndon Pallas [Mon, 22 Apr 2019 20:19:14 +0000 (20:19 +0000)] 
Avoid array-bounds error when debug/fortify enabled

This code causes GCC to error out due to a bounds error with the following set

-D_GLIBCXX_DEBUG
-D_FORTIFY_SOURCE=2

The solution is to copy via iterator.

6 years agodispatcher: return correct function type from ifunc resolver
Derrick Lyndon Pallas [Fri, 19 Apr 2019 21:36:19 +0000 (21:36 +0000)] 
dispatcher: return correct function type from ifunc resolver

6 years agoBump version number for release
Wang, Xiang W [Wed, 10 Apr 2019 10:43:07 +0000 (06:43 -0400)] 
Bump version number for release

6 years agochangelog: updates for 5.1.1 release
Wang, Xiang W [Wed, 3 Apr 2019 10:22:20 +0000 (06:22 -0400)] 
changelog: updates for 5.1.1 release

6 years agounit: check fix of rose instr program dead loop
Hong, Yang A [Tue, 2 Apr 2019 15:36:03 +0000 (23:36 +0800)] 
unit: check fix of rose instr program dead loop

6 years agocmake: #144 using GNUInstallDirs variables instead of hard-coding in *.pc.in
root [Thu, 28 Mar 2019 03:21:00 +0000 (11:21 +0800)] 
cmake: #144 using GNUInstallDirs variables instead of hard-coding in *.pc.in

6 years agoRose: add necessary instruction programs to avoid dead loop
Hong, Yang A [Mon, 25 Mar 2019 13:19:13 +0000 (21:19 +0800)] 
Rose: add necessary instruction programs to avoid dead loop

Fixes github issue #141

6 years agoruntime: mark scratch unused only when no further scratch references
Wang, Xiang W [Sun, 31 Mar 2019 15:19:48 +0000 (11:19 -0400)] 
runtime: mark scratch unused only when no further scratch references

6 years agoRose: extend handling for unexpected logical combination programs
Wang, Xiang W [Wed, 27 Mar 2019 15:38:48 +0000 (11:38 -0400)] 
Rose: extend handling for unexpected logical combination programs

6 years agoRose: add handling for unexpected programs
Wang, Xiang W [Mon, 25 Mar 2019 16:30:07 +0000 (12:30 -0400)] 
Rose: add handling for unexpected programs

6 years agobuild: avoid file path impact on fat runtime build
Wang, Xiang W [Tue, 26 Mar 2019 10:19:03 +0000 (06:19 -0400)] 
build: avoid file path impact on fat runtime build

Fixes github issue #137

6 years agogcc-9: fix CMake parsing of CPU architecture
Wang, Xiang W [Mon, 25 Mar 2019 10:02:39 +0000 (06:02 -0400)] 
gcc-9: fix CMake parsing of CPU architecture

GCC-9 adds known options section for march that causes regex
replace failure in CMake file

Fixes github issue #136

6 years agoBump version number for release
Chang, Harry [Thu, 17 Jan 2019 07:47:30 +0000 (15:47 +0800)] 
Bump version number for release

6 years agochangelog: updates for 5.1.0 release
Chang, Harry [Thu, 3 Jan 2019 06:58:53 +0000 (14:58 +0800)] 
changelog: updates for 5.1.0 release

6 years agounit: check return value of malloc
Wang, Xiang W [Tue, 29 Jan 2019 09:45:51 +0000 (04:45 -0500)] 
unit: check return value of malloc

6 years agochimera: fix scratch space handling in shared scratch use case
Wang, Xiang W [Mon, 21 Jan 2019 08:48:36 +0000 (03:48 -0500)] 
chimera: fix scratch space handling in shared scratch use case

6 years agotools: add catches for C++ exceptions
Wang, Xiang W [Tue, 8 Jan 2019 11:45:31 +0000 (06:45 -0500)] 
tools: add catches for C++ exceptions

6 years agomcclellan: fix dump issue in wide-state case.
Hong, Yang A [Thu, 17 Jan 2019 16:20:06 +0000 (00:20 +0800)] 
mcclellan: fix dump issue in wide-state case.

6 years agoliteral matching: separate path for pure literal patterns
Hong, Yang A [Tue, 8 Jan 2019 22:00:55 +0000 (06:00 +0800)] 
literal matching: separate path for pure literal patterns

6 years agobuild: avoid pcre error for hscollider when using installed PCRE package
Wang, Xiang W [Wed, 26 Dec 2018 04:19:51 +0000 (23:19 -0500)] 
build: avoid pcre error for hscollider when using installed PCRE package

Fixes github issue #127

6 years agofix dead loop under win10 release bin.
Chang, Harry [Tue, 25 Dec 2018 05:49:29 +0000 (13:49 +0800)] 
fix dead loop under win10 release bin.

6 years agohscollider: fix back inserter error for windows
Wang, Xiang W [Mon, 24 Dec 2018 06:32:02 +0000 (01:32 -0500)] 
hscollider: fix back inserter error for windows

6 years agorose: disable switch optimization for windows
Wang, Xiang W [Mon, 24 Dec 2018 05:45:59 +0000 (00:45 -0500)] 
rose: disable switch optimization for windows

6 years agodoc: fix github repo address
Wang, Xiang W [Mon, 24 Dec 2018 02:37:30 +0000 (21:37 -0500)] 
doc: fix github repo address

6 years agomcclellan: wide state fixes for sanitisers and accept state construction
Hong, Yang A [Sun, 23 Dec 2018 20:49:47 +0000 (04:49 +0800)] 
mcclellan: wide state fixes for sanitisers and accept state construction

6 years agoSilence clang warnings about unused variable
Wang, Xiang W [Sat, 22 Dec 2018 02:46:04 +0000 (21:46 -0500)] 
Silence clang warnings about unused variable

6 years agoRose: optimize switch-case with Labels-as-Values
Guangqing Chen [Mon, 3 Dec 2018 21:25:52 +0000 (05:25 +0800)] 
Rose: optimize switch-case with Labels-as-Values

6 years agoUpdate PCRE version to 8.42 (8.41 is also compatible)
Chang, Harry [Thu, 20 Dec 2018 07:28:07 +0000 (15:28 +0800)] 
Update PCRE version to 8.42 (8.41 is also compatible)

6 years agoDFA state compression: 16-bit wide and sherman co-exist
Hong, Yang A [Wed, 19 Dec 2018 09:49:09 +0000 (17:49 +0800)] 
DFA state compression: 16-bit wide and sherman co-exist

6 years agochimera: silence gcc-8 exception catch warning
Wang, Xiang W [Mon, 3 Dec 2018 03:31:44 +0000 (22:31 -0500)] 
chimera: silence gcc-8 exception catch warning

6 years agoJenkins-1424: fixed error which misses report of logical combination under
Chang, Harry [Wed, 31 Oct 2018 03:00:11 +0000 (11:00 +0800)] 
Jenkins-1424: fixed error which misses report of logical combination under
vacuous input.

6 years agoJenkins-1080: fixed error reporting logical combination match in "A&!B" type by
Chang, Harry [Wed, 8 Aug 2018 06:44:01 +0000 (14:44 +0800)] 
Jenkins-1080: fixed error reporting logical combination match in "A&!B" type by
moving flush_comb behind report_eod_matches in hs_close_stream/hs_reset_stream.

6 years agoUse std::distance explicitly to avoid ambiguity with boost
Wang, Xiang W [Wed, 26 Sep 2018 10:52:40 +0000 (06:52 -0400)] 
Use std::distance explicitly to avoid ambiguity with boost

7 years agoBump version number for release
Wang, Xiang W [Mon, 9 Jul 2018 15:15:22 +0000 (11:15 -0400)] 
Bump version number for release

7 years agochangelog: updates for 5.0.0 release
Chang, Harry [Mon, 9 Jul 2018 07:18:10 +0000 (15:18 +0800)] 
changelog: updates for 5.0.0 release

7 years agochimera: update dev-reference
Wang, Xiang W [Wed, 27 Jun 2018 14:21:50 +0000 (10:21 -0400)] 
chimera: update dev-reference

7 years agochimera: add pkgconfig install files
Wang, Xiang W [Mon, 9 Jul 2018 12:26:22 +0000 (08:26 -0400)] 
chimera: add pkgconfig install files

7 years agoWindows porting: update docs.
Lu, Qi [Fri, 6 Jul 2018 15:06:55 +0000 (11:06 -0400)] 
Windows porting: update docs.

7 years agoWindows porting: port hyperscan and chimera tools to windows.
Lu, Qi [Tue, 8 May 2018 16:05:44 +0000 (12:05 -0400)] 
Windows porting: port hyperscan and chimera tools to windows.

7 years agochimera: hybrid of Hyperscan and PCRE
Wang, Xiang W [Fri, 9 Mar 2018 08:52:12 +0000 (03:52 -0500)] 
chimera: hybrid of Hyperscan and PCRE

7 years agoLogical Combination of patterns.
Chang, Harry [Fri, 22 Jun 2018 10:15:21 +0000 (18:15 +0800)] 
Logical Combination of patterns.

7 years agobuild: enable hscollider for installed PCRE package
Wang, Xiang W [Tue, 5 Jun 2018 10:27:13 +0000 (06:27 -0400)] 
build: enable hscollider for installed PCRE package

Fixes github issue #86

7 years agohscollider: fix input length for UTF8 check
Wang, Xiang W [Wed, 18 Apr 2018 03:26:04 +0000 (23:26 -0400)] 
hscollider: fix input length for UTF8 check

7 years agoue2_graph: more direct property_graph defn
Justin Viiret [Wed, 20 Dec 2017 02:01:12 +0000 (13:01 +1100)] 
ue2_graph: more direct property_graph defn

7 years agonfagraph: remove ng_undirected.h
Justin Viiret [Thu, 14 Dec 2017 03:05:05 +0000 (14:05 +1100)] 
nfagraph: remove ng_undirected.h

7 years agong_repeat: use undirected_graph
Justin Viiret [Thu, 14 Dec 2017 02:49:45 +0000 (13:49 +1100)] 
ng_repeat: use undirected_graph

7 years agograph_undirected: adapt bidi graph to undirected
Justin Viiret [Tue, 12 Dec 2017 23:15:21 +0000 (10:15 +1100)] 
graph_undirected: adapt bidi graph to undirected

Introduces an adaptor (like the BGL's reverse_graph) that presents an
undirected view of a bidirectional graph.

Initially used in ng_calc_components.

7 years agomcsheng: debug format string fixes
Justin Viiret [Mon, 29 Jan 2018 00:15:29 +0000 (11:15 +1100)] 
mcsheng: debug format string fixes

7 years agosheng: fix reportCurrent eod flag
Justin Viiret [Thu, 18 Jan 2018 04:53:13 +0000 (15:53 +1100)] 
sheng: fix reportCurrent eod flag

eod here should be 0, not 1. The reportCurrent NFA API function for
Sheng is unused at the moment, so this wasn't causing any problems
earlier.

7 years agomcclellancompile: MAX_SHERMAN_LIST_LEN can be 9
Justin Viiret [Thu, 18 Jan 2018 00:24:00 +0000 (11:24 +1100)] 
mcclellancompile: MAX_SHERMAN_LIST_LEN can be 9

7 years agomisc: docs, typo fixes, small cleanups
Justin Viiret [Wed, 17 Jan 2018 23:41:43 +0000 (10:41 +1100)] 
misc: docs, typo fixes, small cleanups

7 years agorose_build_add: remove unused max_adj param
Justin Viiret [Tue, 16 Jan 2018 23:59:58 +0000 (10:59 +1100)] 
rose_build_add: remove unused max_adj param

In prepAcceptForAddAnchoredNFA(), we used to support different values
for max_adj. Since it's now always zero, remove it.

7 years agong_violet: make calcSplitRatio operation faster
Justin Viiret [Tue, 6 Jun 2017 04:37:18 +0000 (14:37 +1000)] 
ng_violet: make calcSplitRatio operation faster

Implements count_reachable in a less malloc-happy way, improving
compile performance. Adds a count() function to small_color_map.

7 years agong_width: turn min width check into assert
Justin Viiret [Tue, 16 Jan 2018 03:56:04 +0000 (14:56 +1100)] 
ng_width: turn min width check into assert

7 years agoMigrated from 01.org/hyperscan to hyperscan.io
Xiang Wang [Mon, 5 Feb 2018 01:13:49 +0000 (20:13 -0500)] 
Migrated from 01.org/hyperscan to hyperscan.io

7 years agoBump version number for release
Matthew Barr [Tue, 23 Jan 2018 23:06:50 +0000 (10:06 +1100)] 
Bump version number for release

7 years agochangelog: updates for 4.7.0 release
Matthew Barr [Tue, 23 Jan 2018 23:05:09 +0000 (10:05 +1100)] 
changelog: updates for 4.7.0 release

7 years agodoc: describe tools hscheck, hscollider, hsdump
Justin Viiret [Tue, 23 Jan 2018 02:56:22 +0000 (13:56 +1100)] 
doc: describe tools hscheck, hscollider, hsdump

7 years agodoc: in dev guide, avoid Goudy Old Style font
Justin Viiret [Sun, 21 Jan 2018 23:40:37 +0000 (10:40 +1100)] 
doc: in dev guide, avoid Goudy Old Style font

7 years agodoc: update copyright dates for 2018
Justin Viiret [Sun, 21 Jan 2018 23:29:05 +0000 (10:29 +1100)] 
doc: update copyright dates for 2018

7 years agopcre: do not explode if pcre is missing
Matthew Barr [Fri, 19 Jan 2018 04:20:39 +0000 (15:20 +1100)] 
pcre: do not explode if pcre is missing

7 years agohscollider: example test cases
Alex Coyte [Wed, 10 Jan 2018 02:38:20 +0000 (13:38 +1100)] 
hscollider: example test cases

7 years agocmake: support MinSizeRel config
Matthew Barr [Mon, 11 Dec 2017 05:05:32 +0000 (16:05 +1100)] 
cmake: support MinSizeRel config

7 years agoMove cpuid checks inline.
Matthew Barr [Mon, 11 Dec 2017 05:02:26 +0000 (16:02 +1100)] 
Move cpuid checks inline.

During fat runtime function resolution there was a chance that the PLT
might not be initialised in time for us to call the cpuid check
functions. Moving them inline means there is no PLT to worry about.

Fixes #78

7 years agohscollider: allow conversion of FileCorpora unique_ptr to Corpora
Alex Coyte [Tue, 12 Dec 2017 00:41:43 +0000 (11:41 +1100)] 
hscollider: allow conversion of FileCorpora unique_ptr to Corpora

7 years agohscheck: tool to test regex compilation
Justin Viiret [Thu, 7 Dec 2017 03:07:48 +0000 (14:07 +1100)] 
hscheck: tool to test regex compilation

hscheck accepts a file of regular expressions in the form:

    ID:/regex/flags

and tests whether they can be compiled with Hyperscan, reporting the
error if compilation fails.

7 years agohscollider: tool for testing Hyperscan match behaviour against PCRE
Alex Coyte [Mon, 11 Dec 2017 22:29:20 +0000 (09:29 +1100)] 
hscollider: tool for testing Hyperscan match behaviour against PCRE

7 years agoIntroduce hsdump development tool for producing information during compilation.
Alex Coyte [Mon, 20 Nov 2017 02:25:38 +0000 (13:25 +1100)] 
Introduce hsdump development tool for producing information during compilation.

This tool is intended to assist Hyperscan developers with development and
debugging by providing insights into the generated bytecode.

7 years agoext param - more consistent depth check
Matthew Barr [Tue, 14 Nov 2017 22:13:44 +0000 (09:13 +1100)] 
ext param - more consistent depth check