]> git.ipfire.org Git - thirdparty/suricata-verify.git/log
thirdparty/suricata-verify.git
2 years agotests: add http_uri parsing test 1173/head
Victor Julien [Mon, 27 Mar 2023 10:21:41 +0000 (12:21 +0200)] 
tests: add http_uri parsing test

2 years agotests: add stream_size parsing test
Victor Julien [Mon, 27 Mar 2023 10:21:09 +0000 (12:21 +0200)] 
tests: add stream_size parsing test

2 years agotests: add rules testing with engine analysis
Victor Julien [Fri, 17 Mar 2023 08:21:07 +0000 (09:21 +0100)] 
tests: add rules testing with engine analysis

Tests check engine-analysis representation of rules.

2 years agotests: ET open rule parsing test: update rules
Victor Julien [Fri, 17 Mar 2023 17:16:12 +0000 (18:16 +0100)] 
tests: ET open rule parsing test: update rules

2 years agotests: add 5929 test for http2
Victor Julien [Thu, 23 Mar 2023 11:21:44 +0000 (12:21 +0100)] 
tests: add 5929 test for http2

2 years agotests: add ticket 5929 test
Victor Julien [Thu, 23 Mar 2023 08:36:55 +0000 (09:36 +0100)] 
tests: add ticket 5929 test

2 years agobase64_data: add tests for bug 5885 1163/head
Shivani Bhardwaj [Thu, 9 Mar 2023 07:34:35 +0000 (13:04 +0530)] 
base64_data: add tests for bug 5885

2 years agotests/quic-ietf: fix test 1158/head
Jason Ish [Wed, 8 Mar 2023 22:10:01 +0000 (16:10 -0600)] 
tests/quic-ietf: fix test

Suricata was matching on the wrong ja3.

2 years agomqtt-events-unintroduced: fix test
Jason Ish [Sun, 19 Feb 2023 01:00:50 +0000 (19:00 -0600)] 
mqtt-events-unintroduced: fix test

On inspection of the pcap, the signature 2226005 should only alert
once.

Issue: 5799

2 years agomqtt-events-missing-connect: fix test
Jason Ish [Sun, 19 Feb 2023 00:58:13 +0000 (18:58 -0600)] 
mqtt-events-missing-connect: fix test

On inspection of the pcap, the signature 2226000 should only alert once.

Issue: 5799

2 years agomqtt-events-invalid-qos: fix test
Jason Ish [Fri, 17 Feb 2023 18:34:36 +0000 (12:34 -0600)] 
mqtt-events-invalid-qos: fix test

On inspection of the pcap, the signature 2226006 should only alert once.

Issue: 5799

2 years agotest: issue 4759
Jason Ish [Fri, 17 Feb 2023 18:33:15 +0000 (12:33 -0600)] 
test: issue 4759

2 years agotests: fix exception test pcap paths 1156/head
Victor Julien [Tue, 28 Mar 2023 15:35:31 +0000 (17:35 +0200)] 
tests: fix exception test pcap paths

2 years agosmtp-eve: fix filesize and version check
Shivani Bhardwaj [Fri, 10 Mar 2023 05:38:09 +0000 (11:08 +0530)] 
smtp-eve: fix filesize and version check

Earlier, the CRLFs that were a part of the file were also stripped off
as a part of finding and stripping the delimiters in the MIME handler.
This was fixed as a part of
https://redmine.openinfosecfoundation.org/issues/5725.
This patch fixes the test too to reflect the fix.

Ticket: 5821

2 years agofile: Add tests for file_data prefilter keyword
Haleema Khan [Tue, 14 Feb 2023 13:27:10 +0000 (18:27 +0500)] 
file: Add tests for file_data prefilter keyword

Tests the `prefilter` keyword for `file_data` and `file.data`

Ticket #5801

2 years agocreatest: update the default README
Shivani Bhardwaj [Mon, 20 Feb 2023 05:26:03 +0000 (10:56 +0530)] 
createst: update the default README

2 years agocreatest: Create a default README with every test
Alice Akaki [Thu, 24 Nov 2022 18:00:12 +0000 (14:00 -0400)] 
createst: Create a default README with every test

Feature: #5210

2 years agotls: add test for tls.subject keyword
Haleema Khan [Tue, 24 Jan 2023 19:50:09 +0000 (00:50 +0500)] 
tls: add test for tls.subject keyword

Adds tests for `tls.subject` legacy keyword and `tls.cert_subject` new keyword.
Ticket #5544

2 years agotls: add test for tls.issuerdn keyword
Haleema Khan [Tue, 24 Jan 2023 13:59:31 +0000 (18:59 +0500)] 
tls: add test for tls.issuerdn keyword

Adds tests for `tls.issuerdn` legacy keyword and `tls.cert_issuer` new keyword.
Ticket #5544

2 years agotls: organize tls tests into folders
Haleema Khan [Mon, 13 Feb 2023 09:42:16 +0000 (14:42 +0500)] 
tls: organize tls tests into folders

2 years agottl: add tests for prefilter keyword for ipv6 packets
Haleema Khan [Fri, 3 Feb 2023 18:49:27 +0000 (23:49 +0500)] 
ttl: add tests for prefilter keyword for ipv6 packets

Ticket #5800

2 years agoreadme: remove mention to pcapng file type
Juliana Fajardini [Wed, 1 Feb 2023 20:19:10 +0000 (17:19 -0300)] 
readme: remove mention to pcapng file type

Since we're not accepting this format for now, better not to be
misleading.

2 years agotest: Pin minimum version on eve output/smb2 tests 1137/head
Jeff Lucovsky [Wed, 1 Mar 2023 14:17:51 +0000 (09:17 -0500)] 
test: Pin minimum version on eve output/smb2 tests

This PR sets the minimum version for tests changed to reflect new or
modified behavior in versions past mater-6.0.x

2 years agotests: Create tests for master-6.0.x branch
Jeff Lucovsky [Wed, 1 Mar 2023 14:16:36 +0000 (09:16 -0500)] 
tests: Create tests for master-6.0.x branch

This commit introduces master-6.0.x specific tests that cover areas
where functionality is improved or changing for later versions.

2 years agotests: add test for bug 5783 1132/head
Lancer Cheng [Wed, 1 Feb 2023 10:45:33 +0000 (10:45 +0000)] 
tests: add test for bug 5783

2 years agolog: Updates due to 5836
Jeff Lucovsky [Sat, 4 Feb 2023 15:02:12 +0000 (10:02 -0500)] 
log: Updates due to 5836

This commit is needed to accommodate Suricata's changed behavior that
exits if a log file can't be opened at startup time.

2 years agotests: disable bug 5198 1119/head
Victor Julien [Thu, 9 Feb 2023 16:39:01 +0000 (17:39 +0100)] 
tests: disable bug 5198

Needs Suricata fix tracked in 5836.

2 years agotests: add test for bug 3286
Victor Julien [Thu, 9 Feb 2023 15:41:17 +0000 (16:41 +0100)] 
tests: add test for bug 3286

2 years agotests: fix smb test for 6.0.x 1116/head
Victor Julien [Tue, 7 Feb 2023 21:44:40 +0000 (22:44 +0100)] 
tests: fix smb test for 6.0.x

2 years agoframework: explicit utf-8 encoding for reading json 1111/head suricata-6.0.10
Philippe Antoine [Thu, 2 Feb 2023 15:57:01 +0000 (16:57 +0100)] 
framework: explicit utf-8 encoding for reading json

As the default encoding is platform dependent

2 years agotests: smb2 file sha logging test
Victor Julien [Sun, 22 Jan 2023 09:37:35 +0000 (10:37 +0100)] 
tests: smb2 file sha logging test

2 years agogithub-ci: only run suricata-verify once on Ubuntu 1104/head
Jason Ish [Tue, 31 Jan 2023 22:02:49 +0000 (16:02 -0600)] 
github-ci: only run suricata-verify once on Ubuntu

On Ubuntu verify was being run once with the output dir in tree, and
another time elsewhere.  Instead, on Ubuntu just run once with --outdir,
and run on Alma without --outdir to cover both cases and save some time.

2 years agogithub-ci: update checkout action to v3
Jason Ish [Tue, 31 Jan 2023 22:00:55 +0000 (16:00 -0600)] 
github-ci: update checkout action to v3

2 years agotests/log: Verify bug 5198
Jeff Lucovsky [Sun, 4 Sep 2022 12:23:55 +0000 (08:23 -0400)] 
tests/log: Verify bug 5198

This issue requires an ASAN build -- it doesn't reproduce without ASAN.

Issue: 5198

2 years agotests/bsize Add test cases for bsize
Jeff Lucovsky [Mon, 18 May 2020 14:08:50 +0000 (10:08 -0400)] 
tests/bsize Add test cases for bsize

This commit adds several test cases for the `bsize` keyword.

These tests apply to Suricata 7.0.x and newer.

2 years agotests: test midstream w midstream exception policy
Juliana Fajardini [Thu, 19 Jan 2023 14:58:10 +0000 (11:58 -0300)] 
tests: test midstream w midstream exception policy

Related to
Bug #5765

2 years agotest: test logging TLS dates less than 1970
Jason Ish [Fri, 27 Jan 2023 04:57:50 +0000 (22:57 -0600)] 
test: test logging TLS dates less than 1970

Issue: 5817

2 years agottl: add tests for prefilter keyword
Haleema Khan [Fri, 27 Jan 2023 01:36:32 +0000 (06:36 +0500)] 
ttl: add tests for prefilter keyword

Ticket #5800

2 years agotest: configuration file includes
Jason Ish [Thu, 26 Jan 2023 16:24:57 +0000 (10:24 -0600)] 
test: configuration file includes

Test configuration file includes that also include the new fully
qualified name overrides.

Pay attention to our "_" to "-" translation which should not happen for
variables.

2 years agotests/ftp: add checks for too long alerts
Jason Ish [Fri, 20 Jan 2023 22:26:04 +0000 (16:26 -0600)] 
tests/ftp: add checks for too long alerts

Related issue: 5235

2 years agotests: fix bad http host rule tests
Juliana Fajardini [Mon, 12 Dec 2022 22:38:29 +0000 (19:38 -0300)] 
tests: fix bad http host rule tests

The test.yaml files were missing the command set to compare eve.json
output and to run without a pcap file, therefore being simply skipped
for lack of a pcap file.

Also took the opportunity to make these compatible with new error
message formats for Suricata 7.

Test 1 also had a typo in the expected message to be checked, making it
fail.

2 years agodecode: Tests for unknown/arp counters
Jeff Lucovsky [Fri, 16 Dec 2022 14:31:34 +0000 (09:31 -0500)] 
decode: Tests for unknown/arp counters

Issue: 5761

This commit adds tests for decode counters which are new
- decode.arp
- decode.unknown_ethertype

2 years agotest: opcode logging and alert
Jason Ish [Wed, 30 Nov 2022 16:15:11 +0000 (10:15 -0600)] 
test: opcode logging and alert

2 years agotests: update exception policy for new IPS default 1102/head
Victor Julien [Mon, 30 Jan 2023 17:04:19 +0000 (18:04 +0100)] 
tests: update exception policy for new IPS default

2 years agoudp: improve strict/non-strict checks for 6
Victor Julien [Mon, 30 Jan 2023 13:17:55 +0000 (14:17 +0100)] 
udp: improve strict/non-strict checks for 6

2 years agorun.py: fix version comparison checks
Shivani Bhardwaj [Mon, 30 Jan 2023 12:24:20 +0000 (17:54 +0530)] 
run.py: fix version comparison checks

If no minor or patch version was provided, it was set to 0 hence passing
the check for "not None". Fix that by setting the defaults to None
instead for 0 for the equal to check.

2 years agotcp: add test for bug 5379
Shivani Bhardwaj [Fri, 20 Jan 2023 07:48:43 +0000 (13:18 +0530)] 
tcp: add test for bug 5379

2 years agoudp: add tests for bug 5379
Shivani Bhardwaj [Wed, 4 Jan 2023 07:20:24 +0000 (12:50 +0530)] 
udp: add tests for bug 5379

2 years agopcre-invalid-01: update shell check min-version
Shivani Bhardwaj [Sat, 12 Nov 2022 08:34:14 +0000 (14:04 +0530)] 
pcre-invalid-01: update shell check min-version

2 years agorun.py: allow version tests in shell checks
Shivani Bhardwaj [Wed, 2 Nov 2022 19:51:53 +0000 (01:21 +0530)] 
run.py: allow version tests in shell checks

2 years agotests: add frame ips test 1094/head
Victor Julien [Fri, 27 Jan 2023 15:55:00 +0000 (16:55 +0100)] 
tests: add frame ips test

2 years agotests: improve frame gap tests
Victor Julien [Fri, 27 Jan 2023 13:38:30 +0000 (14:38 +0100)] 
tests: improve frame gap tests

Add detection.

2 years agoframes: sip test update
Victor Julien [Fri, 27 Jan 2023 12:38:34 +0000 (13:38 +0100)] 
frames: sip test update

2 years agopcap-log: fix tests for issue 5374 1085/head
Jason Ish [Wed, 18 Jan 2023 18:23:12 +0000 (12:23 -0600)] 
pcap-log: fix tests for issue 5374

Suricata 7.0-dev will now use the time of the start packet for pcap
logging when reading from a file like 6.0 did.

Issue: 5374

2 years agoAdds test about smb ntlmssp arbitrary order 1081/head
Philippe Antoine [Tue, 6 Dec 2022 13:28:48 +0000 (14:28 +0100)] 
Adds test about smb ntlmssp arbitrary order

Ticket: #5258

2 years agotest: update warning about bad hex 1080/head
Philippe Antoine [Thu, 15 Sep 2022 18:58:39 +0000 (20:58 +0200)] 
test: update warning about bad hex

To reflect the full content string

2 years agotests: update frames for stream frames 1071/head
Victor Julien [Sun, 8 Jan 2023 06:43:59 +0000 (07:43 +0100)] 
tests: update frames for stream frames

2 years agotests: fix tcp tests being too strict on tcp objects
Victor Julien [Sun, 8 Jan 2023 06:38:33 +0000 (07:38 +0100)] 
tests: fix tcp tests being too strict on tcp objects

2 years agotests: add rules for flow drops
Victor Julien [Thu, 22 Dec 2022 18:17:47 +0000 (19:17 +0100)] 
tests: add rules for flow drops

2 years agotests: tls nom7 updates 1063/head
Victor Julien [Thu, 29 Sep 2022 08:50:25 +0000 (10:50 +0200)] 
tests: tls nom7 updates

2 years agotests: tls updates for 6 backports
Victor Julien [Mon, 26 Sep 2022 17:12:22 +0000 (19:12 +0200)] 
tests: tls updates for 6 backports

2 years agooutput: fixups for output changes 1043/head
Victor Julien [Thu, 1 Dec 2022 19:33:26 +0000 (20:33 +0100)] 
output: fixups for output changes

2 years agotests: limit rfb community id check to 7 1041/head
Victor Julien [Thu, 15 Dec 2022 10:03:20 +0000 (11:03 +0100)] 
tests: limit rfb community id check to 7

2 years agotests: fix grep for openbsd
Victor Julien [Sat, 10 Dec 2022 19:01:30 +0000 (20:01 +0100)] 
tests: fix grep for openbsd

2 years agotests: fix pcap for openbsd
Victor Julien [Sat, 10 Dec 2022 14:59:52 +0000 (15:59 +0100)] 
tests: fix pcap for openbsd

2 years agotests: fix bug 4376 for openbsd
Victor Julien [Sat, 10 Dec 2022 11:01:47 +0000 (12:01 +0100)] 
tests: fix bug 4376 for openbsd

2 years agocreatest: rename add-version to simply version
Jason Ish [Wed, 7 Dec 2022 21:34:46 +0000 (15:34 -0600)] 
createst: rename add-version to simply version

This is a more consistent mapping to the documented name in test.yaml.

Also add --cfg to the README which was missing.

2 years agocreatest: document --features
Jason Ish [Wed, 7 Dec 2022 21:10:10 +0000 (15:10 -0600)] 
createst: document --features

2 years agocreatest: Commandline param to specify required features
Haleema Khan [Fri, 21 Oct 2022 01:46:46 +0000 (06:46 +0500)] 
createst: Commandline param to specify required features

Feature: #4061

2 years agodetect-bytemath: add tests
Haleema Khan [Mon, 24 Oct 2022 15:05:32 +0000 (20:05 +0500)] 
detect-bytemath: add tests

Ticket: #5589

2 years agotemplate tests: update for removal of C templates 1033/head
Jason Ish [Thu, 17 Nov 2022 22:01:50 +0000 (16:01 -0600)] 
template tests: update for removal of C templates

In 7, the rust based template parser is simply template.

2 years agorfb: adds a check for community_id field in a rfb event 1030/head
Philippe Antoine [Wed, 30 Nov 2022 15:28:14 +0000 (16:28 +0100)] 
rfb: adds a check for community_id field in a rfb event

2 years agotests/http2: Add tests for HTTP/2 decompression bug
David Beckett [Wed, 16 Nov 2022 18:32:01 +0000 (18:32 +0000)] 
tests/http2: Add tests for HTTP/2 decompression bug

7.0.0-beta1 hits anomaly, failed_decompression

2 years agosmtp: fix test counting empty new lines 1029/head
Philippe Antoine [Mon, 28 Nov 2022 20:54:53 +0000 (21:54 +0100)] 
smtp: fix test counting empty new lines

2 years agotests: issue 5223 for 6 1019/head suricata-6.0.9
Victor Julien [Sat, 26 Nov 2022 14:31:17 +0000 (15:31 +0100)] 
tests: issue 5223 for 6

2 years agotests: smb2 async for 6.0.x 1018/head
Victor Julien [Sat, 26 Nov 2022 06:58:20 +0000 (07:58 +0100)] 
tests: smb2 async for 6.0.x

2 years agotests: add tests for bug 5633 1017/head
Victor Julien [Fri, 25 Nov 2022 16:31:43 +0000 (17:31 +0100)] 
tests: add tests for bug 5633

2 years agosmb2: fixes test about smb events count 1014/head
Philippe Antoine [Wed, 23 Nov 2022 07:56:47 +0000 (08:56 +0100)] 
smb2: fixes test about smb events count

2 years agoAdds test about smb2 async read response
Philippe Antoine [Tue, 22 Nov 2022 20:45:52 +0000 (21:45 +0100)] 
Adds test about smb2 async read response

2 years agoframework: utf-8 validation in test stdout/stderr
Philippe Antoine [Fri, 23 Sep 2022 12:08:54 +0000 (14:08 +0200)] 
framework: utf-8 validation in test stdout/stderr

2 years agoframework: adds a timeout of 5 minutes per test
Philippe Antoine [Thu, 15 Sep 2022 08:59:50 +0000 (10:59 +0200)] 
framework: adds a timeout of 5 minutes per test

2 years agotests: add tests for negated protocol matching
Victor Julien [Tue, 21 Dec 2021 09:07:01 +0000 (10:07 +0100)] 
tests: add tests for negated protocol matching

2 years agoquic: adds signature for parsing check
Philippe Antoine [Fri, 28 Oct 2022 20:09:45 +0000 (22:09 +0200)] 
quic: adds signature for parsing check

2 years agosmtp: more valid SMTP for protocol-changed test
Philippe Antoine [Thu, 3 Nov 2022 10:38:36 +0000 (11:38 +0100)] 
smtp: more valid SMTP for protocol-changed test

That is one server banner, plus one response per request

2 years agotest/rules: Update ETOpen rules 1003/head
Jeff Lucovsky [Wed, 10 Aug 2022 12:00:22 +0000 (08:00 -0400)] 
test/rules: Update ETOpen rules

Issue: 2982

During 2982 development, an issue with some rules in the ETOpen ruleset
were discovered and reported to Proofpoint.

This commit updates the ETOpen rules containing the fixes for the
reported issue which manifested in 2 rules: sids 2037001 and 2035521.

2 years agotest/yaml: Improve YAML parsing error messages
Jeff Lucovsky [Tue, 25 Jan 2022 19:14:50 +0000 (14:14 -0500)] 
test/yaml: Improve YAML parsing error messages

Without this commit, a YAML syntactic error is silently ignored. This
patch displays the YAML exception, if any, that occurs while loading the
YAML config file.

2 years agotests/dsize Suricata version 7 and later tests
Jeff Lucovsky [Sat, 22 Jan 2022 14:33:50 +0000 (09:33 -0500)] 
tests/dsize Suricata version 7 and later tests

This commit adds a test for Suricata 7 and later with the new dsize
validation logic. A new error message indicating the actual and expected
dsize value is emitted when there's a mismatch.

2 years agogeneral: Typo fixup
Jeff Lucovsky [Fri, 21 Jan 2022 15:35:11 +0000 (10:35 -0500)] 
general: Typo fixup

2 years agotests: Update to use modified error message
Jeff Lucovsky [Sat, 13 Feb 2021 15:36:33 +0000 (10:36 -0500)] 
tests: Update to use modified error message

2 years agotests: Add test case for 2982
Jeff Lucovsky [Sat, 13 Feb 2021 15:36:11 +0000 (10:36 -0500)] 
tests: Add test case for 2982

2 years agotests: update pcre test for new output
Victor Julien [Tue, 1 Nov 2022 09:12:03 +0000 (10:12 +0100)] 
tests: update pcre test for new output

Disable on 6 until we can do version checks per shell check.

2 years agocreatest: add arg for setting midstream true
Juliana Fajardini [Thu, 24 Feb 2022 19:31:44 +0000 (19:31 +0000)] 
createst: add arg for setting midstream true

With this, one can pass '--midstream' and this will add that as a test
argument and write it to test.yaml. Default is still midstream false.

2 years agotests: add test for pgsql out of order params bug
Juliana Fajardini [Wed, 7 Sep 2022 19:38:12 +0000 (16:38 -0300)] 
tests: add test for pgsql out of order params bug

StartupMessages for pgsql have a series of parameters that may show up
in any order, so let's make sure we can indeed parse them if, for
instance, user, which is a mandatory parameter, isn't the first to be
seen in the list.

Related to
Bug #5524

2 years agotests/pgsql: adjust to new startup message format
Juliana Fajardini [Wed, 7 Sep 2022 19:11:44 +0000 (16:11 -0300)] 
tests/pgsql: adjust to new startup message format

With the pgsql improving, we made database an optional parameter (as it
is, according to the documentation). Then the tests had to be updated.

2 years agotests: add tests for real bittorrent-dht traffic 984/head
Jason Ish [Tue, 4 Oct 2022 22:02:31 +0000 (16:02 -0600)] 
tests: add tests for real bittorrent-dht traffic

2 years agodetect-bytetest: add tests 982/head
Modupe Falodun [Tue, 1 Mar 2022 23:06:21 +0000 (00:06 +0100)] 
detect-bytetest: add tests

Task: 4911

2 years agoreadme: update createst explanation, add examples
Juliana Fajardini [Wed, 6 Jul 2022 19:35:12 +0000 (16:35 -0300)] 
readme: update createst explanation, add examples

There were optional arguments missing in the usage  shown, as well as in
the list with explanations about possible arguments.

2 years agocreatest: fix typo, update copyright year
Juliana Fajardini [Thu, 24 Feb 2022 20:17:47 +0000 (20:17 +0000)] 
createst: fix typo, update copyright year

2 years agocreatest: add option for custom suricata.yaml
Shivani Bhardwaj [Mon, 27 Jun 2022 10:25:38 +0000 (15:55 +0530)] 
createst: add option for custom suricata.yaml

2 years agodetect-icmp-seq: add test
Alice Akaki [Wed, 26 Oct 2022 02:42:12 +0000 (22:42 -0400)] 
detect-icmp-seq: add test

Task: #5597