]>
git.ipfire.org Git - thirdparty/suricata-verify.git/log
Victor Julien [Thu, 20 Oct 2022 05:18:00 +0000 (07:18 +0200)]
tests: update nfs for mac logging fix
Victor Julien [Sat, 15 Oct 2022 14:56:14 +0000 (16:56 +0200)]
tests: various tag rules
Victor Julien [Sat, 15 Oct 2022 09:50:06 +0000 (11:50 +0200)]
tests: add suppress tests
Victor Julien [Sat, 15 Oct 2022 06:07:10 +0000 (08:07 +0200)]
tests: add rate_filter tests
Eric Leblond [Sun, 25 Sep 2022 17:39:59 +0000 (19:39 +0200)]
bug78: relax flow checking
Eric Leblond [Mon, 27 Jun 2022 04:17:31 +0000 (06:17 +0200)]
tests: add tests for ntlmssp keywords
Victor Julien [Wed, 21 Sep 2022 07:39:36 +0000 (09:39 +0200)]
tests: add http file with gap test
Victor Julien [Sat, 17 Sep 2022 12:30:17 +0000 (14:30 +0200)]
files: update for tx-files work
Philippe Antoine [Tue, 26 Jul 2022 14:28:42 +0000 (16:28 +0200)]
filestore: do not enforce a warning id
Victor Julien [Thu, 29 Sep 2022 08:50:25 +0000 (10:50 +0200)]
tests: tls nom7 updates
Victor Julien [Mon, 26 Sep 2022 08:37:48 +0000 (10:37 +0200)]
tests: flowbit bad rules handling for 6.0.7
Jason Ish [Thu, 22 Sep 2022 18:14:33 +0000 (12:14 -0600)]
incomplete-hex: check --init-errors-fatal
For version 6, non-fatal.
For version 7, fatal.
Jason Ish [Thu, 22 Sep 2022 18:07:34 +0000 (12:07 -0600)]
incomplete hex: test with strict content keyword
With strict content parsing, -T should fail out for version 6 and 7.
Jason Ish [Thu, 22 Sep 2022 18:03:09 +0000 (12:03 -0600)]
incomplete-hex: -T tests for version 6 and 7
For version 7, incomplete hex should lead to a -T failure. For
version 6, -T should pass.
Jason Ish [Tue, 20 Sep 2022 18:04:46 +0000 (12:04 -0600)]
test-bad-hex-rule-1: update output for Suricata 6.0.7
https://redmine.openinfosecfoundation.org/issues/5546
Victor Julien [Mon, 26 Sep 2022 08:33:56 +0000 (10:33 +0200)]
tests: limit tls fragmentation test to 7
Victor Julien [Thu, 18 Aug 2022 09:29:14 +0000 (11:29 +0200)]
tests: add test with sslv2 start
Victor Julien [Thu, 11 Aug 2022 19:03:19 +0000 (21:03 +0200)]
tests: add tls fragmentation test
Victor Julien [Thu, 11 Aug 2022 09:26:56 +0000 (11:26 +0200)]
tests: update ssl tests after event rework
Victor Julien [Mon, 19 Sep 2022 17:16:34 +0000 (19:16 +0200)]
tests: disable unittests as we investigate issues
Jason Ish [Thu, 15 Sep 2022 15:34:48 +0000 (09:34 -0600)]
runner: handle binary output from suricata stderr/stdout
Don't attempt to decode output from Suricata stderr/stdout as utf-8, it
is required for relaying the output from Suricata to the log files,
in fact, its not even desired. The log files should have a verbatim
copy of the output for analysis.
Only attempt to utf-8 decode the output when logging in verbose mode,
and then if that fails, fallback to logging the data as a byte buffer.
Victor Julien [Wed, 23 Feb 2022 19:59:43 +0000 (20:59 +0100)]
tests: run Suricata unittests
`ut-complete` runs all tests, but disables ASAN leak checks.
`ut-leakcheck` runs 500ish tests that should pass.
Victor Julien [Wed, 23 Feb 2022 18:26:23 +0000 (19:26 +0100)]
tests/iprep: add a non-matching rule
Shivani Bhardwaj [Wed, 23 Mar 2022 07:02:35 +0000 (12:32 +0530)]
gh/workflow: use enable-debug-validation w build
Juliana Fajardini [Wed, 17 Aug 2022 15:18:13 +0000 (12:18 -0300)]
tests: add ips midstream exception policy tests
Jason Ish [Thu, 4 Aug 2022 16:24:42 +0000 (10:24 -0600)]
runner: print suricata command line in verbose mode
Jason Ish [Thu, 4 Aug 2022 16:20:14 +0000 (10:20 -0600)]
runner: don't fail if the pcap filename is falsey
Instead, if the pcap filename is a "falsey" value in Python, treat it
like "pcap: false" in the requires section as this is an easy mistake to
make, and in some cases makes more sense to allow false where you could
also override the filename.
Jason Ish [Thu, 4 Aug 2022 15:51:59 +0000 (09:51 -0600)]
runner: error out on errors from the runner
Currently exceptions from tests that are not explicitly handled are lost
due to the way Python's multiprocessing module works. This means that
programming errors in the runner are silently ignore with the test not
being run or counted.
Instead, log the traceback for any unexpected exception and terminate
the runner, as this is programming error in the runner and should always
be fatal.
Philippe Antoine [Tue, 22 Feb 2022 08:20:26 +0000 (09:20 +0100)]
Adds quic ietf v1 test
Philippe Antoine [Thu, 2 Sep 2021 10:11:28 +0000 (12:11 +0200)]
Adds smb2 async test
Victor Julien [Fri, 17 Jun 2022 14:38:09 +0000 (16:38 +0200)]
tests: add tests to check flow drops
Jeff Lucovsky [Tue, 12 Jul 2022 13:18:09 +0000 (09:18 -0400)]
test/event: Test for reassembly depth reached event
Issue: 3512
This commit adds a test to validate that the stream reassembly depth
event fire.
Philippe Antoine [Tue, 12 Jul 2022 07:21:36 +0000 (09:21 +0200)]
Adds test for kerberos ticket_encryption
Jeff Lucovsky [Fri, 29 Jul 2022 12:53:40 +0000 (08:53 -0400)]
tests/lua: Byte-extract/byte-math tests
Issue: 2871
Benjamin Wilkins [Tue, 9 Nov 2021 21:00:13 +0000 (16:00 -0500)]
lua: Test byte_extract access from match scripts
Shivani Bhardwaj [Tue, 9 Aug 2022 05:14:35 +0000 (10:44 +0530)]
add test for broken smtp url logging
Shivani Bhardwaj [Wed, 27 Jul 2022 05:18:50 +0000 (10:48 +0530)]
tls: add test for tls.random keyword
Philippe Antoine [Mon, 22 Aug 2022 15:46:20 +0000 (17:46 +0200)]
Adds test about event for failed protocol change
Philippe Antoine [Thu, 25 Aug 2022 15:13:15 +0000 (17:13 +0200)]
dhcp: adds check about renewal_time keyword
Philippe Antoine [Thu, 25 Aug 2022 15:11:26 +0000 (17:11 +0200)]
dhcp: adds check about rebinding_time keyword
Philippe Antoine [Mon, 4 Jul 2022 12:36:57 +0000 (14:36 +0200)]
dhcp: adds test about leasetime keyword
jason taylor [Mon, 25 Jul 2022 23:37:02 +0000 (23:37 +0000)]
add bsize keyword tests
Signed-off-by: jason taylor <jtfas90@gmail.com>
Juliana Fajardini [Tue, 6 Sep 2022 22:02:15 +0000 (19:02 -0300)]
tests: add basic test for reject exception policy
This test only ensures that Suricata does drop packet/flow after
reaching an exception condition with a 'reject' policy.
Related to
Task #5503
jason taylor [Wed, 24 Aug 2022 15:48:38 +0000 (15:48 +0000)]
tests: add dsize option signature tests
Signed-off-by: jason taylor <jtfas90@gmail.com>
Philippe Antoine [Fri, 26 Aug 2022 07:26:59 +0000 (09:26 +0200)]
Adds test for http file to server
Victor Julien [Tue, 23 Mar 2021 10:49:43 +0000 (11:49 +0100)]
tests: update for file logic changes
jason taylor [Tue, 14 Jun 2022 21:17:21 +0000 (21:17 +0000)]
tests: add http.host nocase test
Signed-off-by: jason taylor <jtfas90@gmail.com>
jason taylor [Tue, 14 Jun 2022 21:13:02 +0000 (21:13 +0000)]
tests: add http.host capitalization test
Signed-off-by: jason taylor <jtfas90@gmail.com>
Victor Julien [Thu, 18 Aug 2022 11:55:51 +0000 (13:55 +0200)]
github: replace ubuntu-18.04 with 22.04
Victor Julien [Thu, 18 Aug 2022 11:48:28 +0000 (13:48 +0200)]
github: Suricata 5 is EOL, so remove check
Jeff Lucovsky [Thu, 27 Jan 2022 19:04:57 +0000 (14:04 -0500)]
test/class: Fix errant classification.config ref
This commit supplies a classification.config file for the empty rule
test as this is required with -T (test mode) validation.
Jeff Lucovsky [Thu, 27 Jan 2022 19:03:38 +0000 (14:03 -0500)]
tests/class: Tests for class.config validation
These test cases exercise classification.config validation checking.
Shivani Bhardwaj [Mon, 21 Mar 2022 13:33:02 +0000 (19:03 +0530)]
tests: add test for bug 5197
Juliana Fajardini [Tue, 5 Apr 2022 19:47:31 +0000 (16:47 -0300)]
test/alert-max: add check for discarded alerts
Check that we correctly log to stats how many alerts have been discarded
due to packet alert queue overflow.
Task #5179
Juliana Fajardini [Wed, 23 Feb 2022 12:35:41 +0000 (12:35 +0000)]
tests: add test for cornercase alert_max case
With dynamic memory alocation of the packet alert queue, we must make
sure that when we rearrange signatures in the alert queue we are not
leaking memory. This test is intended to cover such a case.
Related to
Task #4943
Juliana Fajardini [Wed, 19 Jan 2022 18:46:17 +0000 (18:46 +0000)]
tests: add test for packet_alert_max more than 15
Task#4207
Shivani Bhardwaj [Fri, 7 Jan 2022 10:20:02 +0000 (15:50 +0530)]
tests: add test for max alert default & noalerts
Since the default max alert value is 15 and we want to ensure that that
value is enforced if the configuration is set with something invalid,
this test has packet-max-alert set to 0 (which will fall back to 15,
the default). We have 15 'noalert' rules and 1 alert rule that gets
triggered.
Related to task #4942
Victor Julien [Thu, 28 Jul 2022 05:46:10 +0000 (07:46 +0200)]
tests: less strict fileinfo checks for bug-130
Philippe Antoine [Fri, 1 Jul 2022 18:30:44 +0000 (20:30 +0200)]
tests: do not validate an empty array in bug-130
Jason Ish [Tue, 12 Jul 2022 17:04:30 +0000 (11:04 -0600)]
tests/filestore-5408: requires HAVE_NSS
Jason Ish [Mon, 9 May 2022 15:37:32 +0000 (09:37 -0600)]
ips-state: test flow pass for ip-only rule with negation
Ticket: #5361
Shivani Bhardwaj [Tue, 29 Mar 2022 06:34:45 +0000 (12:04 +0530)]
datasets: add test for bug 5109
Philippe Antoine [Fri, 1 Jul 2022 12:04:17 +0000 (14:04 +0200)]
framework: ability to run rules based on a min suricata version
Philippe Antoine [Wed, 29 Jun 2022 19:23:47 +0000 (21:23 +0200)]
snmp: adds rule check about snmp.usm keyword
Philippe Antoine [Thu, 28 Apr 2022 14:38:05 +0000 (16:38 +0200)]
threshold: adds test for threshold.config with by_rule
Philippe Antoine [Wed, 29 Jun 2022 19:55:45 +0000 (21:55 +0200)]
smtp: do not test server detection failure
Jason Ish [Mon, 14 Feb 2022 14:49:16 +0000 (08:49 -0600)]
dns: test DNS frames
Philippe Antoine [Fri, 1 Jul 2022 11:21:21 +0000 (13:21 +0200)]
Adds regression test against forced filestore
Cf https://redmine.openinfosecfoundation.org/issues/5408
Victor Julien [Tue, 14 Jun 2022 11:02:04 +0000 (13:02 +0200)]
github/workflow: explicitly add cargo
Victor Julien [Tue, 14 Jun 2022 09:52:17 +0000 (11:52 +0200)]
tests: add dcerpc/smb test
Victor Julien [Tue, 14 Jun 2022 09:49:36 +0000 (11:49 +0200)]
tests: various dcerpc updates
Victor Julien [Mon, 13 Jun 2022 12:34:52 +0000 (14:34 +0200)]
tests: add test for bug 5392
Victor Julien [Mon, 13 Jun 2022 12:32:30 +0000 (14:32 +0200)]
tests: update http gap test to fixed size logic
Eric Leblond [Sun, 2 Aug 2020 16:49:42 +0000 (18:49 +0200)]
tests/eve-alert-verbose: introduce test
Introduce test on alert verbosity change.
Pierre Chifflier [Sun, 20 Feb 2022 14:54:15 +0000 (15:54 +0100)]
Add bug-1450 tests for suricata 7.0.0 and later
Pierre Chifflier [Sun, 20 Feb 2022 14:52:45 +0000 (15:52 +0100)]
Set maximum version for bug-1450-01
Philippe Antoine [Wed, 17 Jul 2019 13:30:08 +0000 (15:30 +0200)]
Adds test about DNS probing with junk request
Benjamin Wilkins [Tue, 2 Nov 2021 19:24:21 +0000 (15:24 -0400)]
lua: Test SCRule* functions for match scripts
Philippe Antoine [Wed, 1 Jun 2022 12:26:55 +0000 (14:26 +0200)]
Adds test about stream_size keyword
Philippe Antoine [Wed, 1 Jun 2022 12:17:11 +0000 (14:17 +0200)]
Adds test about filesize keyword
Travis Green [Mon, 14 Oct 2019 16:03:10 +0000 (09:03 -0700)]
tests: add dcerpc test per #3109
Victor Julien [Fri, 10 Jun 2022 12:20:34 +0000 (14:20 +0200)]
tests: add test for issue 4376
Shivani Bhardwaj [Fri, 25 Mar 2022 10:29:09 +0000 (15:59 +0530)]
Add tests for smb/dcerpc missing alert
Shivani Bhardwaj [Mon, 21 Mar 2022 14:14:56 +0000 (19:44 +0530)]
tests: add test for bug 5162
Victor Julien [Mon, 21 Mar 2022 21:03:13 +0000 (22:03 +0100)]
tests: ips exception handling tests
Victor Julien [Mon, 21 Mar 2022 21:03:44 +0000 (22:03 +0100)]
tests: test for bug 76
Jason Ish [Fri, 3 Jun 2022 20:15:05 +0000 (14:15 -0600)]
github-ci: don't build eve-validator
Building the eve-validator program is now automatically done as part of
running suricata-verify.
Jason Ish [Wed, 25 May 2022 19:00:09 +0000 (13:00 -0600)]
eve-validator: reduce features in rust deps
Should remove the requirement on system openssl being installed.
Jason Ish [Wed, 25 May 2022 17:44:08 +0000 (11:44 -0600)]
eve-validator: better error messages
On file read error and schema parse errors.
Jason Ish [Mon, 16 May 2022 20:20:40 +0000 (14:20 -0600)]
eve-validation: always build and run eve-validator
Always build and run the eve-validator as part of Suricata-Verify. This
should only add extra time on first run, or after changes to the
"eve-validator" or an upgrade in the Rust toolchain.
Validation can be disabled with the --no-validation command line option.
Validation will not be run if the Suricata source tree does not contain
etc/schema.json.
Validation will also not run on Windows as there is an issue calling the
validation command that needs further looking into.
Philippe Antoine [Thu, 12 May 2022 18:42:07 +0000 (20:42 +0200)]
schema.json: use file from suriceta source tree
Philippe Antoine [Wed, 24 Nov 2021 20:54:55 +0000 (21:54 +0100)]
jsonschema: only run for version >= 7
Philippe Antoine [Mon, 22 Nov 2021 16:16:08 +0000 (17:16 +0100)]
jsonschema: use rust utility
As it is faster than python
Philippe Antoine [Thu, 18 Nov 2021 08:36:55 +0000 (09:36 +0100)]
jsonschema: prints warning if we really do not have it
Victor Julien [Tue, 31 May 2022 09:58:35 +0000 (11:58 +0200)]
output-pcap-log: test copy that tests <7 behavior
Victor Julien [Mon, 30 May 2022 18:14:43 +0000 (20:14 +0200)]
output-pcap-log: fixup tests for Suricata versions
Eric Leblond [Thu, 4 Mar 2021 21:08:39 +0000 (22:08 +0100)]
output-pcap-log-conditional-tag-alert: new test
Test that tag:session produce the same result as alerts when
using pcap conditional.
Eric Leblond [Thu, 4 Mar 2021 21:05:21 +0000 (22:05 +0100)]
output-pcap-log-conditional-noalert: introduce test
Verify that conditional pcap logging do not log if ever there is no
alert.
Eric Leblond [Thu, 4 Mar 2021 20:59:39 +0000 (21:59 +0100)]
output-pcap-log-conditional-alert: introduce test
It uses pcap conditional mode with a matching signature and test
that the resulting pcap is what is expected.
Eric Leblond [Thu, 4 Mar 2021 18:07:02 +0000 (19:07 +0100)]
output-pcap-log: update expected file
Following changes due to conditional logging of pcap the output file
when reading pcap is now log.pcap.0 and the test had to be updated
accordingly.