]> git.ipfire.org Git - thirdparty/rspamd.git/log
thirdparty/rspamd.git
10 years agoRework phishing checks.
Vsevolod Stakhov [Thu, 16 Jul 2015 18:11:42 +0000 (19:11 +0100)] 
Rework phishing checks.

10 years agoExclude HTML urls content from texts
Vsevolod Stakhov [Thu, 16 Jul 2015 16:19:03 +0000 (17:19 +0100)] 
Exclude HTML urls content from texts

10 years agoRemove deprecated function.
Vsevolod Stakhov [Thu, 16 Jul 2015 16:05:33 +0000 (17:05 +0100)] 
Remove deprecated function.

10 years agoFix parts distance compare condition.
Vsevolod Stakhov [Thu, 16 Jul 2015 15:48:49 +0000 (16:48 +0100)] 
Fix parts distance compare condition.

10 years agoFix stupid misprint in array indexing.
Vsevolod Stakhov [Thu, 16 Jul 2015 15:39:53 +0000 (16:39 +0100)] 
Fix stupid misprint in array indexing.

10 years agoAdd logic to preserve newlines in HTML.
Vsevolod Stakhov [Thu, 16 Jul 2015 14:22:51 +0000 (15:22 +0100)] 
Add logic to preserve newlines in HTML.

10 years agoFix addition to html tree.
Vsevolod Stakhov [Thu, 16 Jul 2015 13:51:30 +0000 (14:51 +0100)] 
Fix addition to html tree.

10 years agoAdd test case.
Vsevolod Stakhov [Thu, 16 Jul 2015 13:34:09 +0000 (14:34 +0100)] 
Add test case.

10 years agoFind HTML comment end properly.
Vsevolod Stakhov [Thu, 16 Jul 2015 13:32:55 +0000 (14:32 +0100)] 
Find HTML comment end properly.

10 years agoMisprint.
Vsevolod Stakhov [Thu, 16 Jul 2015 13:09:51 +0000 (14:09 +0100)] 
Misprint.

10 years agoRemove debug.
Vsevolod Stakhov [Thu, 16 Jul 2015 13:04:25 +0000 (14:04 +0100)] 
Remove debug.

10 years agoDo not use reconf for pure lua functions.
Vsevolod Stakhov [Thu, 16 Jul 2015 13:03:54 +0000 (14:03 +0100)] 
Do not use reconf for pure lua functions.

10 years agoMore fixes to html parsing.
Vsevolod Stakhov [Thu, 16 Jul 2015 12:59:24 +0000 (13:59 +0100)] 
More fixes to html parsing.

10 years agoFix content saving in html parser.
Vsevolod Stakhov [Thu, 16 Jul 2015 12:01:09 +0000 (13:01 +0100)] 
Fix content saving in html parser.

10 years agoAdd html extraction unit test.
Vsevolod Stakhov [Thu, 16 Jul 2015 12:00:51 +0000 (13:00 +0100)] 
Add html extraction unit test.

10 years agoAdd lua method to extract text from html.
Vsevolod Stakhov [Thu, 16 Jul 2015 11:09:19 +0000 (12:09 +0100)] 
Add lua method to extract text from html.

10 years agoMerge branch 'html-rework'
Vsevolod Stakhov [Thu, 16 Jul 2015 08:39:27 +0000 (09:39 +0100)] 
Merge branch 'html-rework'

10 years agoUse the new API.
Vsevolod Stakhov [Thu, 16 Jul 2015 08:38:19 +0000 (09:38 +0100)] 
Use the new API.

10 years agoUse new HTML API in message.c
Vsevolod Stakhov [Thu, 16 Jul 2015 08:36:06 +0000 (09:36 +0100)] 
Use new HTML API in message.c

10 years agoFurther rework of html parser.
Vsevolod Stakhov [Thu, 16 Jul 2015 08:32:28 +0000 (09:32 +0100)] 
Further rework of html parser.

10 years agoMerge pull request #333 from fatalbanana/master
Vsevolod Stakhov [Wed, 15 Jul 2015 21:40:37 +0000 (22:40 +0100)] 
Merge pull request #333 from fatalbanana/master

Doc fix: phishing strict_domains syntax (reported by @Fullmetal8ender)

10 years agoMore rework.
Vsevolod Stakhov [Wed, 15 Jul 2015 16:31:00 +0000 (17:31 +0100)] 
More rework.

10 years agoUse more fine-grained input to simplify tests.
Vsevolod Stakhov [Wed, 15 Jul 2015 16:03:12 +0000 (17:03 +0100)] 
Use more fine-grained input to simplify tests.

10 years agoStart FSM for parsing HTML parts.
Vsevolod Stakhov [Wed, 15 Jul 2015 14:26:00 +0000 (15:26 +0100)] 
Start FSM for parsing HTML parts.

10 years agoDoc fix: phishing strict_domains syntax (reported by @Fullmetal8ender) 333/head
Andrew Lewis [Wed, 15 Jul 2015 11:17:56 +0000 (13:17 +0200)] 
Doc fix: phishing strict_domains syntax (reported by @Fullmetal8ender)

10 years agoRefactor html.h.
Vsevolod Stakhov [Wed, 15 Jul 2015 10:49:20 +0000 (11:49 +0100)] 
Refactor html.h.

10 years agoRework R_PARTS_DIFFER rule.
Vsevolod Stakhov [Tue, 14 Jul 2015 23:22:19 +0000 (00:22 +0100)] 
Rework R_PARTS_DIFFER rule.

10 years agoAllow to get different types of memory pool variables.
Vsevolod Stakhov [Tue, 14 Jul 2015 23:22:03 +0000 (00:22 +0100)] 
Allow to get different types of memory pool variables.

10 years agoAdd util.tanh lua utility.
Vsevolod Stakhov [Tue, 14 Jul 2015 23:11:15 +0000 (00:11 +0100)] 
Add util.tanh lua utility.

10 years agoMove distance calculation to message parsing.
Vsevolod Stakhov [Tue, 14 Jul 2015 22:58:56 +0000 (23:58 +0100)] 
Move distance calculation to message parsing.

10 years agoImplement levenshtein distance for words.
Vsevolod Stakhov [Tue, 14 Jul 2015 18:07:49 +0000 (19:07 +0100)] 
Implement levenshtein distance for words.

10 years agoDisable signatures detection as it breaks stuff.
Vsevolod Stakhov [Tue, 14 Jul 2015 18:07:12 +0000 (19:07 +0100)] 
Disable signatures detection as it breaks stuff.

10 years agoFix dereference of NULL pointer.
Vsevolod Stakhov [Tue, 14 Jul 2015 18:06:59 +0000 (19:06 +0100)] 
Fix dereference of NULL pointer.

10 years agoStart removing of old fuzzy algorithm.
Vsevolod Stakhov [Tue, 14 Jul 2015 17:48:42 +0000 (18:48 +0100)] 
Start removing of old fuzzy algorithm.

10 years agoImplement skipping of signatures in text messages.
Vsevolod Stakhov [Tue, 14 Jul 2015 16:33:31 +0000 (17:33 +0100)] 
Implement skipping of signatures in text messages.

10 years agoRework ip_score plugin to support ASN, country and ipnet.
Vsevolod Stakhov [Tue, 14 Jul 2015 14:23:34 +0000 (15:23 +0100)] 
Rework ip_score plugin to support ASN, country and ipnet.

10 years agoMinor fixes in lua.
Vsevolod Stakhov [Tue, 14 Jul 2015 14:23:22 +0000 (15:23 +0100)] 
Minor fixes in lua.

10 years agoDo not treat classify error as fatal error.
Vsevolod Stakhov [Tue, 14 Jul 2015 13:46:04 +0000 (14:46 +0100)] 
Do not treat classify error as fatal error.

10 years agoFix unit test building and starting.
Vsevolod Stakhov [Tue, 14 Jul 2015 13:45:46 +0000 (14:45 +0100)] 
Fix unit test building and starting.

10 years agoFix splitting in case of bogus regexp.
Vsevolod Stakhov [Tue, 14 Jul 2015 12:56:05 +0000 (13:56 +0100)] 
Fix splitting in case of bogus regexp.

10 years agoRename memory pool functions.
Vsevolod Stakhov [Tue, 14 Jul 2015 11:49:11 +0000 (12:49 +0100)] 
Rename memory pool functions.

10 years agoFix some more issues found after mime rework.
Vsevolod Stakhov [Tue, 14 Jul 2015 09:10:34 +0000 (10:10 +0100)] 
Fix some more issues found after mime rework.

10 years agoAdd ASN, country and ipnet lookups.
Vsevolod Stakhov [Tue, 14 Jul 2015 08:57:34 +0000 (09:57 +0100)] 
Add ASN, country and ipnet lookups.

10 years agoAvoid dependency on ARCH dep header.
Vsevolod Stakhov [Mon, 13 Jul 2015 23:10:49 +0000 (00:10 +0100)] 
Avoid dependency on ARCH dep header.

10 years agoFix received headers parsing.
Vsevolod Stakhov [Mon, 13 Jul 2015 23:09:30 +0000 (00:09 +0100)] 
Fix received headers parsing.

10 years agoGList -> GPtrArray for parts
Vsevolod Stakhov [Mon, 13 Jul 2015 23:08:24 +0000 (00:08 +0100)] 
GList -> GPtrArray for parts

10 years agoRework parts and task structure:
Vsevolod Stakhov [Mon, 13 Jul 2015 16:46:50 +0000 (17:46 +0100)] 
Rework parts and task structure:

- Now text_parts, parts and received are arrays
- Pre-allocate arrays with some reasonable defaults
- Use arrays instead of lists in plugins and checks
- Remove unused fields from task structure
- Rework mime_foreach callback function
- Remove deprecated scan_milliseconds field

10 years agoRemove legacy checks.
Vsevolod Stakhov [Mon, 13 Jul 2015 16:46:41 +0000 (17:46 +0100)] 
Remove legacy checks.

10 years agoAdd url encoded tests.
Vsevolod Stakhov [Sat, 11 Jul 2015 21:05:14 +0000 (22:05 +0100)] 
Add url encoded tests.

10 years agoAllow query parameters for files.
Vsevolod Stakhov [Sat, 11 Jul 2015 20:58:32 +0000 (21:58 +0100)] 
Allow query parameters for files.

10 years agoAdd a simple functional test for scanning a file.
Vsevolod Stakhov [Fri, 10 Jul 2015 16:40:58 +0000 (17:40 +0100)] 
Add a simple functional test for scanning a file.

10 years agoFix issues on learning files.
Vsevolod Stakhov [Fri, 10 Jul 2015 16:40:42 +0000 (17:40 +0100)] 
Fix issues on learning files.

10 years agoAllow scanning local files in rspamd.
Vsevolod Stakhov [Fri, 10 Jul 2015 16:24:18 +0000 (17:24 +0100)] 
Allow scanning local files in rspamd.

10 years agoParse incoming request url.
Vsevolod Stakhov [Fri, 10 Jul 2015 15:57:55 +0000 (16:57 +0100)] 
Parse incoming request url.

10 years agoFinally fix an issue with data isolation in sqlite.
Vsevolod Stakhov [Fri, 10 Jul 2015 15:24:32 +0000 (16:24 +0100)] 
Finally fix an issue with data isolation in sqlite.

10 years agoFix some minor issues with sqlite3.
Vsevolod Stakhov [Fri, 10 Jul 2015 15:21:26 +0000 (16:21 +0100)] 
Fix some minor issues with sqlite3.

10 years agoRemove google DNS from tests.
Vsevolod Stakhov [Fri, 10 Jul 2015 14:41:03 +0000 (15:41 +0100)] 
Remove google DNS from tests.

10 years agoSave log files on test errors completely.
Vsevolod Stakhov [Fri, 10 Jul 2015 14:26:46 +0000 (15:26 +0100)] 
Save log files on test errors completely.

10 years agoRework sqlite3 cache.
Vsevolod Stakhov [Fri, 10 Jul 2015 13:58:56 +0000 (14:58 +0100)] 
Rework sqlite3 cache.

10 years agoMore fixes to sqlite3 locking.
Vsevolod Stakhov [Fri, 10 Jul 2015 13:33:10 +0000 (14:33 +0100)] 
More fixes to sqlite3 locking.

10 years agoUnify sqlite open and create function.
Vsevolod Stakhov [Fri, 10 Jul 2015 13:13:39 +0000 (14:13 +0100)] 
Unify sqlite open and create function.

10 years agoMove sqlite3 utils to a separate module.
Vsevolod Stakhov [Fri, 10 Jul 2015 12:20:25 +0000 (13:20 +0100)] 
Move sqlite3 utils to a separate module.

10 years agoQuote strings in pragmas.
Vsevolod Stakhov [Thu, 9 Jul 2015 23:36:34 +0000 (00:36 +0100)] 
Quote strings in pragmas.

10 years agoAdd finalize process operation.
Vsevolod Stakhov [Thu, 9 Jul 2015 23:36:03 +0000 (00:36 +0100)] 
Add finalize process operation.

We could use sqlite transaction for reading as well.

10 years agoAdd additional check on open.
Vsevolod Stakhov [Thu, 9 Jul 2015 18:12:21 +0000 (19:12 +0100)] 
Add additional check on open.

Issue: #331

10 years agoTry to do something about sqlite locking.
Vsevolod Stakhov [Thu, 9 Jul 2015 17:48:43 +0000 (18:48 +0100)] 
Try to do something about sqlite locking.

10 years agoTry to fix sqlite3 blocking.
Vsevolod Stakhov [Thu, 9 Jul 2015 17:48:21 +0000 (18:48 +0100)] 
Try to fix sqlite3 blocking.

Issue: #331

10 years agoUse standard functions definitions.
Vsevolod Stakhov [Thu, 9 Jul 2015 14:11:49 +0000 (15:11 +0100)] 
Use standard functions definitions.

10 years agoFix issues in the tests.
Vsevolod Stakhov [Thu, 9 Jul 2015 14:02:09 +0000 (15:02 +0100)] 
Fix issues in the tests.

10 years agoAdopt build system for new tests.
Vsevolod Stakhov [Thu, 9 Jul 2015 13:45:48 +0000 (14:45 +0100)] 
Adopt build system for new tests.

10 years agoRemove bats tests.
Vsevolod Stakhov [Thu, 9 Jul 2015 13:41:28 +0000 (14:41 +0100)] 
Remove bats tests.

10 years agoRemove bats tests.
Vsevolod Stakhov [Thu, 9 Jul 2015 13:40:56 +0000 (14:40 +0100)] 
Remove bats tests.

10 years agoNew functional tests approach.
Vsevolod Stakhov [Thu, 9 Jul 2015 13:40:36 +0000 (14:40 +0100)] 
New functional tests approach.

10 years agoSkip missing statfiles on classifying.
Vsevolod Stakhov [Thu, 9 Jul 2015 08:38:03 +0000 (09:38 +0100)] 
Skip missing statfiles on classifying.

10 years agoMove statistics initialization to start of workers.
Vsevolod Stakhov [Thu, 9 Jul 2015 08:31:33 +0000 (09:31 +0100)] 
Move statistics initialization to start of workers.

10 years agoAdd tests for xxhash and siphash.
Vsevolod Stakhov [Wed, 8 Jul 2015 16:30:56 +0000 (17:30 +0100)] 
Add tests for xxhash and siphash.

10 years agoAdd sqlite3 backend testing.
Vsevolod Stakhov [Wed, 8 Jul 2015 16:28:30 +0000 (17:28 +0100)] 
Add sqlite3 backend testing.

10 years agoAdd functional test for #331.
Vsevolod Stakhov [Wed, 8 Jul 2015 15:52:00 +0000 (16:52 +0100)] 
Add functional test for #331.

10 years agoFix HTTP error code on learn failures.
Vsevolod Stakhov [Wed, 8 Jul 2015 15:51:44 +0000 (16:51 +0100)] 
Fix HTTP error code on learn failures.

10 years agoFix issue if rspamd cannot create statfiles.
Vsevolod Stakhov [Wed, 8 Jul 2015 15:51:10 +0000 (16:51 +0100)] 
Fix issue if rspamd cannot create statfiles.

Issue: #331

10 years agoUse more UCL vars for tests.
Vsevolod Stakhov [Wed, 8 Jul 2015 15:32:12 +0000 (16:32 +0100)] 
Use more UCL vars for tests.

10 years agoRework cmake caching.
Vsevolod Stakhov [Wed, 8 Jul 2015 14:51:16 +0000 (15:51 +0100)] 
Rework cmake caching.

10 years agoImprove functional tests teardown.
Vsevolod Stakhov [Wed, 8 Jul 2015 13:44:36 +0000 (14:44 +0100)] 
Improve functional tests teardown.

10 years agoDo not use __FUNCTION__ as it's unportable.
Vsevolod Stakhov [Wed, 8 Jul 2015 13:44:22 +0000 (14:44 +0100)] 
Do not use __FUNCTION__ as it's unportable.

10 years agoFix bug when unix sockets were not whitelisted.
Vsevolod Stakhov [Wed, 8 Jul 2015 13:17:49 +0000 (14:17 +0100)] 
Fix bug when unix sockets were not whitelisted.

10 years agoFix openssl handling.
Vsevolod Stakhov [Wed, 8 Jul 2015 13:15:46 +0000 (14:15 +0100)] 
Fix openssl handling.

10 years agoRemove workaround for local cmake.
Vsevolod Stakhov [Wed, 8 Jul 2015 13:07:01 +0000 (14:07 +0100)] 
Remove workaround for local cmake.

10 years agoFix include directive for hiredis.
Vsevolod Stakhov [Wed, 8 Jul 2015 12:41:26 +0000 (13:41 +0100)] 
Fix include directive for hiredis.

10 years agoMore fixes to cmake script.
Vsevolod Stakhov [Wed, 8 Jul 2015 12:41:14 +0000 (13:41 +0100)] 
More fixes to cmake script.

10 years agoAnother try to fix cmake configuration.
Vsevolod Stakhov [Wed, 8 Jul 2015 12:00:14 +0000 (13:00 +0100)] 
Another try to fix cmake configuration.

10 years agoAdopt for the new ProcessPackage.
Vsevolod Stakhov [Tue, 7 Jul 2015 22:57:21 +0000 (23:57 +0100)] 
Adopt for the new ProcessPackage.

10 years agoRework ProcessPackage macro.
Vsevolod Stakhov [Tue, 7 Jul 2015 18:16:26 +0000 (19:16 +0100)] 
Rework ProcessPackage macro.

10 years agoTry to rework FindLua macro.
Vsevolod Stakhov [Tue, 7 Jul 2015 15:45:58 +0000 (16:45 +0100)] 
Try to rework FindLua macro.

10 years agoFix some extreme cases in bayes.
Vsevolod Stakhov [Tue, 7 Jul 2015 11:46:27 +0000 (12:46 +0100)] 
Fix some extreme cases in bayes.

10 years agoAdd test for empty part learning.
Vsevolod Stakhov [Tue, 7 Jul 2015 10:00:02 +0000 (11:00 +0100)] 
Add test for empty part learning.

10 years agoFix null pointer dereference.
Vsevolod Stakhov [Tue, 7 Jul 2015 08:48:01 +0000 (09:48 +0100)] 
Fix null pointer dereference.

10 years agoAdd dependencies test.
Vsevolod Stakhov [Tue, 7 Jul 2015 08:47:50 +0000 (09:47 +0100)] 
Add dependencies test.

10 years agoUse BATS_TMPDIR instead of '/tmp' for tests.
Vsevolod Stakhov [Tue, 7 Jul 2015 07:10:51 +0000 (08:10 +0100)] 
Use BATS_TMPDIR instead of '/tmp' for tests.

10 years agoSlightly improve variables extraction code.
Vsevolod Stakhov [Tue, 7 Jul 2015 07:06:23 +0000 (08:06 +0100)] 
Slightly improve variables extraction code.

10 years agoAllow variables parsing in a command line.
Vsevolod Stakhov [Mon, 6 Jul 2015 19:28:05 +0000 (20:28 +0100)] 
Allow variables parsing in a command line.