]> git.ipfire.org Git - thirdparty/rspamd.git/log
thirdparty/rspamd.git
9 years agoFix format argument for inserting shingles
Vsevolod Stakhov [Thu, 14 Jan 2016 23:51:42 +0000 (23:51 +0000)] 
Fix format argument for inserting shingles

Issue: #478

9 years agoRemove events when 0 or error are returned
Vsevolod Stakhov [Thu, 14 Jan 2016 23:51:24 +0000 (23:51 +0000)] 
Remove events when 0 or error are returned

9 years agoEnable redis conditional missed somehow
Vsevolod Stakhov [Thu, 14 Jan 2016 17:22:39 +0000 (17:22 +0000)] 
Enable redis conditional missed somehow

9 years agoFix potential misuse of unions
Vsevolod Stakhov [Thu, 14 Jan 2016 17:08:30 +0000 (17:08 +0000)] 
Fix potential misuse of unions

Issue: #478
Reported by: @moisseev

9 years agoAdd periodic checks for hyperscan files
Vsevolod Stakhov [Thu, 14 Jan 2016 16:27:00 +0000 (16:27 +0000)] 
Add periodic checks for hyperscan files

9 years agoAnother fix to always-malloc mode
Vsevolod Stakhov [Thu, 14 Jan 2016 14:38:21 +0000 (14:38 +0000)] 
Another fix to always-malloc mode

9 years agoFix issues with freeing of bad rdns requests
Vsevolod Stakhov [Thu, 14 Jan 2016 14:15:01 +0000 (14:15 +0000)] 
Fix issues with freeing of bad rdns requests

9 years agoFix format string
Vsevolod Stakhov [Thu, 14 Jan 2016 14:12:08 +0000 (14:12 +0000)] 
Fix format string

9 years agoFix issues with debug mode of mempool
Vsevolod Stakhov [Thu, 14 Jan 2016 14:11:50 +0000 (14:11 +0000)] 
Fix issues with debug mode of mempool

9 years agoAllow processing images urls for SURBL
Vsevolod Stakhov [Thu, 14 Jan 2016 13:30:55 +0000 (13:30 +0000)] 
Allow processing images urls for SURBL

9 years agoAllow configurations with no classifiers
Vsevolod Stakhov [Thu, 14 Jan 2016 11:53:38 +0000 (11:53 +0000)] 
Allow configurations with no classifiers

9 years agoFix percentages for bayes confidence
Vsevolod Stakhov [Thu, 14 Jan 2016 09:04:16 +0000 (09:04 +0000)] 
Fix percentages for bayes confidence

9 years agoDo not treat bad backend as an assert
Vsevolod Stakhov [Wed, 13 Jan 2016 20:08:49 +0000 (20:08 +0000)] 
Do not treat bad backend as an assert

9 years agoAdd documentation for new statistics
Vsevolod Stakhov [Wed, 13 Jan 2016 07:55:24 +0000 (07:55 +0000)] 
Add documentation for new statistics

9 years agoAdd extra sleep to avoid race condition
Vsevolod Stakhov [Wed, 13 Jan 2016 00:14:05 +0000 (00:14 +0000)] 
Add extra sleep to avoid race condition

When there are no expressions to compile it is possible that hs_helper
will send notice to no workers. So this sleep should resolve the most of
cases where this race occurs.

9 years agoAdd more details to the guide
Vsevolod Stakhov [Tue, 12 Jan 2016 18:19:42 +0000 (18:19 +0000)] 
Add more details to the guide

9 years agoAdd globbing support
Vsevolod Stakhov [Tue, 12 Jan 2016 17:40:57 +0000 (17:40 +0000)] 
Add globbing support

9 years agoImprove error reporting
Vsevolod Stakhov [Tue, 12 Jan 2016 15:17:26 +0000 (15:17 +0000)] 
Improve error reporting

9 years agoUpdate surbl documentation
Vsevolod Stakhov [Tue, 12 Jan 2016 14:40:12 +0000 (14:40 +0000)] 
Update surbl documentation

9 years agoEnable hiredis for travis
Vsevolod Stakhov [Mon, 11 Jan 2016 20:35:11 +0000 (20:35 +0000)] 
Enable hiredis for travis

9 years agoFix include path for embedded hiredis
Vsevolod Stakhov [Mon, 11 Jan 2016 20:34:31 +0000 (20:34 +0000)] 
Fix include path for embedded hiredis

9 years agoRemove deprecated random id
Vsevolod Stakhov [Mon, 11 Jan 2016 19:14:24 +0000 (19:14 +0000)] 
Remove deprecated random id

9 years agoStart SA migrating guide
Vsevolod Stakhov [Mon, 11 Jan 2016 19:10:47 +0000 (19:10 +0000)] 
Start SA migrating guide

9 years agoRemove unused var.
Vsevolod Stakhov [Mon, 11 Jan 2016 17:30:12 +0000 (17:30 +0000)] 
Remove unused var.

9 years agoFix format strings
Vsevolod Stakhov [Mon, 11 Jan 2016 17:26:31 +0000 (17:26 +0000)] 
Fix format strings

9 years agoUpdate from publicsuffix
Vsevolod Stakhov [Mon, 11 Jan 2016 16:54:10 +0000 (16:54 +0000)] 
Update from publicsuffix

9 years agoRemove hiredis from depends
Vsevolod Stakhov [Mon, 11 Jan 2016 16:34:34 +0000 (16:34 +0000)] 
Remove hiredis from depends

9 years agoFix GNU version of strerror_r (hiredis is broken)
Vsevolod Stakhov [Mon, 11 Jan 2016 16:21:43 +0000 (16:21 +0000)] 
Fix GNU version of strerror_r (hiredis is broken)

9 years agoTry to fix brain damage of cmake
Vsevolod Stakhov [Mon, 11 Jan 2016 16:08:30 +0000 (16:08 +0000)] 
Try to fix brain damage of cmake

9 years agoEmbed hiredis as it is broken literally everywhere
Vsevolod Stakhov [Mon, 11 Jan 2016 16:04:50 +0000 (16:04 +0000)] 
Embed hiredis as it is broken literally everywhere

9 years agoEnable per-users learn cache
Vsevolod Stakhov [Mon, 11 Jan 2016 15:16:09 +0000 (15:16 +0000)] 
Enable per-users learn cache

9 years agoIncompatible change: sqlite3 and per_user behaviour
Vsevolod Stakhov [Mon, 11 Jan 2016 14:54:33 +0000 (14:54 +0000)] 
Incompatible change: sqlite3 and per_user behaviour

Now both redis and sqlite3 follows the common principles for per-user
statistics:

1) If per-user statistics is enabled check per-user tokens ONLY
2) If per-user statistics is not enabled then check common tokens ONLY

If you need old behaviour, then you'd need to use separate classifier
for per-user statistics.

9 years agoImplement `per_user` for redis backend
Vsevolod Stakhov [Mon, 11 Jan 2016 14:51:19 +0000 (14:51 +0000)] 
Implement `per_user` for redis backend

9 years agoAdd generic routine to get task's recipient
Vsevolod Stakhov [Mon, 11 Jan 2016 14:12:35 +0000 (14:12 +0000)] 
Add generic routine to get task's recipient

9 years agoFix relearning for sqlite3 cache
Vsevolod Stakhov [Mon, 11 Jan 2016 13:31:10 +0000 (13:31 +0000)] 
Fix relearning for sqlite3 cache

9 years agoFix query
Vsevolod Stakhov [Mon, 11 Jan 2016 11:28:50 +0000 (11:28 +0000)] 
Fix query

9 years agoRework cache API slightly
Vsevolod Stakhov [Mon, 11 Jan 2016 11:18:28 +0000 (11:18 +0000)] 
Rework cache API slightly

9 years agoImplement redis cache operations
Vsevolod Stakhov [Mon, 11 Jan 2016 10:40:19 +0000 (10:40 +0000)] 
Implement redis cache operations

9 years agoWrite initialization for redis cache
Vsevolod Stakhov [Mon, 11 Jan 2016 09:54:59 +0000 (09:54 +0000)] 
Write initialization for redis cache

9 years agoMerge pull request #476 from moisseev/patch-1
Vsevolod Stakhov [Sun, 10 Jan 2016 23:52:18 +0000 (23:52 +0000)] 
Merge pull request #476 from moisseev/patch-1

Add new Message-ID regexp for Thunderbird

9 years agoAdd skeleton of redis cache
Vsevolod Stakhov [Sun, 10 Jan 2016 23:51:32 +0000 (23:51 +0000)] 
Add skeleton of redis cache

9 years agoFix processing of caches
Vsevolod Stakhov [Sun, 10 Jan 2016 23:39:46 +0000 (23:39 +0000)] 
Fix processing of caches

9 years agoFix caches initialization.
Vsevolod Stakhov [Sun, 10 Jan 2016 23:27:51 +0000 (23:27 +0000)] 
Fix caches initialization.

9 years agoFix sqlite cache
Vsevolod Stakhov [Sun, 10 Jan 2016 23:20:13 +0000 (23:20 +0000)] 
Fix sqlite cache

9 years agoRework caches API
Vsevolod Stakhov [Sun, 10 Jan 2016 22:34:19 +0000 (22:34 +0000)] 
Rework caches API

9 years agoAdd new Message-ID regexp for Thunderbird 476/head
Alexander Moisseev [Sun, 10 Jan 2016 16:30:17 +0000 (19:30 +0300)] 
Add new Message-ID regexp for Thunderbird

Thunderbird version 46 and later is using new securely random Message-ID to avoid fingerprinting.
https://bugzilla.mozilla.org/show_bug.cgi?id=902580
SeaMonkey (at least currentnightly build 2.42a1) is not affected by this change.

9 years agoUse constants instead of magic numbers
Vsevolod Stakhov [Sat, 9 Jan 2016 23:41:52 +0000 (23:41 +0000)] 
Use constants instead of magic numbers

9 years agoFix unlearning in sqlite3 cache.
Vsevolod Stakhov [Sat, 9 Jan 2016 22:13:25 +0000 (22:13 +0000)] 
Fix unlearning in sqlite3 cache.

9 years agoFix strange artefact
Vsevolod Stakhov [Sat, 9 Jan 2016 22:03:24 +0000 (22:03 +0000)] 
Fix strange artefact

9 years agoFix learn errors reporting
Vsevolod Stakhov [Sat, 9 Jan 2016 21:57:36 +0000 (21:57 +0000)] 
Fix learn errors reporting

9 years agoFix numbers humanization in `rspamc stat`
Vsevolod Stakhov [Sat, 9 Jan 2016 21:43:33 +0000 (21:43 +0000)] 
Fix numbers humanization in `rspamc stat`

9 years agoFix stats for redis backend
Vsevolod Stakhov [Sat, 9 Jan 2016 21:24:41 +0000 (21:24 +0000)] 
Fix stats for redis backend

9 years agoAdd lazy stat implementation for redis
Vsevolod Stakhov [Sat, 9 Jan 2016 16:08:08 +0000 (16:08 +0000)] 
Add lazy stat implementation for redis

9 years agoStart implementation of lazy redis statistics.
Vsevolod Stakhov [Sat, 9 Jan 2016 14:43:24 +0000 (14:43 +0000)] 
Start implementation of lazy redis statistics.

9 years agoImplement async timered events for statistics
Vsevolod Stakhov [Sat, 9 Jan 2016 13:33:04 +0000 (13:33 +0000)] 
Implement async timered events for statistics

9 years agoFight with hiredis API
Vsevolod Stakhov [Fri, 8 Jan 2016 18:46:09 +0000 (18:46 +0000)] 
Fight with hiredis API

9 years agoFix setting of number of learns.
Vsevolod Stakhov [Fri, 8 Jan 2016 17:21:12 +0000 (17:21 +0000)] 
Fix setting of number of learns.

9 years ago-1 is a *very* bad unit64_t
Vsevolod Stakhov [Fri, 8 Jan 2016 16:21:10 +0000 (16:21 +0000)] 
-1 is a *very* bad unit64_t

9 years agoImplement the case of incrementing backends for bayes
Vsevolod Stakhov [Fri, 8 Jan 2016 16:08:07 +0000 (16:08 +0000)] 
Implement the case of incrementing backends for bayes

9 years agoImpelement the concept when classifier values are integers
Vsevolod Stakhov [Fri, 8 Jan 2016 15:57:15 +0000 (15:57 +0000)] 
Impelement the concept when classifier values are integers

9 years agoFix precendence for ! and &
Vsevolod Stakhov [Fri, 8 Jan 2016 15:46:37 +0000 (15:46 +0000)] 
Fix precendence for ! and &

9 years agoFix redis queries
Vsevolod Stakhov [Fri, 8 Jan 2016 15:46:31 +0000 (15:46 +0000)] 
Fix redis queries

9 years agoFix format string
Vsevolod Stakhov [Fri, 8 Jan 2016 15:29:41 +0000 (15:29 +0000)] 
Fix format string

9 years agoRedis replies can also be strings
Vsevolod Stakhov [Fri, 8 Jan 2016 15:28:32 +0000 (15:28 +0000)] 
Redis replies can also be strings

9 years agoReorder learn procedure.
Vsevolod Stakhov [Fri, 8 Jan 2016 15:17:02 +0000 (15:17 +0000)] 
Reorder learn procedure.

9 years agoImplement redis learning
Vsevolod Stakhov [Fri, 8 Jan 2016 15:16:52 +0000 (15:16 +0000)] 
Implement redis learning

9 years agoUbuntu 12.04 contains totally broken hiredis
Vsevolod Stakhov [Fri, 8 Jan 2016 13:45:36 +0000 (13:45 +0000)] 
Ubuntu 12.04 contains totally broken hiredis

9 years agoAdd conditions for using redis stat backend
Vsevolod Stakhov [Thu, 7 Jan 2016 23:54:09 +0000 (23:54 +0000)] 
Add conditions for using redis stat backend

9 years agoImplement redis classification
Vsevolod Stakhov [Thu, 7 Jan 2016 18:19:53 +0000 (18:19 +0000)] 
Implement redis classification

9 years agoMove redis.c to redis_backend.c
Vsevolod Stakhov [Thu, 7 Jan 2016 16:58:40 +0000 (16:58 +0000)] 
Move redis.c to redis_backend.c

9 years agoAdd missing backend methods
Vsevolod Stakhov [Thu, 7 Jan 2016 16:43:24 +0000 (16:43 +0000)] 
Add missing backend methods

9 years agoRestore redis backend compilation.
Vsevolod Stakhov [Thu, 7 Jan 2016 16:12:22 +0000 (16:12 +0000)] 
Restore redis backend compilation.

9 years agoFix parsing of strings lists from implicit arrays
Vsevolod Stakhov [Thu, 7 Jan 2016 12:53:13 +0000 (12:53 +0000)] 
Fix parsing of strings lists from implicit arrays

9 years agoFix tests
Vsevolod Stakhov [Thu, 7 Jan 2016 11:27:41 +0000 (11:27 +0000)] 
Fix tests

9 years agoAllow lua script call for autolearn
Vsevolod Stakhov [Thu, 7 Jan 2016 09:19:48 +0000 (09:19 +0000)] 
Allow lua script call for autolearn

9 years agoAllow to set autolearn to [ham_score, spam_score]
Vsevolod Stakhov [Thu, 7 Jan 2016 09:10:27 +0000 (09:10 +0000)] 
Allow to set autolearn to [ham_score, spam_score]

9 years agoFix autolearn switch
Vsevolod Stakhov [Thu, 7 Jan 2016 09:03:06 +0000 (09:03 +0000)] 
Fix autolearn switch

9 years agoDo not autolearn if we have the same class for this message
Vsevolod Stakhov [Wed, 6 Jan 2016 23:03:25 +0000 (23:03 +0000)] 
Do not autolearn if we have the same class for this message

9 years agoDo not treat autolearn errors as fatal
Vsevolod Stakhov [Wed, 6 Jan 2016 22:27:44 +0000 (22:27 +0000)] 
Do not treat autolearn errors as fatal

9 years agoImplement autolearn
Vsevolod Stakhov [Wed, 6 Jan 2016 18:18:07 +0000 (18:18 +0000)] 
Implement autolearn

9 years agoAdd a simple workaround to avoid configtest crashes
Vsevolod Stakhov [Wed, 6 Jan 2016 17:46:09 +0000 (17:46 +0000)] 
Add a simple workaround to avoid configtest crashes

9 years agoRestore statistics for libstat
Vsevolod Stakhov [Wed, 6 Jan 2016 17:41:28 +0000 (17:41 +0000)] 
Restore statistics for libstat

9 years agoRework and refactor memory pools code
Vsevolod Stakhov [Wed, 6 Jan 2016 17:19:04 +0000 (17:19 +0000)] 
Rework and refactor memory pools code

9 years agoFix parsing of string lists.
Vsevolod Stakhov [Wed, 6 Jan 2016 17:18:53 +0000 (17:18 +0000)] 
Fix parsing of string lists.

9 years agoAdd preliminary support of async events in libstat
Vsevolod Stakhov [Wed, 6 Jan 2016 16:19:48 +0000 (16:19 +0000)] 
Add preliminary support of async events in libstat

9 years agoFix several memory corruption issues
Vsevolod Stakhov [Wed, 6 Jan 2016 16:05:16 +0000 (16:05 +0000)] 
Fix several memory corruption issues

9 years agoAdd cleanup code for statistics
Vsevolod Stakhov [Wed, 6 Jan 2016 16:00:32 +0000 (16:00 +0000)] 
Add cleanup code for statistics

9 years agoStore event base in statistics library
Vsevolod Stakhov [Wed, 6 Jan 2016 15:25:07 +0000 (15:25 +0000)] 
Store event base in statistics library

9 years agoFix learning.
Vsevolod Stakhov [Wed, 6 Jan 2016 15:08:48 +0000 (15:08 +0000)] 
Fix learning.

9 years agoAdd learning implementation.
Vsevolod Stakhov [Wed, 6 Jan 2016 14:24:07 +0000 (14:24 +0000)] 
Add learning implementation.

9 years agoMerge branch 'stat-rework'
Vsevolod Stakhov [Tue, 5 Jan 2016 19:04:40 +0000 (19:04 +0000)] 
Merge branch 'stat-rework'

9 years agoFix init/deinit of statistics
Vsevolod Stakhov [Tue, 5 Jan 2016 19:04:24 +0000 (19:04 +0000)] 
Fix init/deinit of statistics

9 years agoFix statistics processing
Vsevolod Stakhov [Tue, 5 Jan 2016 18:55:56 +0000 (18:55 +0000)] 
Fix statistics processing

9 years agoFix cache init
Vsevolod Stakhov [Tue, 5 Jan 2016 18:07:27 +0000 (18:07 +0000)] 
Fix cache init

9 years agoFix bayes classifier for the new architecture
Vsevolod Stakhov [Tue, 5 Jan 2016 18:02:47 +0000 (18:02 +0000)] 
Fix bayes classifier for the new architecture

9 years agoDisable redis until rework is done
Vsevolod Stakhov [Tue, 5 Jan 2016 18:02:32 +0000 (18:02 +0000)] 
Disable redis until rework is done

9 years agoFix configuration issues
Vsevolod Stakhov [Tue, 5 Jan 2016 17:30:58 +0000 (17:30 +0000)] 
Fix configuration issues

9 years agoSimplify learn and process functions
Vsevolod Stakhov [Tue, 5 Jan 2016 17:24:40 +0000 (17:24 +0000)] 
Simplify learn and process functions

9 years agoFix tokenization
Vsevolod Stakhov [Tue, 5 Jan 2016 16:59:02 +0000 (16:59 +0000)] 
Fix tokenization

9 years agoRework mmapped file backend
Vsevolod Stakhov [Tue, 5 Jan 2016 16:37:40 +0000 (16:37 +0000)] 
Rework mmapped file backend