From: Vsevolod Stakhov <vsevolod@highsecure.ru>
Date: Fri, 30 Nov 2018 10:00:04 +0000 (+0000)
Subject: [Minor] Slightly extend what we can treat as words
X-Git-Tag: 1.8.3~25
X-Git-Url: http://git.ipfire.org/gitweb.cgi?a=commitdiff_plain;h=44b731c68fc57e94fa26d0172f4805a56bcb94ea;p=thirdparty%2Frspamd.git

[Minor] Slightly extend what we can treat as words
---

diff --git a/src/libstat/tokenizers/tokenizers.c b/src/libstat/tokenizers/tokenizers.c
index 51c711cf83..acbbcf2f01 100644
--- a/src/libstat/tokenizers/tokenizers.c
+++ b/src/libstat/tokenizers/tokenizers.c
@@ -229,7 +229,7 @@ rspamd_utf_word_valid (const gchar *text, const gchar *end,
 
 	U8_NEXT (text, start, finish, c);
 
-	if (u_isalnum (c)) {
+	if (u_isJavaIDPart (c)) {
 		return TRUE;
 	}