]> git.ipfire.org Git - thirdparty/sqlite.git/commit
Optimize the unicode61 tokenizer so that it handles ascii text faster. Make it the...
authordan <dan@noemail.net>
Mon, 12 Jan 2015 17:58:04 +0000 (17:58 +0000)
committerdan <dan@noemail.net>
Mon, 12 Jan 2015 17:58:04 +0000 (17:58 +0000)
commit73f7d6ed75ede36611aa3a69d70d802eecf900fa
tree3183d71db99c1e6ae659e46ebe3fb8af46c056ff
parent27277c4e3c0fa0a05ae87b7b6be6a8380c52ecaf
Optimize the unicode61 tokenizer so that it handles ascii text faster. Make it the default tokenizer. Change the name of the simple tokenizer to "ascii".

FossilOrigin-Name: f22dbccad9499624880ddd48df1b07fb42b1ad66
ext/fts5/fts5.c
ext/fts5/fts5_tokenize.c
ext/fts5/test/fts5near.test
ext/fts5/test/fts5tokenizer.test
ext/fts5/test/fts5unicode.test
manifest
manifest.uuid