xapian: Add phrase-aware tokenizer.
authorRicardo Wurmus <rekado@elephly.net>
Sun, 10 May 2020 06:28:38 +0000 (08:28 +0200)
committerRicardo Wurmus <rekado@elephly.net>
Sun, 10 May 2020 06:28:38 +0000 (08:28 +0200)
commitb6f26c77e1e6756909e47d143ff2a1766454c475
treea7205c654b0a3e56362c809b9b768a62d1fd4a8b
parent43a931ace99e154124b855b5468ea7b10582bfdb
xapian: Add phrase-aware tokenizer.

* mumi/xapian.scm (tokenize): New procedure.
(search): Use it instead of string-tokenize.
* tests/xapian.scm: Test it.
mumi/xapian.scm
tests/xapian.scm