PORTER_TOKENIZER

val PORTER_TOKENIZER: String = "PorterTokenizer"

The name of PSPDFKit's custom porter tokenizer that allows better CJK indexing. This tokenizer also comes with a few drawbacks, like much more lax matching of words (Searching for "Dependency" will also return "Dependencies"), if this is a problem use the UNICODE_TOKENIZER instead.

This is the default tokenizer used when no other one is specified.