tantivy-tokenizer-tiny-segmenter
| Crates.io | tantivy-tokenizer-tiny-segmenter |
| lib.rs | tantivy-tokenizer-tiny-segmenter |
| version | 0.3.0 |
| created_at | 2019-02-14 17:22:18.317435+00 |
| updated_at | 2019-11-07 16:47:55.289729+00 |
| description | A Japanese tokenizer for Tantivy, based on TinySegmenter. |
| homepage | |
| repository | https://github.com/osyoyu/tantivy-tokenizer-tiny-segmenter |
| max_upload_size | |
| id | 114778 |
| size | 71,996 |
Daisuke Aritomo (osyoyu)
documentation
README
tantivy-tokenizer-tiny-segmenter
A Japanese tokenizer for Tantivy based on TinySegmenter. Compatible with Tantivy 0.10.
See examples/basic.rs for basic usage.