tantivy-tokenizer-tiny-segmenter
================================

A Japanese tokenizer for [Tantivy](https://github.com/tantivy-search/tantivy) based on [TinySegmenter](http://chasen.org/~taku/software/TinySegmenter/). Compatible with Tantivy 0.10.

See examples/basic.rs for basic usage.