syntaxdot-tokenizers
| Crates.io | syntaxdot-tokenizers |
| lib.rs | syntaxdot-tokenizers |
| version | 0.5.0 |
| source | src |
| created_at | 2020-11-19 11:14:03.108414 |
| updated_at | 2023-04-24 05:53:09.592319 |
| description | Subword tokenizers |
| homepage | https://github.com/tensordot/syntaxdot |
| repository | https://github.com/tensordot/syntaxdot.git |
| max_upload_size | |
| id | 313965 |
| size | 16,124 |
Daniël de Kok (danieldk)
documentation
https://docs.rs/syntaxdot-tokenizers/