alphabet_detector
| Crates.io | alphabet_detector |
| lib.rs | alphabet_detector |
| version | 0.12.0 |
| created_at | 2025-01-31 11:48:47.163386+00 |
| updated_at | 2026-01-22 16:22:02.022574+00 |
| description | Natural language alphabet detection library |
| homepage | |
| repository | https://github.com/RoDmitry/alphabet_detector |
| max_upload_size | |
| id | 1537452 |
| size | 385,470 |
Dmitry Rodionov (RoDmitry)
documentation
README
Alphabet Detector
Detects 429 alphabets of 347 languages in 174 scripts
One language can be written in multiple scripts, so it will be detected as a different
ScriptLanguage(language + script)
Does not have any models, just matches the alphabet. Not recommended to use as a standalone detector.
It's more like a word separator + language prefilter for an actual language detector (Langram).
Splits text (iterator CharIndices) to words, and detects ScriptLanguages (language + script) of words by used letters (chars).
Extras
Look at the alphabets.rs to understand what languages have already defined alphabets. Some of them need validation.
Warning: can return words with chars from the Unicode private area (for example Lingala, Nuer or Yoruba languages), because of char normalization (composition with Inherited), and there are no such chars defined in Unicode.