plrs
| Crates.io | plrs |
| lib.rs | plrs |
| version | 0.1.3 |
| created_at | 2021-09-10 22:00:45.04518+00 |
| updated_at | 2021-09-10 22:00:45.04518+00 |
| description | The multi-tool of lexical analysis and tokenization. |
| homepage | |
| repository | https://github.com/JakeRoggenbuck/plrs |
| max_upload_size | |
| id | 449494 |
| size | 13,390 |
Jake Roggenbuck (JakeRoggenbuck)
documentation
README
plrs 
The multi-tool of lexical analysis and tokenization.
Install
pip install plrs
Build
maturin build
Examples
API
Global variables
EOF_TOKEN
Classes
Tokens
Settings
Token
- part
- token
- set_part
- set_token
- __str__
- __repr__
Lexer
- new
- char_forward
- skip_over_char_set
- next
Functions
is_char_symbol
is_char_operator
is_char_whitespace
is_char_numeric
is_single_quote
is_double_quote
ends_token
is_part_numeric
tokenize