rust-lexer
| Crates.io | rust-lexer |
| lib.rs | rust-lexer |
| version | 0.2.0 |
| source | src |
| created_at | 2023-07-04 05:28:32.72901 |
| updated_at | 2023-07-09 18:59:23.024077 |
| description | A compiler that generates a Lexer using DFAs (inspired by flex) |
| homepage | |
| repository | |
| max_upload_size | |
| id | 907677 |
| size | 82,666 |
Cyril Sharma (CyrilSharma)
documentation
README
rflex
This is a compiler which takes in a .tk regex specification and outputs a tokenizer. The usage is rflex [input_file] [output_file]. See example.tk and tokenizer.rs for an example input and output. Much of the design was based on the textbook: Compilers, Principles, Designs and Tools.
TODO
Make generator break when it encounters the dead state. Make generator handle variable types! It's really annoying otherwise.