qrawl
| Crates.io | qrawl |
| lib.rs | qrawl |
| version | 0.5.4 |
| created_at | 2025-08-22 02:43:08.162238+00 |
| updated_at | 2025-11-19 00:33:59.695636+00 |
| description | Composable web crawling tools for Rust |
| homepage | https://github.com/QLangstaff/qrawl |
| repository | https://github.com/QLangstaff/qrawl |
| max_upload_size | |
| id | 1805829 |
| size | 243,475 |
Qali (QLangstaff)
documentation
https://docs.rs/qrawl
README
Qrawl
Composable web crawling tools for Rust
Install
cargo add qrawl
Tools
- batch: Batch operations concurrently
- clean: Clean raw data
- extract: Extract structured data
- fetch: Fetch with auto or fast strategy
- map: Map URLs
- scrape: Scrape raw data
Templates
- qrawl_children: Get children from parent URLs
- qrawl_emails: Get emails from given URLs
License
MIT