qrawl

Crates.ioqrawl
lib.rsqrawl
version0.5.4
created_at2025-08-22 02:43:08.162238+00
updated_at2025-11-19 00:33:59.695636+00
descriptionComposable web crawling tools for Rust
homepagehttps://github.com/QLangstaff/qrawl
repositoryhttps://github.com/QLangstaff/qrawl
max_upload_size
id1805829
size243,475
Qali (QLangstaff)

documentation

https://docs.rs/qrawl

README

Qrawl

Composable web crawling tools for Rust

Install

cargo add qrawl

Tools

  • batch: Batch operations concurrently
  • clean: Clean raw data
  • extract: Extract structured data
  • fetch: Fetch with auto or fast strategy
  • map: Map URLs
  • scrape: Scrape raw data

Templates

License

MIT

Commit count: 11

cargo fmt