omnivore-core
| Crates.io | omnivore-core |
| lib.rs | omnivore-core |
| version | 0.1.1 |
| created_at | 2025-08-09 19:53:50.856925+00 |
| updated_at | 2025-08-11 03:15:50.258422+00 |
| description | Core crawler and knowledge graph engine for Omnivore - web scraping, AI extraction, browser automation |
| homepage | https://ov.pranavkarra.me |
| repository | https://github.com/Pranav-Karra-3301/omnivore |
| max_upload_size | |
| id | 1788197 |
| size | 298,778 |
Pranav Karra (Pranav-Karra-3301)
documentation
https://docs.rs/omnivore-core
README
omnivore-core
Core crawler and knowledge graph engine for Omnivore.
- Fast async crawling with Tokio
- Respectful politeness and robots.txt support
- HTML parsing and extraction utilities
- Pluggable storage and graph building
License
MIT OR Apache-2.0