unobtanium-crawler
| Crates.io | unobtanium-crawler |
| lib.rs | unobtanium-crawler |
| version | 3.0.0 |
| created_at | 2024-08-10 22:54:36.015136+00 |
| updated_at | 2025-08-15 13:55:42.677022+00 |
| description | The default web-crawler for unobtanium. |
| homepage | |
| repository | https://codeberg.org/unobtanium/unobtanium |
| max_upload_size | |
| id | 1332784 |
| size | 210,986 |
Slatian (slatian)
documentation
https://docs.rs/unobtanium-crawler
README
unobtanium-crawler
The unobtanium-crawler is the web crawler of the unobtanium search engine.
It is responsible for crawling websites and turning the result into a searchable index.
It is published under an AGPL-3.0-only license.