inverta
| Crates.io | inverta |
| lib.rs | inverta |
| version | 0.1.0 |
| created_at | 2026-01-16 12:09:38.548858+00 |
| updated_at | 2026-01-16 12:09:38.548858+00 |
| description | A basic search engine that downloads pages and matches your search query against their contents. |
| homepage | |
| repository | https://github.com/pratham-srivastava-07/inverta |
| max_upload_size | |
| id | 2048513 |
| size | 69,014 |
Pratham Srivastava (pratham-srivastava-07)
documentation
README
Inverta
Inverta is a basic search engine written in Rust. It allows you to crawl websites, index their content using TF-IDF, and perform search queries against the indexed data.
Features
- Web Crawler: Downloads pages starting from a seed URL.
- Indexer: Builds an inverted index with TF-IDF scoring.
- Search: Query the index to find relevant pages.
Installation
Ensure you have Rust and Cargo installed.
git clone https://github.com/pratham-srivastava-07/Inverta.git
cd Inverta
cargo build --release
Usage
Run the application using Cargo:
cargo run
- Enter a valid URL when prompted (e.g.,
https://example.com). - The crawler will fetch pages (up to a limit).
- Enters a search loop:
- Type a query to search the indexed pages.
- Type
exitto quit.
Dependencies
reqwest: HTTP client for crawling.select: HTML parsing.url: URL parsing and normalization.regex: Tokenization.lazy_static: Static initialization.
License
MIT