tfidf-summarizer
| Crates.io | tfidf-summarizer |
| lib.rs | tfidf-summarizer |
| version | 2.0.0 |
| created_at | 2023-11-09 00:03:53.000501+00 |
| updated_at | 2023-11-09 00:03:53.000501+00 |
| description | Basic tf-idf compute for documents |
| homepage | https://github.com/zakariahajji/tfidf_summarizer |
| repository | https://github.com/zakariahajji/tfidf_summarizer |
| max_upload_size | |
| id | 1029546 |
| size | 9,505 |
Zakaria Hajji (zakariahajji)
documentation
README
TF-IDF Summarizer
tfidf-summarizer is a Rust crate for computing Term Frequency-Inverse Document Frequency (TF-IDF) vectors for a set of documents. This statistical measure is used to evaluate how important a word is to a document in a collection or corpus.
Features
- Tokenization of text data.
- Calculation of term frequency (TF) for words in each document.
- Calculation of document frequency (DF) for words across all documents.
- Calculation of inverse document frequency (IDF) across all documents.
- Computation of TF-IDF scores for words in each document.
Installation
Add this to your Cargo.toml:
[dependencies]
tfidf-summarizer = "0.1.0"