product-os-llm
| Crates.io | product-os-llm |
| lib.rs | product-os-llm |
| version | 0.0.2 |
| created_at | 2025-07-28 01:41:23.525996+00 |
| updated_at | 2025-07-28 01:41:23.525996+00 |
| description | Product OS : LLM provides direct implementation using Candle or indirect implementation using Ollama of different LLMs |
| homepage | |
| repository | |
| max_upload_size | |
| id | 1770581 |
| size | 178,340 |
Jeremy (eremyjay)
documentation
README
Product OS : LLM
Product OS : LLM provides direct implementation using Candle or indirect implementation using Ollama of different LLMs
What is Product OS?
Product OS : LLM provides capabilities and tooling for running natural language models
Installation
Use the Rust crate package manager cargo to install Product OS : LLM.
cargo add product-os-llm
or add Product OS : LLM to your cargo.toml [packages] section.
product-os-coder = { version = "0.0.2", features = [], default-features = true, optional = false }
Features
Product OS LLM supports a number of features leveraging existing Rust libraries including:
- Ability to run on device models using safetensors
- Ability to run on device models using gguf
- Ability to run on device models or remote models using Ollama
- Token counter specific to model
- Specific support for Qwen, Phi and Llama models
// Feature samples TODO
Usage
// Examples TODO
Contributing
Contributions are not currently available but will be available on a public repository soon.