coze
| Crates.io | coze |
| lib.rs | coze |
| version | 0.1.7 |
| source | src |
| created_at | 2024-02-14 11:58:46.353458 |
| updated_at | 2024-03-19 18:47:29.963101 |
| description | An egui app for playing with a local open source LLM. |
| homepage | |
| repository | https://github.com/vincev/coze |
| max_upload_size | |
| id | 1139810 |
| size | 959,092 |
(vincev)
documentation
README
An egui app for prompting local offline LLMs.
Description
coze is an egui application for prompting local
offline LLMs using the Huggingface candle
crate.
Currently it supports the following quantized models:
The first time a model is used its weights are downloaded from Huggingface and cached
to the ~/.cache/coze folder for later use.
The current version supports:
- Prompt history navigation with fuzzy matching.
- History persistence across runs.
- Token generation modes.
- Copy prompts and replies to clipboard.
- Light/Dark mode.
See the app Help menu for usage details.
Installation
The latest version can be installed by getting the binaries for Linux, MacOS, and
Windows from the releases page, or by using cargo:
cargo install --locked coze
To build locally (debug build may be very slow):
git clone https://github.com/vincev/coze
cd coze
cargo r --release