htmx_llamacpp_server
| Crates.io | htmx_llamacpp_server |
| lib.rs | htmx_llamacpp_server |
| version | 0.1.3 |
| created_at | 2024-12-17 18:34:52.040192+00 |
| updated_at | 2024-12-17 20:59:32.431852+00 |
| description | A simple server for the htmx_llamacpp project |
| homepage | |
| repository | |
| max_upload_size | |
| id | 1486597 |
| size | 89,521 |
richardanaya2_2048b.Q6_K.gguf (richardanaya)
documentation
README
HTMX + Llama.cpp Server ❤️
On machine with llama.cpp
.\llama-server -ngl 100 --port 9090 -m <some.gguf> --host 0.0.0.0
When running
cargo run -- --llama http://<llama.cpp_server_IP>:9090