llama-cpp-sys-4

Crates.iollama-cpp-sys-4
lib.rsllama-cpp-sys-4
version0.1.94
created_at2024-10-27 22:59:41.874556+00
updated_at2025-02-11 22:45:30.519815+00
descriptionLow Level Bindings to llama.cpp
homepage
repositoryhttps://github.com/eugenehp/llama-cpp-rs
max_upload_size
id1425094
size9,161,062
Eugene Hauptmann (eugenehp)

documentation

README

llama-cpp-sys

Raw bindings to llama.cpp with cuda support, including new Sampler API from llama-cpp.

See llama-cpp-4 for a safe API.

OpenMPI support

brew install open-mpi
cargo build -F mpi
Commit count: 1057

cargo fmt