shimmy-llama-cpp-sys-2

Crates.ioshimmy-llama-cpp-sys-2
lib.rsshimmy-llama-cpp-sys-2
version0.1.123
created_at2025-10-09 20:01:22.250413+00
updated_at2025-10-09 20:01:22.250413+00
descriptionLow Level Bindings to llama.cpp with MoE CPU offloading support
homepage
repositoryhttps://github.com/Michael-A-Kuykendall/llama-cpp-rs
max_upload_size
id1876142
size16,657,872
Mike Kuykendall (Michael-A-Kuykendall)

documentation

README

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

Commit count: 0

cargo fmt