localllm

Crates.iolocalllm
lib.rslocalllm
version0.2.0
sourcesrc
created_at2024-08-17 16:18:56.0586
updated_at2024-08-18 11:58:50.290549
descriptionqwen2 model lib by llama.cpp
homepage
repositoryhttps://gitlab.com/hjiayz/localllm
max_upload_size
id1341810
size10,408,650
ppc (hjiayz)

documentation

README

localllm

qwen2 model lib by llama.cpp

set LLAMA_LIB="llama.lib ggml.lib common.lib dir"

llama.lib ggml.lib common.lib from https://github.com/hjiayz/build-llama.cpp

example model https://hf-mirror.com/Qwen/Qwen2-1.5B-Instruct-GGUF/blob/main/qwen2-1_5b-instruct-q2_k.gguf

Commit count: 0

cargo fmt