Crates.io | ggml-quants |
lib.rs | ggml-quants |
version | 0.0.0 |
source | src |
created_at | 2024-11-25 06:15:30.380031 |
updated_at | 2024-11-25 06:15:30.380031 |
description | GGml defined quantized data types and their quant/dequant algorithm |
homepage | |
repository | https://github.com/InfiniTensor/gguf |
max_upload_size | |
id | 1459936 |
size | 31,862 |
ggml-quants
is a Rust library that implements the quantized data types defined by ggml
and their corresponding quantization and dequantization algorithms.