# ggml-quants

[![CI](https://github.com/InfiniTensor/gguf/actions/workflows/build.yml/badge.svg?branch=main)](https://github.com/InfiniTensor/gguf/actions)
[![Latest version](https://img.shields.io/crates/v/ggml-quants.svg)](https://crates.io/crates/ggml-quants)
[![Documentation](https://docs.rs/ggml-quants/badge.svg)](https://docs.rs/ggml-quants)
[![license](https://img.shields.io/github/license/InfiniTensor/gguf)](https://mit-license.org/)

`ggml-quants` is a Rust library that implements the quantized data types defined by `ggml` and their corresponding quantization and dequantization algorithms.