valentinus

Crates.iovalentinus
lib.rsvalentinus
version1.1.3
created_at2024-07-12 12:34:04.957532+00
updated_at2026-01-08 21:23:48.284669+00
descriptionA thread-safe vector database for model inference inside LMDB.
homepage
repositoryhttps://github.com/kn0sys/valentinus
max_upload_size
id1300631
size314,191
n12n (kn0sys)

documentation

https://docs.rs/valentinus

README

build test Crates.io Version Crates.io Total Downloads docs.rs GitHub commit activity Matrix

alt text

valentinus

A thread-safe vector database for model inference inside LMDB.

dependencies

  • bincode/serde - serialize/deserialize
  • lmdb-rs - database bindings
  • ndarray - numpy equivalent
  • ort/onnx - embeddings

getting started

NOTE: ensure you have the development packages below (e.g. for Fedora)

  • sudo dnf install openssl-devel
  • sudo dnf install gcc-c++
git clone https://github.com/kn0sys/valentinus && cd valentinus

optional environment variables

var usage default
LMDB_USER working directory of the user for database $USER
LMDB_MAP_SIZE Sets max environment size, i.e. size in memory/disk of all data 20% of available memory
ONNX_PARALLEL_THREADS parallel execution mode for this session 1
VALENTINUS_CUSTOM_DIM embeddings dimensions for custom models all-mini-lm-6 -> 384
VALENTINUS_LMDB_ENV environment for the database (i.e. test, prod) test

tests

  • Note: all tests currently require the all-MiniLM-L6-v2_onnx directory
  • Get the model.onnx and tokenizer.json from huggingface or build them
mkdir all-MiniLM-L6-v2_onnx \
&& cd all-MiniLM-L6-v2_onnx \
&& wget https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/config.json \
&& wget https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/onnx/model.onnx \
&& wget https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/special_tokens_map.json \
&& wget https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/tokenizer_config.json \
&& wget https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/tokenizer.json \
&& wget https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2/resolve/main/vocab.txt

cargo test

examples

see examples

reference

inspired by this chromadb python tutorial

Commit count: 123

cargo fmt