nvs-packer

Crates.ionvs-packer
lib.rsnvs-packer
version0.1.0
created_at2025-09-24 20:30:24.226626+00
updated_at2025-09-24 20:30:24.226626+00
descriptionCLI: Convert JSON docs to native-vector-store bundle (Rust)
homepage
repositoryhttps://github.com/martinboros/native-vector-store
max_upload_size
id1853792
size105,888
Martin Boros (mboros1)

documentation

README

nvs-packer

CLI and library to convert JSON documents with embeddings into a Native Vector Store bundle.

Input JSON format

  • Array of objects. Each element must contain text (or content) and metadata.embedding (array of floats). Optional additional metadata fields are preserved.

Examples

cargo run -p nvs-packer -- \
  ./my-json --out ./.nvs-bundle \
  --dtype f16 --bm25-buckets 32 --compress zstd

As a library, call the loader and writer modules directly for custom flows.

Outputs

  • vectors.f32 or vectors.f16
  • meta.blocks + meta.idx
  • terms.dict, postings.bin, lexicon.bin, doclen.u32
  • manifest.json, checksums.xxhash64, receipts.txt

License: MIT

Commit count: 0

cargo fmt