ort

Crates.ioort
lib.rsort
version2.0.0-rc.4
sourcesrc
created_at2022-11-26 21:59:51.388503
updated_at2024-07-07 20:50:01.874983
descriptionA safe Rust wrapper for ONNX Runtime 1.18 - Optimize and accelerate machine learning inference & training
homepage
repositoryhttps://github.com/pykeio/ort
max_upload_size
id723486
size398,207
Carson M. (decahedron1)

documentation

https://ort.pyke.io/

README

Coverage Results Crates.io Open Collective backers and sponsors
Crates.io ONNX Runtime

ort is an (unofficial) ONNX Runtime 1.18 wrapper for Rust based on the now inactive onnxruntime-rs. ONNX Runtime accelerates ML inference and training on both CPU & GPU.

πŸ“– Documentation

πŸ€” Support

πŸ’– Projects using ort

Open a PR to add your project here 🌟

  • Twitter uses ort to serve homepage recommendations to hundreds of millions of users.
  • Bloop uses ort to power their semantic code search feature.
  • edge-transformers uses ort for accelerated transformer model inference at the edge.
  • Ortex uses ort for safe ONNX Runtime bindings in Elixir.
  • Supabase uses ort to remove cold starts for their edge functions.
  • Lantern uses ort to provide embedding model inference inside Postgres.
  • Magika uses ort for content type detection.

🌠 Sponsor ort
Commit count: 374

cargo fmt