ort

Crates.ioort
lib.rsort
version2.0.0-rc.2
sourcesrc
created_at2022-11-26 21:59:51.388503
updated_at2024-04-27 00:00:38.909979
descriptionA safe Rust wrapper for ONNX Runtime 1.17 - Optimize and Accelerate Machine Learning Inferencing
homepage
repositoryhttps://github.com/pykeio/ort
max_upload_size
id723486
size333,700
Carson M. (decahedron1)

documentation

https://ort.pyke.io/

README

Coverage Results Crates.io Open Collective backers and sponsors
Crates.io ONNX Runtime

ort is an (unofficial) ONNX Runtime 1.17 wrapper for Rust based on the now inactive onnxruntime-rs. ONNX Runtime accelerates ML inference on both CPU & GPU.

πŸ“– Documentation

πŸ€” Support

πŸ’– Projects using ort

Open a PR to add your project here 🌟

  • Twitter uses ort to serve homepage recommendations to hundreds of millions of users.
  • Bloop uses ort to power their semantic code search feature.
  • pyke Diffusers uses ort for efficient Stable Diffusion image generation on both CPUs & GPUs.
  • edge-transformers uses ort for accelerated transformer model inference at the edge.
  • Ortex uses ort for safe ONNX Runtime bindings in Elixir.
  • Supabase uses ort to remove cold starts for their edge functions.
  • Lantern uses ort to provide embedding model inference inside Postgres.

🌠 Sponsor ort
Commit count: 327

cargo fmt