exo-rs

A Rust SDK and wrapper for the Exo AI engine.

exo-rs provides a strongly-typed, ergonomic Rust interface for interacting with Exo clusters, allowing you to easily integrate local LLM capabilities into your Rust applications.

Installation

Add this to your Cargo.toml:

[dependencies]
exo-rs = "0.1.0"

Usage

use exo_rs::{ExoBuilder, ReqwestBackend};
use std::error::Error;

fn main() -> Result<(), Box<dyn Error>> {
    let exo = ExoBuilder::new()
        .base_url("http://localhost:52415")
        .build(ReqwestBackend);

    let request = exo.chat()
        .set_model("mlx-community/Qwen3-30B-A3B-4bit")
        .add_user_message("What can you do?");

    let response = request.validate()?.send()?;
    
    if let Some(choice) = response.choices.first() {
        println!("{}", choice.message.content);
    }

    Ok(())
}

License

MIT