agno-rust

A high-performance Rust implementation of the agno AI agent framework. Build production-ready AI agents with multi-provider LLM support, extensive toolkits, and enterprise-grade features.

Features

Multi-Provider LLM Support (10 Providers)

Built-in Toolkits (13 Toolkits)

Memory and Knowledge

• Vector Stores: In-memory, PostgreSQL (pgvector), Qdrant
• Embedders: OpenAI, Transformers, Whitespace (testing)
• Memory Strategies: Full, Windowed, Summarized, Token-limited
• Document Chunking: Sliding window chunker with overlap

Enterprise Features

• Guardrails: PII detection (SSN, credit card, email, phone), prompt injection detection
• RBAC and Privacy: Access control, principals, privacy rules
• Reasoning: Chain-of-thought orchestration with confidence scoring
• MCP Support: Model Context Protocol client with stdio/HTTP transports

Observability

• Telemetry: OpenTelemetry tracing with OTLP export
• Metrics: Prometheus exporter for run duration, tool calls, failures
• Structured Events: In-memory collector with batch delivery

Runtime and Deployment

• HTTP Server: REST API with SSE streaming
• Workflows: Sequential, parallel, and conditional execution
• Teams: Multi-agent coordination
• Config: File-based or environment variable configuration

Installation

Add to your Cargo.toml:

[dependencies]
agno-rust = "0.3"

Quick Start

use agno_rust::{Agent, OpenAIClient, ToolRegistry};
use agno_rust::tools::{calculator_toolkit, duckduckgo_toolkit};

#[tokio::main]
async fn main() -> agno_rust::Result<()> {
    // Create LLM client
    let model = OpenAIClient::from_env()?.with_model("gpt-4o");
    
    // Register tools
    let mut tools = ToolRegistry::new();
    calculator_toolkit(&mut tools);
    duckduckgo_toolkit(&mut tools, Default::default());
    
    // Create agent
    let mut agent = Agent::new(model).with_tools(tools);
    
    // Chat
    let reply = agent.respond("What is 42 * 17?").await?;
    println!("{reply}");
    
    Ok(())
}

Toolkit Examples

GitHub Integration

use agno_rust::tools::{register_github_tools, GitHubClient};

let mut tools = ToolRegistry::new();
register_github_tools(&mut tools); // Uses GITHUB_TOKEN env var

// Tools: github_search_repos, github_get_repo, github_list_issues, github_read_file

Slack Integration

use agno_rust::tools::{register_slack_tools, SlackClient};

let mut tools = ToolRegistry::new();
register_slack_tools(&mut tools, std::env::var("SLACK_BOT_TOKEN")?);

// Tools: slack_send_message, slack_list_channels, slack_search

SQL Database

use agno_rust::tools::register_sql_tools;

let mut tools = ToolRegistry::new();
register_sql_tools(&mut tools, "/path/to/database.db");

// Tools: sql_query (read-only by default), sql_schema

Academic Research

use agno_rust::tools::{register_arxiv_tools, register_pubmed_tools};

let mut tools = ToolRegistry::new();
register_arxiv_tools(&mut tools);   // Search arXiv papers
register_pubmed_tools(&mut tools);  // Search PubMed

// Tools: arxiv_search, pubmed_search

Memory Strategies

use agno_rust::{WindowedMemoryStrategy, SummarizedMemoryStrategy};

// Keep last 10 messages
let strategy = WindowedMemoryStrategy::new(10);

// Or use summarization for long conversations
let strategy = SummarizedMemoryStrategy::new(5, 5);

Guardrails

use agno_rust::guardrails::{PiiGuardrail, PromptInjectionGuardrail, GuardrailChain};

let mut chain = GuardrailChain::new();
chain.add(PiiGuardrail::new());
chain.add(PromptInjectionGuardrail::new());

// Check input before sending to LLM
match chain.validate("My SSN is 123-45-6789") {
    GuardrailResult::Block(reason) => println!("Blocked: {}", reason),
    GuardrailResult::Pass => println!("Safe to proceed"),
}

MCP Integration

use agno_rust::mcp::{McpClient, StdioTransport, McpTools};

// Connect to MCP server
let transport = StdioTransport::spawn("npx", &["-y", "@modelcontextprotocol/server-filesystem", "/tmp"])?;
let client = McpClient::new(transport);
client.initialize().await?;

// Register MCP tools with agent
let mcp_tools = McpTools::new(client);
mcp_tools.register_all(&mut tools).await?;

Observability

use agno_rust::{init_tracing, init_prometheus_registry};

// Initialize OpenTelemetry tracing
init_tracing("my-agent", Some("http://otel-collector:4317"));

// Initialize Prometheus metrics
init_prometheus_registry();

Architecture

agno-rust/
├── src/
│   ├── agent.rs        # Core agent loop
│   ├── llm.rs          # 10 LLM provider clients
│   ├── tools/          # 13 built-in toolkits
│   ├── guardrails.rs   # PII and injection detection
│   ├── memory.rs       # Memory strategies
│   ├── mcp.rs          # MCP client
│   ├── knowledge/      # RAG and vector stores
│   ├── reasoning.rs    # Chain-of-thought
│   └── server.rs       # HTTP runtime
├── cookbook/           # Example agents
└── scripts/            # Development utilities

Testing

# Run all tests
cargo test

# Run with coverage
cargo tarpaulin

# Format and lint
./scripts/check.sh

License

MIT License - see LICENSE for details.

Acknowledgments

Inspired by agno-agi/agno - the Python agent framework.