toondb-storage

High-performance storage engine for ToonDB with ACID transactions and crash recovery.

Overview

toondb-storage provides the persistence layer for ToonDB, featuring:

• Write-Ahead Logging (WAL): Durable writes with crash recovery
• MVCC Transactions: Snapshot isolation for concurrent access
• Columnar Storage: 80% I/O reduction via projection pushdown
• Memory-Mapped I/O: Zero-copy reads for maximum throughput

Features

• ACID Transactions: Full transactional guarantees with rollback support
• Crash Recovery: Automatic recovery from WAL after unexpected shutdown
• Batch Writes: Group commit for high write throughput
• Compaction: Background compaction to reclaim space
• FFI Layer: C-compatible FFI for Python/Node.js bindings

Installation

[dependencies]
toondb-storage = "0.2.5"

Usage

Most users should use the high-level toondb crate:

use toondb::Database;

let db = Database::open("./my_data")?;

// Transactional writes
let txn = db.transaction()?;
txn.put("users/1", b"Alice")?;
txn.commit()?;

Architecture

┌─────────────────────────────────────────┐
│           toondb-storage                │
├─────────────────────────────────────────┤
│  Transaction Layer (MVCC, Isolation)    │
├─────────────────────────────────────────┤
│  WAL (Write-Ahead Log, Durability)      │
├─────────────────────────────────────────┤
│  Page Cache (Buffer Pool, LRU)          │
├─────────────────────────────────────────┤
│  Storage Engine (LSM-tree, Compaction)  │
└─────────────────────────────────────────┘

Performance

Crate Structure

License

Apache-2.0 - see LICENSE for details.