Ferrislog: A server based kvs

A persistent, log-structured key-value store implemented in Rust with a friendly CLI interface. Designed for reliability and simplicity.

Features

• Network Client Support: Operations can be called from a device to a server
• Core Operations: Set, get, and remove key-value pairs with easy commands
• Persistence: All operations are logged as JSON to survive program restarts
• Automatic Log Compaction: Automatic compaction when log size exceeds threshold
• Snapshots: Create and load snapshots for backup and recovery
• Command Line Interface: Built with clap for intuitive command parsing
• Automatic Separation: If the server address isn't given, the log will be saved in the local device

Installation

# Clone the repository
git clone https://github.com/FabioCanavarro/Ferrislog
cd Ferrislog

# Build with Cargo
cargo build --release

# Install globally
cargo install --path .

Usage

Server

# Setup the server in 127.0.0.1:8080
kvs-server --addr 127.0.0.1:8080

# Setup the server in 127.0.0.1:8080 with the KvEngine
kvs-server --addr 127.0.0.1:8080 --engine Kvs

# Setup the server in 127.0.0.1:8080 with Sled
kvs-server --addr 127.0.0.1:8080 --engine sled

Client

# Set a key-value pair
kvs-client --addr 127.0.0.1:8080 set username ferris

# Get the value for a key
kvs-client --addr 127.0.0.1:8080 get username
# Output: ferris

# Remove a key
kvs-client --addr 127.0.0.1:8080 rm username

# Try to get a non-existent key
kvs-client --addr 127.0.0.1:8080 get username
# Output: Key not found

Implementation Details

Storage Architecture

Ferrislog uses a log-structured storage model:

1. All operations (set, remove) are appended to a log file

2. An in-memory hash map tracks positions of the latest value for each key

3. On startup, the store rebuilds its state by replaying the log

4. Periodic compaction removes redundant entries to keep the log size manageable

Performance Considerations

• Log Compaction: Automatically triggers when log exceeds 1024 bytes

• Memory Usage: Keeps only key pointers in memory, not values

• Recovery: Rebuilds state on startup by replaying the log

Future Enhancements

• Multi-threaded operations for better performance

• Time-to-live (TTL) for keys

• Set the compaction value in kvs-address

• Encryption when sending data