Datastore Emulator in Rust

This project is a custom implementation of the Google Cloud Datastore emulator, written in Rust. It is designed to be a lightweight, high-performance alternative to the official Google emulator for local development and testing.

The repository includes a comprehensive test suite that runs against both this custom emulator and the official Google Datastore emulator to ensure a high degree of API compatibility.

Features

• Core Datastore API: Supports standard gRPC operations like Lookup, RunQuery, and Commit.

• Mutations: Full support for Insert, Update, Upsert, and Delete operations.

• Transactions: Implements BeginTransaction, Commit, and Rollback.

• Querying: Supports property filters (=, !=, <, >, etc.) and composite filters.

• Aggregation Queries: Supports COUNT, SUM, and AVG aggregations.

• ID Management: Implements AllocateIds and ReserveIds.

• Data Import: An HTTP endpoint to import data from official Datastore exports.

How to use

Make sure you have the following prerequisites installed on your system:

• Rust toolchain (using rustup)
• protobuf compiler (protoc)

2. Run the Rust Emulator

To build the Rust emulator, navigate to the project root and run:

cargo run --release

Testing

See the test instructions

Benchmarks

Here are some results with 30 clients and 10 runs each:

If you want to run the benchmarks yourself, run the following commands:

    docker compose up --build -d

install python dependencies:

    poetry install --no-root && poetry env activate

and then run the benchmarks:

    python benchmark/test_benchmark.py --num-clients 30 --num-runs 10