rbir
| Crates.io | rbir |
| lib.rs | rbir |
| version | 0.0.0 |
| source | src |
| created_at | 2024-09-16 03:54:06.834189 |
| updated_at | 2024-09-16 03:54:06.834189 |
| description | RBIR stands for Rewrite Bigdata in Rust. RBIR aims to create a big data ecosystem using Rust. |
| homepage | |
| repository | |
| max_upload_size | |
| id | 1375975 |
| size | 5,271 |
Xuanwo (Xuanwo)
documentation
README
RBIR 
RBIR stands for Rewrite Bigdata in Rust. RBIR aims to create a big data ecosystem using Rust.
This project declares our manifesto and serves as a collection of RBIR projects and posts for anyone interested in joining this journey.
Projects
New Projects
- tikv: Distributed transactional key-value database
- databend: A Rust data warehouse, alternative to Snowflake
- quickwit: A Rust search engine, alternative to Elasticsearch
- risingwave: Rust streaming processing engine
- Apache DataFusion: Fast, extensible query engine built in rust
- influxdb: Scalable datastore for metrics, events, and real-time analytics
- greptimedb: Time series database for metrics, logs and events
- Apache HoraeDB (incubating): High-performance, distributed, cloud native time-series database
- paradedb: Postgres for Search and Analytics
- glaredb: An analytics DBMS for distributed data
- fluvio: Lean and mean distributed stream processing system
- lancedb: Developer-friendly, database for multimodal AI
- slatedb: Cloud-native embedded storage engine built on object storage
- daft: Distributed DataFrame for Python designed for the cloud, powered by Rust
- arroyo: Distributed stream processing engine written in Rust, designed to perform stateful computations on data
New implementations
- arrow-rs: Rust implementation of Apache Arrow
- iceberg-rust: Rust implementation of Apache Iceberg
- paimon-rust: Rust implementation of Apache Paimon
- hudi-rs: Rust implementation of Apache Hudi
- parquet-rs: Rust implementation of Apache Parquet
- avro-rust: Rust implementation of Apache Avro
- orc-rs: Rust implementation of Apache ORC
New integrations
- Apache OpenDAL provides python, nodejs, java, go bindings
- Apache Iceberg is now working on building rust core for pyiceberg
- Apache Paimon is going to build paimon-py by its rust core
- Apache DataFusion Comet is a high-performance accelerator for Apache Spark
- blaze: The Blaze accelerator for Apache Spark leverages native vectorized execution to accelerate query processing
- Apache Uniffle is working on it's rust shuffle server at incubator-uniffle/rust/experimental/server