epochfs
| Crates.io | epochfs |
| lib.rs | epochfs |
| version | |
| source | src |
| created_at | 2025-01-24 10:14:41.81884+00 |
| updated_at | 2025-03-11 08:56:37.115024+00 |
| description | EpochFS is a versioned cloud file system with git-like branching, transaction support. |
| homepage | |
| repository | |
| max_upload_size | |
| id | 1529276 |
| Cargo.toml error: | TOML parse error at line 17, column 1 | 17 | autolib = false | ^^^^^^^ unknown field `autolib`, expected one of `name`, `version`, `edition`, `authors`, `description`, `readme`, `license`, `repository`, `homepage`, `documentation`, `build`, `resolver`, `links`, `default-run`, `default_dash_run`, `rust-version`, `rust_dash_version`, `rust_version`, `license-file`, `license_dash_file`, `license_file`, `licenseFile`, `license_capital_file`, `forced-target`, `forced_dash_target`, `autobins`, `autotests`, `autoexamples`, `autobenches`, `publish`, `metadata`, `keywords`, `categories`, `exclude`, `include` |
| size | 0 |
Xuanwo (Xuanwo)
documentation
README
EpochFS
EpochFS is a versioned cloud file system with git-like branching, transaction support.
Motivation
EpochFS is inspired by delta Lake and lakeFS, it is a data lake but for files, offering git-like branching, transaction support, and scaling to handle exabyte-level data effortlessly.
Features in minds
In my minds, EpochFS will support the following features:
- A library that allows users to integrate and operate EpochFS directly within their applications.
- A FUSE implementation enabling users to mount EpochFS as a local file system.
- Support for both serverless mode and meta-server mode:
- Serverless Mode: EpochFS stores all metadata within the storage.
- Meta-Server Mode: EpochFS offloads all metadata to a separate server and commits changes to the storage layer, ensuring eventual consistency.
- Capability to seamlessly convert an existing bucket into EpochFS at no cost.
- Functionality to export and restore an EpochFS instance.
- Support for multiple storage backends, including S3, GCS, and Azure Blob Storage.
Current Plan
The current plan is implement the basic functionalities of EpochFS and provide a library that allows users to integrate and operate EpochFS directly within their applications.
License
Licensed under Apache License, Version 2.0.