Crates.io | alp |
lib.rs | alp |
version | 0.0.1 |
source | src |
created_at | 2024-10-11 21:19:27.686588 |
updated_at | 2024-10-11 21:27:45.884197 |
description | A pure Rust implementation of Adaptive Lossless floating-Point Compression by Afroozeh et al. |
homepage | |
repository | https://github.com/spiraldb/alp |
max_upload_size | |
id | 1405854 |
size | 45,002 |
As modern data and analytics workloads have shifted from SQL to general-purpose programming languages such as Python, the amount of floating point data has grown massively. It is a problem for modern database systems to effectively compress this data without loss of precision, while preserving desirable traits such as random access and auto-vectorization.
In 2023, Afroozeh et al. published ALP, a response to these issues. The code was written in C++ and integrated into DuckDB. To ease the integration into other tools, we present a Rust implementation of both variants of ALP (ALP and ALP for "real doubles").