parquet-key-management

Crates.ioparquet-key-management
lib.rsparquet-key-management
version0.4.0
created_at2025-05-08 01:17:13.518198+00
updated_at2025-09-25 23:38:01.832643+00
descriptionImplements the Parquet Key Management Tools API in Rust to enable integration with a Key Management Server when using Parquet modular encryption.
homepagehttps://github.com/G-Research/parquet-key-management-rs
repositoryhttps://github.com/G-Research/parquet-key-management-rs
max_upload_size
id1664731
size202,357
Jonathan Giannuzzi (jgiannuzzi)

documentation

README

Parquet Key Management for Rust

crates.io docs.rs

This library implements the Parquet Key Management Tools API in Rust to enable using a Key Management Server (KMS) to write and read encrypted Parquet files. It is used in conjunction with the Parquet modular encryption support in the Apache parquet crate.

This library can be used to write and read encrypted Parquet files that are compatible with other Parquet implementations, for example PyArrow and Apache Spark.

Concrete KMS client implementations are not included. To integrate with your KMS client you need to implement the KmsClient trait.

Please see the API documentation for examples of how to use this library and the full API reference.

Feature Flags

The parquet_key_management crate provides the following features which may be enabled in your Cargo.toml:

  • datafusion - enables the datafusion module, which implements integration with Apache DataFusion
Commit count: 18

cargo fmt