inserter-x

Crates.ioinserter-x
lib.rsinserter-x
version0.1.2
created_at2025-06-08 10:53:25.702735+00
updated_at2025-06-11 15:16:30.448492+00
descriptionCopy or insert dataframes into databases (currently only Clickhouse)
homepage
repository
max_upload_size
id1704778
size126,653
(trxe)

documentation

README

inserter-x

(Documentation WIP) A simple (and fast) polars dataframe to database insertion utility.

Currently only supports Clickhouse. Implementing other databases will be prioritized if there is a need and there is a client that supports fast insertion.

Run benchmark examples

cargo run --release --example insert-bench -- -f <filepath> -h <host> -o <comma-separated-order_by-keys> -p <comma-separated-primary_keys> [--not-null <comma-separated-not_null_keys>]

# example
cargo run --release --example insert-bench -- -f ~/Downloads/train.csv -h http://default:password@localhost:8123/ -o GPA \

Clickhouse

The ClickhouseInserter provides an interface to table creation and insertion queries. Insertion is supported via the ArrowStream format. See tests/mod.rs for examples.

Acknowledgements

Name and concept inspired by connector-x.

Commit count: 0

cargo fmt