parqbench

Crates.ioparqbench
lib.rsparqbench
version0.2.0
sourcesrc
created_at2022-09-23 23:57:10.071326
updated_at2022-09-25 21:41:27.402988
descriptionA utility for viewing parquet files built on egui.
homepage
repository
max_upload_size
id672739
size125,173
Connor Keane (Kxnr)

documentation

README

ParqBench

A simple, cross-platform, utility for viewing parquet files, build on egui and arrow.

TODO List

  • CI for builds/releases
  • load partitioned dataset
  • tab layout/tree
  • add controls and metadata to side panels
  • parse pandas format metadata
  • open with hooks (cmd line args)
  • notification for errors
  • support all filetypes supported by datafusion
  • Update datafusion and egui/eframe
  • Auto resize columns
  • revisit &str vs String usages
  • Ui for basic query operations
  • source configuration in query pane
  • rich metadata with parquet crate

Installation

Generic, portable binaries for Windows and Linux are available on the releases.

ParqBench is tested for Linux (Manjaro 22.0, kernel 5.15.60) and Windows 10 (21H2). Releases are built with:

cargo build --release --target x86_64-pc-windows-gnu cargo build --release --target x86_64-unknown-linux-gnu

The builds are self-contained, portable, executables. The resulting binaries are placed in target/<target>.

Commit count: 0

cargo fmt