cdl-k8s-core

Crates.iocdl-k8s-core
lib.rscdl-k8s-core
version0.1.4
sourcesrc
created_at2024-11-23 11:20:50.947816
updated_at2024-11-23 11:20:50.947816
descriptionConnected Data Lake Framework
homepagehttps://github.com/ulagbulag/connected-data-lake
repositoryhttps://github.com/ulagbulag/connected-data-lake
max_upload_size
id1458389
size35,044
Ho Kim (kerryeon)

documentation

https://docs.rs/cdl-k8s-core

README

Connected Data Lake

Usage

docker run --rm 'quay.io/ulagbulag/connected-data-lake:latest'

Install K8S Operator

# Register the Connected Data Lake repository
helm repo add cdl "https://smartx-team.github.io/connected-data-lake"

# Deploy a Connected Data Lake operator
helm install -n "cdl-operator" "cdl-operator" "cdl/cdl-operator"

Install Dependencies on Ubuntu 24.04

# Install os dependencies
sudo apt-get update
sudo apt-get install -y \
  build-essential \
  fuse \
  libfuse-dev \
  libprotoc-dev \
  protobuf-compiler \
  rustup

# Install & Update the latest stable rust
rustup default stable

Build on the local machine

Build Requirements

  • gcc
  • fuse
  • protobuf
  • rust >=1.82

Build CDL rust CLI

cargo run --release --

Build CDL python API

Please check your python virtual environment (i.e. conda) before running.

cd python
maturin develop --release

Build K8S Operator

Please check your kubernetes config file ~/.kube/config before running.

cargo run --package 'cdl-k8s-operator' --release --
Commit count: 0

cargo fmt