easy-tensorrt-core

Crates.ioeasy-tensorrt-core
lib.rseasy-tensorrt-core
version0.3.1
created_at2025-05-22 01:37:12.304447+00
updated_at2025-05-26 10:02:03.227249+00
descriptionRust wrapper for NVIDIA TensorRT
homepage
repositoryhttps://github.com/BurtonQin/easy-tensorrt
max_upload_size
id1684644
size33,118
Burton Qin (BurtonQin)

documentation

README

easy-tensorrt-core

A safe wrapper around easy-tensorrt-sys. Provide the core functions to build and run TensorRT engine.

Inspired by tensorrt-rs.

Major changes from tensorrt-rs:

  1. Replace cuda-rs with cudarc.
  2. Replace Tensor with AbstractTensor trait. Any tensor (e.g. tch::Tensor) that implements AbstractTensor can be used.
  3. Add init module to faciitate the initialization of tensorrt plugins and cuda context.
  4. Init engine with CuStream and avoid passing in another CuStream when inference.
Commit count: 21

cargo fmt