easy-tensorrt-sys

Crates.ioeasy-tensorrt-sys
lib.rseasy-tensorrt-sys
version0.2.1
created_at2025-05-22 01:36:30.915127+00
updated_at2025-05-26 09:56:22.498077+00
descriptionRust binding to NVIDIA TensorRT, forked from tensorrt-rs-sys
homepage
repositoryhttps://github.com/BurtonQin/easy-tensorrt
max_upload_size
id1684643
size1,546,525
Burton Qin (BurtonQin)

documentation

README

easy-tensorrt-sys

Rust binding to NVIDIA TensorRT.

This is a fork of tensorrt-rs-sys, which seems no longer activately maintained.

What's new

  1. Replaced the dependency cuda-rs with cudarc for cuda interaction, which is actively maintained and offers better compatibility.
  2. Add init_libnv_infer_plugins to address initialization issues with TensorRT plugins.

Installation

To use easy-tensorrt-sys, ensure you have the following installed:

  • CUDA Toolkit (e.g., CUDA 11.8)
  • TensorRT SDK (e.g., TensorRT 8.6.1.6)
  • Rust (with cargo)

Linux

  1. Install CUDA and TensorRT (e.g., via .deb packages or tarballs).
  2. Set environment variables if your install paths are non-standard:
export CUDA_INCLUDE_PATH=/usr/local/cuda/include
export TENSORRT_INCLUDE_PATH=/usr/local/TensorRT-8.6.1.6/include
export TENSORRT_LIB_PATH=/usr/local/TensorRT-8.6.1.6/lib

Windows

Install CUDA and TensorRT from NVIDIA’s website.

Set environment variables:


$env:CUDA_INCLUDE_PATH = "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8\include"
$env:TENSORRT_INCLUDE_PATH = "C:\Program Files\NVIDIA GPU Computing Toolkit\TensorRT\include"
$env:TENSORRT_LIB_PATH = "C:\Program Files\NVIDIA GPU Computing Toolkit\TensorRT\lib"

Notes

  • Tested on Linux, with TensorRT 8.6.1.6, CUDA 11.8.

  • Other platforms or versions are not guaranteed to work.

Contributions

Contributions are welcome! Feel free to open issues or submit pull requests.

Commit count: 21

cargo fmt