easy-tensorrt-core
| Crates.io | easy-tensorrt-core |
| lib.rs | easy-tensorrt-core |
| version | 0.3.1 |
| created_at | 2025-05-22 01:37:12.304447+00 |
| updated_at | 2025-05-26 10:02:03.227249+00 |
| description | Rust wrapper for NVIDIA TensorRT |
| homepage | |
| repository | https://github.com/BurtonQin/easy-tensorrt |
| max_upload_size | |
| id | 1684644 |
| size | 33,118 |
Burton Qin (BurtonQin)
documentation
README
easy-tensorrt-core
A safe wrapper around easy-tensorrt-sys. Provide the core functions to build and run TensorRT engine.
Inspired by tensorrt-rs.
Major changes from tensorrt-rs:
- Replace cuda-rs with cudarc.
- Replace Tensor with AbstractTensor trait. Any tensor (e.g. tch::Tensor) that implements AbstractTensor can be used.
- Add init module to faciitate the initialization of tensorrt plugins and cuda context.
- Init engine with CuStream and avoid passing in another CuStream when inference.