Request for TensorRT-LLM 1.0+ Support on Jetson Platforms

[a312718087]

System Info

System Information:

• jetson orin 64G

Detailed output:

Paste the output of the above commands here

How would you like to use TensorRT-LLM

Hi TensorRT-LLM Team,
The latest release of TensorRT-LLM has reached version 1.0, but we've noticed that Jetson Orin devices only support up to version 0.12.0 at this time.
We are eager to leverage the new features and improvements introduced in TensorRT-LLM 1.0+ for our edge AI applications running on Jetson Orin. Could you please provide an update on:
When official support for TensorRT-LLM 1.0+ on Jetson Orin will be available?
Are there any workarounds or unofficial methods to deploy TensorRT-LLM 1.0+ on Jetson Orin currently?
Thank you for your hard work on this amazing tool! Looking forward to your response.

Before submitting a new issue...

• Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.

[WilliamTambellini]

+1