User Guide

Jetson AGX™ Orin Developer Kit Reviewer's Guide

First audio - P99: 0.0249245

Chunk - average: 0.00473509

Chunk - P90: 0.00488245

Chunk - P95: 0.00489093

Chunk - P99: 0.0058794

Throughput (RTF): 50.8159

At the end stop benchmarking using:

bash stopBenchmark.sh

NVIDIA TAO

NVIDIA provides pre-trained, production-ready neural network models on the NVIDIA GPU Cloud

(NGC). For each model, NVIDIA provides a deployable model and a trainable model. The deployable

model is production ready and optimized to run on inferencing pipeline while the trainable model is

intended for fine tuning using custom data with NVIDIA TAO.

In this demo, you will experience:

• Deploying production ready high accuracy, optimized models on Jetson

• Using Train-Adapt-Optimize to train a trainable model on cloud and then deploy the trained

model on Jetson.

To setup the demo, Create a directory and name it as “Review” in your home directory if already not

created.

mkdir $HOME/Review

Download the tar ball named “TAO-PTM.tar.gz” required for this demo from

here and move it inside

the Review Directory. And untar the tar ball:

cd $HOME/Review

Move “TAO-PTM.tar.gz” to inside the $HOME/Review and then untar it:

tar -xvf TAO-PTM.tar.gz

Install the demo using: