select.parts
Selection

8 GB Jetson production module with the highest AI performance

Asked as: “Our detection model fits in 8 GB. Which 8 GB Jetson production module gives the highest AI performance?”

Answered by the Rapidflare agent

The Jetson Orin NX 8GB has the highest AI performance of our 8 GB Jetson production modules. It's rated at 70 TOPS in default mode and up to 117 TOPS in Super mode. nvidia.comnvidia.com ↗“up to 117 INT8 TOPS (Super mode), 1024 CUDA cores, 6-core Cortex-A78AE, 8GB LPDDR5, 10-40W”

8 GB Jetson production modules (5 total) nvidia.com +4nvidia.com ↗“Compact Ampere SoM; up to 117 INT8 TOPS (Super mode)”nvidia.com ↗“Entry Ampere SoM; up to 67 INT8 TOPS (Super mode)”developer.nvidia.com ↗“Compact Volta SoM; up to 21 INT8 TOPS”developer.nvidia.com ↗“Pascal SoM; 1.33 TFLOPS FP16, 256 CUDA cores”developer.nvidia.com ↗“Industrial/rugged Pascal SoM; 256 CUDA cores”

ModuleAI perf, default (TOPS)AI perf, Super (TOPS)FP32, default / Super (TFLOPS)Power, default / Super
Jetson Orin NX 8GB701171.56 / 2.410–20 W / 10–40 W
Jetson Orin Nano 8GB4067– / 2.17–15 W / 7–25 W
Jetson Xavier NX 8GB21–0.845 / –10–20 W
Jetson TX2not listed–0.666 / –7.5–15 W
Jetson TX2inot listed–0.63 / –10–20 W

How to read the table:

  • TOPS figures are INT8, but they're not measured the same way across generations. Orin numbers are sparse INT8 and Xavier numbers are dense INT8, so the Orin vs. Xavier NX gap isn't a direct comparison.
  • Super mode exists only on Orin NX and Orin Nano. A dash in the Super columns means no Super figure is stated for that module.
  • TX2 / TX2i have no TOPS rating in the catalog, so for these two I've given FP32 only. The Jetson TX2 is also marked EOL (end of life). developer...developer.nvidia.com ↗“Pascal SoM; 1.33 TFLOPS FP16”

What this means for your detection model: the Orin NX 8GB leads in both default and Super mode. Its memory bandwidth is 102 GB/s in both modes, the highest of the five. The Orin Nano 8GB has 68 GB/s by default and 102 GB/s in Super mode. If you need a lower power budget, the Orin Nano 8GB is the next step down. nvidia.com +1nvidia.com ↗“8GB LPDDR5, 10-40W”nvidia.com ↗“8GB LPDDR5 (102 GB/s), 7-25W”

Sources

  1. Jetson Orin NX 8GB nvidia.com
  2. Jetson Xavier NX 8GB developer.nvidia.com