select.parts
Full list

Jetson production modules with 64 or more Tensor Cores

Asked as: “For mixed-precision work at the edge, which Jetson production modules have 64 or more Tensor Cores?”

Answered by the Rapidflare agent

Five Jetson production modules have a listed count of 64 or more Tensor Cores. Each of them has exactly 64, and no module lists more than 64.

Production modules with ≥64 Tensor Cores nvidia.com +4nvidia.com ↗“2048 CUDA + 64 Tensor cores, 12-core Cortex-A78AE, 64GB LPDDR5”nvidia.com ↗“Industrial-grade Ampere SoM; up to 248 INT8 TOPS, 2048 CUDA + 64 Tensor cores”developer.nvidia.com ↗“512 CUDA + 64 Tensor cores, 8-core Carmel, 64GB LPDDR4x”developer.nvidia.com ↗“512 CUDA + 64 Tensor cores, 8-core Carmel, 32GB LPDDR4x, 10-30W”developer.nvidia.com ↗“Industrial Volta SoM; up to 30 INT8 TOPS, 512 CUDA + 64 Tensor cores”

ModuleGPU architectureTensor CoresCUDA coresMemoryMax AI (INT8 TOPS)Max FP32 TFLOPSPower
Jetson AGX Orin 64GBAmpere64204864 GB LPDDR5275 (sparse)5.315–60 W
Jetson AGX Orin IndustrialAmpere64204864 GB LPDDR5248 (sparse)4.815–75 W
Jetson AGX Xavier 64GBVolta6451264 GB LPDDR4x32 (dense)1.4110–30 W
Jetson AGX Xavier 32GBVolta6451232 GB LPDDR4x32 (dense)1.4110–30 W
Jetson AGX Xavier IndustrialVolta6451232 GB LPDDR4x30 (dense)1.2420–40 W

Notes:

  • Different TOPS bases: The Orin figures are sparse INT8 and the Xavier figures are dense INT8. That means the TOPS numbers can't be compared directly across the two generations.
  • Lifecycle: The Jetson AGX Xavier 64GB is listed as EOL. No lifecycle status is listed for the other four. developer...developer.nvidia.com ↗“identity.lifecycle_status=EOL”
  • Near miss: The Jetson AGX Orin 32GB has 56 Tensor Cores, so it falls just short of 64. What I couldn't find: There's no Tensor Core count listed for the three Blackwell-based Thor modules. Those are the Jetson AGX Thor T5000, Jetson T4000 and IGX T5000. I've left them out because I can't confirm they meet the ≥64 threshold. Their mixed-precision figures are given in FP4 instead: developer... +2developer.nvidia.com ↗“compute.gpu_cuda_cores=2560, compute.gpu_architecture=Blackwell”developer.nvidia.com ↗“compute.gpu_cuda_cores=1536, compute.gpu_architecture=Blackwell”nvidia.com ↗“IGX Thor system-on-module” nvidia.comnvidia.com ↗“1792 CUDA + 56 Tensor cores”
  • AGX Thor T5000: up to 2070 FP4 TFLOPS developer...developer.nvidia.com ↗“up to 2070 FP4 TFLOPS”
  • T4000: up to 1200 FP4 TFLOPS developer...developer.nvidia.com ↗“up to 1200 FP4 TFLOPS”
  • IGX T5000: 2070 FP4 TFLOPS nvidia.comnvidia.com ↗“performance.max_fp4_tflops=2070 TFLOPS”

If you're deciding on raw low-precision throughput rather than Tensor Core count, the Thor modules are worth considering.

Sources

  1. Jetson AGX Orin 64GB nvidia.com
  2. Jetson AGX Xavier 64GB developer.nvidia.com
  3. Jetson AGX Thor T5000 developer.nvidia.com
  4. IGX T5000 nvidia.com