select.parts
Comparison

IGX Thor Developer Kit vs IGX Orin Developer Kit: GPU architecture, memory and bandwidth

Asked as: “for a medical imaging prototype, how do the IGX Thor Developer Kit and IGX Orin Developer Kit compare on GPU architecture, mem and memory bandwidth?”

Answered by the Rapidflare agent · graded correct in Rapidbench v0.0.2

The IGX Thor Developer Kit moves to a newer GPU architecture (Blackwell instead of Ampere). It also has twice the system memory (128 GB vs. 64 GB) and higher listed system memory bandwidth (273 GB/s vs. 204.8 GB/s). It also comes with a discrete GPU already installed, while on the IGX Orin Developer Kit the discrete GPU is optional.

IGX Thor Developer KitIGX Orin Developer Kit
Built-in GPU architectureBlackwellAmpere
Built-in GPU CUDA cores2,5602,048
Built-in GPU Tensor coresNot listed64
System memory128 GB LPDDR5X64 GB LPDDR5
System memory bandwidth273 GB/s204.8 GB/s
Discrete GPURTX PRO 6000 Blackwell Max-Q, pre-installed, with 96 GB GDDR7Optional RTX 6000 Ada

About these figures:

  • Bandwidth: The bandwidth figures go with the LPDDR5X/LPDDR5 system memory. I couldn't find bandwidth figures for either discrete GPU's own memory.
  • Discrete GPU memory: On the Thor kit, the 96 GB of GDDR7 sits on the discrete GPU and is in addition to the 128 GB of system memory. I couldn't find a memory size for the optional RTX 6000 Ada on the Orin kit.
  • Peak performance: The two kits publish peak figures in different formats, so they can't be compared directly. Thor is rated at up to 5,581 FP4 TFLOPS (sparse). Orin is rated at up to 1,705 TOPS (sparse), and that figure includes the optional discrete GPU.

Datasheets: