select.parts
Comparison

Jetson AGX Thor vs Jetson AGX Orin 64GB developer kits: INT8 TOPS, memory and power

Asked as: “I need to compare the Jetson AGX Thor and Jetson AGX Orin 64GB developer kits on AI performance in INT8 TOPS, memory and power envelope.”

Answered by the Rapidflare agent · graded correct in Rapidbench v0.0.2

The Jetson AGX Thor Developer Kit has 1035 TOPS of INT8 AI performance, compared with 275 TOPS for the Jetson AGX Orin Developer Kit 64GB. Thor also has twice the memory (128 GB vs. 64 GB) and more memory bandwidth, but it can draw up to 130 W, compared with 60 W for the Orin kit.

Jetson AGX Thor vs. Jetson AGX Orin 64GB Developer Kits developer... +1developer.nvidia.com ↗“performance.max_ai_tops=1035 TOPS”nvidia.com ↗“performance.max_ai_tops=275 TOPS”

SpecJetson AGX Thor Developer KitJetson AGX Orin Developer Kit 64GB
AI performance (INT8, sparse)1035 TOPS275 TOPS
Memory size128 GB64 GB
Memory typeLPDDR5XLPDDR5
Memory bandwidth273 GB/s204.8 GB/s
Power envelope40–130 W15–60 W

Notes:

  • INT8 basis: Both TOPS figures are sparse INT8, so the two numbers can be compared directly.
  • FP4 (Thor only): The Thor kit is also rated at 2070 TFLOPS in FP4. That figure uses a different precision, so it can't be compared with the INT8 TOPS numbers above. developer...developer.nvidia.com ↗“performance.max_fp4_tflops=2070 TFLOPS”
  • Super mode: These kits have no separate Super-mode figures. Super mode only applies to the Jetson Orin NX and Orin Nano.

Sources

  1. Jetson AGX Thor Developer Kit developer.nvidia.com
  2. Jetson AGX Orin Developer Kit 64GB nvidia.com