select.parts
Full list

Production modules with more than 200 GB/s of memory bandwidth

Asked as: “LLM token rate on our robot is memory-bandwidth bound. Which production modules offer more than 200 GB/s of memory bandwidth?”

Answered by the Rapidflare agent

Six NVIDIA production modules have more than 200 GB/s of memory bandwidth. They come in two tiers: 273 GB/s on the Blackwell-based Thor modules and 204.8 GB/s on the Ampere-based AGX Orin modules.

Production modules above 200 GB/s developer... +5developer.nvidia.com ↗“128GB LPDDR5X (273 GB/s)”developer.nvidia.com ↗“Mid-tier Blackwell Thor SoM; up to 1200 FP4 TFLOPS, 64GB memory, 40-70W”nvidia.com ↗“128GB LPDDR5X, 4x 25GbE, 699-pin B2B, 40-130 W”nvidia.com ↗“64GB LPDDR5 (204.8 GB/s)”nvidia.com ↗“64GB LPDDR5, extended temp, 15-75W”nvidia.com ↗“32GB LPDDR5, 15-40W”

ModuleFamilyMemory bandwidthMemoryPower envelope
Jetson AGX Thor T5000Jetson Thor273 GB/s128 GB LPDDR5X40–130 W
Jetson T4000Jetson Thor273 GB/s64 GB LPDDR5X40–70 W
IGX T5000IGX Thor273 GB/s128 GB LPDDR5X40–130 W
Jetson AGX Orin 64GBJetson AGX Orin204.8 GB/s64 GB LPDDR515–60 W
Jetson AGX Orin IndustrialJetson AGX Orin204.8 GB/s64 GB LPDDR515–75 W
Jetson AGX Orin 32GBJetson AGX Orin204.8 GB/s32 GB LPDDR515–40 W

What this means for your choice:

  • All three Thor modules have the same bandwidth (273 GB/s). They differ in memory size and power. The IGX T5000 is a separate part from the Jetson T5000, but it's pin-compatible and comes with optional functional safety. nvidia.com +1nvidia.com ↗“a separate SKU from Jetson T5000 (P/N 900-13834-0080-001) but form-factor and pin-compatible with it”nvidia.com ↗“for custom carrier boards with optional functional safety”
  • All three AGX Orin modules have 204.8 GB/s. The Industrial version adds extended temperature support and is pin-compatible with AGX Orin. nvidia.comnvidia.com ↗“extended temp, 15-75W; pin-compatible with AGX Orin”
  • Super mode doesn't add any modules. The Orin NX and Orin Nano reach at most 102 GB/s in Super mode, which is well below 200 GB/s.

Bandwidth sets your token rate, but memory size sets how big a model fits. If you need to run larger models, the 128 GB Thor modules give you the most room.

Sources

  1. Jetson AGX Thor T5000 developer.nvidia.com
  2. IGX T5000 nvidia.com
  3. Jetson AGX Orin 32GB nvidia.com