select.parts
Selection

Lowest-power NVIDIA module with at least 64 GB of memory

Asked as: “Battery-powered service robot that needs 64 GB of RAM for a local LLM. Of the NVIDIA modules with at least 64 GB, which one has the lowest max power envelope?”

Answered by the Rapidflare agent

The Jetson AGX Xavier 64GB has the lowest maximum power envelope at 30 W, but its lifecycle status is EOL. Among the 64 GB+ modules that aren't listed as EOL, the Jetson AGX Orin 64GB has the lowest maximum at 60 W.

I found six NVIDIA production modules with at least 64 GB of memory. Here they are, sorted by maximum power:

NVIDIA production modules with ≥64 GB memory developer... +5developer.nvidia.com ↗“64GB LPDDR4x, dual NVDLA, 10-30W”nvidia.com ↗“64GB LPDDR5 (204.8 GB/s), dual NVDLA, 15-60W”nvidia.com ↗“64GB LPDDR5, extended temp, 15-75W”developer.nvidia.com ↗“64GB memory, 40-70W”developer.nvidia.com ↗“128GB LPDDR5X (273 GB/s)”nvidia.com ↗“128GB LPDDR5X, 4x 25GbE, 699-pin B2B, 40-130 W”

ModuleMemoryPower envelopeMax AI (INT8 TOPS)Lifecycle
Jetson AGX Xavier 64GB64 GB LPDDR4x10–30 W32 (dense)EOL
Jetson AGX Orin 64GB64 GB LPDDR515–60 W275 (sparse)—
Jetson T400064 GB LPDDR5X40–70 W600 (sparse)—
Jetson AGX Orin Industrial64 GB LPDDR515–75 W248 (sparse)—
Jetson AGX Thor T5000128 GB LPDDR5X40–130 W1035 (sparse)—
IGX T5000128 GB LPDDR5X40–130 WNot listed in the catalog—

For a battery-powered robot:

  • The AGX Xavier 64GB uses the least power, but it is EOL. Its 32 TOPS figure is dense INT8, while the Orin and Thor figures are sparse INT8, so the numbers can't be compared directly. developer...developer.nvidia.com ↗“up to 32 INT8 TOPS”
  • The AGX Orin 64GB is the lowest-power option that isn't EOL. It also has the lowest minimum power (15 W) of the non-EOL modules, along with the AGX Orin Industrial. Its memory bandwidth is 204.8 GB/s. nvidia.comnvidia.com ↗“64GB LPDDR5 (204.8 GB/s)”
  • The Jetson T4000 is the next step up. Its maximum is 70 W, but its minimum is higher (40 W). Its memory bandwidth is 273 GB/s. developer...developer.nvidia.com ↗“64GB memory, 40-70W”

None of these modules has a separate Super-mode power rating.

Sources

  1. Jetson AGX Xavier 64GB developer.nvidia.com
  2. Jetson AGX Orin 64GB nvidia.com
  3. Jetson AGX Thor T5000 developer.nvidia.com
  4. IGX T5000 nvidia.com