The desk
Die Brief

DIE.BRIEF

Hardware desk
GPU Architecture CONFIRMED

Rubin GPU puts resident state ahead of peak FLOPS

The Die Brief Desk, after developer.nvidia.com

Resident state is the first constraint in the Rubin GPU filing, because 288 GB of HBM4 and 22 TB/s of bandwidth decide how much model state stays on-chip.

Picture from developer.nvidia.com
Picture from developer.nvidia.com
Rubin GPU
Transistors336 billion
Streaming multiprocessors224
Tensor Cores896
NVFP4 performanceup to 50 petaflops
HBM4 capacity288 GB
HBM4 bandwidthup to 22 TB/s
NVLink 6 scale-up bandwidth3,600 GB/s
HBM stacks12-Hi

NVLink 6 moves that state at 3,600 GB/s across GPUs, so the constraint becomes how much can remain resident rather than how fast the GPU can compute.

Picture from developer.nvidia.com
Picture from developer.nvidia.com

The 12-Hi HBM4 stacks and doubled interface width point to higher-capacity memory for suppliers.

Picture from developer.nvidia.com
Picture from developer.nvidia.com

The 40% power-budget claim still needs rack-level proof, and the filing leaves out TDP, process node, price, and ship date.

Picture from developer.nvidia.com
Picture from developer.nvidia.com

No physical package photo appears, so the two-die NV-HBI layout stays a diagram rather than measured silicon under load or thermal behavior data.

The shift from peak FLOPS to resident state is the change, and the filing lacks rack-level proof.

After developer.nvidia.com. We did not report this. The pictures, if any, are theirs.

October 24, 2026 · 2 min
Copy link Share to X