NVIDIA B200 SXM

The B200 is NVIDIA's Blackwell architecture GPU, announced in March 2024. It represents a generational leap: 20 petaFLOPS of FP4 tensor compute (a new precision format designed for inference), 192GB HBM3e memory, and 8 TB/s memory bandwidth. The Blackwell chip is fabricated at TSMC on the 4NP process and contains 208 billion transistors — the largest chip NVIDIA has built. Two B200 dies are connected via NVLink-C2C to form the GB200 "super chip." NVIDIA's GB200 NVL72 rack — 72 B200 GPUs connected via NVLink — is designed to operate as a single large inference engine, capable of serving a 1.8 trillion parameter model. Demand for B200s drove NVIDIA's market capitalisation above $3 trillion in 2024.

Architecture: Blackwell | Process: TSMC 4NP | Transistors: 208B | FP4 Tensor: 20 PFLOPS | Memory: 192GB HBM3e | Bandwidth: 8 TB/s | TDP: 1,000W | Interconnect: NVLink 5.0 (1.8 TB/s)