Intel Gaudi 3

Intel's Gaudi 3 accelerator, released in April 2024, is Intel's most competitive AI chip to date. It claims 1.84× the AI compute and 1.5× the memory bandwidth of the H100 SXM5 on specific workloads, with 128GB HBM2e memory. Gaudi 3 is notable for its built-in 24-port 200Gbps Ethernet fabric — it handles inter-chip communication via standard networking rather than proprietary interconnects, which simplifies cluster construction. The competitive question is not peak specs but real-world performance on production workloads, where CUDA optimisation continues to give NVIDIA a material advantage. Intel has struggled to convert technical specifications into market share in AI accelerators.

Architecture: Gaudi 3 | Process: TSMC 5nm | BF16: 1,835 TFLOPS | Memory: 128GB HBM2e | Bandwidth: 3.7 TB/s | TDP: 900W | Interconnect: 24× 200GbE RoCE