AWS Trainium2

Amazon's Trainium2 is a custom AI training chip designed for AWS, announced in November 2023. Amazon claims it delivers up to 4× the performance and 2× the energy efficiency of its first-generation Trainium chip. Trainium2 is available in EC2 Trn2 instances and in UltraServer configurations that pool up to 64 chips. Like Google's TPUs, Trainium is only accessible via cloud service and is not sold as hardware. Amazon's motivation mirrors Google's: reducing dependence on NVIDIA for the training workloads that underpin AWS AI services. The Neuron SDK provides the software layer. Trainium2 is optimised for the largest model training runs and has been used internally to train Amazon Titan models.

Architecture: Custom NeuronCore v3 | Accelerators per UltraServer: 64 | Memory: HBM | Interconnect: NeuronLink v3 | Form factor: Cloud-only (EC2 Trn2)