An HPE enterprise-grade bare metal server with the AMD Instinct MI210 accelerator — 64 GB of HBM2e for machine learning and high-performance computing. Sizing hardware for a language model is a different question: start from LLM hosting instead.
Engineered for machine learning and high-performance computing. The MI210 pairs 2nd Gen CDNA™ compute architecture with 64 GB of HBM2e memory for intensive training, inference, and HPC applications.
The MI250 and MI250X are OAM modules for specialized exascale platforms. The MI210 brings the same 2nd Gen CDNA™ architecture to a standard PCIe 4.0 card — which is why it is the Instinct accelerator on our shelf.
| MI210 | L40S | A100 | H100 | |
|---|---|---|---|---|
| GPU Architecture | CDNA 2.0 | Ada Lovelace | NVIDIA Ampere | Hopper |
| GPU Memory | 64GB HBM2e | 48GB GDDR6 | 80GB HBM2e | 80GB HBM3 |
| GPU Memory Bandwidth | 1638 GB/s | 864 GB/s | 1935 GB/s | 3352 GB/s |
| FP32 | 22.63 TFLOPS | 91.6 TFLOPS | 19.5 TFLOPS | 51 TFLOPS |
| TF32 Tensor Core | 312 TFLOPS | 366 TFLOPS | 312 TFLOPS | 756 TFLOPS |
| FP16/BF16 Tensor Core | 181 TFLOPS | 733 TFLOPS | 624 TFLOPS | 1513 TFLOPS |
| Power | Up to 300W | Up to 350W | Up to 400W | Up to 350W |
| Loading... | Loading... | Loading... | Loading... |
Get answers to common questions about deploying and operating MI210 GPU-accelerated bare metal servers for training, inference, and high-performance computing applications.