2023 11 22 27 AI CONTENTS2 GPU CUDA GPU AI ROCm AI+CUDA XVEVxOmRoNqRqOsRmRtMqRaQdN8OsQqQoMnOfQpOrQfQmOoN6MqRtNNZtRuMuOnOsP3 GPU4 AI GPU AI GPU GPU GPU GPU,BR100 BLink 8 512GB/s NVLink BR100 BLink 8 512GB/s GPGPU GPU FP32 TF32 FP/BF16 INT8 nm W TFLOPs TFLOPs TFLOPs TOPs GB GB/s NVIDIA V100 SXM 2017 12 300 5120 15.7 125 32 900 NVIDIA A100 SXM 2020 7 400 6912 19.5 156 624 80 2039 NVIDIA H100 SXM 2022 4 700 16896 60 500 120 4000 80 3072 AMD MI100 2020 7 300 7680 23.1 46.1 184.6 184.6 32 1228 AMD MI210 2022 6 300 6656 22.6 45.3 181 181 64 1638 AMD MI250 2021 6 560 13312 45.3 90.5 362.1 362.1 128 3277 AMD MI250X 2021 6 560 14080 47.9 95.7 383 383 128 3277 2021 7 350 4096 32 1024 MTT S2000 2022 12 150 4096 10.6 40 32 MTT S3000 2022 4096 15.2 32 448 BI-V100 2021 7 250 18.5 37 37 295 32 1228 BR100 2022 7 256 512 1024 2048 64 BR104 2022 7nm 128 256 512 1024 32 BR100P 2022 7nm 550 240 480 960 1920 64 1638 BR104P 2022 7nm 300 112 224 448 896 32 819 UL32 10 8 32 UL64 15 16 64 L32 25 32 128 L64 45 64 256 XL 120 128 512 32/64