20240107_中航证券_科技行业专题研究：AI智算时代已至算力芯片加速升级_66页.pdf
2024 01 07 AI S0640522040001 AI Chiplet AI 21 AI AI AI AI GPU AI CPU+GPU AI(55-75%)(10-20%)10-20%AI GPU A100 H100 HBM ChatGPT GPU SK HBM3 2023 10 SK 2023 HBM3 HBM3E Omdia 2025 HBM 25 CoWoS HBM CPU/GPU CoWoS IDC CoWoS 20%2024 CoWos 2023 2.5D/3D 2023-2028 22%CAGR AI GPU HBM AI AI ChatGPT AI AI AI GPU HBM GPU AI AI 1956 21 AI AI AI IDC EFLOPS FP64 IDC 2022 54.5 EFLOPS 2027 117.3 EFLOPS 2022 259.9EFLOPS 2027 1117.4 EFLOPS 2022-2027 33.9%16.6%EFLOPS FP16AI IDC AI IDC 2022 195 2026 347 17.3%2023 91 82.5%2027 134 21.8%AI IDC IDC 2023 8 30 2002023 4 2023 1000 PFLOPS FP16 2025 18000 PFLOPS FP32 2023 12 2025 14EFLOPS FP32 25EFLOPS FP16 2EFLOPS FP642023 10 2025 300 EFLOPS 35%AI AI AI AI AI AI(55-75%)(10-20%)10-20%AI GPU A100 H100 GPU AI AI CPU GPU ASIC FPGA GPU ASIC FPGA GPU SoC Apple Silicon DDR/GDDR/HBMSRAM RRAM MRAM HBM SK ChatGPT HBM High Bandwidth Memory HBM DDR GPU 3D DRAM Omdia 2025 HBM 25 ChatGPT GPU SK HBM3 2023 10 SK 2023 HBM3 HBM3E HBM3 HBM TB/s semiconductor engineering CoWoS HBM CPU/GPU CoWoS AI CoWoS AMD IDC CoWoS 20%2024 CoWos 2023 2.5D/3D 2023-2028 22%CAGR CoWoSAI vicorpower MPS GPU/CPU AI GPU vicorpower 2000A AI AI AI AI GPU HBM AI GPU AMD HBM MPS ADI AI AI GPU HBM GPU AI AI AI AI GPU FPGA ASIC CPU AI CPU GPU AI AI AI(L1 L5)CPUCPU CPU,L1GPU AI,GPU,CPU,AI AMD L2DSP IP DSP,IP,Cadence L3FPGAFPGA:,FPGA,L4TPU/ASIC,ASIC FPGA,L5 TrueNorth,IBMGPU GPU GPU GPU GPU AIGPU AI AI GPU IDC transformer Transformer Transformer Transformer Transformer BERT GPT Transformers Transformer GPU Transformer GPU Transformer GPU GPU IDC GPU 80%CPU+GPU IDC CPU GPU ASIC FPGA NPU CPU+GPU 2023 10 FPGA FPGA GPUFPGA Bing ASIC ASIC NPU BPU Google TPUGPU AMD GPU CUDA AI CUDA-X AI AI CUDA Compute Unified Device Architecture 2006 GPGPU GPU CUDA GPU C CUDA GPU CUDA GPU CUDA CUDA AI CUDA AI Wintel CUDA CUDA CUDA CUDA PC Wintel Windows+AI CUDA GPU CUDA Wintel CUDA API GPUGPU GPU ifind AI GPU AI AI GPU AI 2022 ChatGPT 2023Q2 Q3 171%285%2022 9 GPU A100 H100 2023 10 A800 H800 AI AI 50%100%AI AI ifind 2023 12 15 NVIDIA GPU CPU AI NVIDIA AI Enterprise 2023 230.8%AI AI AI 2023 TTM TTM 2023 230.8%26.62 63.23 85.5%AMD 113.1%10.08 1,071.82-8.3%70.9%3.60-115.86-20.8%84.0%32.70 162.98 3.2%165.4%98.81-53.88-44.8%39.1%73.40-208.82-18.5%IDC AI IDC 2022 AI 15%AI AI+AI+AI 910 7nm A100/A800 310 12nm 710 5nm 800 12nm P4 2 7nm 12nm A10 BR100 7nm MTT S3000 7nm T20 12nm Gaudi 7nm N C JM9 AI AI GPU HBM GPU AI GPU CUDA The information CUDA CUDA CUDA CUDA CUDA 50 50 50 300 3-5 3-5 1000-3000 AI AMD CUDA+Meta AI GPU CUDA AI GPU AI 公司 芯片名 发布时间 代数 制程（nm）对标英伟达GPU Trainium 2022 1 5 Inferentia 2019 2 5Google Tensor(TPU)2015 4 7 Athena 2024 1 5对标英特尔CPU Graviton 2018 3 5Google Maple 2025 1 5Google Cypress 2025 1 5 Cascade 2024 1 5 ICT GPU A100 H100 910 MLU290-M5 MTT S3000FP32 TFLOPS 19.5 60-15.2FP16 TFLOPS 624 2000 280-(GB)80 80 32-32 32(TB/S)2 3-1 0.4 GB/S 600 900 56.5-600-W 400 700 300-350 250 CUDA CUDA Mindspore ROCm CUDA-Mindspore Omdia TensorFlow,PyTorch,MindSpore PaddlePaddle Omdia,TensorFlow PyTorch,MindSpore,ChatGPT AIGC,AI,Omdia,TensorFlow MindSpore,TensorFlow MindSpore AI AI AI GPU GPU CANN CUDA TensorFlow Pytorch PyTorch NPU 50 AI CUDA Pytorch GPU AI 2023 1 2.0-2.0 AI ICT 2023 2 23 16 70%AI AI CPU+GPU CPU DCU x86 C UD A”x86 ARM 2021 2022 2023 7.45 14.14 12.79 CPU DCU GPGPU 2023Q3 CPU x86 3000 5000 7000 DCU 8000 CUDA AI DCU GPGPU ROCm GPU ROCm AMD GPU CUDA AMD GPU HIP OpenCL ROCm CUDA CUDA ROCm CUDA CUDA ROCm ROCm CUD A”DCU DCU AI AI OEM AI 100 MLU100 2018 270 MLU270 2019 290 MLU290 2020 370 MLU370 2021 2022 1000 2020 1001 2022 220 MLU220 2019 IP IP 1A 2016 1H 2017 1M 2018 ifind G AI AI GPU HBM GPU AI AI TrendForce AI TrendForce AI DRAM SSD HBM DRAM 500 600GB AI DRAM 1.2 1.7TB AI GPGPU NVIDIA A100 80GB 4 8 HBM 320640GB AI Server DRAM SSD HBM AI vs AI AI DRAM 500-600GB 1.2-1.7TB 2.2-2.7TBSSD 4.1TB 4.1TB 8TBHBM 320-640GB 512-1024GBHBM GPU AMD DRAM DRAM HBM HBM High Bandwidth Memory JEDEC HBM GDDR TSV DRAM GPU HBM GPU ASIC HBMHBM GPU NVIDIA AMD AI HBM A100 AMD MI200 HBM2e H100 SK HBM3 AMD MI300X 192GB HBM3 H100 1.6 AI GPU GPU NVIDIA V100 SXM22017 HBM2 16GB/32GB 900 GB/sNVIDIA A100 80GB SXM2020 HBM2e 80GB 2039GB/sNVIDIA H100 SXM2022 HBM3 80GB 3.35TB/sAMD Instinct MI1002020 HBM2 32GB 1.2 TB/sAMD Instinct MI2002021 HBM2e 128GB 3.2TB/sAMD Instinct MI300X2023 HBM3 192GB 5.2TB/s HBM GB/sHBM Mordor Intelligence AI HBM AI GPU HBM TrendForce 2023 HBM 2.9 GB 2024 Mordor Intelligence 2020 HBM 10.68 2026 40.89 2021-2026 25.4%HBM SK 2023 7 HBM 1%2023 10%2024 AI HBM DDR5 2023 10 SK 2023 HBM3 HBM3E HBM 10.6840.890510152025303540452020 20262021-2026CAGR 25.4%50%40%10%53%38%9%0%10%20%30%40%50%60%SK 2022 2023 HBM DRAM SemiAnalysis HBM DRAM HBM 5%SemiAnalysis 2026 20%SK Kim Woo-hyun 4 2023 HBM 50%HBM TrendForce 2022 HBM SK 50%40%10%AI GPU HBM 2023 NVIDIA H100 AMD MI300 HBM3 SK HBM3 53%2023 2024 38%9%HBM 2023-2.4%0.6%HBM TrendForce HBM 2022 2023 HBM SK SK MTK SSD 5 26 SSD SSD 2022-2026 SSD 23.7%SSD SK LNG Intel 2023 9 2.7 SKenpulse SKC-ENF75.1%SKC-ENF 100%High-K/OLED RGB CMOS RGB RDL i-Line AI AI GPU HBM GPU AI Heterogeneous Integration CPU+GPU Grace Hopper CPU GPU 3D Grace Hopper GPUCPU AI 2020 AI HBM TSV HBM GPU CoWoS 2010 2020 2030()(TSV)(SiP*)AI RDL Flip Chip TSV SK TSV HBM HDM HBM HBM HBM SK HBM1 HBM2 HBM2E HBM3 128GB/s 307GB/s 460GB/s 819GB/s 4 4/8 4/8 4/12 1GB 4GB/8GB 8GB/16GB 16GB/24GBI/O 1Gbps 2.4Gbps 3.6Gbps 6.4Gbps HBM HBM DRAM TSV DRAM X 4”DRAM 4 bit X8 8 X16 16 Pin X32 HBM X1024 HBM CoWoS HBM GPU HBM HBM 2.5D HBM 2.5D HBM/Pads HBM CoWoS 2.5D CoWoS HBM CoWoS GPU CoWoS HBM 2.5DCoWoS Amkor TSV interposer fabrication for 3D IC packaging,TSV TSV 1/2 3 4 5 UBM 8 UBM 6 9 107 TSV 1 2 3 CoW CoW+oS CoWoS CoW oS Chip on Wafer CoW CoW Substrate KLA AMD IC AT&S 3D SoC DRAM 3D-IC AI HBM TSV 2.5D TSV RDL HD-FO IC 5 ABF IC yole PCB PCB IC CSP FCBGA IC Yole IC 2022 151 2028 289 11%,IC 46%fastprint 2021-2022 IC IC IC ifind IC CSP IC I/O BGA IC IC FCBGA 200/6,000/2024 FCBGA 2,000/2/2022 9 CSP 3.5/CSP IC IC 1 5 FC Flip Chip Yole FC 80%FC-BGA FC-SiP FC FC g/i AI AI GPU HBM GPU AI AI MPS 24 MPS 2015 8 2021 40 CPU GPU 10 10 20 CPU CPU PoL eFuse 6 2.8 0.6 0.6 48V kW IT 6-8kW/12-15kW/2027 30kW 40%48V 12V 100W 48V 6.25W 16 2016 48V MPS 48V AC/DC 48V DC/DC 12V 12V PoL CPU GPU 1V-3.3V IC MOSFET MOSFET DrMOS IC 13.3V vs 10 20 BSPDN IR Droop EUV IR Droop IR 50mV 20mV 44%30 TSV(BPR)(nTSV)TSV IR Intel 20A PowerVia RibbonFET 2024 ARL 2027 1.4nm Powervia 2024 2 2025 2026 DC/DC AF/OIS Chiplet 48V AI AI GPU HBM GPU AI AI AI AI AI AI AI AI AI AI GPU AI AI 300 10%300-10%-10%300 10%300 300 300 SAC S0640122030028 SAC S0640522040001 2022 1 SAC S0640122080006 2022 7 SAC S0640122040021 2022
