|2024 03 19 GTC 2024 TMT/GTC 2024 3 18-21 CEO 3 18 AI AI 1 AI Blackwell Blackwell GPU 1 2080 AI 2 Transformer 3 NVLink 4 RAS 5 AI 6 1 GPT-MoE-1.8T 8000 Hopper GPU 15MW Blackwell 2000 GB200 NVL72 GPU 4MW Blackwell die 1040 4NP Hopper AI 5 AI 20petaFLOPS 192GB HBM3e Blackwell GPU 2 die 2080 1 Hopper Hopper 2 2*Blackwell GPU+1*Grace CPU GB200 2*Blackwell GPU+1*Grace 382GB HBM3e 900GB/s NVLink-C2C GB200 Grace Blackwell Superchip 40 petaFLOPS AI Blackwell 4*Blackwell GPU+2*Grace CPU 80 petaFLOPS AI 1.7TB HBM3e 32TB/s MGX GB200 NVL72 One giant GPU 18 trays/rack 72*Blackwell GPU+36*Grace CPU 1.4 exaFLOPS AI 30TB HBM3e 2 GB200 NVLink Switch System 18 NVLink Switch 72 1.8TB/s 130TB/s GB200 NVLink Switch Spine 72 Blackwell GPU NVLink 5000 NVLink 2 NV 6 120kW 20kW 2kW NVLink Spine GB200 25 45 2/s 2X 3 NVLink Switch Blackwell NVLink Switch 500 4NP 72 200Gb/s Serdes GPU NVLink Switch System 18 NVLink Switch 72 1.8TB/s 130TB/s Quantum InfiniBand Switch 800Gb/s 230.4Tb/s Quantum-X800 InfiniBand Spectrum-X800 4 Vision Pro Omniverce JETSON NV Omniverse Cloud NV HEALTHCARE NVIDIA BioNeMo NIMs Vision Pro NV Omniverce Cloud Blackwell%492 9.7 7244.0 9.3 5867.5 8.5%1m 6m 12m 30.8-6.5-11.1 23.8-3.1-2.1 1 FY24Q4 FY25Q1 240 2024-02-22 2 AI AI 2023-04-20 3 GTC 2023 AI iPhone AI 2023-03-23 S1090511060002-50-40-30-20-1001020Mar/23 Jul/23 Nov/23 Feb/24(%)电子 沪深300 AI 2 NIMs NEMO AI Foundry Omniverce Isaac robotics Ansys Synopsys Cadence Isaac JETSON THOR ROBOTIC COMPUTE&Stack GTC Blackwell GPU Vision Pro GPU/CPU PCB/IC RAID NV GPU/CPU 昇 HBM 1 EDA/IP PCB IC AI XR/GTC 2024 0YEVzQmRtQmNqOoNtOsNmN6McM6MsQmMmOmQkPmMnOeRsQoO7NqQxPwMsPtPuOsOsQ 3 GTC 2024 2024 3 18 1993 2006 CUDA 2012 Alex Net AI Kuda 2016 DGX1 8 GPU 170 DGX1 OpenAI DGX1 2022 Transformer ChatGPT 2023 AI 1 1 Ansys Synopsys Cadence AI 1 Ansys Ansys Omniverse Digital twins GPU install basis install basis CSPs 4 2 Synopsys Synopsys Nvidia Synopsys 3 Cadence EDA SDA Cadence Nvidia GPU 100 2 Blackwell GPU Transformer CAE EDA SDA Omniverse Transformer OpenAI 1.8 1.8 token 300 400 500 SELENE EOS GPU tensor cores NV link DGX1 2021 SELENE 4500 GPU 2023 EOS GPU GPU GPU 2 SELENE 3 EOS ChatGPT PksZMXGpWvA3ARtZO4ehJbzkDSe1RnSOm2svFrHBRVlKohRVjbBE1khFUItI4bAi 5 GPU Blackwell GPU Blackwell 2080 Grace-Blackwell Blackwell GPU 4 Blackwell dies Grace CPU NV link PCI Express transformer engine transformer engine NV link Hopper GPU 1.8TB Hopper Ras Blackwell gate bit of memory 100%Secure AI 4 Blackwell 6 5 Blackwell 6 Blackwell 7 7 Blackwell 8 Blackwell 9 Blackwell high line speed compression engine 20 Hopper FP8 2.5 FP6 8 10 Blackwell GPU 11 Blackwell content token generation FP4 5 2 5 10 10 100 1000 12 8 NVLink Switch Chip 500 Hopper NV Links 1.8TB GPU GPU GPU GPU 9 13 NVLink Switch Chip GTC DGX OpenAI DGX DGX 170 0.17 PFLOPS 720 PFLOPS 1 Exaflops 1 Exaflops DGX NV Link Spine 130TB 5000 NV Link 14 DGX GPU GTC Transceivers ReTimer NV Link Spine NV Link Switch 20 120 20 25 45 HGX GPU 70 35000 DGX GPU 60 10 DGX 1.8 GPT 3 5 25000 Hopper 8000 GPU 15 90 Blackwell 2000 GPU 90 5 15 Blackwell GB200 GTC NVIDIA GPU token ChatGPT 1 GPU Chatbot Chatbot token token token token GPU 2 token token per user GPU GPU Token Y GPU token X token GPU token Tensor Parallel Expert Parallel Pipeline Parallel Data Parallel GPU NVIDIA GPU CUDA TP2 EP8 DP4 2 Tensor Parallel 8 Expert Parallel 4 Data Parallel 4 Tensor Parallel 16 Expert Parallel 11 16 GPU Token GTC Blackwell Hopper Blackwell Hopper AI Blackwell Hopper 30 Hopper Hopper 2080 FP4 Tensor Core NV Link Switch GPU NV Link Switch 10 Blackwell AI AI AI Hopper Blackwell AI CSP OEM ODM Sovereign AI Blackwell Blackwell 12 17 Blackwell Hopper GTC 3 AWS Blackwell AWS AWS Blackwell AI GPU 222 Exaflops AWS SageMaker AI Bedrock AI Amazon Robotics NVIDIA Omniverse Isaac Sim AWS NVIDIA AWS Blackwell GCP A100s H100s T4s L4s CUDA GPU Gemma GCP Jax XLA Vertax AI Oracle Oracle Blackwell Oracle NVIDIA DGX Cloud Oracle Database NVIDIA InfiniBand Cloud Omniverse Healthcare Azure Fabric 4 AI Blackwell Blackwell Wistron Omniverse SDK API 13 HGX DGX 1 AI CAD 51%Omniverse Wistron Omniverse Wistron 50%40%AI Omniverse AI 18 Omniverse Cloud GTC 2 2012 Alex Net Cat 100 RGB 2012 14 19 GTC 3 AI 1500 Earth-2 CorrDiff AI 2021 AI 25 CorrDiff AI WRF ERA5 CorrDiff 25 2 1000 3000 CorrDiff AI CorrDiff Earth-2 CoreDiff 15 20 CoreDiff GTC 4 AI 15 AI AlphaFold X 20 AlphaFold 21 GTC 16 5 AI NVIDIA BioNeMo NIMs NIMs MolMIM AlphaFold DiffDock MolMIM BioNeMo MolMIM BioNemo 22 BioNeMo NIM GTC 6 NIM NVIDIA MolMIM CorrDiff NVIDIA Inference Microservice NIM NVIDIA ARB CUDA RTLM Tensor Inference Server GPU API AI API Chatbots NIM Chatbots 17 23 NVIDIA Inference Microservice(NIM)GTC 7 AI Python AI AI NIM NIM SAP NIM GPU NIM NIM Chatbots Chatbots.AI Co-pilot Llama2 70B NIM Chatbot Chatbot NIM NeMo Microservices Chatbot 1 AI AI 2 3 DGX Cloud TSMC NIM NeMo Microservice DGX Cloud 18 24 NeMo Microservices GTC AI Foundry NeMo DGX 25 PDF GTC PDF PDF PDF lemon retriever NeMo 19 26 DHT GTC Coplit NeMo Foundry Gara generative snowflake 10000 NeMo nymphs Dell Dell 27 Dell AI GTC dgx 20 28 DGX OVX AGX GTC 29 Omniverse,DGX GTC 100000 AMR Isaac video metropolis 100 amr amr metropolis coop coop AMR 21 metropolis vision foundation isaac cicd omniverse omniverse cloud API AI USD 30 GTC acts 22 31 GTC Omniverse Vision Pro 32 Vision Pro GTC Thor 23/transformer model 33 GTC GR00T Isaac lab osmo GDX ovx Isaac/osmo/Groot 24 34 GR00T GTC NeMo DGX Foundry omniverse 25 6-12 A 300 500 20%5-20%5%5%