New NVIDIA Blackwell GPU platform coming to AWS


Devdiscourse News Desk | California | Updated: 19-03-2024 10:57 IST | Created: 19-03-2024 10:57 IST
New NVIDIA Blackwell GPU platform coming to AWS
Image Credit: Flickr
  • Country:
  • United States

Amazon Web Services (AWS) and NVIDIA are extending longstanding strategic collaboration to accelerate AI (artificial intelligence) innovation. The partnership will see AWS offering NVIDIA GB200 Grace Blackwell Superchip and B100 Tensor Core GPUs to help customers unlock new generative AI capabilities.

"The deep collaboration between our two organizations goes back more than 13 years, when together we launched the world's first GPU cloud instance on AWS, and today we offer the widest range of NVIDIA GPU solutions for customers," said Adam Selipsky, CEO at AWS.

AWS will offer the NVIDIA Blackwell platform, featuring GB200 NVL72, with 72 Blackwell GPUs and 36 Grace CPUs interconnected by fifth-generation NVIDIA NVLink. NVIDIA Blackwell on AWS delivers a massive leap forward in speeding up inference workloads for resource-intensive, multi-trillion parameter language models.

AWS plans to offer EC2 instances featuring the new B100 GPUs deployed in EC2 UltraClusters for accelerating generative AI training and inference at a massive scale. GB200s will also be available on the NVIDIA DGX Cloud AI platform that gives enterprise developers dedicated access to the infrastructure and software needed to build and deploy advanced generative AI models. The Blackwell-powered DGX Cloud instances on AWS will accelerate the development of cutting-edge generative AI and LLMs that can reach beyond 1 trillion parameters.

Project Ceiba, a collaboration between NVIDIA and AWS to build one of the world’s fastest AI supercomputers, will feature 20,736 GB200 Superchips capable of processing 414 exaflops for NVIDIA's own research and development.

"AI is driving breakthroughs at an unprecedented pace, leading to new applications, business models, and innovation across industries. Our collaboration with AWS is accelerating new generative AI capabilities and providing customers with unprecedented computing power to push the boundaries of what's possible," said Jensen Huang, founder and CEO of NVIDIA.

Give Feedback