NVIDIA NGC Software Available on AWS Marketplace to Accelerate AI Deployment

AI is changing every industry. As with any business, well begun is half done.

To help companies get started quickly, NVIDIA is working with AWS to provide 21 NVIDIA NGC software resources directly in AWS Marketplace. Customers can search, purchase, and immediately use software and services running on AWS in AWS Marketplace.

NGC is a catalog of software optimized to run on NVIDIA GPU cloud instances, including Amazon EC2 P4d instances powered by the NVIDIA A100 Tensor Core GPUs that set MLPerf records. AWS users can deploy this software for free to accelerate their AI deployments.

NVIDIA began providing GPU-optimized software through the NVIDIA NGC catalog in 2017. Subsequently, the industry's demand for such resources has surged. Currently, more than 250,000 users have downloaded more than 1 million AI containers, pre-trained models, application frameworks, Helm charts, and other machine learning resources provided in the catalog.

Working together to create another precedent for cloud services

AWS is the first cloud service provider to offer the NGC catalog in its marketplace. When making new deployments, many organizations look to the cloud first. Therefore, data scientists and developers can use NGC software as they wish to help their companies succeed. With NGC, they can easily start new AI projects in the AWS ecosystem.

“AWS and NVIDIA have collaborated on accelerated computing for more than a decade, and we are proud to offer the NVIDIA NGC catalog in AWS Marketplace,” said Chris Grusz, director of AWS Marketplace. “With NVIDIA NGC software now available directly from AWS Marketplace, customers can access and deploy these specialized software resources directly on AWS, simplifying and accelerating their AI deployments.”

NGC AI Containers Debut on AWS Marketplace

To help data scientists and developers build and deploy AI solutions, the NGC catalog provides hundreds of NVIDIA GPU-accelerated machine learning frameworks and industry-specific software development kits. On December 18, NGC was released in AWS Marketplace, which includes NVIDIA's most cutting-edge GPU-accelerated AI software in healthcare, recommendation systems, conversational AI, computer vision, HPC, robotics, data science, and machine learning, including:

NVIDIA AI: A framework and tool suite that includes MXNet, TensorFlow, NVIDIA Triton Inference Server, and PyTorch.

NVIDIA Clara Imaging: NVIDIA’s domain-optimized application framework that accelerates deep learning training and inference for medical imaging use cases.

NVIDIA DeepStream SDK: A multi-platform, scalable video analytics framework that can be deployed at the edge and connected to any cloud.

NVIDIA HPC SDK: A suite of HPC compilers, libraries, and software tools.

NVIDIA Isaac Sim Machine Learning Training: A toolkit that helps robotics machine learning engineers use Isaac Sim to generate synthetic images for training object detection deep neural networks.

NVIDIA Merlin: An open source beta framework for building large-scale deep learning recommender systems.

NVIDIA NeMo: An open source Python toolkit for developing state-of-the-art conversational AI models.

RAPIDS: A suite of open source data science software libraries.

Instant access to performance-optimized AI software

NGC software in AWS Marketplace brings many advantages to lay the foundation for data scientists and developers to succeed in the field of AI.

Faster access to software: AWS Marketplace gives developers and data scientists easy access to the latest versions of NVIDIA AI software.

Latest versions of NVIDIA software: NGC software in AWS Marketplace is synchronized. Therefore, AWS users can access the latest version of the software as soon as it is available in the NGC catalog. The software is continuously optimized to provide users with the latest features and performance improvements every month.

Simplified software deployment: Amazon EC2, Amazon SageMaker, Amazon Elastic Kubernetes Service (EKS), and Amazon Elastic Container Service (ECS) users can quickly subscribe, extract, and run NGC software on NVIDIA GPU instances, all within the AWS Management Console. In addition, SageMaker users no longer need to store containers in Amazon Elastic Container Registry (ECR), simplifying their workflow.

Continuous integration and development: AWS Marketplace also offers NGC Helm charts to help DevOps teams deploy services quickly and continuously.