The world's leading system manufacturer launches NVIDIA AI-ready servers to dramatically improve generative AI performance for enterprises

Dell Technologies, HPE and Lenovo to launch servers with NVIDIA L40S GPU and NVIDIA BlueField to support VMware Private AI Foundation with NVIDIA

Las Vegas — VMware Explore — August 22, 2023 PT — NVIDIA today announced that the world’s leading system manufacturer will launch AI-ready servers with support for VMware Private AI Foundation with NVIDIA, also announced today, to help Enterprises use their own business data to customize and deploy generative AI applications.

NVIDIA AI-ready servers will use NVIDIA® L40S GPUs, NVIDIA BlueField®-3 DPUs and NVIDIA AI Enterprise software to enable enterprises to fine-tune generative AI foundation models and deploy generative AI applications, such as intelligent chatbots, search and summary tools, and more. These servers also provide NVIDIA-accelerated infrastructure and software to support VMware Private AI Foundation with NVIDIA.

As the world's leading system manufacturers, Dell Technologies, HPE and Lenovo will launch servers equipped with NVIDIA L40S before the end of the year to accelerate the development of enterprise-level AI.

"A new era of computing has arrived, and companies across all industries are rushing to adopt generative AI," said NVIDIA founder and CEO Jensen Huang . "We are bringing generative AI to the forefront through an ecosystem of the world's top software and systems partners. to global businesses.”

NVIDIA AI Ready Server is an ideal platform for enterprises deploying VMware Private AI Foundation with NVIDIA.

Raghu Raghuram, CEO of VMware, said: "Generative AI is driving the digital transformation process, and enterprises need a fully integrated solution to build applications more securely to drive business development. Through VMware, NVIDIA, and our server manufacturing Combining the expertise of business partners, enterprises will be able to develop and deploy AI while ensuring data privacy, security and control.

Promoting enterprise generative AI transformation

NVIDIA AI-ready servers will provide full-stack acceleration infrastructure and software for industries that are racing to apply generative AI to drug discovery, retail product descriptions, intelligent virtual assistants, manufacturing simulations, fraud detection and more.

These servers run on NVIDIA AI Enterprise, the operating system of the NVIDIA AI platform. The software provides production-ready, enterprise-grade support and security for more than 100 frameworks, pre-trained models, tool suites and software, including NVIDIA NeMo™ for LLM, NVIDIA Modulus for simulation, NVIDIA RAPIDS for data science ™ and NVIDIA Triton™ inference servers for production AI.

Designed to handle complex AI workloads containing billions of parameters, the L40S GPU is equipped with the fourth-generation Tensor Core and FP8 Transformer engine, which can provide more than 1.45 PFLOPS of tensor processing power, and its training performance is the NVIDIA A100 Tensor Core GPU 1.7 times.

Compared with NVIDIA A100 GPU, NVIDIA L40S can improve generative AI inference performance in generative AI applications such as intelligent chatbots, assistants, search and summarization by 1.2 times.

Integrating NVIDIA BlueField DPUs accelerates, offloads, and isolates huge computing workloads including virtualization, networking, storage, security, and other cloud-native AI services to further increase speed.

NVIDIA ConnectX®-7 SmartNICs deliver advanced hardware offload and ultra-low latency to deliver class-leading scalable performance for data-intensive generative AI workloads.

A vast ecosystem driving enterprise generative AI deployment

The world's leading computer manufacturers are building NVIDIA AI-ready servers, including Dell PowerEdge R760xa, HPE ProLiant Gen11 servers for VMware Private AI Foundation with NVIDIA, and Lenovo ThinkSystem SR675 V3.

Michael Dell, chairman and CEO of Dell Technologies, said: "Generative AI is a 'catalyst' for innovation that will help solve some of the world's biggest challenges. Dell's generative AI solutions powered by NVIDIA AI-ready servers will play a critical role. important role in accelerating human progress by driving unprecedented improvements in productivity and transforming the way industry operates."

Antonio Neri, president and CEO of HPE, said: “Generative AI will drive new scales of enterprise productivity—from empowering chatbots and digital assistants to helping design and develop new solutions. We are excited to continue our partnership with "Working closely with NVIDIA to leverage NVIDIA's GPUs and software across a range of enterprise-class tuning and inference workload solutions will accelerate the deployment of generative AI."

Yang Yuanqing, Chairman and CEO of Lenovo Group, said: "Enterprises are eager to adopt generative AI to drive intelligent transformation. By partnering with NVIDIA and VMware, Lenovo is further expanding its leading position in the field of generative AI and solidifying its unique Positioning to help customers on their AI adoption journey.”

Availability

NVIDIA AI-ready servers powered by L40S GPUs and BlueField DPUs will be available before the end of the year, with instances expected to be available from cloud service providers in the coming months.