AWS and NVIDIA Collaborate on ‘Next Generation’ AI Infrastructure

Amazon Web Services (AWS) and NVIDIA are collaborating on “next generation” artificial intelligence (AI) infrastructure.

The infrastructure will be optimized for training large language models (LLMs) and developing generative AI applications, the companies said in a Tuesday (March 21) press release.

“Generative AI has awakened companies to reimagine their products and business models and to be the disruptor and not the disrupted,” NVIDIA Founder and CEO Jensen Huang said in the release. “We are thrilled to combine our expertise, scale and reach to help customers harness accelerated computing and generative AI to engage the enormous opportunities ahead.”

The latest generation capabilities delivered by this partnership are meant to power question answering, code generation, video and image generation, speech recognition and other demanding generative AI applications, according to the press release.

Specifically built to facilitate AI-fueled innovation by both enterprises and startups, they accelerate the time-to-train machine learning (ML) models by up to six times, enable the training of larger, more complex models and are expected to lower the cost of training ML models by 40%, the release said.

“AWS has unmatched experience delivering GPU-based instances that have pushed the scalability envelope with each successive generation, with many customers scaling machine learning training workloads to more than 10,000 GPUs today,” AWS CEO Adam Selipsky said in the release. “With second-generation EFA, customers will be able to scale their P5 instances to over 20,000 NVIDIA H100 GPUs, bringing supercomputer capabilities on demand to customers ranging from startups to large enterprises.”

In one recent example of the development of AI solutions, NVIDIA and Deutsche Bank announced in December that they are partnering to accelerate the use of AI in financial services.

NVIDIA will support the bank’s cloud migration by developing AI and ML tools to simplify and speed up decision-making.

“AI, ML and data will be a game changer in banking, and our partnership with NVIDIA is further evidence that we are committed to redefining what is possible for our clients,” Deutsche Bank CEO Christian Sewing said at the time.

In another example, home improvement chain Lowe’s unveiled an “interactive digital store twin” in September and said users of NVIDIA’s Omniverse virtual world will be able to use its virtual 3D product catalog to “create new possibilities in the applications for retail and beyond.”