Nvidia Wants to Own Every Chip Inside AI Data Centers

Nvidia is hyping up its new Vera Rubin chip system this week, revealing new performance benchmarks for the GPU and CPU combo ahead of rival AMD’s annual product event in San Francisco on Thursday.

During a lengthy technical workshop last week at the company’s headquarters in Santa Clara, California, Nvidia executives boasted to a small group of journalists about the chip system’s increased power and efficiency capabilities. The biggest takeaway: Nvidia, which has long specialized in making GPUs, is increasingly trying to position itself as a supplier of CPUs that can power AI agents.

While GPUs are still the main hardware that companies use to train and run their AI models, the industry’s shift toward more complex, agentic systems has increased demand for CPUs, which can orchestrate data flows, networking, and other software tasks. That’s likely one reason Nvidia has been eager to promote itself as a supplier of complete AI systems, rather than just AI chips.

Vera Rubin is Nvidia’s successor to its hybrid superchip system Grace Blackwell, and represents the linchpin of its near-term future powering the AI industry. It’s designed to offer one CPU for every two GPUs. In a single Vera Rubin NVL 72 super chip system, there are 36 Vera CPUs for every 72 Rubin GPUs. Nvidia is also selling the Vera CPU as a standalone product, and it has reportedly told Chinese customers these could be ready as soon as August.

The CPU chip Nvidia is using for its new Vera Rubin hardware system.

Courtesy of NVIDIA

Nvidia executives emphasized that its new Vera Rubin NVL72 racks—a stack of chips packed into a single liquid-cooled platform—are much more “plug-and-play” than some of its earlier products. During a brief tour of a Nvidia data center lab in Silicon Valley, Nvidia executives shared that OpenAI already has one Vera Rubin rack in use.

Nvidia CEO Jensen Huang didn’t make an appearance at the workshop in Santa Clara last week; he was in Japan announcing the chipmaker’s new partnerships with a number of Japanese firms to develop AI for robotics. The briefings were instead led by Ian Buck, Nvidia’s longtime vice president of accelerated computing and the architect behind the company’s CUDA software.

“We’re on a roadmap to crank out new architectures, not just GPUs but CPUs,” Buck told reporters. “We’re going to keep innovating, because it’s do this or die in Silicon Valley.”

The meetings were held in Huang’s executive briefing center, where multiple desks nearby were piled with bags of Taiwanese snacks that the CEO brought back from his recent trip to Computex, a massive annual semiconductor trade show in Taipei, an Nvidia spokesperson told WIRED.