Jensen Huang says Nvidia's Vera CPU will challenge Xeon and Epyc in the data center

Skye Jacobs

Posts: 2,029   +59
Staff
Winners & losers: Nvidia CEO Jensen Huang has announced that the company's Vera CPU will debut as a standalone infrastructure product, not merely as a supporting element for its GPUs. For the first time, Nvidia will sell a processor capable of powering full computing stacks on its own, signaling an intentional move into the heart of the data center market long dominated by AMD and Intel. Huang described Vera as "revolutionary," hinting that early partners such as CoreWeave are already preparing deployments, even before official design wins have been announced.

This decision represents far more than a new product launch; it is the culmination of Nvidia's push to become a one-stop silicon provider for AI and high-performance computing. The company's strategy is clear: rather than relying on GPUs to accelerate other firms' CPUs, Nvidia now wants its own architecture to run every stage of computation, from number-crunching cores to AI inference pipelines.

The shift is expanding its influence across cloud and enterprise infrastructure, aiming to position Nvidia as a full-system supplier rather than a single-component vendor.

Technically, Vera arrives well-equipped for that ambition. The processor is built around 88 custom Armv9.2 Olympus cores, each capable of running two threads through Spatial Multithreading. This design gives Vera an effective footprint of 88 cores and 176 threads, unlocking parallel performance traditionally reserved for x86-based rivals.

Nvidia's choice to base the CPU on Arm architecture allows more flexibility in performance scaling and power optimization – critical advantages in data center efficiency.

The chip integrates 1.5 terabytes of LPDDR5X memory and delivers 1.2 terabytes per second of bandwidth, an unusually high ratio for a general-purpose CPU. That balance makes Vera especially suited for memory-intensive workloads such as AI model preprocessing, data analytics, and simulation.

Still, it remains unclear whether Nvidia will support conventional DDR5 RDIMM modules or rely solely on the LPDDR5X configuration typical of its system-on-module designs.

A defining component of Vera's architecture is its second-generation Scalable Coherency Fabric, a high-speed interconnect that links all 88 cores across a single monolithic die. The fabric enables 3.4 terabytes per second of bisection bandwidth, allowing efficient data exchange between cores with minimal latency – an engineering choice that sidesteps the synchronization delays often encountered in chiplet-based CPUs such as AMD's EPYC.

Vera's fabric doesn't act alone. It interfaces directly with Nvidia's NVLink Chip-to-Chip technology, now in its second generation, providing up to 1.8 terabytes per second of coherent bandwidth to external components such as the upcoming Rubin GPU.

The symmetry between Vera and Rubin enables them to share memory models and data, creating a unified CPU-GPU environment within the same compute framework.

Vera's cores use FP8 arithmetic and six 128-bit SVE2 vector units for faster data and AI processing. These capabilities allow Vera to handle certain AI and floating-point operations directly on its CPU cores, reducing the need to offload everything to a GPU. In doing so, Nvidia shifts AI-inference efficiency closer to the CPU – an advantage that could reduce energy overhead and latency in diverse enterprise applications.

For Nvidia, the Vera CPU marks both a technological milestone and a strategic turning point. It transforms the company from the world's leading GPU supplier into a direct competitor in the general-purpose computing market. AMD's EPYC and Intel's Xeon families will soon face a new kind of challenger – one leveraging the same GPU-CPU integration that has fueled Nvidia's rise in AI acceleration.

Permalink to story:

 
What delicious vendor lock in will they come up with. Just expect the worst (for the customer) from NVIDIA and you're probably right.

With NVIDIAs resources behind this I could see this becoming quite successful. Especially if they do some bundle deals with their AI cards for all those data centers being build. NVIDIA as the one stop-shop.
Smart choice on NVIDIAs part as well now that Microsoft has shown of their own AI-chip I'm sure Google, Alibaba and Amazon aren't far behind and the insane pricing for NVIDIAs AI cards can't continue, if they don't want their stock to tank they need to diversify.
I don't see what would prevent those hyperscalers from doing the same though, most of the work is still done by ARM after all or alternatively AMD/Intel could start offering ARM products in the same segment to prevent NVIDIA from gaining too much marketshare - not like they're short on knowledge. Heck, bet they already got designs that are at least half way there just waiting to see how NVIDIAs attempt shakes out.
 
Nvidia selling a standalone CPU feels like the logical endgame of the AI data center era. Once you’re already supplying the GPUs, networking, interconnects, and software stack, the CPU is basically the last piece of the monopoly puzzle.

The technical approach is really interesting too. A monolithic Arm CPU with that much memory bandwidth and coherent fabric sounds almost purpose-built for AI workloads rather than traditional general computing. It’s less about replacing Xeon everywhere and more about owning the full AI pipeline.

Nvidia trying to become the Apple of the data center: full-stack integration, but at the cost of vendor lock-in.
 
Back