Nvidia unlocks CUDA for RISC-V processors, opening up its AI ecosystem

Alfonso Maruccia

Posts: 1,881   +569
Staff
What just happened? Since its introduction in 2006, CUDA has been a proprietary technology running exclusively on Nvidia's own GPU hardware. Now, the GeForce maker appears ready to open CUDA to at least one additional architecture. Just don't expect to run CUDA-optimized code on AMD or Intel GPUs anytime soon.

Nvidia has officially ported its Compute Unified Device Architecture (CUDA) to RISC-V, a move announced at a recent RISC-V summit in China. According to Nvidia's Frans Sijstermans, this port enables a RISC-V CPU to act as the central application processor in CUDA-based AI systems. RISC-V International shared a slide from his presentation illustrating an ideal CUDA AI setup with GPU, CPU, and DPU (data-processing unit) components, highlighting the platform's potential to reshape AI hardware.

Sijstermans explained that a RISC-V CPU will soon be able to orchestrate an AI system by managing application software and operating system tasks. A CUDA-compatible GPU – meaning a Nvidia GPU or AI accelerator – would handle multithreaded CUDA kernel execution, while the DPU would take care of networking operations.

Nvidia has yet to announce a release date for the RISC-V CUDA port. With enough investment and development, RISC-V could eventually rival Arm in performance and efficiency. Its royalty-free model makes it particularly appealing in China and other regions affected by US tariffs on advanced chip technologies.

Based on an open-source standard, the RISC-V architecture has become a popular choice for microcontrollers and other embedded systems. Several major Linux distributions now offer official support for the ISA, while open-source developers are making a significant push toward consumer-oriented applications like gaming.

Despite generating billions from AI hardware and other proprietary technologies, Nvidia has supported the RISC-V architecture for years. The company has used RISC-V cores in specialized microcontroller units since 2015, developing both hardware and software solutions in-house.

Although Nvidia fully backs RISC-V as a legitimate CPU architecture, it isn't ready to bring CUDA to other third-party processors yet. Optimized code designed for CUDA still requires Nvidia hardware to run – though efforts are underway to enable CUDA binaries on non-Nvidia GPUs.

Permalink to story:

 
The current AI-generated videos are absolutely amazing.

Video games in the future that get generated through AI will be so lifelike that the graphic violence will be incredible.
 
Does Nvidia use the cpu for anything more than booting the system and feeding their GPU's. While it's a good thing that the offer as many cpu options as they can (a rarity in the Nvidia walled garden), RISC V has less software than ARM at this point, and has a long way to go.

If you don't need the horsepower, I'm sure Nvidia and others will jump all over it for it's one redeeming feature....no license fees. None of these tech titans can pass up more money.
 
I know it's going to take a good long while before I will use a RISC-V CPU in a computer I use daily, I have to admit, the development and growth of the ISA is pretty impressive.

The more America insists on squeezing the rest of the world via tariff's, or straight up sanctions, the more and more development that will go into something like RISC-V. The truth is, most people are fed up with Microsoft forcing Windows changes and copilot down our throats, most people are bored of the same Intel and AMD duopoly that's been going on for the past 30 years.
 
Back