Nvidia's AI chips already make billions, now Jensen Huang wants $2,000 per GPU in annual software fees

zohaibahd

Posts: 994   +19
Staff
In context: Most of Nvidia's money comes from selling the hardware that fills AI data centers. Those sales are largely one-off deals, though, so Jensen Huang seems keen on something that keeps paying after the chips ship. At GTC Berlin last week, the CEO said it costs about $2,000 per GPU every year to run all of the company's software for AI agents.

The Register was first to report Huang's quote from a question-and-answer session at the event on October 22. The CEO told attendees that software licensing "will become increasingly a major part of our company's business." The $2,000 figure was his example of how that licensing would be priced.

That money covers the Nvidia software needed to run agents inside what the company calls AI factories – its name for data centers built around AI work. However, it's not clear how this fits with what Nvidia already charges. The company sells an AI Enterprise suite that businesses license to build and run AI on its hardware. It's listed at $4,500 per GPU for a year, support included. Committing to five years brings the total to $18,000 per GPU, equivalent to $3,600 a year.

Huang's figure is lower than both existing prices, but the company hasn't explained how the two prices relate. There's also no word on when the $2,000 pricing might arrive.

The company has been building out that agent software at a fast pace. A day before the Q&A, it launched the OpenShell Reference Architecture, an expansion of a safety platform introduced in September. In it, agents run on Vera CPUs inside OpenShell, an open-source sandbox that controls which files, networks, and tools they can reach. BlueField-4 networking chips running Nvidia's Sentry software watch from the outside and can quarantine an agent within milliseconds if it oversteps those limits.

Huang leaned on OpenShell when asked about AI safety during the same session. "If you're making an omelette, you don't need a hammer," he said.

At $2,000 each, every million licensed GPUs would bring Nvidia $2 billion in recurring annual revenue, as long as customers continued running the software. That's not much next to the $96.2 billion the company brought in last quarter. Still, it's money that doesn't depend on anyone buying new chips.

Since the fee is charged per GPU, how Nvidia counts a GPU matters, too. When Huang said last year that the company would start counting each silicon die as a separate GPU, The Register noted that the change could double the number of AI Enterprise licenses some servers need. Nvidia has since gone back to counting whole modules for Vera Rubin, at least in how it describes its systems.

Permalink to story:

 
'Taint gonna happen, Leather Man, for me at least, and I would not be surprised if there are others who refuse to pay for your greed/crap, too.
 
Now que hordes of comments from people who have no idea how corporate software licensing works.

You do not need to use Nvidias AI control and creation software. You can use anybody's tools. This cost is for Nvidias software suite. All commercial software licenses look like this, and $2k a year per core is pretty cheap compared to their performance.

You think this **** is bad go look up some VMware contracts.
 
Jenny sounds like he's getting pretty desperate lately. He reminds me of the crypto bros.

What makes me laugh is that we are likely going to see an AI V Sony situation. People will just use AI to create free AI software. And much how the free and opensource models are cheaper for corperations to run locally than buying from token factories, I'm sure there will soon be a big ecosystem of FOSS AI generate software for...running AI.

It'll be really fun if the technology they created to make "normies" irrelevant is what ends up making the big guys irrelevant, too.
 
Last edited:
Did anyone actually read the article before posting about “greed” etc?

This is for the software that a vendor can CHOOSE to run with the GPUs they purchase.

They ALREADY charge this - the interview a few days ago simply was Jensen stating how much it cost Nvidia (they tend to charge MORE than $2000 per GPU on average - as stated by this article!).

A vendor has the choice to purchase Nvidia GPUs and run alternate software - but that software tends to be even costlier!
 
Did anyone actually read the article before posting about “greed” etc?

This is for the software that a vendor can CHOOSE to run with the GPUs they purchase.

They ALREADY charge this - the interview a few days ago simply was Jensen stating how much it cost Nvidia (they tend to charge MORE than $2000 per GPU on average - as stated by this article!).

A vendor has the choice to purchase Nvidia GPUs and run alternate software - but that software tends to be even costlier!
This is the love/hate relationship I have with CUDA. Buying an Nvidia card used to mean you paid the enterance fee upfront to gain access to that ecosystem. Now their is a bunch of proprietary software in the CUDA ecosystem and they can charge whatever they want for it because AMD does not and cannot support CUDA and most people are sitting behind $100,000 GPUS aren't saying "guess I wont use it now that I have to pay $2000 a year for it".

I also see this as grasping at straws because running a token factory has gotten so expensive that I see lots of neoclouds just saying "screw it, I'm done" if they costs don't go down some how and nVidia gets their pint of blood in the process. What people aren't seeing is that this is going to piss off a ton of developers who have spent tons of time and money to help develop the CUDA platform and much of the software that these AI systems run on.

From my perspective it looks like a rug pull combined with an act of desperation.
 
This is the love/hate relationship I have with CUDA. Buying an Nvidia card used to mean you paid the enterance fee upfront to gain access to that ecosystem. Now their is a bunch of proprietary software in the CUDA ecosystem and they can charge whatever they want for it because AMD does not and cannot support CUDA and most people are sitting behind $100,000 GPUS aren't saying "guess I wont use it now that I have to pay $2000 a year for it".

I also see this as grasping at straws because running a token factory has gotten so expensive that I see lots of neoclouds just saying "screw it, I'm done" if they costs don't go down some how and nVidia gets their pint of blood in the process. What people aren't seeing is that this is going to piss off a ton of developers who have spent tons of time and money to help develop the CUDA platform and much of the software that these AI systems run on.

From my perspective it looks like a rug pull combined with an act of desperation.
But they’re ALREADY charging for the software… it’s not like this is anything new… and yeah, it’s sucky but…
 
Omg omg omg, I am so excited. We are going to pay subscription for new geforce drivers!
Can you imagine how excellent and timely those will be when the company is actually being paid
to make those? We are entering a golden age of GPUs, my friends!
 
Back