Nvidia's secret weapon: It's the software, stupid

Jay Goldberg

Posts: 98   +2
Staff
The big picture: Nvidia's Jensen Huang kickstarted CES this year with his keynote. We listened to it and read a fair amount of analysis since. If you don't have 90 minutes to spare, we can sum it up for you: Nvidia has all the software. Or at least it has more than you do.

Want to build a robot? They have software for that. Design a factory? Check. Autonomous cars, drug discovery, video games – they have that too. And it is not just a basic application on offer; it has multiple layers – for designing a robot, modeling out its physical world interactions, and then putting it into production. Nvidia has software for all of those.

Editor's Note:
Guest author Jonathan Goldberg is the founder of D2D Advisory, a multi-functional consulting firm. Jonathan has developed growth strategies and alliances for companies in the mobile, networking, gaming, and software industries.

This is not exactly news, we have written about this before, but the point of all this is to drive home the message that most companies will get a big leg up by starting with Nvidia's offerings.

In fairness, we have no idea how successful any of these will be. We are fairly certain that Nvidia is not too clear on that either. Their superpower is the ability to take chances without fear of failure, and our suspicion is that many of this week's announcements will face mixed results.

That being said, the sheer quantity and depth of their offerings should be sobering for everyone else. Put simply, for companies who do not plan to train their own foundational models, working with Nvidia's tools is going to be the easiest way to develop AI applications.

This is especially true for other semiconductor companies. Here, Nvidia's lead is doubly formidable. First, competing with Nvidia in selling AI semis requires a massive investment in software, and probably half a decade to build it out.

AMD is a year or two along that journey, and they are way ahead of number three. Broadcom does not have the software offerings, but they are going to do just fine selling to that handful of companies building their own foundational models. Everyone else has a long journey just to reach table stakes.

The other item we pulled out of Huang's remarks was the level to which Nvidia is 'eating its own dog food.' They seem to be using AI tools to accelerate the development of their own chips. We think it is too soon to tell how much of the semiconductor design cycle can benefit from transformer-based AI models, but if even half of the workflow can be improved (dare we say 'accelerated') by AI, then Nvidia is going to have a meaningful productivity advantage over its competitors.

Last year, Nvidia added $70 billion of revenue and $52 billion in operating profit, while only adding $6 billion in operating expenses. And now there is a risk that they are going to get even more productive?

Permalink to story:

 
Nvidia isn’t just playing chess; they’re building the chessboard, writing the rules, and selling the pieces to everyone else. The real flex isn’t their hardware anymore—it’s their ability to make every other company’s journey feel like a startup trying to compete against a tech god.

Haters are going to hate, and I'm personally indifferent to Nvidia, but if you look at their numbers the recipe is working, no doubt.
 
Nvidia isn’t just playing chess; they’re building the chessboard, writing the rules, and selling the pieces to everyone else. The real flex isn’t their hardware anymore—it’s their ability to make every other company’s journey feel like a startup trying to compete against a tech god.

Haters are going to hate, and I'm personally indifferent to Nvidia, but if you look at their numbers the recipe is working, no doubt.
They print their own money too!
 
If no other tech company get to compete with Nvidia, they will dictate the price of Ai hardware the way they want. It is already happening here in Brazil where Nvidia GPUs costs like 8x more than USA average price.
 
Anyone can do the maths.
I'm going to assume you know next to nothing about business and have never had the absurdity of a 75% profit margin put into perspective. Walmart has a profit margin of 2.9%, Target's is 6.7%, Apple has a profit margin of 24% and McDonald's is 33%. Most operate with profit margins under 15% and a 20% margin is considered "highly profitable". So while the BOM on a 5090 might not be $500, nVidia is making a KILLING on each one, There is no reason for it to be $2000
 
I'm going to assume you know next to nothing about business and have never had the absurdity of a 75% profit margin put into perspective. Walmart has a profit margin of 2.9%, Target's is 6.7%, Apple has a profit margin of 24% and McDonald's is 33%. Most operate with profit margins under 15% and a 20% margin is considered "highly profitable". So while the BOM on a 5090 might not be $500, nVidia is making a KILLING on each one, There is no reason for it to be $2000

LMAO.

It’s cute that you’re trying to compare Nvidia to Walmart or McDonald’s. Let’s break this down and put things into perspective. Walmart has a 2.9% profit margin because they sell bulk goods at razor-thin margins to billions of people. Nvidia, on the other hand, doesn’t sell Big Macs or paper towels, it sells cutting-edge technology, GPUs, and an entire software ecosystem that industries rely on to build AI models, design robots... and simulate entire factories.

Now let’s revisit some actual numbers: Nvidia generated $70 billion in revenue last year, with $52 billion of that as operating profit. That’s a 74% operating margin, a figure Walmart and McDonald's can’t even dream of. Why?? Because Nvidia isn’t competing in a low-margin business; they’ve created a near-monopoly in high-performance computing and AI software.

It’s not just a GPU anymore, it’s a key to their software stack, AI tools, and years of R&D. That’s the kind of value-add that lets them charge a premium and still dominate.

So yes... they’re making a killing, but they’re also providing unmatched value to industries that are willing to pay for it. If you’re going to argue about margins, at least understand the context of the market Nvidia operates in.

Comparing them to McDonald's is as absurd as comparing a Tesla to a tricycle. Get it right.
Edit: Typos.
 
LMAO.

It’s cute that you’re trying to compare Nvidia to Walmart or McDonald’s. Let’s break this down and put things into perspective. Walmart has a 2.9% profit margin because they sell bulk goods at razor-thin margins to billions of people. Nvidia, on the other hand, doesn’t sell Big Macs or paper towels, it sells cutting-edge technology, GPUs, and an entire software ecosystem that industries rely on to build AI models, design robots... and simulate entire factories.

Now let’s revisit some actual numbers: Nvidia generated $70 billion in revenue last year, with $52 billion of that as operating profit. That’s a 74% operating margin, a figure Walmart and McDonald's can’t even dream of. Why?? Because Nvidia isn’t competing in a low-margin business; they’ve created a near-monopoly in high-performance computing and AI software.

It’s not just a GPU anymore, it’s a key to their software stack, AI tools, and years of R&D. That’s the kind of value-add that lets them charge a premium and still dominate.

So yes... they’re making a killing, but they’re also providing unmatched value to industries that are willing to pay for it. If you’re going to argue about margins, at least understand the context of the market Nvidia operates in.

Comparing them to McDonald's is as absurd as comparing a Tesla to a tricycle. Get it right.
Edit: Typos.
So, you ARE an nvidia employee after all! Good to know, it all makes sense now.
 
Math was the word you were looking for, it is not plural.
Double ouch.

Not everyone is American, nor does everyone use American English.
 
LMAO.

It’s cute that you’re trying to compare Nvidia to Walmart or McDonald’s. Let’s break this down and put things into perspective. Walmart has a 2.9% profit margin because they sell bulk goods at razor-thin margins to billions of people. Nvidia, on the other hand, doesn’t sell Big Macs or paper towels, it sells cutting-edge technology, GPUs, and an entire software ecosystem that industries rely on to build AI models, design robots... and simulate entire factories.

Now let’s revisit some actual numbers: Nvidia generated $70 billion in revenue last year, with $52 billion of that as operating profit. That’s a 74% operating margin, a figure Walmart and McDonald's can’t even dream of. Why?? Because Nvidia isn’t competing in a low-margin business; they’ve created a near-monopoly in high-performance computing and AI software.

It’s not just a GPU anymore, it’s a key to their software stack, AI tools, and years of R&D. That’s the kind of value-add that lets them charge a premium and still dominate.

So yes... they’re making a killing, but they’re also providing unmatched value to industries that are willing to pay for it. If you’re going to argue about margins, at least understand the context of the market Nvidia operates in.

Comparing them to McDonald's is as absurd as comparing a Tesla to a tricycle. Get it right.
Edit: Typos.
nVidia hasn't provided any value, even OpenAI has said that ChatGPT isn't profitable. All nVidia has done is create a fan base they can abuse while using third parties to siphon risk and money for venture capitalists. If you look at nVidia's Price to earnings ration, it's actually quite another story. They generate very little money relative to the value of their stock. Now nVidia currently has the highest price to earnings ratio of any company. In PE Ratios, higher=BAD. it means Over valued.

Lets go back to walmart. While their Profit margin is only 3%, they MADE $157B in profits in 2024
 
again you missed the point.

But thats understandable.

99% of people in these forums want to have discussion and get along with each other, you? not so much.

Go back to Reddit.
I kept it civil until you tried to 'correct' me so confidently. I’m not missing the point, I’m addressing the one you brought up.

If 99% of people want to have discussions and get along, maybe starting with less absoluteness in your comments would help foster that. But hey, you do you ;-)
 
If it is the software, then why did they have to create this new power connector?
I would argue that they are pushing everything to the max.
The result: leading GPUs in the last 10 years
 
If it is the software, then why did they have to create this new power connector?
I would argue that they are pushing everything to the max.
The result: leading GPUs in the last 10 years
They make you buy a new GPU for the opportunity of using their software. And while YOU might not pay for it, the developers certainly pay for it. Then gamers end up paying for it anyway in the form of development costs and bad gameplay because devs introduce lootboxes and MTX to make up the difference
 
Nvidia can churn out license locked tools to their heart's contentment but in reality any widespread adoption (I mean real adoption, at actual scale and not for making headlines) will take place under open source software. The real power of AI currently, is not the results, but the hungry investors' fears of missing out.
 
I've been saying this for years. For AMD to compete with nvidia, it needs to have a full software stack.

nvidia has turnkey solutions in pretty much all its offerings, be it gaming, AI, Machine learning, robotics, selfdriving, media creation, 3d rendering, etc.
 
In my humble opinion, Nvidia is a very mediocre software company with a lot of unfinished or problematic software solutions, CUDA libraries excluded. Some unresolved issues:

- massive performance and latency issues with bugged drivers - I'm not talking about gaming (which is fine on my side), I mean productivity and general 'snappiness' in windows itself, even when the GPU is in idle state. Just google Latencymon and Nvidia.

- crashes in Adobe products (Premiere Pro and After Effects), where the official bugfix is to do a fallback to an outdated driver. And then it's a wait and hope game if they can fix it in the next version. Thankfully it's not a long wait as Nvidia releases an endless stream of updates (that's never a good sign for stable software, btw).

- the antique Geforce control panel. Fire it up and be welcomed by an oldschool Windows XP-looking GUI. Dude, that driver GUI felt already outdated with Windows 7. I'm aware of the new NVIDIA app, but that is bug ridden too (the new app overlay can sometimes cause massive fps drops for gamers). I think the new app was almost a full year essentially in beta because of all those sw issues. And now it's good? Just try it out for yourself. And just consider how long it took them to produce some kind of an update, then rushing it out with those bugs.

Just for context: I'm not a hater, I'm not saying a competitor has better drivers. I am a long term Nvidia user (creator and gamer). Right now I own a 4090 and I will make the switch to the new 5090 as soon as it launches. That being said, not everything they do is great in my eyes. But they do have a great proprietary software strategy, I give them that. Certainly Nvidia wants to be seen as the leading software company in AI while the AI gold rush is on. And they will stay valid, because right now there is no way around CUDA, not because it's flawless, but because it's the oldest (19yrs) and therefore most referenced software of it's kind.

But from my point of view they have a very underperforming track record in software, drivers and bugfixing. I even doubt they have a legitimate sized testing practice or established test governance.

Yes Nvidia, please BE a proper software company!

My two cents, your mileage may vary.
 
Last edited:
- crashes in Adobe products (Premiere Pro and After Effects), where the official bugfix is to do a fallback to an outdated driver. And then it's a wait and hope game if they can fix it in the next version. Thankfully it's not a long wait as Nvidia releases an endless stream of updates (that's never a good sign for stable software, btw).
It does crash randomly Photoshop and Lightroom as well, regardless of the driver version used.
People complain about AMD’s drivers but Nvidia has its share of issues as well.
 
Back