Nvidia's Hopper H100 pictured, features 80GB HBM3 memory and impressive VRM

[Tudor Cibean]

Bottom line: Nvidia took the wraps off its Hopper architecture at GTC 2022, announcing the H100 server accelerator but only showing off renders of it. Now we finally have some in-hand photos of the SXM variant of the card, which features a mind-boggling 700W TDP.

It's been a bit over a month since Nvidia unveiled their H100 server accelerator based on the Hopper architecture, and so far, we've only seen renders of it. That changes today, as ServeTheHome has just shared pictures of the card in its SXM5 form factor.

The GH100 compute GPU is fabricated on TSMC's N4 process node and has an 814 mm2 die size. The SXM variant features 16896 FP32 CUDA cores, 528 Tensor cores, and 80GB of HBM3 memory connected using a 5120-bit bus. As can be seen in the images, there are six 16GB stacks of memory around the GPU, but one of these is disabled.

Nvidia also quoted a staggering 700W TDP, 75% higher than its predecessor, so it's no surprise that the card comes with an extremely-impressive VRM solution. It features 29 inductors, each equipped with two power stages and an additional three inductors with one power stage. Cooling all of these tightly packed components will probably be a challenge.

Another noticeable change is the connector layout for SXM5. There's now a short and a long mezzanine connector, whereas previous generations featured two identically sized longer ones.

Nvidia will start shipping H100-equipped systems in Q3 of this year. It's worth mentioning that the PCIe version of the H100 is currently listed in Japan for 4,745,950 yen ($36,300) after taxes and shipping, although it has fewer CUDA cores, downgraded HBM2e memory, and half the TDP of the SXM variant.

Permalink to story.

https://www.techspot.com/news/94499-nvidia-hopper-h100-pictured-features-80gb-hbm3-memory.html

 

[Mr Majestyk]

With great power comes great power usage no doubt.

 

[captaincranky]

With great power comes great power usage no doubt.

Not to mention great price. I wonder if they'll release an "entry level" version, at the customary $150.00 price point.

 

[takaozo]

Just curious how the final colling might look. 700W in a 1.5-2 square inch surface.......

 

[Adhmuz]

Just curious how the final colling might look. 700W in a 1.5-2 square inch surface.......

That's actually a lot of surface area when compared to what the 12900k has, which at 208mm² pushes 300 watts. 700 watts into 814mm² doesn't look nearly as bad anymore.

 

[Geralt]

That's actually a lot of surface area when compared to what the 12900k has, which at 208mm² pushes 300 watts. 700 watts into 814mm² doesn't look nearly as bad anymore.

It is 200W higher than what an average iron consumes. It's totally crazy. I have to pass.

 

[Beerfloat]

It is 200W higher than what an average iron consumes. It's totally crazy. I have to pass.

You were going to buy one until you read about its power requirements?

 

[Sausagemeat]

You were going to buy one until you read about its power requirements?

Maybe he only has the $36K for the card and there isn’t enough money left in his budget to power it for a year at 700w. But at 500w he would have just about had enough. Such a shame, dam Nvidia, they are always dumping on the little guys.

 

[Geralt]

You were going to buy one until you read about its power requirements?

Yes.

 

[Ludak021]

Let's see how many corners will AIBs cut to make more money. First to go: power section, gotta make those <$10 at most...

 

[mbk34]

I've read the article, I know the products name, I can see a photo, I've read the specs and even understand that it kicks out a lot of heat. What I don't understand is what the hell the thing is or what it's used for.

 

[elementalSG]

Finally, something that can run Crysis without a doubt! Only needs 700Ws!

 

[wiyosaya]

I've read the article, I know the products name, I can see a photo, I've read the specs and even understand that it kicks out a lot of heat. What I don't understand is what the hell the thing is or what it's used for.

Certainly not for Crysis! HPC is your answer, my friend.

 

[mbk34]

HPC is your answer, my friend.

High Performance Computing? Concrete? Can you explain how these devices help and what sort of applications they're used in. And why are they aimed at servers rather than dedicated computers?