Microsoft and OpenAI built a supercomputer with 285,000 CPU cores and 10,000 GPUs

nanoguy

Posts: 458   +4
Staff member

At its virtual Build 2020 developer conference, Microsoft revealed several interesting sneak peeks into its latest efforts to unify Windows 10 app development, offer more useful tools for power users, and integrate more Linux goodies via the Windows Subsystem for Linux.

A less talked about but still interesting announcement at the event is that Microsoft has partnered with OpenAI to make one of the top five AI supercomputers out there. The beast is essentially an Azure-linked supercomputer that's built specifically to test OpenAI's artificial intelligence models, from the ones that write believable fake news and beat you at Dota 2, to the more practical ones that can improve robotics and decision-making.

Microsoft didn't go too deep into the technical details of the new supercomputer, but it did say that it consists of more than 285,000 CPU cores coupled with 10,000 GPUs grouped into servers equipped with 400 gigabits per second of network bandwidth.

The main reason why the company is throwing so much compute power into AI applications is that models are almost doubling in size every few months. For instance, Microsoft's Turing model for natural language processing has ballooned to 17 billion parameters from just one billion it had one year ago.

Last year, Microsoft entered a multi-year partnership with OpenAI, pouring $1 billion into the AI company started by Elon Musk to have it use Azure in training AIs. But more importantly, the fact that OpenAI chose Azure as its cloud platform of choice is yet another win for Microsoft on that front.

Permalink to story.

 

SilentMarket

Posts: 16   +5
Microsoft is a software vendor that doesn't do hardware stuff.
They don't make the CPU, they don't make the GPU. They assemble them and call it a build and that is pretty much every showcase of a supercomputer if you have enough resources.
 
  • Like
Reactions: Reehahs

dpj620

Posts: 9   +5

SilentMarket

Posts: 16   +5

dpj620

Posts: 9   +5
It is for the show because the competitor Google triggers it. Look at both Microsoft and Google, do they produce their own chips and make something on their own at a large quantity for the customer? Never. Better fix the more bugs on the Windows bugs instead.
Tired: Why don't they fix the bugs in Windows
Wired: 8 quantum labs around the globe is just for show
 
  • Like
Reactions: TempleOrion

SilentMarket

Posts: 16   +5
Tired: Why don't they fix the bugs in Windows
Wired: 8 quantum labs around the globe is just for show
The world doesn't need "loyal" customers like you. In the meanwhile, I can tell you know nothing about quantum computers, it is experimental and limited. It is not a replacement. Again, a show is a show. You won't be able to use a supercomputer anyway, why bother telling me what it feels like?