Facebook's poker-playing AI beats world's top pros in multiplayer game

midian182

Posts: 7,435   +67
Staff member

We’ve already seen artificial intelligence get the better of humans in Go, Chess, and computer games such as DOTA 2 and Starcraft II. Back in 2017, Libratus, an artificial intelligence program developed at Carnegie Mellon University, beat four professional poker players in 1-on-1 games.

Libratus’ successor, Pluribus, went one better. Designed by researchers from Facebook’s AI lab and Carnegie Mellon, it played over 10,000 hands of poker against five pros—all of whom have won at least $1 million during their poker careers—winning a virtual $48,000. Pluribus also played games against one human and four versions of itself, but the bots could not communicate with each other, preventing any collusion. The program won an average of $5 per hand, taking about 20 seconds to play each one, with hourly winnings of around $1,000.

“It’s the first time AI has achieved superhuman performance in a multiplayer game,” said Tuomas Sandholm, who developed Pluribus alongside Noam Brown.

To deal with the complexity of playing multiple opponents, Pluribus was designed to predict just two or three moves ahead, rather than trying to work out how they would play all the way to the end of the round. It’s said to be an excellent bluffer, and its unpredictability makes the AI difficult to play against.

As with other AIs, Pluribus mastered poker by playing copies of itself, learning the game and slowly improving over eight days and hundreds of thousands of hands. The program was created using a 64-core server packed with less than 512GB of RAM, but it runs on two Haswell processors and uses 128GB during games.

Beyond playing multiple opponents at poker, Pluribus has applications in several areas, including investment banking, self-driving cars, negotiating, and wargames—the US Army Research Office contributed to the project’s funding.

Permalink to story.

 

Ean Mogg

Posts: 173   +79
Does it play the 'Poker' game on the same computer that the AI is on? So given it an advantage perhaps or plays on it's own computer ?
 
Part of poker and much of player vs player/dealer gambling is reading the opponent. Not surprised a metal box was hard to beat.
 

Mugsy

Posts: 745   +181
One major No-No in gambling is "counting cards" (remembering which cards have already been seen to guesstimate what cards your opponent(s) has/have and you may get next.)

There is simply no way to stop an "AI" from doing this, and will do so with near perfection as it is incapable of forgetting which cards it has already seen, so it's going to win just about every time.

This doesn't mean the AI is "smarter". It means the programmers didn't program into it the (dis)ability to forget.