Poker Pros Barely Beat Bot

In the Brains Vs. Artificial Intelligence poker competition last week, the human players won, sort of.

Thomas Claburn, Editor at Large, Enterprise Mobility

May 11, 2015

3 Min Read
<p align="left">Image: Rivers Casino</p>

Beyond Apple Watch: What's Next In Wearables

Beyond Apple Watch: What's Next In Wearables

Beyond Apple Watch: What's Next In Wearables (Click image for larger view and slideshow.)

At Pittsburgh's Rivers Casino last week, the brains battled a bot to a narrow win in Texas Hold'em poker -- or to a draw, depending on whom you ask.

Four top poker players collectively played 80,000 hands of Heads-up No-limit Texas Hold'em (two players) against an artificial intelligence program called Claudico over the course of two weeks.

At the end of the Brains Vs. Artificial Intelligence competition, three of the four players had more money than the computer. Together the human players' winnings exceeded Claudico's by $732,713.

Bjorn Li, Doug Polk, and Dong Kim led Claudico by $529,033, $213,671, and $70,491, respectively. Jason Les trailed Claudico by $80,482.

But given that $170 million was bet during the contest, the human monetary edge amounts to less than half a percentage point of that total -- a statistical tie.

"From how well Claudico played, I think it was balanced and a strong opponent, but I don't want this misrepresented as a tie," countered Polk in a tweet.

Polk also characterized Claudico as a "strong opponent" in a videotaped statement, praising the computer program's balanced approach to solving poker problems. But he observed that the AI made unusual decisions, like betting $19,000 to win what was then a $700 hand. "That's not a human thing, that's a computer thing," he said, noting that people are more reluctant to wager so much money.

No actual betting took place. The humans each received a fee from a prize purse of $100,000 donated by Rivers Casino and Microsoft Research.

Claudico's creator didn't characterize the outcome as a defeat.

"It would have been no shame for Claudico to lose to a set of such talented pros, so even pulling off a statistical tie with them is a tremendous achievement," said Tuomas Sandholm, the professor of computer science at Carnegie Mellon University who led Claudico's development, in a statement.

Last July, a predecessor of Claudico, Tartanian7, won a Heads-up No-limit Texas Hold'em contest against other AI bots at the Association for the Advancement of Artificial Intelligence's 2014 Computer Poker Competition.

Sandholm said that beating top human poker players isn't the goal, though he contends AI will soon be able to do so. The aim of his work is to create an artificial intelligence system that can make decisions based on incomplete information, a feat that has applications in a wide variety of fields, including business, cybersecurity, and medicine.

Claudico runs on the Pittsburgh Supercomputing Center's Blacklight computer, an SGI UV 1000cc-NUMA shared-memory system comprising 256 blade servers, each with two Intel Xeon X7560 (Nehalem) eight-core processors. The human players used their own laptops at the casino to connect to Claudico.

In a way, each side won: The humans got to declare victory, statistics be damned, and the machine got 80,000 poker hands to study for its eventual dominance.

About the Author(s)

Thomas Claburn

Editor at Large, Enterprise Mobility

Thomas Claburn has been writing about business and technology since 1996, for publications such as New Architect, PC Computing, InformationWeek, Salon, Wired, and Ziff Davis Smart Business. Before that, he worked in film and television, having earned a not particularly useful master's degree in film production. He wrote the original treatment for 3DO's Killing Time, a short story that appeared in On Spec, and the screenplay for an independent film called The Hanged Man, which he would later direct. He's the author of a science fiction novel, Reflecting Fires, and a sadly neglected blog, Lot 49. His iPhone game, Blocfall, is available through the iTunes App Store. His wife is a talented jazz singer; he does not sing, which is for the best.

Never Miss a Beat: Get a snapshot of the issues affecting the IT industry straight to your inbox.

You May Also Like

More Insights