Artificial intelligence can learn Atari games from scratch, say scientists
Is a robot uprising coming in 2015?
Maybe 鈥� but only to show you up at the arcade.
Led by researchers Demis Hassabis and Volodymyr Mnih, Google-owned DeepMind Technologies has created an artificial intelligence capable of playing simple video games with minimal training. They their breakthrough today in Nature.
Dubbed the deep Q-network agent (or DQN), DeepMind鈥檚 program can play a number of popular Atari 2600 titles, including 鈥楶ong,鈥� 鈥楽pace Invaders,鈥� and 鈥楤reakout.鈥� According to the study, it is 鈥渢he first artificial agent that is capable of learning to excel at a diverse array of challenging tasks.鈥�
Video game-playing AI already exists, as any lonely gamer can tell you. In the absence of a real human opponent, most games allow players to challenge the 鈥渃omputer.鈥� But in those games, the AI is endowed with a series of specific rules that guide its behavior. DQN, on the other hand, is given only one objective 鈥� maximize the score. From there, it 鈥渨atches鈥� the gameplay to learn new strategies in real time. Like the human brain, it learns from experience.
鈥淚t looks trivial in the sense that these are games from the 80s and you can write solutions to these games quite easily,鈥� Dr. Hassabis, who co-founded DeepMind, BBC. 鈥淲hat is not trivial is to have one single system that can learn from the pixels, as perceptual inputs, what to do. The same system can play 49 different games from the box without any pre-programming. You literally give it a new game, a new screen and it figures out after a few hours of gameplay what to do.鈥�
Perhaps more impressively, DQN can take these strategies and apply them to games it hasn鈥檛 played before. In other words, when DQN gets better at one video game, it鈥檚 actually getting better at a whole host of games.
The program is far from perfect, however. While it rivals human players in action-oriented games, it struggles with more open-ended titles.
鈥淕ames where the system doesn't do well are ones that require long-term planning,鈥� Dr. Mnih NBC. 鈥淔or instance, in Ms. Pac-Man, if you have to get to the other side of the maze you have to perform quite sophisticated pathfinding and avoid ghosts to get there.鈥�
As DeepMind prepares DQN for ever more complex gameplay, an even greater potential waits on the horizon. Even more so than chess, video games can provide a model of the real world 鈥� one that requires intricate, adaptive decision-making. Researchers remain silent on exactly what real-world functions they have planned, but slyly noted that their program could someday drive a real car with 鈥渁 few tweaks.鈥� Does that mean DQN could go from Mario Kart champ to digital chauffeur? Only time will tell.
