海角大神

Yesterday, SpaceX and Telsa motors founder Elon Musk donated $10 million to help save the world 鈥� or so he thinks.

Musk鈥檚 donation went to the Future of Life Institute (FLI), a 鈥渧olunteer-run research and outreach organization working to mitigate existential risks facing humanity.鈥� To that end, Musk鈥檚 money will be distributed to like-minded researchers around the world. But what exactly are these 鈥渆xistential risks鈥� humanity is supposedly pitted against?

As the memory storage and processing of computers steadily approaches that of the human brain, some predict that an artificial 鈥渟uperintelligence鈥� is just on the horizon. And while the prospect has the scientific community buzzing about the possibilities, some academics are hesitant. Musk and others see artificial intelligence as a dangerous new frontier 鈥� and perhaps a threat . Crazy? Maybe not, according to a growing list of prominent scientific thinkers.

"There are seven billion of us on this little spinning ball in space. And we have so much opportunity," MIT professor and FLI founder Max Tegmark the Atlantic. "We have all the resources in this enormous cosmos. At the same time, we have the technology to wipe ourselves out."

And the FLI isn鈥檛 just some social club for rich weirdos. Stephen Hawking and Morgan Freeman are both on the organization鈥檚 scientific advisory board, bringing brain power and star power to its support base. Skype creator Jaan Tallinn co-founded the group. The rest of the board is comprised of academics with pedigrees from Harvard, MIT, and Cambridge University.

Oxford University鈥檚 Nick Bostrom, who is also on the board, wrote an entire book on the subject of AI takeover:聽Superintelligence: Paths, Dangers, Strategies. In its preface, he writes:

鈥淚n principle, we could build a kind of superintelligence that would protect human values. We would certainly have strong reason to do so. In practice, the control problem 鈥� the problem of how to control what the superintelligence would do 鈥� looks quite difficult. It also looks like we will only get one chance. Once unfriendly superintelligence exists, it would prevent us from replacing it or changing its preferences. Our fate would be sealed.鈥�

In the works of science-fiction writer Isaac Asimov, intelligent machines are bound by 鈥淭he Three Laws of Robotics,鈥� which forbid them to cause harm to humans. But that wouldn鈥檛 necessarily work in the real world, Bostrom writes. He suggests that superintelligences might respond to human requests with perverse instantiation 鈥� that is, they could achieve a desired outcome by unintended means. For example, a superintelligence programmed to make us happy would choose the most efficient and effective way of doing so 鈥� by implanting electrodes into the pleasure centers of our brains.

As dire as it all sounds, the FLI鈥檚 isn鈥檛 to halt the progress of artificial intelligence research. Instead, it hopes to ensure that AI systems remain 鈥渞obust and beneficial鈥� to human society.

"Building advanced AI is like launching a rocket,鈥� Tallinn stated in a press release. 鈥淭he first challenge is to maximize acceleration, but once it starts picking up speed, you also need to to focus on steering."

But if superintelligent AI really does pose a threat to mankind, how do we assess that threat? How can humans anticipate the actions of a fundamentally more intelligent machine? Of a being that became sentient not through Darwinian natural selection, but by human ingenuity?

The members of FLI don鈥檛 have the answers. They just want the scientific community to start asking the questions, Tegmark says.

"The reason we call it The Future of Life Institute and not the Existential Risk Institute is we want to emphasize the positive," Tegmark . "We humans spend 99.9999 percent of our attention on short-term things, and a very small amount of our attention on the future."