海角大神

Someday soon, you will ask a robot to fetch a slice of pizza from your refrigerator. On that day, you鈥檒l trust that the robot won鈥檛 tear through your walls and rip the fridge door off its hinges to get at your leftovers.

Getting robots to do the things humans do in the ways that humans do them (or better) without human intervention is an immensely wicked problem of autonomy. With as many as half of American jobs at risk of automation according to one study, and with an expected 10 million self driving cars on the road by 2020, robots are going to be everywhere, forever, and they won鈥檛 go away.

The enormous scope and scale of how autonomous robots will begin changing our lives requires the public and technologists alike to consider the challenges of autonomy.

Where will we allow robots to intercede into our lives? How do we make ethical judgments about the behavior of robots? What kind of partnerships will we develop with them?

These are big questions. And one key challenge at the core of many of them is, in roboticist-talk, what it means to establish 鈥渕eaningful human control,鈥� or sufficient oversight over an autonomous agent.聽

To get a grip on our autonomous future, we鈥檒l need to figure out what constitutes 鈥渆nough鈥� oversight of a machine imbued with incredible intelligence.

Today, most robots are made to accomplish a very specific set of tasks within a very specific set of parameters, such as geographic or time limitations, that are tied to the circuits of the machine itself.

鈥淲e鈥檙e not at the stage where robots can do everything that humans can do,鈥� says Dr. Spring Berman, assistant professor of mechanical and aerospace engineering at Arizona State University. 鈥淭hey could be multi-functional but they鈥檙e limited by their hardware.鈥�

Thus, they need a human hand to help direct them toward a specific goal, in a futuristic version of ancient dog and human partnerships, says Dr. Nancy Cooke, a professor of human systems engineering at ASU, who studies human-machine teaming.

Before dogs can lead search and rescue teams to buried skiers or sniff out bombs, they require an immense amount of training and 鈥渙n-leash鈥� time, Cooke says, and the same level of training is necessary for robots, though that training is usually programmed and based on multiple tests as opposed to the robot actually 鈥渓earning.鈥�

Even after rigorous 鈥渢raining鈥� and vetting against a variety of distractions and difficulties, sometimes robots still do things they aren鈥檛 supposed to do because of quirks buried in their programming. In those cases, someone needs to be held accountable if the robot goes outside of its boundaries.

鈥淚t can鈥檛 be some patsy sitting in a cubicle somewhere pushing a button,鈥� says Dr. Heather Roff, a research scientist at ASU鈥檚 Global Security Initiative and senior research fellow at Oxford University. 鈥淭hat鈥檚 not meaningful.鈥�

Based on her work with autonomous weapons systems, Dr. Roff says she is also wary of the sentiment that there will always be a human around.

鈥淎 machine is not a morally responsible agent,鈥� she says, 鈥渁 human has to have a pretty good idea of what he鈥檚 asking the system to do, and the human has to be accountable.鈥�

The allure of technology resolving problems difficult for humans, like identifying enemy combatants, is immense.

Yet technological solutions require us to reflect deeply on the system being deployed: How is the combatant being identified? By skin tone, or gender or age or the presence or absence of certain clothing? What happens when a domestic police force deploys a robot equipped with this software? Ultimately, whose finger is on the trigger?

Many of the ethics questions in robotics boil down to how the technology could be used by someone else in the future, and how much decision-making power you give to a robot, says Berman.

鈥淚 think it鈥檚 really important that a moral agent is the solely responsible person [for a robot],鈥� says Roff. 鈥淗umans justify bad actions all the time even without robots. We can鈥檛 create a situation where someone can shirk their moral responsibilities.鈥�

And we can鈥檛 allow robots to make decisions without asking why we want robots to make those decisions in the first place. Answering those questions allows us to understand and implement meaningful human control.