A robotaxi, a collision, and the bumpy road to an AI future
Loading...
| San Francisco
While artificial intelligence promises to transform society in major ways, driverless taxis offer a stark example of the bumpy road the technology faces before it reaches its potential.
In California, for example, a serious collision involving a robotaxi is forcing the state to reevaluate its growing push into driverless technology.
Last week, the California Department of Motor Vehicles suspended the right of Cruise to operate driverless taxis in the state after one of its San Francisco robotaxis hit and dragged a woman some 20 feet on Oct. 2. The state agency accuses the company, a unit of General Motors, of failing to disclose that dragging incident 鈥 a charge the company denies. Cruise has since paused all its driverless operations in the United States, it announced, in order to 鈥渆xamine our processes, systems, and tools and reflect on how we can better operate in a way that will earn public trust.鈥
Why We Wrote This
A story focused onA recent collision in San Francisco was initiated by humans but also brought safety hurdles for driverless cars into sharp relief. It highlights the role regulators will play in the issue of new technology and public trust.
The irony is that everyone agrees that people triggered the incident, not the robotaxi. But that fact may not be enough to save the company 鈥 and perhaps the driverless taxi industry as a whole 鈥 from serious reputational harm. It is the latest example of how regulation of young technologies can shape emerging industries and public perceptions in unexpected ways, and gaps in that regulation can prove as hazardous as the technology itself.
It鈥檚 a particularly timely lesson as various forms of AI begin to course through the economy and society.聽
鈥淭his is early days, and it is the Wild West of policy, particularly at the state level,鈥 says Billy Riggs, a University of San Francisco professor who studies transportation innovation. 鈥淭here鈥檚 a perception that somehow the technology isn鈥檛 ready. And I would say many times perception can become reality.鈥澛
Increasingly ubiquitous in San Francisco
For months now, San Franciscans have become increasingly familiar with the sight of cabs with rooftops brimming with sensors and laser radar moving about the city with no one at the wheel. Besides Cruise, Waymo (owned by Google parent Alphabet) and Zoox (an Amazon subsidiary) have deployed the technology here, although Zoox still has operators in the driver鈥檚 seat, just in case.聽
While the public can now use robotaxis in a growing number of cities, such as Austin and Phoenix, San Francisco鈥檚 dense population, narrow streets, and hills pose some of the toughest challenges for the technology. The reaction has been mixed.
鈥淲e love Cruise!鈥 says Alyssa Guevara, a junior at the University of San Francisco. During her first trip in January, when driverless cabs were still in the testing phase and rides were free, her robotaxi started to pull around a double-parked car into the opposite lane and stopped. Then a firetruck came toward her, unable to proceed. She and her friend used the car鈥檚 internal communication to reach an operator. Within five minutes a Cruise employee entered the car and moved it.
鈥淚 wasn鈥檛 worried,鈥 says Ms. Guevara. 鈥淚 honestly felt really safe in a weird way.鈥 Since then she has taken more Cruise rides than she can count, although none since the company started charging for service in August.
A threat to human jobs?
San Francisco cab drivers, by contrast, are wary. New technology, in the form of ride-sharing apps from Lyft and Uber, blindsided their industry nearly a decade ago. And because Lyft and then Uber were able to use their technology to turn anyone into a cab driver without the costs of training or taxi medallions 鈥 a regulatory gray area 鈥 employment in the taxi industry plummeted.
鈥淲hen Uber and Lyft came in, it basically meant that an amateur could do a professional鈥檚 job,鈥 says Mark Gruberg, co-manager of Green Cab LLC. At its peak in the early 2010s, the tiny driver-owned company had 19 taxis; it now has eight. Many cab drivers, who bought a taxi medallion (a city-issued license) for up to $250,000 before Uber and Lyft took off, have quit, sitting on mountains of debt with medallions that are nearly worthless. Longtime San Francisco cabbie Matthew Sutter still owes $150,000 on his. Mr. Gruberg expects more drivers to retire if the new wave of AI floods in聽as driverless cabs.
鈥淭hey don鈥檛 wait in taxi lines; they don鈥檛 take a break; they don鈥檛 stop; they don鈥檛 have to go to the bathroom,鈥 says Evelyn Engel, a cab driver and executive board member of the San Francisco Taxi Workers Alliance. 鈥淎nd if they鈥檙e not with a passenger, they鈥檒l keep driving because they鈥檒l be mapping and updating software and so forth. ... The Utopian vision is that everybody will take a self-driving car. We can get rid of parking lots at Safeway and parking lots downtown. But the flip side of that is that there won鈥檛 just be a rush hour; there鈥檒l be cars constantly on the road, circling the block if nothing else.鈥
Still, the regulation that didn鈥檛 protect local cabbies from the rise of Uber and Lyft may still offer them some protection. Many of the nearly worthless medallions still allow traditional taxis to pick up passengers from the airport, which Uber, Lyft, Waymo, and Cruise聽cannot do. Ditto for transportation for people with disabilities, a franchise the city pays only taxi drivers to provide.聽
Instead, it appears the gig workers at Uber and Lyft 鈥 those with the least regulatory protection 鈥 are most at risk from the technology.
鈥淚 hate it,鈥 says one San Francisco Uber driver, who declined to give her name. 鈥淭he reason I hate them [the driverless cabs] is that they are taking away jobs in the future.鈥 She drives up to 40 hours a week. It is her only employment.
The technology has also irritated a growing number of San Francisco drivers and city workers who have had to deal with a series of problems and delays caused by the robotaxis. The public backlash began in August in the city鈥檚 North Beach neighborhood, a day after the California Public Utilities Commission allowed Cruise and Waymo to move from a limited test phase to round-the-clock operation and charging for rides.
Publicized problems
鈥淚t happened right there,鈥 says Aaron Peskin, president of the San Francisco Board of Supervisors, pointing to the intersection of Vallejo and Grant streets from his chair outside Caffe Trieste. Ten聽Cruise taxis inexplicably came to a halt here on聽Aug. 12, blocking all traffic on both one-way streets and causing a massive traffic jam. Heavy cellphone use during a local musical festival limited the available wireless bandwidth, Cruise says, delaying the company鈥檚 remote operators to move the cars out of the way.
Four days later, a Cruise cab plowed through traffic cones and drove into freshly poured concrete. That same month, a Waymo vehicle came to a stop between a fire engine and a car on fire. That forced firefighters to carry their hose around the taxi to fight the blaze.
The fire department alone has logged dozens of incidents in which the driverless cars have interfered with emergency personnel, including running over fire hoses and blocking fire trucks and other emergency vehicles, according to Deputy Fire Chief Darius Luttropp. The city鈥檚 fire chief says driverless cabs are not ready for prime time.
The companies point out that such incidents are rare exceptions. In San Francisco and Phoenix, where Waymo is also active, 鈥渢he Waymo Driver encounters active emergency vehicles approximately once per 100 miles, which equates to over a 100 encounters per day,鈥 the company said in an email. 鈥淭he vast majority of these often challenging and complex encounters have been without issue.鈥
Cruise, with the most robotaxis in San Francisco, has come in for the lion鈥檚 share of the criticism. After two nonfatal car crashes in mid-August, one involving a fire truck in emergency mode that hit a Cruise cab, the state DMV stepped in. Cruise agreed to halve the number of cabs operating in San Francisco while the department investigated. Now, the department has suspended indefinitely the company鈥檚 driverless cars from the state, although Cruise can still test its cars if there鈥檚 a safety driver.
This month鈥檚 dragging incident represents the biggest challenge yet for Cruise, which has been harboring plans to expand to many other cities.
After the Oct. 2 collision, the company initially was eager to share its video of the incident with reporters, says Brad Templeton, chairman emeritus of the Electronic Frontier Foundation and a self-driving car consultant. He asked for and received the video, which showed a woman crossing an intersection against the light, and then getting hit by a human driver and deflected into the path of Cruise鈥檚 robotaxi. The driverless car began braking but couldn鈥檛 avoid hitting the woman.
What the partial video did not show was what happened after the collision. The car came to a stop and then moved slowly to the curb, as it was programmed to do, dragging the woman with it. This incident poses two challenging questions for the company: (1) Did it cover up the incident? (2) Are its cars really safer than human drivers, as it claims?聽
The company claims it was fully open about the incident with regulators. Cruise鈥檚 immediate focus was to prove its car did not trigger the incident and to help police track down the driver who did. (He or she fled the scene). So it shared the video that was immediately available, which only showed the events up to the initial collision, not the dragging incident later.
Cruise says it quickly alerted federal and state regulators, requested a meeting the following day, showed the full video, and answered questions. The National Highway Traffic Safety Administration confirms it got the full video the following day. The state DMV says it did not. In its order last week suspending Cruise鈥檚 right to operate driverless taxis in California, the department allowing its actions if the manufacturer 鈥渉as misrepresented any information related to safety of the autonomous technology of its vehicles.鈥澛
What future for robotaxis?
Unlike certain forms of AI, such as ChatGPT, that try to mimic humans鈥 common sense, driverless taxis strictly follow a set of rules based upon millions of miles of driving experience. For example, when the robotaxi dragged the pedestrian to the curb, its protocol apparently contained no exception for people caught under the car.
Cruise will be back on the streets of San Francisco, predicts Mr. Sutter, the taxi driver. 鈥淭here鈥檚 so much money invested that they won鈥檛 just give up on this,鈥 he says. But 鈥渋n the end of it all, it鈥檚 not going to work. I really think there鈥檚 just going to be too much liability involved.鈥
Statistically speaking, robotaxis may ultimately prove to be safer than human drivers. They don鈥檛 speed, or get sleepy or inebriated. And the incidents that do occur, as regrettable as they are, allow the companies to tweak the software so the cars quickly become safer fleetwide.
鈥淭hese vehicles are never going to be perfect,鈥 says Mr. Templeton, the consultant. 鈥淭he question that we鈥檒l want to know is: Will the public feel that the serious accidents, which will happen, are a black eye for the whole industry? Or is there something where you say, that鈥檚 terrible, but at least it鈥檚 happening less often than it is with all the people who are driving?鈥