海角大神

Where are all the space hotels? Why smart people make terrible forecasts.

Virgin Galactic is in good company when it comes to aerospace organizations over-promising on their ability to deliver new technology, suggesting that accurate project management may actually be harder than rocket science. 

|
Lefteris Pitarakis/AP/File
British billionaire Richard Branson poses in 2012 in the window of what, according to the company, would be the world鈥檚 first commercial spaceplane. At the time, the company expected commercial flights to begin by 2016; however, they did not.

If all had gone according to plan, the James Webb Space Telescope (JWST) would be celebrating its of capturing stunning portraits of distant galaxies,聽NASA would be hard at work on its , Virgin Galactic would be running聽 to the edge of space for just $50,000 a head, and a Russian company would be doing brisk business with its .

Of course, that's not how it worked out in reality. Last month, Virgin Galactic made its that 鈥渘ext year鈥 it will finally shuttle tourists to space, joining the JWST on the horizon of 2018, and the inaugural mission of NASA's new Space Launch System . As for that space hotel, don't ask.聽

Planning for the future is part of what it means to be human, but cognitive biases, development challenges, and financing conventions conspire to make accurate predictions next to impossible. With forecasting occupying a central role in our greatest ambitions from space to construction, economists and engineers alike are harnessing new tools that let the past inform the future, aiming to make prediction more science and less art.聽

At the root of the problem is the tendency to take the optimism generated by a grand idea and overlay that on the execution without applying the critical rigor required to foresee the inevitable hurdles that are likely to complicate the process. Known to psychology for decades, the Planning Fallacy describes the tendency to overstate chances of finishing tasks on time, despite memories of past projects having rarely gone as planned.

鈥淎pparently, people can know the past and still be ,鈥 wrote psychologist Roger Buehler in his 1995 paper on the topic.

Even the most conservative forecasts can fall prey to evidence-dismissing confidence. Of students asked to lay out a timeline that specifies the dates by which they felt 50 percent, 75 percent, and 99 percent sure they would have finished an academic project, fewer than half actually completed the assignment before the 99-percent prediction.

鈥淜ind of counterintuitively, it鈥檚 because people base their predictions too much on imagining and planning how the task is going to unfold,鈥 explains Dr. Buehler, a professor of social psychology at聽Wilfrid Laurier University. Most folks think through a mental simulation of completing various stages of the task and budget time accordingly.

鈥淭he problem with that approach is that those kinds of scenarios tend to be oversimplified, idealized, and don鈥檛 take enough obstacles into account,鈥 he continues. Indeed, another study found that only 3 percent of participants considered potential roadblocks during the planning process.

Even when reminded of past failed predictions, people tend to assume those were isolated mishaps, forgetting that there are countless ways for a plan to go wrong but only one way for it to go right.

When individuals gather into groups, the situation gets even worse. 鈥淚f the team is all invested in the project, getting together and planning it out as a group in fact exacerbated the bias,鈥 says Buehler. Apparently, no one wants to be a Negative Nancy.

It鈥檚 basically impossible for an individual to overcome his or her optimism bias, according to megaproject management scholar Bent Flyvbjerg. 鈥淭hese are very basic human mechanisms that apply in all walks of life,鈥 he says. 鈥淓xperts, including myself, are just as optimistic as laypeople. Just because you know you鈥檙e optimistic doesn鈥檛 mean that you鈥檙e not optimistic.鈥

Such optimism often leads to underestimating the chance of unknown unknowns derailing your project, so planning experts suggest a technique called , where project planners learn from past risk by predicting overruns based on how similarly complex projects fared before.

鈥淚ndependent researchers have found that reference class forecasting is the most accurate forecasting method that you can get,鈥 says Dr. Flyvbjerg. 鈥淵ou cannot be optimistic because you鈥檙e taking out human judgement.鈥

The aerospace industry in particular could use some new tricks. Virgin Galactic doesn't release public estimates, but according to the US Government Accountability Office鈥檚 annual review, NASA鈥檚 large project costs have overrun budget by in each of the last nine years, a figure dominated by the ballooning costs of the JWST.

The outlines three prediction models: drawing holistic analogies to previous projects (if the Curiosity Mars rover cost this much, then the next lander might cost this much), calculating relationships between key characteristics and cost (perhaps聽doubling the mass doubles price), and building up itemized costs (this much for labor, this much for parts).

But when you鈥檙e attempting the unprecedented, be it space tourism or a Pluto probe, how do you build data-based models?聽

鈥淭hat is more difficult, but not impossible,鈥 says Flyvbjerg. 鈥淧eople often think of their projects as more unique than they actually are.鈥

Not one to back down from a challenge, NASA聽in 2013 and 2014 developed the software, which uses reference class forecasting tenets to predict the most uncertain of undertakings: creating new technology. Mining a database of over 3,000 past technology development projects, the program's creators isolated a handful of characteristics that showed predictive power, such as technology area and a classification scheme known as , or TRLs, which go from 1 (physically conceivable on paper) to 9 (mission proven).

Such tools formalize techniques that have proved effective, according to former ESA program manager Alan Thirkettle, who oversaw the development of the European ISS components. He describes a budgeting process that has long incorporated reference class forecasting type thinking, but one that may have varied between managers and facilities.聽

TCASE is just one of a suite of models, and how successful they鈥檒l prove remains to be seen. The 2016 GAO report congratulated NASA for slowing budget creep in recent years, but attributed it only in part to聽new project management tools, with the rest of the credit going to rising baseline estimates that hide percentage-wise growth.聽

What鈥檚 more, TCASE 聽to technologies in the early development stage. This period may be the most uncertain, but it counterintuitively accounts for less than a fifth of total development resources. A meta-study of a dozen NASA missions found that costs tend to explode toward the end, with dedicated to moving a technology from TRL 7 (space-ready prototype) to launch.

Mr. Thirkettle says this trend is standard, likening spacecraft development to building an electric car. Even if inventing long-range battery tech is tough, actually building the whole car costs much more. 聽鈥淭he system is far, far more expensive than the technology development part,鈥 he says.聽

Flyvbjerg suggests another reason, one to which newer organizations may succumb more easily. 鈥淥ften people get surprised at the end,鈥 he explains. 鈥淚f people have been hiding the uncertainties, which is very common human behavior, then you will actually have a blowout鈥 where all of a sudden reality hits the project and all the unpleasant, hidden things appear.鈥

These unavoidable features of the development cycle combine with cognitive bias to make even the best-laid plans go awry. But to make matters worse, even if reference class forecasting could roughly estimate the chance of unknown unknowns cropping up, it's hard to get advance funding for what-if scenarios.聽

"Historically you can say on the average project you might get somewhere between 5 and 10 percent of surprise that you just couldn鈥檛 foresee," says聽Thirkettle, but "you can't say give me an extra so many million because I may get a launch failure." Available money tends to get spent, so any rainy-day funds have to be carefully earmarked.聽

This paradox means that even though planners may expect delays, initially authorized plans often don't reflect that wisdom, making them closer to a best case scenario than a firm promise.

And space just exaggerates that challenge. "You tend to be fairly close to the state of the art so you can get surprises no matter how much discipline you try to put into things,"聽Thirkettle says.聽

You've read  of  free articles. Subscribe to continue.
Real news can be honest, hopeful, credible, constructive.
What is the Monitor difference? Tackling the tough headlines 鈥 with humanity. Listening to sources 鈥 with respect. Seeing the story that others are missing by reporting what so often gets overlooked: the values that connect us. That鈥檚 Monitor reporting 鈥 news that changes how you see the world.
QR Code to Where are all the space hotels? Why smart people make terrible forecasts.
Read this article in
/Science/Spacebound/2017/0601/Where-are-all-the-space-hotels-Why-smart-people-make-terrible-forecasts
QR Code to Subscription page
Start your subscription today
/subscribe