NPR : News

This Slide Shows Why Wouldn't Work At Launch

This is a story of contrast between two popular methods of software development. One is called "waterfall," the other, "agile."

Waterfall development favors listing a huge set of requirements for a system up front, letting developers go away for months (if not longer) and expecting a huge software product in the end.

The agile method does the opposite, favoring work done in phases, delivering "minimum shippable" parts of a software system in weekly or biweekly cycles. This allows for iterating — or adjusting to hiccups discovered in the previous cycle, changing features or quashing bugs quickly and avoiding getting an end product that doesn't look a thing like what your users need.

Like many government projects, was developed under the waterfall approach — and to its near doom.

In March, outside consultants from McKinsey & Co. were brought in to do a "red team," or outside progress report, on the system we know as That system includes a data "hub," or pipeline for verification of eligibility; a federal marketplace to shop for plans; and, ultimately, an interface to enroll in health insurance coverage.

The key findings in the presentation (below) come on Page 5. Even though it was written in March, the slide sums up most of the key problems we eventually saw with the rollout of last month: limited testing time, evolving requirements, over-reliance on contractors and "stacking" of all the phases of development. The really damaging decision, according to the consultants: launching "at scale." The exchanges for all 50 states opened on the same day, instead of a few states at a time, gradually opening the marketplaces in phases.

Consultants shared this presentation with many key people in the Obama administration, including Health and Human Services Secretary Kathleen Sebelius. The overall document warns of the waterfall approach's many problems for this project, as well as those unrelated to the style of software development process government was using.

Consultants noted there was no clear leader in charge of this project, which we now know contributed to its disastrous release. And there was no "end-to-end testing" of its full implementation, something we now know never happened.

The raw presentation is embedded below, with a few annotations I added for you to explore. You can jump from one annotation to another by clicking on the bolded notes on the right side of this embed. Or you can explore this at full screen.

Copyright 2013 NPR. To see more, visit


No Meekness Here: Meet Rosa Parks, 'Lifelong Freedom Fighter'

As the 60th anniversary of the historic Montgomery Bus Boycott approaches, author Jeanne Theoharis says it's time to let go of the image of Rosa Parks as an unassuming accidental activist.

Internet Food Culture Gives Rise To New 'Eatymology'

Internet food culture has brought us new words for nearly every gastronomical condition. The author of "Eatymology," parodist Josh Friedland, discusses "brogurt" with NPR's Rachel Martin.
WAMU 88.5

World Leaders Meet For The UN Climate Change Summit In Paris

World leaders meet for the UN climate change summit in Paris to discuss plans for reducing carbon emissions. What's at stake for the talks, and prospects for a major agreement.


Payoffs For Prediction: Could Markets Help Identify Terrorism Risk?

In a terror prediction market, people would bet real money on the likelihood of attacks. NPR's Scott Simon speaks with Stephen Carter about whether such a market could predict — and deter — attacks.

Leave a Comment

Help keep the conversation civil. Please refer to our Terms of Use and Code of Conduct before posting your comments.