Filed Under:

Charity Watchdog Shakes Up Ratings To Focus On Results

Play associated audio
Dennis Chestnut stands next to a stretch of the Anacostia River in Washington, D.C., on Oct. 2. Chestnut, who has been working to clean up the Anacostia for decades, says it can take a long time for a nonprofit to see an end result.
Abbey Oldham/NPR
Dennis Chestnut stands next to a stretch of the Anacostia River in Washington, D.C., on Oct. 2. Chestnut, who has been working to clean up the Anacostia for decades, says it can take a long time for a nonprofit to see an end result.

There's one area of the economy that's growing faster than business or government.

According to the Urban Institute, in the 10 years between 2001 and 2011, the number of nonprofits increased 25 percent. But most of them aren't very good at measuring their effectiveness — at least, that's the conclusion of the nonprofit watchdog Charity Navigator, which rates thousands of nonprofits to help donors make decisions on their giving.

Now, Charity Navigator is planning to change its ratings system. President and CEO Ken Berger says donors deserve to know if the money they're giving is going to programs that work.

"Think about the fact that [in] the largest nonprofit sector in the history of the world, we do not know whether or not we're having meaningful results and to what extent," Berger says. "It's not to say that they're not having results, but they often just don't know what the heck they are."

So Berger is shaking up Charity Navigator's ratings system. At the moment, Charity Navigator compares how much money a nonprofit spends on its programs with how much it spends on overhead. But beginning in 2016, the rating will also factor in results.

"How clearly do you identify the problem that you're trying to solve and how well do you have measures to know that you're on the road to solving that problem?" Berger says.

Give People A New Outlook, Then Measure It

But what if the problem you're trying to solve is in the middle of a war zone? Doctors Without Borders Executive Director Sophie Delaunay says she's leery about a system that would grade a nonprofit based on its results.

"I mean, it really depends on how they're going to use their results and what is their own understanding of what they're trying to analyze," she says.

Charity Navigator has suggested that one way nonprofits can evaluate their effectiveness is to ask the people they serve how they're doing. But Delaunay says that's "totally unrealistic" for doctors performing surgery in a war zone: "There is no way we're going to send a questionnaire to our patients, who are displaced and in a dramatic state, about whether they are satisfied with our care."

For other nonprofits, surveys are no big deal. Surale Phillips, a consultant to arts groups around the country, says many theaters and dance companies already ask their audiences for feedback.

"You probably get a questionnaire about what you thought of the show and the questions will be about the artistic process," she says.

Still, lots of nonprofit arts groups say their goal is to use theater or music to bring people together, or to make people think differently about the world. Those results are hard for arts organizations to measure, Phillips says.

"In the medical industry or environmental industry, or things that are not the arts, there are often standards that are across the board," she says. "We don't have those kinds of standards [in] the arts. We don't have, you know, CO2 levels to measure change."

But Dennis Chestnut does. He's executive director of the environmental nonprofit Groundwork Anacostia River DC, which measures change in the Anacostia River in Washington, D.C. Their mission is both restoration and education: Chestnut says they're trying to get people to care more about the environmental health of their community, learn how to improve it and then make it part of their daily lives.

"It might take ... a period of years to measure the impact," he says, "for us to, you know, actually see that end result, that outcome."

The Price Of Surveying Results

Another obstacle many nonprofits could face is how to pay for evaluations. Charity Navigator is asking for a fairly sophisticated process. With nonprofit jargon like "causal logic" and "pre-defined outputs," you need a glossary to get through the description. Phillips, the arts consultant, says it takes training to do the kind of evaluation they're asking for.

"It's not necessarily about sending one staff person to a workshop," she says. "It's a really intense process."

But Charity Navigator's Berger says nonprofits complained about the ratings formula way back when they first started doing them, 11 years ago.

"The outcry from the sector was: 'You're not measuring what matters most,' 'You need to evaluate us on our results.' That's what we were told until 2011," he says. "Now that we've got this, now we're being told, 'No, wait. It's too hard; it's too complicated; it's too expensive.' It's this, that and the other thing."

If nonprofits are going to ask people for money, Berger says, they should be able to show them their results.

Copyright 2013 NPR. To see more, visit http://www.npr.org/.

 

NPR

Book Review: 'Kinder Than Solitude'

Ellah Allfrey reviews Kinder Than Solitude, by Yiyun Li.
NPR

Plant Breeders Release First 'Open Source Seeds'

Scientists and food activists are launching a campaign to promote seeds that can be freely shared, rather than protected through patents and licenses. They call it the Open Source Seed Initiative.
NPR

John Edwards Resumes Career As Trial Attorney

The former U.S. senator and Democratic presidential hopeful is one of three attorneys representing a boy in a medical malpractice case in North Carolina.
NPR

When Parents Are The Ones Too Distracted By Devices

Parents often complain that smartphones keep their kids distracted from conversation. What happens when it's the other way around, when kids can't get their smartphone-glued parents' attention?

Leave a Comment

Help keep the conversation civil. Please refer to our Terms of Use and Code of Conduct before posting your comments.