Current Weather
The Spy FM

Charity Watchdog Shakes Up Ratings To Focus On Results

Filed by KOSU News in US News.
October 22, 2013

There’s one area of the economy that’s growing faster than business or government.

According to the Urban Institute, in the 10 years between 2001 and 2011, the number of nonprofits increased 25 percent. But most of them aren’t very good at measuring their effectiveness — at least, that’s the conclusion of the nonprofit watchdog Charity Navigator, which rates thousands of nonprofits to help donors make decisions on their giving.

Now, Charity Navigator is planning to change its ratings system. President and CEO Ken Berger says donors deserve to know if the money they’re giving is going to programs that work.

“Think about the fact that [in] the largest nonprofit sector in the history of the world, we do not know whether or not we’re having meaningful results and to what extent,” Berger says. “It’s not to say that they’re not having results, but they often just don’t know what the heck they are.”

So Berger is shaking up Charity Navigator’s ratings system. At the moment, Charity Navigator compares how much money a nonprofit spends on its programs with how much it spends on overhead. But beginning in 2016, the rating will also factor in results.

“How clearly do you identify the problem that you’re trying to solve and how well do you have measures to know that you’re on the road to solving that problem?” Berger says.

Give People A New Outlook, Then Measure It

But what if the problem you’re trying to solve is in the middle of a war zone? Doctors Without Borders Executive Director Sophie Delaunay says she’s leery about a system that would grade a nonprofit based on its results.

“I mean, it really depends on how they’re going to use their results and what is their own understanding of what they’re trying to analyze,” she says.

Charity Navigator has suggested that one way nonprofits can evaluate their effectiveness is to ask the people they serve how they’re doing. But Delaunay says that’s “totally unrealistic” for doctors performing surgery in a war zone: “There is no way we’re going to send a questionnaire to our patients, who are displaced and in a dramatic state, about whether they are satisfied with our care.”

For other nonprofits, surveys are no big deal. Surale Phillips, a consultant to arts groups around the country, says many theaters and dance companies already ask their audiences for feedback.

“You probably get a questionnaire about what you thought of the show and the questions will be about the artistic process,” she says.

Still, lots of nonprofit arts groups say their goal is to use theater or music to bring people together, or to make people think differently about the world. Those results are hard for arts organizations to measure, Phillips says.

“In the medical industry or environmental industry, or things that are not the arts, there are often standards that are across the board,” she says. “We don’t have those kinds of standards [in] the arts. We don’t have, you know, CO2 levels to measure change.”

But Dennis Chestnut does. He’s executive director of the environmental nonprofit Groundwork Anacostia River DC, which measures change in the Anacostia River in Washington, D.C. Their mission is both restoration and education: Chestnut says they’re trying to get people to care more about the environmental health of their community, learn how to improve it and then make it part of their daily lives.

“It might take … a period of years to measure the impact,” he says, “for us to, you know, actually see that end result, that outcome.”

The Price Of Surveying Results

Another obstacle many nonprofits could face is how to pay for evaluations. Charity Navigator is asking for a fairly sophisticated process. With nonprofit jargon like “causal logic” and “pre-defined outputs,” you need a glossary to get through the description. Phillips, the arts consultant, says it takes training to do the kind of evaluation they’re asking for.

“It’s not necessarily about sending one staff person to a workshop,” she says. “It’s a really intense process.”

But Charity Navigator’s Berger says nonprofits complained about the ratings formula way back when they first started doing them, 11 years ago.

“The outcry from the sector was: ‘You’re not measuring what matters most,’ ‘You need to evaluate us on our results.’ That’s what we were told until 2011,” he says. “Now that we’ve got this, now we’re being told, ‘No, wait. It’s too hard; it’s too complicated; it’s too expensive.’ It’s this, that and the other thing.”

If nonprofits are going to ask people for money, Berger says, they should be able to show them their results. [Copyright 2013 NPR]

Leave a Reply

5AM to 9AM Morning Edition

Morning Edition

For more than two decades, NPR's Morning Edition has prepared listeners for the day ahead with two hours of up-to-the-minute news, background analysis, commentary, and coverage of arts and sports.

Listen Live Now!

9AM to 10AM The Takeaway

The Takeaway

A fresh alternative in morning news, "The Takeaway" provides a breadth and depth of world, national and regional news coverage that is unprecedented in public media.

View the program guide!

10AM to 11PM On Point

On Point

On Point unites distinct and provocative voices with passionate discussion as it confronts the stories that are at the center of what is important in the world today. Leaving no perspective unchallenged, On Point digs past the surface and into the core of a subject, exposing each of its real world implications.

View the program guide!

Upcoming Events in your area (Submit your event today!)

Streaming audio and podcasts

Stream KOSU on your smartphone

Phone Streaming

SmartPhone listening options on this page are intended for many iPhones, Blackberries, etc. with low-cost software applications available to listen to our full-time web streams, both News on KOSU-1 and Classical on KOSU-2.

Learn more about our complete range of streaming services

We're perfecting the patient experience - Stillwater Medical Center