Current Weather
The Spy FM

Poor Peer Review Cited In Retracted DNA Study

Filed by KOSU News in Science.
July 22, 2011

Scientists are admitting that a scientific finding that seemed too good to be true was too good to be true. The researchers are retracting a study that claimed you could use genetic tools to predict people’s likelihood of living to 100.

Paola Sebastiani and Thomas Perls are both at Boston University. Perls studies centenarians — people who live to be 100 or more. He’s not a geneticist, but he is convinced that genes play an important role in how long someone will live, because longevity clearly runs in families. So Perls teamed up with geneticist Sebastiani.

She developed a computer model that used 150 genetic markers — specific bits of DNA scattered around the 23 pairs of human chromosomes — to predict who would be able to join the centenarian club. As they reported in the journal Science, the accuracy of this model was 77 percent.

That was a year ago. Now, Sebastiani and Perls have retracted the paper making that claim. They have admitted a mistake, an honest mistake, in the way the collected their data.

Greg Cooper, a geneticist at the HudsonAlpha Institute for Biotechnology in Huntsville, Ala., uses genetic analysis similar to the ones Sebastiani used. “I think this should have been caught at the peer review stage,” Cooper says.

Peer review is the process scientific journals use to vet research papers. The journal sends submitted manuscripts to scientists who work in the field and ask them to evaluate the work — not to see if it is right or wrong, but to make sure that it was done according to proper scientific procedures.

A Problem With Peer Review?

Cooper saw the paper right after it was initially published and was instantly suspicious.

“Anybody with significant amounts of experience with analyzing SNP array data — which were the primary source for the raw data that were generated for that study — the first reaction should have been, ‘Wow, these SNPs are really interesting. Can we look at the raw data? We need to make sure there’s nothing goofy about it,’ ” says Cooper.

In fact, there was something goofy about the results. One of the systems used to analyze the DNA SNPs had a flaw, a flaw known to most geneticists in the field.

So what happened? The Boston University researchers issued a statement acknowledging technical errors, but asserting that they believe their main results are still valid. Science, the journal that published the paper originally, issued a statement noting that it publishes some 800 articles a year and only a handful are retracted.

But this retraction underscores a bigger problem.

In an email, Science editor-in-chief Bruce Alberts points out that research papers are built on a wide variety of new, highly complex technologies. Finding a team of reviewers with all the needed expertise is tricky. And how many reviewers are enough to be sure nothing slips through? The answer, says Alberts, is not always clear.

Duke University geneticist David Goldstein is sympathetic to the dilemma of getting peer review right. “I think everybody recognizes that the review process is far from perfect. By and large it works, but it doesn’t work every single time,” he says.

Goldstein says when the system fails, it usually gets discovered, and ultimately corrected. [Copyright 2011 National Public Radio]

Leave a Reply

5AM to 9AM Morning Edition

Morning Edition

For more than two decades, NPR's Morning Edition has prepared listeners for the day ahead with two hours of up-to-the-minute news, background analysis, commentary, and coverage of arts and sports.

Listen Live Now!

9AM to 10AM The Takeaway

The Takeaway

A fresh alternative in morning news, "The Takeaway" provides a breadth and depth of world, national and regional news coverage that is unprecedented in public media.

View the program guide!

10AM to 11PM On Point

On Point

On Point unites distinct and provocative voices with passionate discussion as it confronts the stories that are at the center of what is important in the world today. Leaving no perspective unchallenged, On Point digs past the surface and into the core of a subject, exposing each of its real world implications.

View the program guide!

Upcoming Events in your area (Submit your event today!)

Streaming audio and podcasts

Stream KOSU on your smartphone

Phone Streaming

SmartPhone listening options on this page are intended for many iPhones, Blackberries, etc. with low-cost software applications available to listen to our full-time web streams, both News on KOSU-1 and Classical on KOSU-2.

Learn more about our complete range of streaming services

We're perfecting the patient experience - Stillwater Medical Center