E-news Exclusive

Scientific Literature Overstates Psychotherapy’s Effectiveness in Treating Depression

The scientific literature paints an overly rosy picture of the efficacy of psychological treatments for depression. That is the conclusion of a study published September 30 in the journal PLOS ONE. It is the follow-up to a study published in 2008 that created a considerable stir when it found a comparable publication bias in scientific articles reporting the efficacy of antidepressant drugs.

“This doesn’t mean that psychotherapy doesn’t work. Psychotherapy does work. It just doesn’t work as well as you would think from reading the scientific literature,” says Steven Hollon, the Gertrude Conaway Vanderbilt professor of psychology, who coauthored the study with colleagues from Oregon Health & Science University (OHSU), VU University Amsterdam, and the University of Groningen.

The basic problem arises because clinical studies of the treatments for depression with more positive outcomes are more likely to be published than studies with less favorable results. “It’s like flipping a bunch of coins and only keeping the ones that come up heads,” Hollon says.

The research team identified all the US National Institutes of Health grants awarded to fund clinical trials of psychological treatments for depression from 1972 to 2008. They found that nearly one-quarter of these grants (13 of 55) had not published trial results.

They contacted the researchers who had conducted the 13 unpublished studies and requested the results from their studies. Using the unpublished data together with the published data, they conducted a series of meta-analyses from which they concluded that psychotherapy works, but that its effectiveness was inflated by publication bias.

“This study shows that publication bias occurs in psychotherapy, mirroring what we’ve seen previously with antidepressants and other drugs,” says coauthor Erick Turner, an associate professor of psychiatry and pharmacology at OHSU School of Medicine, who directed the 2008 study of antidepressants. A question raised by that study, but not answered, was whether it was reasonable to recommend psychotherapy over drug treatment without examining whether publication bias might also be occurring with psychotherapy.

“Journal articles are vetted through the process of peer review, but this process has loopholes, allowing treatment benefits to be overstated and potential harms to be understated,” Turner says. “The consumers of this skewed information are health care providers and, ultimately, their patients.”

The authors suggest that both the funding agencies and the journals should archive the original proposals and raw data from the trials, both published and unpublished, so that this form of reporting bias can be detected and corrected in the future.

— Source: Vanderbilt University