A survey identified publication bias in the secondary literature.

TitleA survey identified publication bias in the secondary literature.
Publication TypeJournal Article
Year of Publication2006
AuthorsCarter AO, Griffin GH, Carter TP
JournalJournal of clinical epidemiology
Date Published2006 Mar
KeywordsCross-Sectional Studies; Evidence-Based Medicine; Humans; MEDLINE; Peer Review, Research; Periodicals as Topic; Publication Bias; Randomized Controlled Trials as Topic; Societies, Medical; Treatment Outcome

OBJECTIVE: To investigate the existence of publication bias in the translation of evidence from the primary to the secondary literature, using the ACP Journal Club (ACPJC) as a representative of secondary literature and Medline as a representative of primary literature.

METHODS: A cross-sectional survey of randomly selected randomized controlled trials of therapy published between 1994 and 2002 in English in Medline and all summaries of therapy trials published by ACPJC between the same dates. The main outcome measure was the rate of positive trials from among those trials aiming to find a difference between groups.

RESULTS: 831 trials from Medline and 823 summaries of trials from ACPJC met the inclusion criteria and were included in the study. Compared to trials cataloged in Medline, ACPJC preferentially summarized trials with a positive outcome (P < .001). This bias remained after controlling for other selection biases seen in the ACPJC such as preferentially summarizing multicentered trials with large sample size, no active treatment control, blinding, and in certain disease fields (adjusted odds ratio 2.8, 95% confidence interval 2.02-3.93).

CONCLUSION: The ACPJC preferentially summarizes trials with a positive outcome. Efforts should be made to reduce this bias.

Alternate JournalJ Clin Epidemiol