Determinants of selective reporting: A taxonomy based on content analysis of a random selection of the literature

Jenny T. van der Steen, Cornelis A. van den Bogert, Mirjam C. van Soest-Poortvliet, Soulmaz Fazeli Farsani, René H. J. Otten, Gerben ter Riet, Lex M. Bouter

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Background Selective reporting is wasteful, leads to bias in the published record and harms the credibility of science. Studies on potential determinants of selective reporting currently lack a shared taxonomy and a causal framework. Objective To develop a taxonomy of determinants of selective reporting in science. Design Inductive qualitative content analysis of a random selection of the pertinent literature including empirical research and theoretical reflections. Methods Using search terms for bias and selection combined with terms for reporting and publication, we systematically searched the PubMed, Embase, PsycINFO and Web of Science databases up to January 8, 2015. Of the 918 articles identified, we screened a 25 percent random selection. From eligible articles, we extracted phrases that mentioned putative or possible determinants of selective reporting, which we used to create meaningful categories. We stopped when no new categories emerged in the most recently analyzed articles (saturation). Results Saturation was reached after analyzing 64 articles. We identified 497 putative determinants, of which 145 (29%) were supported by empirical findings. The determinants represented 12 categories (leaving 3% unspecified): focus on preferred findings (36%), poor or overly flexible research design (22%), high-risk area and its development (8%), dependence upon sponsors (8%), prejudice (7%), lack of resources including time (3%), doubts about reporting being worth the effort (3%), limitations in reporting and editorial practices (3%), academic publication system hurdles (3%), unfavorable geographical and regulatory environment (2%), relationship and collaboration issues (2%), and potential harm (0.4%). Conclusions We designed a taxonomy of putative determinants of selective reporting consisting of 12 categories. The taxonomy may help develop theory about causes of selection bias and guide policies to prevent selective reporting.
Original languageEnglish
Article numbere0188247
JournalPLoS ONE
Volume13
Issue number2
DOIs
Publication statusPublished - 2018

Cite this

van der Steen, J. T., van den Bogert, C. A., van Soest-Poortvliet, M. C., Farsani, S. F., Otten, R. H. J., ter Riet, G., & Bouter, L. M. (2018). Determinants of selective reporting: A taxonomy based on content analysis of a random selection of the literature. PLoS ONE, 13(2), [e0188247]. https://doi.org/10.1371/journal.pone.0188247