Chapter 1 – Reproducibility in Biomedical Research

Published on Jan 1, 2018
· DOI :10.1016/B978-0-12-804725-5.00001-X
Kevin Mullane12
Estimated H-index: 12
Michael J. Curtis28
Estimated H-index: 28
Michael Williams18
Estimated H-index: 18
Abstract The biomedical research ecosystem—academic, federal, and industrial—is dedicated to understanding human disease causality and developing effective therapeutics. The successes of this system over the past century have resulted in many effective drugs leading society to expect an endless supply of new therapeutics, particularly for chronic diseases that lack effective treatments (e.g., Alzheimer’s, diabetes). An increased recognition that the quality, relevance, reliability, and reproducibility of biomedical research cannot be guaranteed despite self-correction and peer review, coupled with the incessant hyping of inconsequential data by authors and their institutions, has led to a situation that is incompatible with sustained success in drug discovery. This risks the loss of credibility with the public, which does not bode well for the future of biomedical research. This chapter outlines the reproducibility problem and its magnitude, setting the stage for potential solutions that are discussed elsewhere in this monograph.
  • References (278)
  • Citations (1)
📖 Papers frequently viewed together
2 Citations
353 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Kevin Mullane (Gladstone Institutes)H-Index: 12
#2Michael Williams (NU: Northwestern University)H-Index: 18
Abstract Efforts to address reproducibility concerns in biomedical research include: initiatives to improve journal publication standards and peer review; increased attention to publishing methodological details that enable experiments to be reconstructed; guidelines on standards for study design, implementation, analysis and execution; meta-analyses of multiple studies within a field to synthesize a common conclusion and; the formation of consortia to adopt uniform protocols and internally repr...
12 CitationsSource
#1Jeffrey Beall (University of Colorado Denver)H-Index: 14
47 CitationsSource
#1Daniel J. Holder (USMA: United States Military Academy)H-Index: 27
#2Michael J. Marino (USMA: United States Military Academy)H-Index: 27
4 CitationsSource
#1C.X. Weichenberger (AmeriCorps VISTA)H-Index: 2
#2Edwin Pozharskiy (UMB: University of Maryland, Baltimore)H-Index: 17
Last. Bernhard Rupp (AmeriCorps VISTA)H-Index: 32
view all 3 authors...
The de facto commoditization of biomolecular crystallography as a result of almost disruptive instrumentation automation and continuing improvement of software allows any sensibly trained structural biologist to conduct crystallo­graphic studies of biomolecules with reasonably valid outcomes: that is, models based on properly interpreted electron density. Robust validation has led to major mistakes in the protein part of structure models becoming rare, but some depositions of protein–peptide com...
6 CitationsSource
1 CitationsSource
#1Mark Lucanic (Buck Institute for Research on Aging)H-Index: 6
#2W. Todd Plummer (Buck Institute for Research on Aging)H-Index: 2
Last. Patrick C. Phillips (UO: University of Oregon)H-Index: 42
view all 34 authors...
Irreproducibility of biological findings is a major challenge for drug development. Here the authors examine the lifespans of 22 worm strains in three different laboratories and the effects of ten known chemicals to assess reproducibility in the face of variations in genetic background, chemical treatment and lab environment.
31 CitationsSource
Ethical review boards must focus on clinical promise as well as safety to hold the first tests of drugs in humans to a higher standard, say Jonathan Kimmelman and Carole Federico.
18 CitationsSource
#1Brian A. Nosek (UVA: University of Virginia)H-Index: 61
#2Timothy M. Errington (Center for Open Science)H-Index: 8
The first results from the Reproducibility Project: Cancer Biology suggest that there is scope for improving reproducibility in pre-clinical cancer research.
56 CitationsSource
42 CitationsSource
8 CitationsSource
Cited By1
Abstract There is a clear perception in the literature that there is a crisis in reproducibility in the biomedical sciences. Many underlying factors contributing to the prevalence of irreproducible results have been highlighted with a focus on poor design and execution of experiments along with the misuse of statistics. While these factors certainly contribute to irreproducibility, relatively little attention outside of the specialized statistical literature has focused on the expected prevalenc...
6 CitationsSource