How can preregistration contribute to research in our field

Published on Sep 1, 2016
· DOI :10.1080/23743603.2015.1070611
Kai J. Jonas18
Estimated H-index: 18
(UvA: University of Amsterdam),
Joseph Cesario18
Estimated H-index: 18
(MSU: Michigan State University)
Comprehensive Results in Social Psychology (CRSP) is a novel journal for preregistered research (so-called registered reports, RR) in the field of social psychology. It offers RR-only publications, with the possibility of adding exploratory analysis and data as well. After submission of introduction, hypotheses, methods, procedure, and analysis plan, submitted manuscripts are reviewed prior to data collection. If the peer review process results in a positive evaluation of the manuscript, an initial publication agreement (IPA) is issued upon which publication of the manuscript (given adherence to the registered protocol) independent of the obtained results is possible. CRSP seeks to complement the publication options in our field by making transparent confirmatory and exploratory research possible.
  • References (32)
  • Citations (13)
📖 Papers frequently viewed together
2,486 Citations
2,235 Citations
677 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Daniël H. J. Wigboldus (Radboud University Nijmegen)H-Index: 31
#2Ron Dotsch (Radboud University Nijmegen)H-Index: 23
Not so long ago, in the early days of experimental psychology, researchers performed their data analyses by hand (or paid people to do these calculations for them). No wonder, they took ample time beforehand to think through which analyses to perform (and especially which not). Exploring data was not really an option. The t value or F value that resulted from the calculations provided a more or less definitive answer. H0 could be rejected or not. During the past decades, we have quickly moved fr...
18 CitationsSource
#1Klaas Sijtsma (Tilburg University)H-Index: 42
Abstract Recent fraud cases in psychological and medical research have emphasized the need to pay attention to Questionable Research Practices (QRPs). Deliberate or not, QRPs usually have a deteriorating effect on the quality and the credibility of research results. QRPs must be revealed but prevention of QRPs is more important than detection. I suggest two policy measures that I expect to be effective in improving the quality of psychological research. First, the research data and the research ...
32 CitationsSource
#1Daniel J. Simons (UIUC: University of Illinois at Urbana–Champaign)H-Index: 52
#2Alex O. Holcombe (USYD: University of Sydney)H-Index: 22
Last. Barbara A. Spellman (UVA: University of Virginia)H-Index: 24
view all 3 authors...
55 CitationsSource
#1Joseph CesarioH-Index: 18
#2Kai J. Jonas (UvA: University of Amsterdam)H-Index: 18
In this article, we argue that whether or not a replication attempt is informative is dependent on the accuracy of one's underlying model to explain the effect, as it is the explanatory model that enumerates the contingencies necessary for producing the effect. If the model is incorrect, then a researcher may unknowingly change variables that the model says are irrelevant but which are really essential, rendering the replication results ambiguous. The expectation that effects of priming on socia...
16 CitationsSource
#1Kou MurayamaH-Index: 31
#2Reinhard PekrunH-Index: 61
Last. Klaus FiedlerH-Index: 2
view all 3 authors...
Recent studies have indicated that research practices in psychology may be susceptible to factors that increase false-positive rates, raising concerns about the possible prevalence of false-positive findings. The present article discusses several practices that may run counter to the inflation of false-positive rates. Taking these practices into account would lead to a more balanced view on the false-positive issue. Specifically, we argue that an inflation of false-positive rates would diminish,...
68 CitationsSource
#1Edward Miguel (University of California, Berkeley)H-Index: 46
#2Colin F. Camerer (California Institute of Technology)H-Index: 103
Last. M. J. van der Laan (University of California, Berkeley)H-Index: 11
view all 19 authors...
There is growing appreciation for the advantages of experimentation in the social sciences. Policy-relevant claims that in the past were backed by theoretical arguments and inconclusive correlations are now being investigated using more credible methods. Changes have been particularly pronounced in development economics, where hundreds of randomized trials have been carried out over the last decade. When experimentation is difficult or impossible, researchers are using quasi-experimental designs...
156 CitationsSource
#1Daniel J. Simons (UIUC: University of Illinois at Urbana–Champaign)H-Index: 52
Reproducibility is the cornerstone of science. If an effect is reliable, any competent researcher should be able to obtain it when using the same procedures with adequate statistical power. Two of the articles in this special section question the value of direct replication by other laboratories. In this commentary, I discuss the problematic implications of some of their assumptions and argue that direct replication by multiple laboratories is the only way to verify the reliability of an effect.
219 CitationsSource
239 CitationsSource
#1Kurt Gray (UNC: University of North Carolina at Chapel Hill)H-Index: 26
#2Daniel M. Wegner (Harvard University)H-Index: 68
There are many guides on proper psychology, but far fewer on interesting psychology. This article presents six guidelines for interesting research. The first three—Phenomena First, Be Surprising, and Grandmothers, Not Scientists— suggest how to choose your research question; the last three—Be The Participant, Simple Statistics, and Powerful Beginnings—suggest how to answer your research question and offer perspectives on experimental design, statistical analysis, and effective communication. The...
16 CitationsSource
170 CitationsSource
Cited By13
#1Zhiyi Chen (SWU: Southwest University)
#1Zhiyi Chen (SWU: Southwest University)H-Index: 3
Last. Tingyong Feng (SWU: Southwest University)
view all 4 authors...
Globally, about 17% individuals are suffering from the maladaptive procrastination until now, which impacts individual's financial status, mental health, and even public policy. However, the comprehensive understanding of neuroanatomical understructure of procrastination still remains gap. 688 participants including 3 independent samples were recruited for this study. Brain morphological dynamics referred to the idiosyncrasies of both brain size and brain shape. Multilinear regression analysis w...
#1Christof Weinhardt (KIT: Karlsruhe Institute of Technology)H-Index: 25
#2Aalst van der Wmp (RWTH Aachen University)H-Index: 116
Last. Oliver Hinz (Goethe University Frankfurt)H-Index: 18
view all 3 authors...
#1Malte Friese (Saarland University)H-Index: 30
#2David D. LoschelderH-Index: 13
Last. Michael Inzlicht (U of T: University of Toronto)H-Index: 45
view all 5 authors...
An influential line of research suggests that initial bouts of self-control increase the susceptibility to self-control failure (ego depletion effect). Despite seemingly abundant evidence, some researchers have suggested that evidence for ego depletion was the sole result of publication bias and p-hacking, with the true effect being indistinguishable from zero. Here, we examine (a) whether the evidence brought forward against ego depletion will convince a proponent that ego depletion does not ex...
28 CitationsSource
#1Janis Zickfeld (UMA: University of Mannheim)H-Index: 9
#2Thomas W. Schubert (University of Oslo)H-Index: 28
The expectations that PhD students face in the social sciences have been increasing steadily. At the same time, the behavioral and social sciences have faced a substantial turmoil questioning the reproducibility of research findings and the way how researchers should perform research. In the present chapter, we provide guidance on possible ways how PhD students can make sense of this turmoil or “sail from the seas of chaos into the corridors of stability” (Lakens & Evers, 2014). We review recent...
4 CitationsSource
#1William J. Chopik (MSU: Michigan State University)H-Index: 18
#2Ryan H. Bremner (University of St. Thomas (Minnesota))H-Index: 2
Last. Victor N. Keller (MSU: Michigan State University)H-Index: 6
view all 4 authors...
Over the past 10 years, crises surrounding replication, fraud, and best practices in research methods have dominated discussions in the field of psychology. However, no research exists examining how to communicate these issues to undergraduates and what effect this has on their attitudes toward the field. We developed and validated a 1-hr lecture communicating issues surrounding the replication crisis and current recommendations to increase reproducibility. Pre- and post-lecture surveys suggest ...
9 CitationsSource
#1Martin S. Hagger (Curtin University)H-Index: 58
#2Daniel F. Gucciardi (Curtin University)H-Index: 25
Last. Nikos L. D. Chatzisarantis (Curtin University)H-Index: 50
view all 3 authors...
Tests of social cognitive theories provide informative data on the factors that relate to health behavior, and the processes and mechanisms involved. In the present article, we contend that tests of social cognitive theories should adhere to the principles of nomological validity, defined as the degree to which predictions in a formal theoretical network are confirmed. We highlight the importance of nomological validity tests to ensure theory predictions can be disconfirmed through observation. ...
10 CitationsSource
#1Tal Yarkoni (University of Texas at Austin)H-Index: 37
#2Jacob Westfall (University of Texas at Austin)H-Index: 10
Psychology has historically been concerned, first and foremost, with explaining the causal mechanisms that give rise to behavior. Randomized, tightly controlled experiments are enshrined as the gold standard of psychological research, and there are endless investigations of the various mediating and moderating variables that govern various behaviors. We argue that psychology’s near-total focus on explaining the causes of behavior has led much of the field to be populated by research programs tha...
169 CitationsSource
#1Dario Krpan (LSE: London School of Economics and Political Science)H-Index: 3
On a daily basis, people are exposed to numerous stimuli, ranging from colors and smells to sounds and words, that could potentially activate different cognitive constructs and influence their actions. This type of influence on human behavior is referred to as priming. Roughly two decades ago, behavioral priming was hailed as one of the core forces that shape automatic behavior. However, failures to replicate some of the representative findings in this domain soon followed, which posed the follo...
2 CitationsSource
The following article considers whether psychology is moving in the right direction by exploring the evidentiary value movement. Although the author considers the movement to be a net positive, she discusses concerns regarding the scope and tone of the discussions to date. She encourages the movement to consider heretofore underrepresented subfields and to reduce the use of negative tone.
5 CitationsSource
#1Joseph Cesario (MSU: Michigan State University)H-Index: 18
#2Kai J. Jonas (UM: Maastricht University)H-Index: 18
Last. Dana R. Carney (University of California, Berkeley)H-Index: 20
view all 3 authors...
5 CitationsSource