A Systems-Based Approach to Fostering Robust Science in Industrial-Organizational Psychology

Published on Mar 1, 2018in Industrial and Organizational Psychology5.25
路 DOI :10.1017/iop.2017.55
James A. Grand8
Estimated H-index: 8
(UMD: University of Maryland, College Park),
Steven G. Rogelberg30
Estimated H-index: 30
(UNCC: University of North Carolina at Charlotte)
+ 5 AuthorsDonald M. Truxillo31
Estimated H-index: 31
(PSU: Portland State University)
Credibility and trustworthiness are the bedrock upon which any science is built. The strength of these foundations has been increasingly questioned across the sciences as instances of research misconduct and mounting concerns over the prevalence of detrimental research practices have been identified. Consequently, the purpose of this article is to encourage our scientific community to positively and proactively engage in efforts that foster a healthy and robust industrial and organizational (I-O) psychology. We begin by advancing six defining principles that we believe reflect the values of robust science and offer criteria for evaluating proposed efforts to change scientific practices. Recognizing that the contemporary scientific enterprise is a complex and diverse network of actors and institutions, we then conclude by identifying 12 stakeholders who play important roles in achieving a culture of robust science in I-O psychology and offer recommendations for actions we can take as members of these groups to strengthen our science.
Figures & Tables
  • References (98)
  • Citations (16)
馃摉 Papers frequently viewed together
40 Citations
85 Citations
22 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
In this article the author explores ways in which research into personnel management matters in an academic setting can be incorporated into daily business practice in a real-world work environment. A number of suggestions are provided including a way in which academic findings can be made more relevant, the idea that real situations be considered from the start of research and that aspects of knowledge management and transfer be taken into account. The article also suggests a role for professio...
69 CitationsSource
#1Janelle H. Cheung (Clemson University)H-Index: 7
#2Deanna K. Burns (Clemson University)H-Index: 1
Last. Michael T. SliterH-Index: 14
view all 4 authors...
Purpose Amazon Mechanical Turk is an increasingly popular data source in the organizational psychology research community. This paper presents an evaluation of MTurk and provides a set of practical recommendations for researchers using MTurk.
61 CitationsSource
#1Eliza Byington (USYD: University of Sydney)H-Index: 4
#2Will Felps (UNSW: University of New South Wales)H-Index: 13
We argue that much academic misconduct can be explained as the result of social dilemmas occurring at two levels of management science. First, the career benefits associated with engaging in noncre...
14 CitationsSource
#1Steve W. J. Kozlowski (MSU: Michigan State University)H-Index: 45
#2Gilad Chen (UMD: University of Maryland, College Park)H-Index: 36
Last. Eduardo Salas (Rice University)H-Index: 106
view all 3 authors...
20 CitationsSource
#1Jose M. Cortina (GMU: George Mason University)H-Index: 30
#2Herman Aguinis (GW: George Washington University)H-Index: 56
Last. Richard P. DeShonH-Index: 31
view all 3 authors...
We offer a critical review and synthesis of research methods in the first century of the Journal of Applied Psychology. We divide the chronology into 6 periods. The first emphasizes the first few issues of the journal, which, in many ways, set us on a methodological course that we sail to this day, and then takes us through the mid-1920s. The second is the period through World War II, in which we see the roots of modern methodological concepts and techniques, including a transition from a discov...
20 CitationsSource
#1Ernest H. O鈥橞oyle (UI: University of Iowa)H-Index: 10
#2George C. Banks (Longwood University)H-Index: 22
Last. Erik Gonzalez-Mule (UI: University of Iowa)H-Index: 8
view all 3 authors...
85 CitationsSource
#1John Antonakis (UNIL: University of Lausanne)H-Index: 32
Abstract In this position paper, I argue that the main purpose of research is to discover and report on phenomena in a truthful manner. Once uncovered, these phenomena can have important implications for society. The utility of research depends on whether it makes a contribution because it is original or can add to cumulative research efforts, is rigorously and reliably done, and is able to inform basic or applied research and later policy. However, five serious 鈥渄iseases鈥 stifle the production ...
64 CitationsSource
6 CitationsSource
#1John R. Hollenbeck (MSU: Michigan State University)H-Index: 49
#2Patrick M. Wright (USC: University of South Carolina)H-Index: 52
In this editorial we discuss the problems associated with HARKing (Hypothesizing After Results Are Known) and draw a distinction between Sharking (Secretly HARKing in the Introduction section) and Tharking (Transparently HARKing in the Discussion section). Although there is never any justification for the process of Sharking, we argue that Tharking can promote the effectiveness and efficiency of both scientific inquiry and cumulative knowledge creation. We argue that the discussion sections of a...
32 CitationsSource
2 CitationsSource
Cited By16
#1Helen Hughes (University of Leeds)H-Index: 5
#2Matthew C. Davis (University of Leeds)H-Index: 6
Last. Alison McKay (University of Leeds)H-Index: 14
view all 4 authors...
ABSTRACTConducting impactful research is a cornerstone of good academic practice. It increases the likelihood that research outcomes are used to generate positive change, e.g., by improving working...
#1George C. Banks (UNCC: University of North Carolina at Charlotte)H-Index: 22
#2James G. Field (WVU: West Virginia University)H-Index: 7
Last. Steven G. Rogelberg (UNCC: University of North Carolina at Charlotte)H-Index: 30
view all 7 authors...
Open science refers to an array of practices that promote openness, integrity, and reproducibility in research; the merits of which are being vigorously debated and developed across academic journals, listservs, conference sessions, and professional associations. The current paper identifies and clarifies major issues related to the use of open science practices (e.g., data sharing, study pre-registration, open access journals). We begin with a useful general description of what open science in ...
4 CitationsSource
Problematisation: In recent years, psychology has been going through a crisis of sorts. Research methods and practices have come under increased scrutiny, with many issues identified as negatively contributing to low replicability and reproducibility of psychological research. Implications: As a consequence, researchers are increasingly called upon to overhaul and improve their research process. Various stakeholders within the scientific community are arguing for more openness and rigor within i...
1 CitationsSource
#1P.M. Bal (University of Lincoln)H-Index: 23
#2E. Doci (VU: VU University Amsterdam)H-Index: 3
Last. Marino Van Zelst (Tilburg University)H-Index: 1
view all 33 authors...
ABSTRACTThis manifesto presents 10 recommendations for a sustainable future for the field of Work and Organizational Psychology. The manifesto is the result of an emerging movement around the Futur...
1 CitationsSource
#1Kevin R. Murphy (UL: University of Limerick)H-Index: 57
#2Herman Aguinis (GW: George Washington University)H-Index: 56
The practice of hypothesizing after results are known (HARKing) has been identified as a potential threat to the credibility of research results. We conducted simulations using input values based on comprehensive meta-analyses and reviews in applied psychology and management (e.g., strategic management studies) to determine the extent to which two forms of HARKing behaviors might plausibly bias study outcomes and to examine the determinants of the size of this effect. When HARKing involves cherr...
4 CitationsSource
#1Michael R. Dougherty (UMD: University of Maryland, College Park)H-Index: 21
#2L. Robert Slevc (UMD: University of Maryland, College Park)H-Index: 13
Last. James A. Grand (UMD: University of Maryland, College Park)H-Index: 8
view all 3 authors...
There is a growing interest in changing the culture of psychology to improve the quality of our science. At the root of this interest is concern over the reproducibility of key findings. A variety ...
2 CitationsSource
#1James A. Grand (UMD: University of Maryland, College Park)H-Index: 8
#2Steven G. Rogelberg (UNCC: University of North Carolina at Charlotte)H-Index: 30
Last. Scott Tonidandel (Davidson College)H-Index: 22
view all 5 authors...
A variety of alternative mechanisms, strategies, and 鈥渨ays of doing鈥 have been proposed for improving the rigor and robustness of published research in the psychological sciences in recent years. In this article, we describe two existing but underused publication models鈥攔egistered reporting (RR) and results-blind reviewing (RBR)鈥攖hat we believe would contribute in important ways to improving both the conduct and evaluation of psychological research. We first outline the procedures and distinguis...
6 CitationsSource
#1Christopher T. Rotolo (PepsiCo)H-Index: 6
#2Allan H. Church (PepsiCo)H-Index: 12
Last. Garett C. Foster (UMSL: University of Missouri鈥揝t. Louis)H-Index: 2
view all 8 authors...
Organizations are undergoing unprecedented transformation in the area of talent management (TM). Companies are rapidly adopting new tools and approaches in a variety of what has traditionally been core areas of industrial and organizational (I-O) psychology such as performance management, employee attitudes, recruiting, testing and assessment, and career development. Increasingly, however, these new approaches have little to no research backing behind them, and they do not tend to be the focus o...
9 CitationsSource