Match!

Meta-Analytic Choices and Judgment Calls: Implications for Theory Building and Testing, Obtained Effect Sizes, and Scholarly Impact

Published on Jan 1, 2011in Journal of Management9.06
· DOI :10.1177/0149206310377113
Herman Aguinis56
Estimated H-index: 56
(IU: Indiana University Bloomington),
Dan R. Dalton59
Estimated H-index: 59
(IU: Indiana University Bloomington)
+ 2 AuthorsCatherine M. Dalton16
Estimated H-index: 16
(IU: Indiana University Bloomington)
Abstract
The authors content analyzed 196 meta-analyses including 5,581 effect-size estimates published in Academy of Management Journal, Journal of Applied Psychology, Journal of Management, Personnel Psychology, and Strategic Management Journal from January 1982 through August 2009 to assess the presumed effects of each of 21 methodological choices and judgment calls on substantive conclusions. Results indicate that, overall, the various meta-analytic methodological choices available and judgment calls involved in the conduct of a meta-analysis have little impact on the resulting magnitude of the meta-analytically derived effect sizes. Thus, the present study, based on actual meta-analyses, casts doubt on previous warnings, primarily based on selective case studies, that judgment calls have an important impact on substantive conclusions. The authors also tested the fit of a multivariate model that includes relationships among theory-building and theory-testing goals, obtained effect sizes, year of publication of...
  • References (78)
  • Citations (121)
References78
Newest
#1Herman Aguinis (IU: Indiana University Bloomington)H-Index: 56
#2Ryan K. Gottfredson (IU: Indiana University Bloomington)H-Index: 12
Last.Thomas A. Wright (KSU: Kansas State University)H-Index: 33
view all 3 authors...
#1Herman Aguinis (IU: Indiana University Bloomington)H-Index: 56
#2Charles A. Pierce (U of M: University of Memphis)H-Index: 30
Last.Catherine M. Dalton (IU: Indiana University Bloomington)H-Index: 16
view all 5 authors...
#1Herman Aguinis (IU: Indiana University Bloomington)H-Index: 56
#2Steven Andrew Culpepper (University of Colorado Denver)H-Index: 15
Last.Charles A. Pierce (U of M: University of Memphis)H-Index: 30
view all 3 authors...
#1Inge Geyskens (Tilburg University)H-Index: 22
#2Rekha Krishnan (SFU: Simon Fraser University)H-Index: 5
Last.Paulo V. CunhaH-Index: 1
view all 4 authors...
#1Herman Aguinis (University of Colorado Denver)H-Index: 56
#2Charles A. Pierce (U of M: University of Memphis)H-Index: 30
Last.Ivan S. Muslin (U of M: University of Memphis)H-Index: 4
view all 4 authors...
Cited By121
Newest
#1Justin A. DeSimone (UA: University of Alabama)H-Index: 6
#2Tine Köhler (University of Melbourne)H-Index: 5
Last.Jeremy L. Schoen (University of Mississippi)H-Index: 2
view all 3 authors...
#1Jaekyo Seo (UMN: University of Minnesota)H-Index: 1
#2Ki Bum Noh (UMN: University of Minnesota)
Last.Alexandre A Ardichvili (UMN: University of Minnesota)H-Index: 22
view all 3 authors...
#1Wen Shan (NUS: National University of Singapore)H-Index: 1
#2Joshua Keller (UNSW: University of New South Wales)H-Index: 6
Last.Damien Joseph (NTU: Nanyang Technological University)H-Index: 11
view all 3 authors...
#1Antonia J. Kaluza (Goethe University Frankfurt)H-Index: 1
#2Diana Boer (University of Koblenz and Landau)H-Index: 14
Last.Rolf van Dick (Goethe University Frankfurt)H-Index: 47
view all 4 authors...
#1Claudia Cristina Bitencourt (Universidade do Vale do Rio dos Sinos)H-Index: 6
#2Fernando de Oliveira Santini (Universidade do Vale do Rio dos Sinos)H-Index: 8
Last.Eduardo Kunzel Teixeira (PUCRS: Pontifícia Universidade Católica do Rio Grande do Sul)H-Index: 3
view all 5 authors...
#1Robbie C. M. van Aert (Tilburg University)H-Index: 8
#2Jelte M. Wicherts (Tilburg University)H-Index: 39
Last.M.A.L.M. van Assen (UU: Utrecht University)H-Index: 25
view all 3 authors...
View next paperMethods of Meta-Analysis: Correcting Error and Bias in Research Findings