Match!

Limitations of PET-PEESE and Other Meta-Analysis Methods:

Published on Jul 1, 2017in Social Psychological and Personality Science3.60
· DOI :10.1177/1948550617693062
Tommy Stanley32
Estimated H-index: 32
(Hendrix College)
Abstract
A novel meta-regression method, precision-effect test and precision-effect estimate with standard errors (PET-PEESE), predicts and explains recent high-profile failures to replicate in psychology. The central purpose of this article is to identify the limitations of PET-PEESE for application to social/personality psychology. Using typical conditions found in social/personality research, our simulations identify three areas of concern. PET-PEESE performs poorly in research areas where there are only a few studies, all studies use small samples, and where there is very high heterogeneity of results from study to study. Nonetheless, the statistical properties of conventional meta-analysis approaches are much worse than PET-PEESE under these same conditions. Our simulations suggest alterations to conventional research practice and ways to moderate PET-PEESE weaknesses.
  • References (30)
  • Citations (23)
References30
Newest
#1Tommy Stanley (Hendrix College)H-Index: 32
#2Hristos Doucouliagos (Deakin University)H-Index: 30
44 CitationsSource
#1Tommy Stanley (Hendrix College)H-Index: 32
#2Hristos Doucouliagos (Deakin University)H-Index: 30
Last.John P. A. Ioannidis (Stanford University)H-Index: 151
view all 3 authors...
15 CitationsSource
#1Robbie C. M. van Aert (Tilburg University)H-Index: 8
#2Jelte M. Wicherts (Tilburg University)H-Index: 39
Last.M.A.L.M. van Assen (UU: Utrecht University)H-Index: 25
view all 3 authors...
46 CitationsSource
#1Blakeley B. McShane (NU: Northwestern University)H-Index: 16
#2Ulf Böckenholt (NU: Northwestern University)H-Index: 32
Last.Karsten T. Hansen (UCSD: University of California, San Diego)H-Index: 15
view all 3 authors...
63 CitationsSource
#1Martin S. Hagger (Curtin University)H-Index: 54
#2Nikos L. D. Chatzisarantis (Curtin University)H-Index: 49
275 CitationsSource
#1Stephan B. Bruns (University of Kassel)H-Index: 6
#2John P. A. Ioannidis (Stanford University)H-Index: 151
50 CitationsSource
#1Tommy Stanley (Hendrix College)H-Index: 32
#2Hristos Doucouliagos (Deakin University)H-Index: 30
88 CitationsSource
#1Jacky Au (UCI: University of California, Irvine)H-Index: 12
#2Ellen Sheehan (UCI: University of California, Irvine)H-Index: 2
Last.Susanne M. Jaeggi (UCI: University of California, Irvine)H-Index: 31
view all 6 authors...
262 CitationsSource
#1Tim Bogg (WSU: Wayne State University)H-Index: 18
#2Leanne Lasecki (WSU: Wayne State University)H-Index: 2
20 CitationsSource
#1Alexander A. AartsH-Index: 1
#2Joanna E. Anderson (DRDC: Defence Research and Development Canada)H-Index: 3
Last.Kellylynn Zuni (Adams State University)H-Index: 2
view all 270 authors...
2,235 CitationsSource
Cited By23
Newest
#1Claire Noble (University of Liverpool)H-Index: 5
#2Giovanni Sala (Osaka University)H-Index: 9
Last.Julian M. Pine (University of Liverpool)H-Index: 33
view all 7 authors...
Source
#1Agnieszka Sorokowska (TUD: Dresden University of Technology)H-Index: 16
#2Piotr Sorokowski (UWr: University of Wrocław)H-Index: 15
Last.Thomas Hummel (TUD: Dresden University of Technology)H-Index: 72
view all 5 authors...
9 CitationsSource
#1Anna MinasyanH-Index: 4
#2Juliane Zenker (GAU: University of Göttingen)H-Index: 2
Last.Sebastian Vollmer (GAU: University of Göttingen)H-Index: 20
view all 4 authors...
Source
#1Nicholas A. Coles (UT: University of Tennessee)H-Index: 3
#2Jeff T. Larsen (UT: University of Tennessee)H-Index: 27
Last.Ashley Kuelz (UT: University of Tennessee)
view all 4 authors...
Source
#1Faye Nitschke (UQ: University of Queensland)H-Index: 1
#2Blake M. McKimmie (UQ: University of Queensland)H-Index: 15
Last.Eric J. Vanman (UQ: University of Queensland)H-Index: 18
view all 3 authors...
Source
#1Margarita Sala (SMU: Southern Methodist University)H-Index: 7
#2Catherine Rochefort (SMU: Southern Methodist University)H-Index: 2
Last.Austin S. Baldwin (SMU: Southern Methodist University)H-Index: 13
view all 4 authors...
Source
#1Nicholas A. Coles (UT: University of Tennessee)H-Index: 3
#2Jeff T. Larsen (UT: University of Tennessee)H-Index: 27
Last.Heather C. Lench (A&M: Texas A&M University)H-Index: 18
view all 3 authors...
5 CitationsSource
#1Evan C. Carter (ARL: United States Army Research Laboratory)H-Index: 13
#2Felix D. Schönbrodt (LMU: Ludwig Maximilian University of Munich)H-Index: 19
Last.Joseph Hilgard (ISU: Illinois State University)H-Index: 10
view all 4 authors...
22 CitationsSource
#1N. Deniz Aksayli (University of Nottingham)H-Index: 2
#2Giovanni Sala (Osaka University)H-Index: 9
Last.Fernand Gobet (University of Liverpool)H-Index: 39
view all 3 authors...
2 CitationsSource
#1Mark Assink (UvA: University of Amsterdam)H-Index: 10
#2Claudia E. van der Put (UvA: University of Amsterdam)H-Index: 14
Last.Machteld Hoeve (UvA: University of Amsterdam)H-Index: 19
view all 7 authors...
2 CitationsSource
View next paperMeta-regression approximations to reduce publication selection bias