Empirical examination of the replicability of associations between brain structure and psychological variables

Published on Dec 17, 2018in bioRxiv
· DOI :10.1101/496729
Shahrzad Kharabian1
Estimated H-index: 1
Simon B. Eickhoff86
Estimated H-index: 86
+ 1 AuthorsSarah Genon12
Estimated H-index: 12
Linking interindividual differences in psychological phenotype to variations in brain structure is an old dream for psychology and a crucial question for cognitive neurosciences. Yet, replicability of the previously-reported 9structural brain behavior9 (SBB)-associations has been questioned, recently. Here, we conducted an empirical investigation, assessing replicability of SBB among heathy adults. For a wide range of psychological measures, the replicability of associations with gray matter volume was assessed. Our results revealed that among healthy individuals 1) finding an association between performance at standard psychological tests and brain morphology is relatively unlikely 2) significant associations, found using an exploratory approach, have overestimated effect sizes and 3) can hardly be replicated in an independent sample. After considering factors such as sample size and comparing our findings with more replicable SBB-associations in a clinical cohort and replicable associations between brain structure and non-psychological phenotype, we discuss the potential causes and consequences of these findings.
  • References (72)
  • Citations (3)
📖 Papers frequently viewed together
4 Authors (Reut Avinun, ..., Ahmad R. Hariri)
1 Citations
1 Author (Samaneh Sadeghi)
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Paul De Boeck (OSU: Ohio State University)H-Index: 37
#2Minjeong Jeon (UCLA: University of California, Los Angeles)H-Index: 12
12 CitationsSource
#1Benjamin O. Turner (NTU: Nanyang Technological University)H-Index: 10
#2Erick J. Paul (Microsoft)H-Index: 11
Last. Aron Keith BarbeyH-Index: 27
view all 4 authors...
Despite a growing body of research suggesting that task-based functional magnetic resonance imaging (fMRI) studies often suffer from a lack of statistical power due to too-small samples, the proliferation of such underpowered studies continues unabated. Using large independent samples across eleven tasks, we demonstrate the impact of sample size on replicability, assessed at different levels of analysis relevant to fMRI researchers. We find that the degree of replicability for typical sample siz...
30 CitationsSource
#1Thomas J. Vanasse (University of Texas Health Science Center at San Antonio)H-Index: 2
#2P. Mickle Fox (University of Texas Health Science Center at San Antonio)H-Index: 11
Last. Peter T. FoxH-Index: 114
view all 7 authors...
10 CitationsSource
#1Elmira Ismaylova (UdeM: Université de Montréal)H-Index: 4
#2Jessica Di Sante (Concordia University)H-Index: 3
Last. Linda Booij (Concordia University)H-Index: 28
view all 7 authors...
Numerous studies have shown differences in the functioning in the areas of the frontal-limbic circuitry between depressed patients and controls. However, current knowledge on frontal-limbic neural substrates of individual differences in mood states in everyday life in healthy individuals is scarce. The present study investigates anatomical, resting-state and functional neural correlates of daily mood states in healthy individuals. We expected to observe associations between mood and the frontal-...
4 CitationsSource
#1Sarah Genon (HHU: University of Düsseldorf)H-Index: 12
#2Andrew T. Reid (University of Nottingham)H-Index: 16
Last. Simon B. Eickhoff (HHU: University of Düsseldorf)H-Index: 86
view all 5 authors...
Many brain regions have been defined, but a comprehensive formalization of each region’s function in relation to human behavior is still lacking. Current knowledge comes from various fields, which have diverse conceptions of ‘functions’. We briefly review these fields and outline how the heterogeneity of associations could be harnessed to disclose the computational function of any region. Aggregating activation data from neuroimaging studies allows us to characterize the functional engagement of...
24 CitationsSource
When designing a study, the planned sample size is often based on power analyses. One way to choose an effect size for power analyses is by relying on pilot data. A-priori power analyses are only accurate when the effect size estimate is accurate. In this paper we highlight two sources of bias when performing a-priori power analyses for between-subject designs based on pilot data. First, we examine how the choice of the effect size index (η2, ω2 and e2) affects the sample size and power of the m...
34 CitationsSource
The presumed dominance of “original discovery” over replication is an anomaly. Original discovery has more value than replication primarily when scientific investigation can immediately generate numerous discoveries most of which are true and accurate. This scenario is uncommon. A model shows how original discovery claims typically have small or even negative value. Science becomes worthy mostly because of replication.
5 CitationsSource
#1Henk R. Cremers (UvA: University of Amsterdam)H-Index: 9
#2Tor D. Wager (CU: University of Colorado Boulder)H-Index: 72
Last. Tal Yarkoni (University of Texas at Austin)H-Index: 35
view all 3 authors...
Statistically underpowered studies can result in experimental failure even when all other experimental considerations have been addressed impeccably. In fMRI the combination of a large number of dependent variables, a relatively small number of observations (subjects), and a need to correct for multiple comparisons can decrease statistical power dramatically. This problem has been clearly addressed yet remains controversial—especially in regards to the expected effect sizes in fMRI, and especial...
60 CitationsSource
#1Sarah Genon (University of Liège)H-Index: 12
#2Tobias Wensing (RWTH Aachen University)H-Index: 2
Last. Simon B. Eickhoff (HHU: University of Düsseldorf)H-Index: 86
view all 8 authors...
Abstract Recently, we showed that the functional heterogeneity of the right dorsal premotor (PMd) cortex could be better understood by dividing it into five subregions that showed different behavioral associations according to task-based activations studies. The present study investigated whether the revealed behavioral profile could be corroborated and complemented by a structural brain behavior correlation approach in two healthy adults cohorts. Grey matter volume within the five volumes of in...
4 CitationsSource
The past several years have been a time for soul searching in psychology, as we have gradually come to grips with the reality that some of our cherished findings are less robust than we had assumed. Nevertheless, the replication crisis highlights the operation of psychological science at its best, as it reflects our growing humility. At the same time, institutional variables, especially the growing emphasis on external funding as an expectation or de facto requirement for faculty tenure and prom...
33 CitationsSource
Cited By3
#1M. Tahmasian (Forschungszentrum Jülich)
#2Fateme Samea (Shahid Beheshti University)H-Index: 3
Last. Sofie L. Valk (Forschungszentrum Jülich)H-Index: 8
view all 11 authors...
Humans need about 7 to 9 hours of sleep per night. Sleep habits are heritable, associated with brain function and structure, and intrinsically related to well-being, mental and physical health. This raises the question whether associations between sleep, mental and physical health can be attributed to a shared macroscale neurobiology. Combining neuroimaging and behavioral genetic approaches in two independent large-scale datasets (n=1887) we demonstrate phenotypic and genetic correspondence betw...
#1Reut Avinun (Duke University)H-Index: 7
#2Salomon Israel (HUJI: Hebrew University of Jerusalem)H-Index: 28
Last. Ahmad R. Hariri (Duke University)H-Index: 74
view all 4 authors...
1 CitationsSource