Match!

Assessing reliability in neuroimaging research through intra-class effect decomposition (ICED)

Published on Jul 2, 2018in eLife7.551
· DOI :10.7554/eLife.35718
Andreas M. Brandmaier14
Estimated H-index: 14
(MPG: Max Planck Society),
Elisabeth Wenger13
Estimated H-index: 13
(MPG: Max Planck Society)
+ 3 AuthorsUlman Lindenberger81
Estimated H-index: 81
(MPG: Max Planck Society)
Abstract
  • References (32)
  • Citations (3)
📖 Papers frequently viewed together
1 Citations
1974
1 Author (Alan L. Sockloff)
78% of Scinapse members use related papers. After signing in, all features are FREE.
References32
Newest
#1Craig Hedge (Cardiff University)H-Index: 7
#2Georgina Powell (Cardiff University)H-Index: 5
Last. Petroc Sumner (Cardiff University)H-Index: 30
view all 3 authors...
Individual differences in cognitive paradigms are increasingly employed to relate cognition to brain structure, chemistry, and function. However, such efforts are often unfruitful, even with the most well established tasks. Here we offer an explanation for failures in the application of robust cognitive paradigms to the study of individual differences. Experimental effects become well established – and thus those tasks become popular – when between-subject variability is low. However, low betwee...
120 CitationsSource
#1Andreas M. Brandmaier (MPG: Max Planck Society)H-Index: 14
#2Timo von Oertzen (MPG: Max Planck Society)H-Index: 19
Last. Christopher Hertzog (MPG: Max Planck Society)H-Index: 61
view all 5 authors...
Latent Growth Curve Models (LGCM) have become a standard technique to model change over time. Prediction and explanation of inter-individual differences in change are major goals in lifespan research. The major determinants of statistical power to detect individual differences in change are the magnitude of true inter-individual differences in linear change (LGCM slope variance), design precision, alpha level, and sample size. Here, we show that design precision can be expressed as the inverse o...
5 CitationsSource
#1Mario PannunziH-Index: 7
#2Rikkert HindriksH-Index: 10
Last. Gustavo DecoH-Index: 62
view all 13 authors...
3 CitationsSource
#1Stephanie Noble (Yale University)H-Index: 6
#2Marisa N. Spann (Columbia University)H-Index: 13
Last. Dustin Scheinost (Yale University)H-Index: 28
view all 6 authors...
65 CitationsSource
#1Elisa Filevich (MPG: Max Planck Society)H-Index: 10
#2Nina Lisofsky (MPG: Max Planck Society)H-Index: 6
Last. Simone Kühn (MPG: Max Planck Society)H-Index: 42
view all 9 authors...
Background Most studies of brain structure and function, and their relationships to cognitive ability, have relied on inter-individual variability in magnetic resonance (MR) images. Intra-individual variability is often ignored or implicitly assumed to be equivalent to the former. Testing this assumption empirically by collecting enough data on single individuals is cumbersome and costly. We collected a dataset of multiple MR sequences and behavioural covariates to quantify and characterize intr...
14 CitationsSource
#1Evan M. Gordon (UTD: University of Texas at Dallas)H-Index: 22
#2Timothy O. Laumann (WashU: Washington University in St. Louis)H-Index: 23
Last. Nico U.F. Dosenbach (WashU: Washington University in St. Louis)H-Index: 24
view all 20 authors...
Summary Human functional MRI (fMRI) research primarily focuses on analyzing data averaged across groups, which limits the detail, specificity, and clinical utility of fMRI resting-state functional connectivity (RSFC) and task-activation maps. To push our understanding of functional brain organization to the level of individual humans, we assembled a novel MRI dataset containing 5 hr of RSFC data, 6 hr of task fMRI, multiple structural MRIs, and neuropsychological tests from each of ten adults. U...
186 CitationsSource
#1Muzamil Arshad (WSU: Wayne State University)H-Index: 4
#2Jeffrey A. Stanley (WSU: Wayne State University)H-Index: 32
Last. Naftali Raz (WSU: Wayne State University)H-Index: 61
view all 3 authors...
In an age-heterogeneous sample of healthy adults, we examined test–retest reliability (with and without participant repositioning) of two popular MRI methods of estimating myelin content: modeling the short spin–spin (T2) relaxation component of multi-echo imaging data and computing the ratio of T1-weighted and T2-weighted images (T1w/T2w). Taking the myelin water fraction (MWF) index of myelin content derived from the multi-component T2 relaxation data as a standard, we evaluate the concurrent ...
25 CitationsSource
#1Jason P. LerchH-Index: 61
#2A. van der KouweH-Index: 41
Last. Stamatios N. SotiropoulosH-Index: 31
view all 9 authors...
The study of neuroanatomy using MRI enables key insights into how our brains function, are shaped by genes and environment, and how they change with development, aging and disease. The authors provide an overview of the methods for measuring the brain and also describe key artifacts and confounds
64 CitationsSource
#1Walter P. Vispoel (UI: University of Iowa)H-Index: 18
#2Carrie A. Morris (UI: University of Iowa)H-Index: 6
Last. Murat Kilinc (UI: University of Iowa)H-Index: 3
view all 3 authors...
8 CitationsSource
#1Tenko Raykov (MSU: Michigan State University)H-Index: 32
#2George A. Marcoulides (UCSB: University of California, Santa Barbara)H-Index: 8
Last. Thanos PatelisH-Index: 3
view all 3 authors...
A critical discussion of the assumption of uncorrelated errors in classical psychometric theory and its applications is provided. It is pointed out that this assumption is essential for a number of fundamental results and underlies the concept of parallel tests, the Spearman–Brown’s prophecy and the correction for attenuation formulas as well as the discrepancy between observed and true correlations, and the upper bound property of the reliability index with respect to validity. These relationsh...
8 CitationsSource
Cited By3
Newest
#1Andreas M. Brandmaier (MPG: Max Planck Society)H-Index: 14
#2Paolo GhislettaH-Index: 28
Last. Timo von Oertzen (MPG: Max Planck Society)H-Index: 19
view all 3 authors...
Longitudinal data collection is a time-consuming and cost-intensive part of developmental research. Wu et al. (2016) discussed planned missing (PM) designs that are similar in efficiency to complete designs but require fewer observations per person. The authors reported optimal PM designs for linear latent growth curve models based on extensive Monte Carlo simulations. They called for further formal investigation of the question as to how much the proposed PM mechanisms influence study design ef...
Source
Abstract Background Computational models show great promise in mapping latent decision-making processes onto dissociable neural substrates and clinical phenotypes. One prominent example in reinforcement learning (RL) is model-based planning, which specifically relates to transdiagnostic compulsivity. However, the reliability of computational model-derived measures like model-based planning is unclear. Establishing reliability is necessary to ensure such models measure stable, trait-like processe...
Source
#1Beate E. Muehlroth (MPG: Max Planck Society)H-Index: 1
#2Markus Werkle-Bergner (MPG: Max Planck Society)H-Index: 22
In quest of new avenues to explain, predict, and treat pathophysiological conditions during aging, research on sleep and aging has flourished. Despite the great scientific potential to pinpoint mechanistic pathways between sleep, aging, and pathology, only little attention has been paid to the suitability of analytic procedures applied to study these interrelations. On the basis of electrophysiological sleep and structural brain data of healthy younger and older adults, we identify, illustrate, ...
4 CitationsSource
#1Chaitali AnandH-Index: 3
#2Andreas M. Brandmaier (MPG: Max Planck Society)H-Index: 14
Last. Naftali Raz (MPG: Max Planck Society)H-Index: 61
view all 6 authors...
We investigated test–retest reliability of two MRI-derived indices of white-matter microstructural properties in the human corpus callosum (CC): myelin water fraction (MWF) and geometric mean T2 relaxation time of intra/extracellular water (geomT2IEW), using a 3D gradient and multi spin-echo sequence in 20 healthy adults (aged 24–69 years, 10 men). For each person, we acquired two back-to-back acquisitions in a single session, and the third after a break and repositioning the participant in the ...
Source
#1Julian David Karch (LEI: Leiden University)H-Index: 3
#2Elisa Filevich (Humboldt University of Berlin)H-Index: 10
Last. Simone Kühn (MPG: Max Planck Society)H-Index: 42
view all 10 authors...
Abstract Adequate reliability of measurement is a precondition for investigating individual differences and age-related changes in brain structure. One approach to improve reliability is to identify and control for variables that are predictive of within-person variance. To this end, we applied both classical statistical methods and machine-learning-inspired approaches to structural magnetic resonance imaging (sMRI) data of six participants aged 24–31 years gathered at 40–50 occasions distribute...
Source
#1Stephanie Noble (Yale University)H-Index: 6
#2Dustin ScheinostH-Index: 28
Last. R. Todd Constable (Yale University)H-Index: 84
view all 3 authors...
Abstract Background Once considered mere noise, fMRI-based functional connectivity has become a major neuroscience tool in part due to early studies demonstrating its reliability. These fundamental studies revealed only the tip of the iceberg; over the past decade, many test-retest reliability studies have continued to add nuance to our understanding of this complex topic. A summary of these diverse and at times contradictory perspectives is needed. Objectives We aimed to summarize the existing ...
11 CitationsSource
#1Beate E. Muehlroth (MPG: Max Planck Society)H-Index: 1
#2Markus Werkle-Bergner (MPG: Max Planck Society)H-Index: 22
In quest of new avenues to explain, predict, and treat pathophysiological conditions during aging, research on sleep and aging has flourished. Despite the great scientific potential to pinpoint mechanistic pathways between sleep, aging, and pathology, only little attention has been paid to the suitability of analytic procedures applied to study these interrelations. On the basis of electrophysiological sleep and structural brain data of healthy younger and older adults, we identify, illustrate, ...
Source
#1Elliot M. Tucker-Drob (University of Texas at Austin)H-Index: 31
#2Andreas M. Brandmaier (MPG: Max Planck Society)H-Index: 14
Last. Ulman Lindenberger (MPG: Max Planck Society)H-Index: 81
view all 3 authors...
6 CitationsSource