Psychometrics and the neuroscience of individual differences: Internal consistency limits between-subjects effects.

Published on Aug 1, 2017in Journal of Abnormal Psychology5.519
· DOI :10.1037/abn0000274
Greg Hajcak66
Estimated H-index: 66
(SBU: Stony Brook University),
Alexandria Meyer14
Estimated H-index: 14
(FSU: Florida State University),
Roman Kotov38
Estimated H-index: 38
(SBU: Stony Brook University)
  • References (51)
  • Citations (19)
📖 Papers frequently viewed together
120 Citations
264 Citations
4 Authors (Dan Foti, ..., Greg Hajcak)
249 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Katherine R. Luking (SBU: Stony Brook University)H-Index: 11
#2Brady D. Nelson (SBU: Stony Brook University)H-Index: 19
Last. Greg Hajcak (SBU: Stony Brook University)H-Index: 66
view all 5 authors...
Abstract Background Abnormal neural response to reward is increasingly thought to function as a biological correlate of emerging psychopathology during adolescence. However, this view assumes that such responses have good psychometric properties, especially internal consistency—an assumption that is rarely tested. Methods Internal consistency (i.e., split-half reliability) was calculated for event-related potential (ERP) and blood oxygen level–dependent (BOLD) responses to monetary gain and loss...
21 CitationsSource
#1Alexandria Meyer (FSU: Florida State University)H-Index: 14
#2Greg Hajcak (SBU: Stony Brook University)H-Index: 66
Last. Daniel N. Klein (SBU: Stony Brook University)H-Index: 73
view all 5 authors...
12 CitationsSource
#1Alexandria Meyer (SBU: Stony Brook University)H-Index: 14
#2Matthew D. Lerner (SBU: Stony Brook University)H-Index: 19
Last. Greg Hajcak (SBU: Stony Brook University)H-Index: 66
view all 5 authors...
55 CitationsSource
This article describes the National Institute of Mental Health's Research Domain Criteria (RDoC) initiative. The description includes background, rationale, goals, and the way the initiative has been developed and organized. The central RDoC concepts are summarized and the current matrix of constructs that have been vetted by workshops of extramural scientists is depicted. A number of theoretical and methodological issues that can arise in connection with the nature of RDoC constructs are highli...
210 CitationsSource
#1Anna Weinberg (McGill University)H-Index: 27
#2Alexandria Meyer (SBU: Stony Brook University)H-Index: 14
Last. Greg Hajcak (SBU: Stony Brook University)H-Index: 66
view all 7 authors...
The error-related negativity (ERN) currently appears as a physiological measure in relation to three Research Domain Criteria (RDoC) constructs: Cognitive Control, Sustained Threat, and Reward Learning. We propose a conceptual model in which variance in the ERN reflects individual differences in the degree to which errors are evaluated as threatening. We also discuss evidence for the placement of the ERN in the “Sustained Threat” construct, as well as evidence that the ERN may more specifically ...
68 CitationsSource
#1Christopher J. Patrick (FSU: Florida State University)H-Index: 68
#2Greg Hajcak (SBU: Stony Brook University)H-Index: 66
As highlighted by articles in the current special issue, the RDoC initiative holds promise for advancing understanding of mental health problems. However, the initiative is at its early stages and it remains unclear what level of progress can be achieved and how quickly. In this closing article, we identify major challenges facing RDoC and propose concrete approaches to addressing these challenges, including (a) clearer specification of clinical problems for study, with use of symptom dimensions...
40 CitationsSource
#1Anna Weinberg (UIC: University of Illinois at Chicago)H-Index: 27
#2Raoul Dieterich (Humboldt University of Berlin)H-Index: 3
Last. Anja Riesel (Humboldt University of Berlin)H-Index: 15
view all 3 authors...
Abstract The ability to detect and respond to errors is critical to successful adaptation to a changing environment. The error-related negativity (ERN), an event-related potential (ERP) component, is a well-validated neural response to errors and reflects the error monitoring activity of the anterior cingulate cortex (ACC). Additionally, the ERN is implicated in several processes key to adaptive functioning. Abnormalities in error-related brain activity have been linked to multiple forms of psyc...
61 CitationsSource
#1Greg Hajcak (SBU: Stony Brook University)H-Index: 66
#2Christopher J. Patrick (FSU: Florida State University)H-Index: 68
The Research Domain Criteria (RDoC) reflects a paradigm shift in mental health research aimed at establishing a science of psychopathology that is grounded in neuroscience. In many ways, the RDoC approach to research has been utilized for decades by psychophysiologists who have leveraged a range of biological measures to study variability in psychological processes as a function of individual differences. We highlight the critical role of psychophysiology in the era of RDoC, and briefly review t...
8 CitationsSource
#1Scott A. Baldwin (BYU: Brigham Young University)H-Index: 30
#2Michael J. Larson (BYU: Brigham Young University)H-Index: 34
Last. Peter E. Clayson (UCLA: University of California, Los Angeles)H-Index: 20
view all 3 authors...
Psychometric studies of the ERN, CRN, Pe, and Pc ERPs are increasing. Coherent integration of these results is difficult with classical test theory because the definition of error depends on the measure of reliability. This study used generalizability theory, which extends the ideas of classical test theory, as a framework for evaluating the influence of psychopathology and number of trials on dependability of measurement. Participants included 34 people meeting criteria for major depression, 29...
29 CitationsSource
#1Philip TovoteH-Index: 8
#2Jonathan P. FadokH-Index: 11
Last. Andreas LüthiH-Index: 41
view all 3 authors...
Recent methodological progress has greatly facilitated the determination of the connectivity and functional characterization of complex neural circuits. In this Review, Tovote, Fadok and Luthi examine studies that have adopted circuit-based approaches to gain insight into how the brain governs fear and anxiety.
486 CitationsSource
Cited By19
#1Peter E. Clayson (USF: University of South Florida)H-Index: 1
To ensure adequate reliability (i.e., internal consistency), it is common in studies using event-related brain potentials (ERPs) to exclude participants for having too few trials. This practice is particularly relevant for error-related ERPs, such as error-related negativity (ERN), where the number of recorded ERN trials is not entirely under the researcher's control. Furthermore, there is a widespread practice of inferring reliability based on published psychometric research, which assumes that...
1 CitationsSource
#1Pablo Ribes-Guardiola (James I University)
#2Rosario Poy (James I University)H-Index: 13
Last. Javier Moltó (James I University)H-Index: 16
view all 4 authors...
This study examined associations of performance-monitoring event-related potentials (ERPs) from go/no-go and flanker tasks with one another, and with psychopathy-related traits of disinhibition, meanness, and boldness. A task-dependent relationship was evident between the error-related negativity (ERN) and trait disinhibition, with high-disinhibited participants showing reduced no-go ERN but not flanker ERN. Disinhibition was also inversely related to variants of the P3 and the error positivity ...
#1Brian W. Bauer (USM: University of Southern Mississippi)H-Index: 2
#2Brian J. Albanese (AU: Auburn University)
Last. Daniel W. Capron (USM: University of Southern Mississippi)H-Index: 20
view all 7 authors...
Very few people who desire death by suicide ever make a suicide attempt, highlighting the importance of determining factors that influence the capability to enact lethal self-harm. One such factor is fearlessness about death, which has been found to be an important predictor of suicide attempts. Recently, longitudinal evidence found that fearlessness about death is positively associated with fluctuations in suicidal ideation. Efforts exploring biophysical mechanisms of suicide have found diminis...
#2Iulia BanicaH-Index: 1
Last. Annmarie MacNamaraH-Index: 17
view all 6 authors...
Psychological assessments typically rely on self-report and behavioral measures. Augmenting these with neurophysiological measures of the construct in question may increase the accuracy and predictive power of these assessments. Moreover, thinking about neurophysiological measures from an assessment perspective may facilitate under-utilized research approaches (e.g., brain-based recruitment of participants). However, the lack of normative data for most neurophysiological measures has prevented t...
#1Elizabeth Bauer (A&M: Texas A&M University)
#2Annmarie MacNamara (A&M: Texas A&M University)H-Index: 17
Last. Carien M. van Reekum (University of Reading)H-Index: 19
view all 7 authors...
Intolerance of uncertainty (IU) is a transdiagnostic risk factor for internalizing disorders. Prior work has found that IU may be associated with either increased reactivity to threat or, alternatively, with decreased differential responding between threat and nonthreat/safety cues (i.e., threat generalization). For example, work by Morriss, Macdonald, & van Reekum (2016) found that higher IU was associated with increased threat generalization during acquisition (using skin conductance response ...
#1Hans S. Schroder (Harvard University)H-Index: 13
#2Stefanie Nickels (Harvard University)
Last. Diego A. Pizzagalli (Harvard University)H-Index: 60
view all 6 authors...
#1Peter E. Clayson (USF: University of South Florida)H-Index: 20
#2Kaylie A. Carbine (BYU: Brigham Young University)H-Index: 6
Last. Michael J. Larson (BYU: Brigham Young University)H-Index: 34
view all 3 authors...
Abstract Performance-monitoring event-related brain potentials (ERPs), such as the error-related negativity (ERN) and reward positivity (RewP), are advocated as biomarkers of depression symptoms and risk. However, a recent meta-analysis indicated effect size heterogeneity in the ERN and RewP literatures. Hence, advocating these ERPs as biomarkers of depression might be premature or possibly misguided due to the selective reporting of significant analyses on the part of researchers (e.g., p-hacki...
1 CitationsSource
#1Elizabeth L. Davis (UCR: University of California, Riverside)H-Index: 10
#2Rebecca J. Brooker (A&M: Texas A&M University)H-Index: 2
Last. Sarah Kahle (UC Davis: University of California, Davis)H-Index: 9
view all 3 authors...
The developmental psychobiology of self-regulation in childhood has received increasing attention in recent years. As a next step in advancing research and theorizing about the processes by which early biological correlates of self-regulation are forged, a more nuanced consideration of the contexts in which these phenomena are embedded is needed. This review synthesizes insights from distinct but complementary approaches to studying the developmental psychobiology of early self-regulation, focus...
2 CitationsSource
#1Peter E. Clayson (UCLA: University of California, Los Angeles)H-Index: 20
#2Kaylie A. Carbine (BYU: Brigham Young University)H-Index: 6
Last. Michael J. Larson (BYU: Brigham Young University)H-Index: 34
view all 4 authors...