Review of eye-related measures of drivers’ mental workload

Published on Jan 1, 2015in Procedia Manufacturing
· DOI :10.1016/j.promfg.2015.07.783
Gerhard Marquart2
Estimated H-index: 2
(TU Delft: Delft University of Technology),
Christopher Cabrall10
Estimated H-index: 10
(TU Delft: Delft University of Technology),
Joost C. F. de Winter21
Estimated H-index: 21
(TU Delft: Delft University of Technology)
The assessment of mental workload could be helpful to road safety especially if developments of vehicle automation will increasingly place drivers into roles of supervisory control. With the rapidly decreasing size and increasing resolution of cameras as well as exponential computational power gains, remote eye measurements are growing in popularity as non-obtrusive and non-distracting tools for assessing driver workload. This review summarizes literature on the relation between eye measurement parameters and drivers’ mental workload. Various eye activity measures including blinks, fixations, and saccades have previously researched and confirmed as useful estimates of a driver's mental workload. Additionally, recent studies in pupillometry have shown promise for real-time prediction and assessment of driver mental workload after effects of illumination are accounted for. Specifically, workload increases were found to be indicated by increases in blink latency, PERCLOS, fixation duration, pupil dilation, and ICA; by decreases in blink duration and gaze variability; and with mixed results regarding blink rate. Given such a range of measures available, we recommend using multiple assessment methods to increase validity and robustness in driver assessment.
  • References (46)
  • Citations (45)
📖 Papers frequently viewed together
5,987 Citations
351 Citations
4 Authors (Oskar Palinko, ..., Peter A. Heeman)
149 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1C. DlugoschH-Index: 3
#2Antonia S. ContiH-Index: 3
Last. Klaus BenglerH-Index: 23
view all 3 authors...
Assessing a driver´s mental workload during tasks that are not visual-manual is a challenging endeavor. Especially with the rapid development of speech systems, this is becoming increasingly important. Pupillometry promises to be a suitable physiological measurement method, sensitive to variations of cognitive workload. This driving simulator study shows that the pupillometry data indicate a significant increase in cognitive activity during conversation tasks regardless of the acoustic channel u...
6 CitationsSource
#1Oskar Palinko (UNH: University of New Hampshire)H-Index: 9
#2Andrew L. Kun (UNH: University of New Hampshire)H-Index: 15
Pupil diameter can be used as a physiological measure of cognitive load in driving simulator studies. However, pupil size depends on both cognitive load and lighting conditions. In order to accurately estimate cognitive load these two effects must be separated. In this study the authors introduce illumination only, cognitive only and combined tasks. Based on these they decouple the two effects on pupil diameter and they design a predictor of the pupil’s reaction to light which can be used to est...
19 CitationsSource
#1Erwin R BoerH-Index: 1
Delayed event detection and degraded vehicle control are observed when drivers fuel their need to perform extra-driving activities. Vehicle control and event detection are shown to degrade most if the in-vehicle task requires spatial cognitive resources and/or if the activity requires visual perception and/or manual control manipulation. In-vehicle tasks with auditory input and/or voice output that primarily demand low levels of verbal cognitive resources appear to affect event detection only to...
32 CitationsSource
#1Joost C. F. de Winter (TU Delft: Delft University of Technology)H-Index: 21
#2Riender Happee (TU Delft: Delft University of Technology)H-Index: 25
Last. Neville A. Stanton (University of Southampton)H-Index: 59
view all 4 authors...
Adaptive cruise control (ACC), a driver assistance system that controls longitudinal motion, has been introduced in consumer cars in 1995. A next milestone is highly automated driving (HAD), a system that automates both longitudinal and lateral motion. We investigated the effects of ACC and HAD on drivers’ workload and situation awareness through a meta-analysis and narrative review of simulator and on-road studies. Based on a total of 32 studies, the unweighted mean self-reported workload was 4...
197 CitationsSource
#1Ying Wang (MIT: Massachusetts Institute of Technology)H-Index: 8
#2Bryan Reimer (MIT: Massachusetts Institute of Technology)H-Index: 31
Last. Bruce Mehler (MIT: Massachusetts Institute of Technology)H-Index: 23
view all 4 authors...
An observer's visual scanning behavior tends to narrow during periods of increased cognitive demand. Thus, measures of gaze concentration have become a popular method of gauging cognitive demand, but the consensus on the best method for computing gaze concentration is still evolving. This analysis considers measures of gaze concentration while driving an on-road vehicle, with and without two types of secondary cognitive demand (auditory and visuospatial working memory). We compare the advantages...
53 CitationsSource
#1Gianluca BorghiniH-Index: 16
#2Laura Astolfi (Sapienza University of Rome)H-Index: 35
Last. Fabio Babiloni (Sapienza University of Rome)H-Index: 59
view all 5 authors...
351 CitationsSource
Oct 28, 2013 in AutomotiveUI (Automotive User Interfaces and Interactive Vehicular Applications)
#1Vera Demberg (Saarland University)H-Index: 14
#2Asad B. Sayeed (Saarland University)H-Index: 9
Last. Christian Müller (German Research Centre for Artificial Intelligence)H-Index: 49
view all 4 authors...
This paper shows that fine-grained linguistic complexity has measurable effects on cognitive load with consequences for the design of in-car spoken dialogue systems. We used synthesized German sentences with grammatical ambiguities to test the additional workload caused by human sentence processing during driving. For the driving task, we used the Continuous Tracking and Reaction (ConTRe) task, which we believe is suitable for the measurement of the fine-grained effects of linguistically-related...
13 CitationsSource
#1Daniel DamböckH-Index: 10
#2T. WeissgerberH-Index: 2
Last. Klaus BenglerH-Index: 23
view all 4 authors...
Increasing safety and comfort are motivations for designing new assistance systems and enhance existing functionalities. As the driver is gradually replaced by new automation systems, new constellations of driver and automation in mutual vehicle guidance have to be rethought. This article presents driver response time in critical driving situations with a visual secondary task depending on the automation level. Concerning the perspective of the driver, a coherence of subjective and objective wor...
23 CitationsSource
Jan 1, 2013 in INTERSPEECH (Conference of the International Speech Communication Association)
#1Andrew L. Kun (UNH: University of New Hampshire)H-Index: 15
#2Oskar Palinko (UNH: University of New Hampshire)H-Index: 9
Last. Peter A. HeemanH-Index: 21
view all 4 authors...
In a driving simulator study, we explore the feasibility of using pupil diameter to estimate how the cognitive load of the driver changes during a spoken dialogue with a remote conversant. We confirm that it is feasible to use pupil diameter to differentiate between parts of the dialogue that increase the cognitive load of the driver, and those that decrease it. Our long term goal is to build a spoken dialogue system that can adapt its behavior when the driver is under high cognitive load, wheth...
11 Citations
#1Vera Demberg (Saarland University)H-Index: 14
Pupillometry: the Index of Cognitive Activity in a dual-task study Vera Demberg ( Cluster of Excellence, Saarland University, Campus C7.4, 66123 Saarbr¨ucken, Germany Abstract This paper reports experimental results on the index of cogni- tive activity (ICA), a recent micro-level measure in pupillom- etry, which relates processing load to the frequency of rapid small dilations of the pupil. We collected pupil size during a tracking task which was cast in a simulated dri...
8 Citations
Cited By45
#1Guofa Li (SZU: Shenzhen University)H-Index: 8
#2Weijian Lai (SZU: Shenzhen University)
Last. Yuezhi Li (SZU: Shenzhen University)
view all 7 authors...
Abstract Traffic congestion is more likely to lead to aggressive driving behavior that is associated with increased crash risks. Previous studies mainly focus on driving behavior during congestion when studying congestion effects. However, the negative effects of congestion on driving behavior may also affect drivers’ post-congestion driving. To fill this research gap, this study examined the influence of traffic congestion on driver behavior on the post-congestion roads (i.e., the roads travell...
#1Damee Choi (Hamamatsu University)
#2Toshihisa Sato (AIST: National Institute of Advanced Industrial Science and Technology)H-Index: 6
Last. Satoshi Kitazaki (AIST: National Institute of Advanced Industrial Science and Technology)H-Index: 8
view all 6 authors...
Abstract The present study investigated effects of cognitive and visual loads on driving performance after take-over request (TOR) in an automated driving task. Participants completed automated driving in a driving simulator without a non-driving related task, with an easy non-driving related task, and with a difficult non-driving related task. The primary task was to monitor the environment and the system state. An N-back task and a Surrogate Reference Task (SuRT) were adapted to induce cogniti...
#1Margherita Peruzzini (University of Modena and Reggio Emilia)H-Index: 11
#2Fabio Grandi (University of Modena and Reggio Emilia)H-Index: 2
Last. Marcello Pellicciari (University of Modena and Reggio Emilia)H-Index: 14
view all 3 authors...
Abstract In the context of smart factories, where intelligent machines share data and support enhanced functionalities at a factory level, workers are still seen as spectators rather than active players (Hermann, Pentek, & Otto, 2017). Instead, Industry 4.0 represents a great opportunity for workers to become part of the intelligent system; on one hand, operators can generate data to program machines and optimize the process flows, on the other hand they can receive useful information to support...
1 CitationsSource
#1Chuhao Wu (Purdue University)
#2Jackie S. Cha (Purdue University)H-Index: 2
Last. Denny Yu (Purdue University)H-Index: 9
view all 6 authors...
#1Gaojian Huang (Purdue University)
#2Clayton Steele (Purdue University)
Last. Brandon J. Pitts (Purdue University)H-Index: 3
view all 4 authors...
The rapid growth of autonomous vehicles is expected to improve roadway safety. However, certain levels of vehicle automation will still require drivers to ‘takeover’ during abnormal situations, whi...
#1Mostafa Pouyakian (Shahid Beheshti University of Medical Sciences and Health Services)H-Index: 2
#1MostafaPouyakian (Shahid Beheshti University of Medical Sciences and Health Services)
Last. MojtabaZokaei (Shahid Beheshti University of Medical Sciences and Health Services)
view all 6 authors...
#1Da Tao (SZU: Shenzhen University)H-Index: 5
#2Xu Zhang (SZU: Shenzhen University)
Last. Tingru Zhang (SZU: Shenzhen University)H-Index: 5
view all 6 authors...
Mental workload (MWL) is widely used in the design and evaluation of complex human–machine systems and can be measured by a number of physiological measures. However, the effectiveness of these measures seems unknown. This study was conducted to provide a comprehensive understanding of the effectiveness of physiological measures of MWL. Four electronic databases were systematically searched for empirical studies measuring MWL with physiological measures. Ninety-four studies were included for ana...
Oct 15, 2019 in MM (ACM Multimedia)
#1Ioannis Agtzidis (TUM: Technische Universität München)H-Index: 3
#2Mikhail Startsev (TUM: Technische Universität München)H-Index: 4
Last. Michael Dorr (TUM: Technische Universität München)H-Index: 17
view all 3 authors...
Eye tracking and the analysis of gaze behaviour are established tools to produce insights into how humans observe their surroundings and consume visual multimedia content. For example, gaze recordings may be directly used to study attention allocation towards the areas and objects of interest. Furthermore, segmenting the raw gaze traces into their constituent eye movements has applications in the assessment of subjective quality and mental load, and may improve computational saliency prediction ...
#1Matthias Beggiato (Chemnitz University of Technology)H-Index: 8
#2Franziska Hartwich (Chemnitz University of Technology)H-Index: 3
Last. Josef F. Krems (Chemnitz University of Technology)H-Index: 24
view all 3 authors...
Abstract Comfort in automated driving is considered a key issue for broad acceptance of automated vehicles. The research project KomfoPilot at Chemnitz University of Technology aimed to investigate factors that influence comfort in automated driving as well as to identify physiological indicators of discomfort. In an empirical driving simulator study, 40 participants from 25 to 84 years old experienced three highly automated trips including six potentially uncomfortable situations in each trip. ...
#1Christoph Strauch (University of Ulm)H-Index: 3
#2Kristin Mühl (University of Ulm)H-Index: 4
Last. Anke Huckauf (University of Ulm)H-Index: 10
view all 7 authors...
Abstract Trusting autonomous vehicles is seen as crucial for their dissemination. However, research on autonomous driving so far is restricted by using closed training courses or simulators and by comparing behaviour and evaluation while driving oneself (a manual car) with being driven (by an autonomous car). In the current study, we investigated passengers’ eye movements, categorized as safety-relevant or not safety-relevant, and trust ratings while being driven, once manually and once by an au...
1 CitationsSource