Concurrent Adaptation of Human and Machine Improves Simultaneous and Proportional Myoelectric Control

Published on Jul 1, 2015in IEEE Transactions on Neural Systems and Rehabilitation Engineering3.478
· DOI :10.1109/TNSRE.2015.2401134
Janne M. Hahne9
Estimated H-index: 9
Sven Dähne19
Estimated H-index: 19
+ 2 AuthorsLucas C. Parra51
Estimated H-index: 51
(CCNY: City College of New York)
Myoelectric control of a prosthetic hand with more than one degree of freedom (DoF) is challenging, and clinically available techniques require a sequential actuation of the DoFs. Simultaneous and proportional control of multiple DoFs is possible with regression-based approaches allowing for fluent and natural movements. Conventionally, the regressor is calibrated in an open-loop with training based on recorded data and the performance is evaluated subsequently. For individuals with amputation or congenital limb-deficiency who need to (re)learn how to generate suitable muscle contractions, this open-loop process may not be effective. We present a closed-loop real-time learning scheme in which both the user and the machine learn simultaneously to follow a common target. Experiments with ten able-bodied individuals show that this co-adaptive closed-loop learning strategy leads to significant performance improvements compared to a conventional open-loop training paradigm. Importantly, co-adaptive learning allowed two individuals with congenital deficiencies to perform simultaneous 2-D proportional control at levels comparable to the able-bodied individuals, despite having to a learn completely new and unfamiliar mapping from muscle activity to movement trajectories. To our knowledge, this is the first study which investigates man-machine co-adaptation for regression-based myoelectric control. The proposed training strategy has the potential to improve myographic prosthetic control in clinically relevant settings.
  • References (40)
  • Citations (27)
📖 Papers frequently viewed together
136 Citations
290 Citations
968 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Ali Ameri (UNB: University of New Brunswick)H-Index: 5
#2Ernest Nlandu Kamavuako (AAU: Aalborg University)H-Index: 14
Last. Philip A. Parker (UNB: University of New Brunswick)H-Index: 30
view all 5 authors...
This study describes the first application of a support vector machine (SVM) based scheme for real-time simultaneous and proportional myoelectric control of multiple degrees of freedom (DOFs). Three DOFs including wrist flexion–extension, abduction–adduction and forearm pronation–supination were investigated with 10 able-bodied subjects and two individuals with transradial limb deficiency (LD). A Fitts' law test involving real-time target acquisition tasks was conducted to compare the usability ...
64 CitationsSource
#1Han-Jeong Hwang (Technical University of Berlin)H-Index: 16
#2Janne M. Hahne (Technical University of Berlin)H-Index: 9
Last. Klaus-Robert MüllerH-Index: 92
view all 3 authors...
Objective. Recent studies have shown the possibility of simultaneous and proportional control of electrically powered upper-limb prostheses, but there has been little investigation on optimal channel selection. The objective of this study is to find a robust channel selection method and the channel subsets most suitable for simultaneous and proportional myoelectric prosthesis control of multiple degrees-of-freedom (DoFs). Approach. Ten able-bodied subjects and one person with congenital upper-li...
15 CitationsSource
#1Ali Ameri (UNB: University of New Brunswick)H-Index: 5
#2Ernest Nlandu Kamavuako (AAU: Aalborg University)H-Index: 14
Last. Philip A. Parker (UNB: University of New Brunswick)H-Index: 30
view all 5 authors...
Abstract A training strategy for simultaneous and proportional myoelectric control of multiple degrees of freedom (DOFs) is proposed. Ten subjects participated in this work in which wrist flexion–extension, abduction–adduction, and pronation–supination were investigated. Subjects were prompted to elicit contractions corresponding and proportional to the excursion of a moving cursor on a computer screen. Artificial neural networks (ANNs) were used to map the electromyogram (EMG) signals obtained ...
17 CitationsSource
Aug 1, 2014 in EMBC (International Conference of the IEEE Engineering in Medicine and Biology Society)
#1Marina M.-C. Vidovic (Technical University of Berlin)H-Index: 4
#2Liliana P. ParedesH-Index: 6
Last. Klaus-Robert Müller (Technical University of Berlin)H-Index: 4
view all 9 authors...
3 CitationsSource
#1Max Ortiz-Catalan (Chalmers University of Technology)H-Index: 11
#2Bo Håkansson (Chalmers University of Technology)H-Index: 28
Last. Rickard Brånemark (Sahlgrenska University Hospital)H-Index: 33
view all 3 authors...
The prediction of simultaneous limb motions is a highly desirable feature for the control of artificial limbs. In this work, we investigated different classification strategies for individual and simultaneous movements based on pattern recognition of myoelectric signals. Our results suggest that any classifier can be potentially employed in the prediction of simultaneous movements if arranged in a distributed topology. On the other hand, classifiers inherently capable of simultaneous predictions...
53 CitationsSource
#1Amy L. Orsborn (University of California, Berkeley)H-Index: 12
#2Helene G. Moorman (HWNI: Helen Wills Neuroscience Institute)H-Index: 10
Last. Jose M. Carmena (HWNI: Helen Wills Neuroscience Institute)H-Index: 39
view all 6 authors...
Summary Neuroplasticity may play a critical role in developing robust, naturally controlled neuroprostheses. This learning, however, is sensitive to system changes such as the neural activity used for control. The ultimate utility of neuroplasticity in real-world neuroprostheses is thus unclear. Adaptive decoding methods hold promise for improving neuroprosthetic performance in nonstationary systems. Here, we explore the use of decoder adaptation to shape neuroplasticity in two scenarios relevan...
99 CitationsSource
#1Michael A. Powell (Johns Hopkins University)H-Index: 3
#2Rahul R. KalikiH-Index: 8
Last. Nitish V. Thakor (Johns Hopkins University)H-Index: 66
view all 3 authors...
We assessed the ability of four transradial amputees to control a virtual prosthesis capable of nine classes of movement both before and after a two-week training period. Subjects attended eight one-on-one training sessions that focused on improving the consistency and distinguishability of their hand and wrist movements using visual biofeedback from a virtual prosthesis. The virtual environment facilitated the precise quantification of three prosthesis control measures. During a final evaluatio...
46 CitationsSource
We propose an approach for online simultaneous and proportional myoelectric control of two degrees-of-freedom (DoF) of the wrist, using surface electromyographic signals. The method is based on the nonnegative matrix factorization (NMF) of the wrist muscle activation to extract low-dimensional control signals translated by the user into kinematic variables. This procedure does not need a training set of signals for which the kinematics is known (labeled dataset) and is thus unsupervised (althoug...
115 CitationsSource
#1Janne M. HahneH-Index: 9
#2F. BiebmannH-Index: 1
Last. Lucas C. Parra (CCNY: City College of New York)H-Index: 51
view all 8 authors...
In recent years the number of active controllable joints in electrically powered hand-prostheses has increased significantly. However, the control strategies for these devices in current clinical use are inadequate as they require separate and sequential control of each degree-of-freedom (DoF). In this study we systematically compare linear and nonlinear regression techniques for an independent, simultaneous and proportional myoelectric control of wrist movements with two DoF. These techniques i...
136 CitationsSource
#1Arjan Gijsberts (Idiap Research Institute)H-Index: 13
#2Rashida Bohra (DLR: German Aerospace Center)H-Index: 1
Last. Claudio Castellini (DLR: German Aerospace Center)H-Index: 26
view all 8 authors...
Stable myoelectric control of hand prostheses remains an open problem. The only successful human–machine interface is surface electromyography, typically allowing control of a few degrees of freedom. Machine learning techniques may have the potential to remove these limitations, but their performance is thus far inadequate: myoelectric signals change over time under the influence of various factors, deteriorating control performance. It is therefore necessary, in the standard approach, to regula...
57 CitationsSource
Cited By27
Abstract One of the most common issue in surface electromyography (sEMG) based myocontrol is to set a recurrent feature which allows to ensure a reliable multi degree of freedom (MDoF) prosthetic drive, mainly due to non-stationary behavior of signal. According to studies, electrode placement and shifts, variation in muscle contraction effort and muscle fatigue are the most common disturbance sources in sEMG recording, which traduces into a cumbersome donning and doffing recalibration. Many rele...
#1Carles IgualH-Index: 1
Last. Jorge IgualH-Index: 10
view all 4 authors...
State-of-the-art high-end prostheses are electro-mechanically able to provide a great variety of movements. Nevertheless, in order to functionally replace a human limb, it is essential that each movement is properly controlled. This is the goal of prosthesis control, which has become a growing research field in the last decades, with the ultimate goal of reproducing biological limb control. Therefore, exploration and development of prosthesis control are crucial to improve many aspects of an amp...
#2Dario FarinaH-Index: 76
Last. Ivan VujaklijaH-Index: 11
view all 3 authors...
Conventional myoelectric controllers provide a mapping between electromyographic signals and prosthetic functions. However, due to a number of instabilities continuously challenging this process, an initial mapping may require an extended calibration phase with long periods of user-training in order to ensure satisfactory performance. Recently, studies on co-adaptation have highlighted the benefits of concurrent user learning and machine adaptation where systems can cope with deficiencies in the...
#1Luzheng Bi (BIT: Beijing Institute of Technology)H-Index: 11
#2Aberham ->Genetu Feleke (BIT: Beijing Institute of Technology)H-Index: 1
Last. Cuntai Guan (NTU: Nanyang Technological University)H-Index: 41
view all 3 authors...
Abstract Electromyography (EMG) signal is one of the widely used biological signals for human motor intention prediction, which is an essential element in human-robot collaboration systems. Studies on motor intention prediction from EMG signal have been concentrated on classification and regression models, and there are numerous review and survey papers on classification models. However, to the best of our knowledge, there is no review paper on regression models or continuous motion prediction f...
4 CitationsSource
#1Cosima Prahm (Medical University of Vienna)H-Index: 5
#2Alexander SchulzH-Index: 38
Last. Oskar C. Aszmann (Medical University of Vienna)H-Index: 25
view all 8 authors...
Research on machine learning approaches for upper-limb prosthesis control has shown impressive progress. However, translating these results from the lab to patient’s everyday lives remains a challenge because advanced control schemes tend to break down under everyday disturbances, such as electrode shifts. Recently, it has been suggested to apply adaptive transfer learning to counteract electrode shifts using as little newly recorded training data as possible. In this paper, we present a novel, ...
#1Aidan D. RocheH-Index: 10
#2Ben Lakey (Imperial College London)
Last. Oskar C. Aszmann (Medical University of Vienna)H-Index: 25
view all 6 authors...
Purpose of Review This paper aims to summarise the development trends in upper limb bionics over the past 5 years.
#1Philipp Beckerle (Technische Universität Darmstadt)H-Index: 11
#2Claudio Castellini (DLR: German Aerospace Center)H-Index: 26
Last. Bigna Lenggenhager (UZH: University of Zurich)H-Index: 20
view all 3 authors...
Advanced human-machine interfaces render robotic devices applicable to study and enhance human cognition. This turns robots into formidable neuroscientific tools to study processes such as the adaptation between a human operator and the operated robotic device and how this adaptation modulates human embodiment and embodied cognition. We analyze bidirectional human-machine interface (bHMI) technologies for transparent information transfer between a human and a robot via efferent and afferent chan...
3 CitationsSource
#1Carles Igual (Polytechnic University of Valencia)H-Index: 1
#2Jorge Igual (Polytechnic University of Valencia)H-Index: 10
Last. Lucas C. Parra (CCNY: City College of New York)H-Index: 51
view all 4 authors...
In proportional myographic control, one can control either position or velocity of movement. Here, we propose to use adaptive auto-regressive filters, so as to gradually adjust between the two. We implemented this in an adaptive system with closed-loop feedback, where both the user and the machine simultaneously attempt to follow a cursor on a 2-D arena. We tested this on 15 able-bodied and three limb-deficient participants using an eight-channel myoelectric armband. The human–machine pairs lear...
1 CitationsSource
#1Richard B. Woodward (NU: Northwestern University)H-Index: 3
#2Levi J. Hargrove (NU: Northwestern University)H-Index: 33
Background Pattern recognition technology allows for more intuitive control of myoelectric prostheses. However, the need to collect electromyographic data to initially train the pattern recognition system, and to re-train it during prosthesis use, adds complexity that can make using such a system difficult. Although experienced clinicians may be able to guide users to ensure successful data collection methods, they may not always be available when a user needs to (re)train their device.
2 CitationsSource
#1Leonie Schmalfuss (GAU: University of Göttingen)H-Index: 2
#2Janne M. Hahne (GAU: University of Göttingen)H-Index: 9
Last. David Liebetanz (GAU: University of Göttingen)H-Index: 35
view all 9 authors...
2 CitationsSource