Communicative hand gestures as an implicit measure of artificial limb embodiment and daily usage

Published on Mar 16, 2020in medRxiv
· DOI :10.1101/2020.03.11.20033928
Roni O. Maimon-Mor2
Estimated H-index: 2
(University of Oxford),
Emeka Obasi1
Estimated H-index: 1
(UCL: University College London)
+ 5 AuthorsTamar R. Makin21
Estimated H-index: 21
(UCL: University College London)
When people talk, they move their hands to enhance meaning. Here we ask whether people spontaneously use their artificial limbs (prostheses) to gesture, and whether prosthesis gesture behaviour relates to everyday prosthesis use and perceived embodiment. One-handed participants with congenital and acquired hand loss and two-handed controls participated in gesture-facilitating tasks, measured using acceleration monitors and further validated with offline video coding. Everyday functional prosthesis use and perceived prosthesis embodiment were assessed using questionnaires. Perhaps surprisingly, one- and two-handed participants did not differ in the amount of gestures they produced. However, they did differ in their gesture profile. One-handers performed more, and bigger, movements with their intact hand while gesturing relative to their prosthesis, whereas two-handers produced more equal movements across hands. Importantly, one-handers who incorporated their prosthesis more into gesturing, that is - produced gestures that were more similar to their two-handed counterparts - also showed more frequent prosthesis use in day-to-day life. Although as a group, one-handers only marginally agreed that their prosthesis feels like a body-part, people reporting positive embodiment also showed great prosthesis habits, both for communication and daily function. We propose that measuring gesture behaviour in prosthesis-users can be used as an implicit and objective clinical tool to monitor and assess successful prosthesis adoption.
  • References (23)
  • Citations (2)
📖 Papers frequently viewed together
9 Authors (Hanul Bang, ..., Sung H. Han)
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1van den Heiligenberg Fmz. (University of Oxford)H-Index: 1
#2Tanya Orlov (HUJI: Hebrew University of Jerusalem)H-Index: 9
Last. Tamar R. Makin (University of Oxford)H-Index: 5
view all 9 authors...
The human brain contains multiple hand-selective areas, in both the sensorimotor and visual systems. Could our brain repurpose neural resources, originally developed for supporting hand function, to represent and control artificial limbs? We studied individuals with congenital or acquired hand-loss (hereafter one-handers) using functional MRI. We show that the more one-handers use an artificial limb (prosthesis) in their everyday life, the stronger visual hand-selective areas in the lateral occi...
11 CitationsSource
#1Jenny Lu (U of C: University of Chicago)H-Index: 3
#2Susan Goldin-Meadow (U of C: University of Chicago)H-Index: 72
In everyday communication, speakers not only describe, but they also depict. When depicting, speakers can take on the role of other people and quote their speech or imitate their actions. In previous work, we developed a paradigm to elicit depictions in speakers. Here we apply this paradigm to signers to explore depiction in the manual modality, with a focus on depiction of the size and shape of objects. We asked signers to describe two objects that could easily be characterized using lexical si...
3 CitationsSource
#1Catherine E. Lang (WashU: Washington University in St. Louis)H-Index: 42
#2Kimberly J. Waddell (WashU: Washington University in St. Louis)H-Index: 7
Last. Marghuretta D. Bland (WashU: Washington University in St. Louis)H-Index: 9
view all 4 authors...
A key reason for referral to rehabilitation services after stroke and other neurological conditions is to improve one's ability to function in daily life. It has become important to measure a person's activities in daily life, and not just measure their capacity for activity in the structured environment of a clinic or laboratory. A wearable sensor that is now enabling measurement of daily movement is the accelerometer. Accelerometers are commercially-available devices resembling large wrist wat...
19 CitationsSource
#1Fiona van den Heiligenberg (University of Oxford)H-Index: 3
#2Nick Yeung (University of Oxford)H-Index: 38
Last. Tamar R. Makin (University of Oxford)H-Index: 21
view all 5 authors...
Some theories propose that tools become incorporated into the neural representation of the hands (a process known as tool embodiment; Maravita & Iriki, 2004). Others suggest that conceptual body representation is rigid and that experience with one’s own body is insufficient for adapting bodily cognition, as shown in individuals born without hands (Vannuscorps & Caramazza, 2016) and in amputees with persistent phantom hand representation (Kikkert et al., 2016). How sharp is the conceptual boundar...
9 CitationsSource
#1Tamar R. Makin (UCL: University College London)H-Index: 21
#2Frederique de Vignemont (EHESS: School for Advanced Studies in the Social Sciences)H-Index: 11
Last. A. Aldo Faisal (Imperial College London)H-Index: 21
view all 3 authors...
The increasing integration of wearable technologies with the human body raises neural and cognitive challenges and opportunities.
33 CitationsSource
#1Alix Chadwell (University of Salford)H-Index: 3
#2Laurence Kenney (University of Salford)H-Index: 19
Last. John Head (University of Salford)H-Index: 4
view all 5 authors...
Users of myoelectric prostheses can often find them difficult to control. This can lead to passive-use of the device or total rejection, which can have detrimental effects on the contralateral limb due to overuse. Current clinically available prostheses are ‘open loop’ systems, and although considerable effort has been focused on developing biofeedback to “close the loop”, there is evidence from laboratory-based studies that other factors, notably improving predictability of response, may be as,...
33 CitationsSource
#1Ivan Vujaklija (GAU: University of Göttingen)H-Index: 13
#2Dario Farina (GAU: University of Göttingen)H-Index: 80
Last. Oskar C. Aszmann (Medical University of Vienna)H-Index: 27
view all 3 authors...
: Absence of an upper limb leads to severe impairments in everyday life, which can further influence the social and mental state. For these reasons, early developments in cosmetic and body-driven prostheses date some centuries ago, and they have been evolving ever since. Following the end of the Second World War, rapid developments in technology resulted in powered myoelectric hand prosthetics. In the years to come, these devices were common on the market, though they still suffered high user ab...
34 CitationsSource
#1Susannah M. Engdahl (UM: University of Michigan)H-Index: 3
#2Breanne P. Christie (UM: University of Michigan)H-Index: 4
Last. Deanna H. Gates (UM: University of Michigan)H-Index: 16
view all 6 authors...
Background Novel techniques for the control of upper limb prostheses may allow users to operate more complex prostheses than those that are currently available. Because many of these techniques are surgically invasive, it is important to understand whether individuals with upper limb loss would accept the associated risks in order to use a prosthesis.
53 CitationsSource
#1Ryan R. Bailey (WashU: Washington University in St. Louis)H-Index: 10
#2Joseph W. Klaesner (WashU: Washington University in St. Louis)H-Index: 12
Last. Catherine E. Lang (WashU: Washington University in St. Louis)H-Index: 42
view all 3 authors...
Background. Motor capability is commonly assessed inside the clinic, but motor performance in real-world settings (ie, outside of the clinic) is seldom assessed because measurement tools are lacking. Objective. To quantify real-world bilateral upper-limb (UL) activity in nondisabled adults and adults with stroke using a recently developed accelerometry-based methodology. Methods. Nondisabled adults (n = 74) and adults with chronic stroke (n = 48) wore accelerometers on both wrists for 25 to 26 h...
85 CitationsSource
#1Tamar R. Makin (University of Oxford)H-Index: 21
#2Alona O Cramer (University of Oxford)H-Index: 3
Last. Heidi Johansen-Berg (University of Oxford)H-Index: 83
view all 7 authors...
The loss of a limb will have a profound impact on an individual’s daily life. Nevertheless, individuals can employ a variety of behavioural strategies to adapt to the loss of, say, a hand. Some become skilled at using the residual part of their arm, while others prefer to rely on their other hand. Their brain, too, will undergo major changes. Many studies have shown that the region of the brain that controlled a given limb can be “taken over” by another part of the body if that limb is lost. Thi...
57 CitationsSource
Cited By2
#1Paulina Kieliba (UCL: University College London)H-Index: 1
#2Danielle Clode (UCL: University College London)
Last. Tamar R. Makin (UCL: University College London)H-Index: 21
view all 4 authors...
From hand tools to cyborgs, humans have long been fascinated by the opportunities afforded by augmenting ourselves. Here, we studied how motor augmentation with an extra robotic thumb (the Third Thumb) impacts the biological hand representation in the brains of able-bodied people. Participants were tested on a variety of behavioural and neuroimaging tests designed to interrogate the augmented hand9s representation before and after 5-days of semi-intensive training. Training improved the Thumb9s ...
#1Roni Maimon Mor (University of Oxford)H-Index: 1
#2Tamar R. Makin (University of Oxford)H-Index: 21
The potential ability of the human brain to represent an artificial limb as a body part (embodiment) has been inspiring engineers, clinicians, and scientists as a means to optimise human–machine interfaces. Using functional MRI (fMRI), we studied whether neural embodiment actually occurs in prosthesis users’ occipitotemporal cortex (OTC). Compared with controls, different prostheses types were visually represented more similarly to each other, relative to hands and tools, indicating the emergenc...
1 CitationsSource