Match!

Application of wavelet scattering networks in classification of ultrasound image sequences

Published on Sep 1, 2017
· DOI :10.1109/ULTSYM.2017.8091649
Amir Khan9
Estimated H-index: 9
(GMU: George Mason University),
Ananya S. Dhawan2
Estimated H-index: 2
(GMU: George Mason University)
+ 2 AuthorsSiddhartha Sikdar17
Estimated H-index: 17
(GMU: George Mason University)
Sources
Abstract
Recently, ultrasound imaging of muscle contractions has been used by several research groups to infer volitional motor intent of the user, and has shown promise as a novel muscle computer interface. Learning spatiotemporal features from ultrasound image sequences is challenging because of deformations introduced by probe repositioning. The image features are sensitive to probe placement and even small displacements during cross-session donning and doffing of the probe could compromise the classification accuracy when using a model trained on a previous session. This requires frequent recalibration. Deep learning based feature extractors have been shown to be invariant to translation, rotation and slight deformations. In this study, we investigated the feasibility of wavelet-based deep scattering features to preserve motion classification accuracy across multiple donning and doffing sessions. It was demonstrated that scattering features, which do not require learning filter weights, can significantly improve the cross-session classification accuracy by 20–30%. It can be concluded that these features are robust to minor probe displacements. They need to be further investigated with a larger data set to investigate their robustness in accurately classifying different muscle movements.
  • References (13)
  • Citations (2)
📖 Papers frequently viewed together
2010EMBC: International Conference of the IEEE Engineering in Medicine and Biology Society
3 Authors (Thomas Lorrain, ..., Dario Farina)
8 Citations
2016
2 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
References13
Newest
#1M. Z. Ahmad (National University of Sciences and Technology)H-Index: 5
#2Awais M. Kamboh (National University of Sciences and Technology)H-Index: 8
Last. Amir Khan (National University of Sciences and Technology)H-Index: 9
view all 4 authors...
Epilepsy is one of the most common neurological disorders, which manifests as unprovoked seizures. The prevalence of epilepsy is higher in developing countries, where medical facilities are ill-equipped and under-staffed. Mobile EEG devices promise a new dawn for long-term ambulatory EEG monitoring, which has a potential to revolutionize health care for neurological disorders especially epilepsy. Increasing the outreach to underserved communities and continuous monitoring of patients will yield ...
3 CitationsSource
#1Weichao Guo (SJTU: Shanghai Jiao Tong University)H-Index: 5
#2Xinjun Sheng (SJTU: Shanghai Jiao Tong University)H-Index: 17
Last. Xiangyang Zhu (SJTU: Shanghai Jiao Tong University)H-Index: 23
view all 4 authors...
Advanced myoelectric prosthetic hands are currently limited due to the lack of sufficient signal sources on amputation residual muscles and inadequate real-time control performance. This paper presents a novel human–machine interface for prosthetic manipulation that combines the advantages of surface electromyography (EMG) and near-infrared spectroscopy (NIRS) to overcome the limitations of myoelectric control. Experiments including 13 able-bodied and three amputee subjects were carried out to e...
14 CitationsSource
May 2, 2017 in CHI (Human Factors in Computing Systems)
#1Jess McIntosh (UoB: University of Bristol)H-Index: 5
#2Asier Marzo (UoB: University of Bristol)H-Index: 12
Last. Carol Phillips (University Hospitals Bristol NHS Foundation Trust)H-Index: 1
view all 4 authors...
Recent improvements in ultrasound imaging enable new opportunities for hand pose detection using wearable devices. Ultrasound imaging has remained under-explored in the HCI community despite being non-invasive, harmless and capable of imaging internal body parts, with applications including smart-watch interaction, prosthesis control and instrument tuition. In this paper, we compare the performance of different forearm mounting positions for a wearable ultrasonographic device. Location plays a f...
17 CitationsSource
#1Nima Akhlaghi (GMU: George Mason University)H-Index: 4
#2Clayton A. Baker (GMU: George Mason University)H-Index: 2
Last. Siddhartha Sikdar (GMU: George Mason University)H-Index: 17
view all 10 authors...
Surface electromyography (sEMG) has been the predominant method for sensing electrical activity for a number of applications involving muscle–computer interfaces, including myoelectric control of prostheses and rehabilitation robots. Ultrasound imaging for sensing mechanical deformation of functional muscle compartments can overcome several limitations of sEMG, including the inability to differentiate between deep contiguous muscle compartments, low signal-to-noise ratio, and lack of a robust gr...
33 CitationsSource
#1Kuang-Yu Chang (AS: Academia Sinica)H-Index: 7
#2Chu-Song Chen (AS: Academia Sinica)H-Index: 32
This paper presents a cost-sensitive ordinal hyperplanes ranking algorithm for human age estimation based on face images. The proposed approach exploits relative-order information among the age labels for rank prediction. In our approach, the age rank is obtained by aggregating a series of binary classification results, where cost sensitivities among the labels are introduced to improve the aggregating performance. In addition, we give a theoretical analysis on designing the cost of individual b...
58 CitationsSource
#1Siddhartha Sikdar (GMU: George Mason University)H-Index: 17
#2Huzefa Rangwala (GMU: George Mason University)H-Index: 20
Last. Joseph J. Pancrazio (GMU: George Mason University)H-Index: 33
view all 8 authors...
Recently there have been major advances in the electro-mechanical design of upper extremity prosthetics. However, the development of control strategies for such prosthetics has lagged significantly behind. Conventional noninvasive myoelectric control strategies rely on the amplitude of electromyography (EMG) signals from flexor and extensor muscles in the forearm. Surface EMG has limited specificity for deep contiguous muscles because of cross talk and cannot reliably differentiate between indiv...
38 CitationsSource
#1Joan Bruna (NYU: New York University)H-Index: 25
#2Stéphane Mallat ('ENS Paris': École Normale Supérieure)H-Index: 45
A wavelet scattering network computes a translation invariant image representation which is stable to deformations and preserves high-frequency information for classification. It cascades wavelet transform convolutions with nonlinear modulus and averaging operators. The first network layer outputs SIFT-type descriptors, whereas the next layers provide complementary invariant information that improves classification. The mathematical analysis of wavelet scattering networks explains important prop...
580 CitationsSource
#1Claudio CastelliniH-Index: 26
#2Georg PassigH-Index: 9
Last. E. Zarka (DLR: German Aerospace Center)H-Index: 1
view all 3 authors...
Medical ultrasound imaging is a well-known technique to gather live views of the interior of the human body. It is totally safe, it provides high spatial and temporal resolution, and it is nowadays available at any hospital. This suggests that it could be used as a human-computer interface. In this paper, we use ultrasound images of the human forearm to predict the finger positions, including thumb adduction and thumb rotation. Our experimental results show that there is a clear linear relations...
55 CitationsSource
Jun 1, 2011 in CVPR (Computer Vision and Pattern Recognition)
#1Joan Bruna (École Polytechnique)H-Index: 25
#2Stéphane Mallat (École Polytechnique)H-Index: 45
A scattering vector is a local descriptor including multiscale and multi-direction co-occurrence information. It is computed with a cascade of wavelet decompositions and complex modulus. This scattering representation is locally translation invariant and linearizes deformations. A supervised classification algorithm is computed with a PCA model selection on scattering vectors. State of the art results are obtained for handwritten digit recognition and texture classification.
53 CitationsSource
Oct 4, 2009 in UIST (User Interface Software and Technology)
#1T. Scott Saponas (UW: University of Washington)H-Index: 22
#2Desney S. Tan (Microsoft)H-Index: 51
Last. James A. Landay (UW: University of Washington)H-Index: 62
view all 6 authors...
Previous work has demonstrated the viability of applying offline analysis to interpret forearm electromyography (EMG) and classify finger gestures on a physical surface. We extend those results to bring us closer to using muscle-computer interfaces for always-available input in real-world applications. We leverage existing taxonomies of natural human grips to develop a gesture set covering interaction in free space even when hands are busy with other objects. We present a system that classifies ...
212 CitationsSource
Cited By2
Newest
#1Ananya S. DhawanH-Index: 2
#2Biswarup MukherjeeH-Index: 3
Last. Siddhartha SikdarH-Index: 17
view all 9 authors...
Technological advances in multi-articulated prosthetic hands have outpaced the methods available to amputees to intuitively control these devices. Amputees often cite difficulty of use as a key contributing factor for abandoning their prosthesis, creating a pressing need for improved control technology. A major challenge of traditional myoelectric control strategies using surface electromyography electrodes has been the difficulty in achieving intuitive and robust proportional control of multipl...
#1Mohammad Hassan Jahanandish (UTD: University of Texas at Dallas)H-Index: 1
#2Nicholas P. Fey (UTD: University of Texas at Dallas)H-Index: 14
Last. Kenneth Hoyt (UTD: University of Texas at Dallas)H-Index: 20
view all 3 authors...
Objective: Powered assistive devices need improved control intuitiveness to enhance their clinical adoption. Therefore, the intent of individuals should be identified and the device movement should adhere to it. Skeletal muscles contract synergistically to produce defined lower-limb movements so unique contraction patterns in lower-extremity musculature may provide a means of device joint control. Ultrasound (US) imaging enables direct measurement of the local deformation of muscle segments. Hen...
3 CitationsSource
#1Ananya S. Dhawan (GMU: George Mason University)H-Index: 2
#2Biswarup Mukherjee (GMU: George Mason University)H-Index: 3
Last. Siddhartha Sikdar (GMU: George Mason University)H-Index: 17
view all 9 authors...
Technological advances in multi-articulated prosthetic hands have outpaced the methods available to amputees to intuitively control these devices. Amputees often cite difficulty of use as a key contributing factor for abandoning their prosthesis, creating a pressing need for improved control technology. A major challenge of traditional myoelectric control strategies using surface electromyography electrodes has been the difficulty in achieving intuitive and robust proportional control of multipl...
2 CitationsSource