Transferrable Operative Difficulty Assessment in Robot-assisted Teleoperation: A Domain Adaptation Approach.

Published on Jan 1, 2019in arXiv: Robotics
Ziheng Wang2
Estimated H-index: 2
(UTD: University of Texas at Dallas),
Cong Feng6
Estimated H-index: 6
+ 1 AuthorsAnn Majewicz Fey2
Estimated H-index: 2
Providing an accurate and efficient assessment of operative difficulty is important for designing robot-assisted teleoperation interfaces that are easy and natural for human operators to use. In this paper, we aim to develop a data-driven approach to numerically characterize the operative difficulty demand of complex teleoperation. In effort to provide an entirely task-independent assessment, we consider using only data collected from the human user including: (1) physiological response, and (2) movement kinematics. By leveraging an unsupervised domain adaptation technique, our approach learns the user information that defines task difficulty in a well-known source, namely, a Fitt's target reaching task, and generalizes that knowledge to a more complex human motor control scenario, namely, the teleoperation of a robotic system. Our approach consists of two main parts: (1) The first part accounts for the inherent variances of user physiological and kinematic response between these cross-domain motor control scenarios that are vastly different. (2) A stacked two-layer learner is designed to improve the overall modeling performance, yielding a 96.6% accuracy in predicting the known difficulty of a Fitts' reaching task when using movement kinematic features. We then validate the effectiveness of our model by investigating teleoperated robotic needle steering as a case study. Compared with a standard NASA TLX user survey, our results indicate significant differences in the difficulty demand for various choices of needle steering control algorithms, p<0.05, as well as the difficulty of steering the needle to different targets, p<0.05. The results highlight the potential of our approach to be used as a design tool to create more intuitive and natural teleoperation interfaces in robot-assisted systems.
  • References (53)
  • Citations (0)
📖 Papers frequently viewed together
2018ICRA: International Conference on Robotics and Automation
3 Authors (Ziheng Wang, ..., Ann Majewicz Fey)
2 Citations
3 Authors (Ji Liang, ..., Lili Guo)
1 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1David Whitney (Brown University)H-Index: 6
#2Eric Rosen (Brown University)H-Index: 3
Last. Stefanie Tellex (Brown University)H-Index: 22
view all 5 authors...
Teleoperation allows a human to remotely operate a robot to perform complex and potentially dangerous tasks such as defusing a bomb, repairing a nuclear reactor, or maintaining the exterior of a space station. Existing teleoperation approaches generally rely on computer monitors to display sensor data and joysticks or keyboards to actuate the robot. These approaches use 2D interfaces to view and interact with a 3D world, which can make using them difficult for complex or delicate tasks. To addre...
22 CitationsSource
#1Ziheng Wang (UTD: University of Texas at Dallas)H-Index: 2
#2Ann Majewicz Fey (UTD: University of Texas at Dallas)H-Index: 2
Purpose With the advent of robot-assisted surgery, the role of data-driven approaches to integrate statistics and machine learning is growing rapidly with prominent interests in objective surgical skill assessment. However, most existing work requires translating robot motion kinematics into intermediate features or gesture segments that are expensive to extract, lack efficiency, and require significant domain-specific knowledge.
14 CitationsSource
#1Mahya Shahbazi (UWO: University of Western Ontario)H-Index: 10
#2Seyed Farokh Atashzar (UWO: University of Western Ontario)H-Index: 8
Last. Rajni V. Patel (UWO: University of Western Ontario)H-Index: 32
view all 3 authors...
While conventional bilateral Single-Master/Single-Slave (SM/SS) teleoperation systems have received considerable attention during the past several decades, multilateral teleoperation is only recently being studied. Unlike an SM/SS system, which consists of one master-slave set, multilateral teleoperation frameworks involve a minimum of three agents in order to remotely perform a task. This paper presents an overview of multilateral teleoperation systems and classifies the existing state-of-the-a...
6 CitationsSource
May 1, 2018 in ICRA (International Conference on Robotics and Automation)
#1Ziheng Wang (UTD: University of Texas at Dallas)H-Index: 2
#2Isabella Reed (UTD: University of Texas at Dallas)H-Index: 2
Last. Ann Majewicz Fey (UTD: University of Texas at Dallas)H-Index: 2
view all 3 authors...
2 CitationsSource
1 CitationsSource
#1Lora A. Cavuoto (UB: University at Buffalo)H-Index: 12
#2Ahmed A. Hussein (Cairo University)H-Index: 13
Last. Khurshid A. Guru (Roswell Park Cancer Institute)H-Index: 38
view all 11 authors...
Objective To investigate the cognitive and physical workload experienced by each operating room team member for different types of urologic procedures. Methods Surgeons, anesthesiologists, surgical fellows, bedside assistants, circulating nurses, and scrub nurses completed the National Aeronautics and Space Administration Task Load Index questionnaire for various urologic robot-assisted surgery procedures. A total of 338 questionnaires from 55 unique individuals were collected. Workload differen...
7 CitationsSource
#1Dan Pan (THU: Tsinghua University)H-Index: 2
#2Yijing Zhang (THU: Tsinghua University)H-Index: 1
Last. Zhizhong Li (THU: Tsinghua University)H-Index: 19
view all 3 authors...
This study aims to explore how task complexity and spatial ability on teleoperation performance, especially the interaction effects of task complexity and spatial ability. Three kinds of robotic arm teleoperation task were designed, namely point aiming, line alignment, and cross alignment. They were respectively treated as teleoperation task with low, middle and high complexity. Teleoperation performance were measured from task completion time, rate of extra distance moved, operation slip and co...
1 CitationsSource
#1Euijung Yang (Iowa State University)H-Index: 3
#2Michael C. Dorneich (Iowa State University)H-Index: 13
The effects of intermittent and variable time delay were investigated to understand the cognitive and physical consequences of gaps between an input from an operator and the corresponding feedback response from the system. Time delay has been shown to disrupt task performance in various areas including psychology and telerobotics. Previous research in multiple domains has focused on the performance effects of time delay and overcoming technological limitations that cause time delay. However, rob...
5 CitationsSource
#1Han U. Yoon (A&M: Texas A&M University)H-Index: 2
#2Ranxiao F. Wang (UIUC: University of Illinois at Urbana–Champaign)H-Index: 1
Last. Pilwon Hur (A&M: Texas A&M University)H-Index: 11
view all 4 authors...
This paper presents an approach to developing an assistive interface for humanrobot interaction that provides users with customized haptic and visual feedback. The developed interface targets to improve users task performance by customizing assistance policy and level based on users performance and control strategy. To achieve this, the users control strategy was modeled based on inverse optimal control technique. Then, features describing the geometric and behavioral characteristics of user con...
4 CitationsSource
#1Kimberly StowersH-Index: 5
#2James M. Oglesby (UCF: University of Central Florida)H-Index: 4
Last. Eduardo Salas (Rice University)H-Index: 106
view all 6 authors...
Objective:We have developed a framework for guiding measurement in human–machine systems.Background:The assessment of safety and performance in human–machine systems often relies on direct measurement, such as tracking reaction time and accidents. However, safety and performance emerge from the combination of several variables. The assessment of precursors to safety and performance are thus an important part of predicting and improving outcomes in human–machine systems.Method:As part of an in-de...
10 CitationsSource
Cited By0