Icons / Logo / Facebook Created with Sketch. Icons / Logo / Google Created with Sketch. Icons / Logo / ORCID Created with Sketch. Branding/Logomark minus Citation Combined Shape Icon/Bookmark-empty Icon/Copy Icon/Collection Icon/Close Copy 7 no author result Created with Sketch. Icon/Back Created with Sketch. Match!

Seeing Under the Cover: A Physics Guided Learning Approach for In-Bed Pose Estimation

Shuangjun Liu (NU: Northeastern University), Sarah Ostadabbas10
Estimated H-index: 10
(NU: Northeastern University)
Abstract
Human in-bed pose estimation has huge practical values in medical and healthcare applications yet still mainly relies on expensive pressure mapping (PM) solutions. In this paper, we introduce our novel physics inspired vision-based approach that addresses the challenging issues associated with the in-bed pose estimation problem including monitoring a fully covered person in complete darkness. We reformulated this problem using our proposed Under the Cover Imaging via Thermal Diffusion (UCITD) method to capture the high resolution pose information of the body even when it is fully covered by using a long wavelength IR technique. We proposed a physical hyperparameter concept through which we achieved high quality groundtruth pose labels in different modalities. A fully annotated in-bed pose dataset called Simultaneously-collected multimodal Lying Pose (SLP) is also formed/released with the same order of magnitude as most existing large-scale human pose datasets to support complex models' training and evaluation. A network trained from scratch on it and tested on two diverse settings, one in a living room and the other in a hospital room showed pose estimation performance of 99.5% and 95.7% in PCK0.2 standard, respectively. Moreover, in a multi-factor comparison with a state-of-the art in-bed pose monitoring solution based on PM, our solution showed significant superiority in all practical aspects by being 60 times cheaper, 300 times smaller, while having higher pose recognition granularity and accuracy.
  • References (13)
  • Citations (0)
References13
Newest
Shuangjun Liu (NU: Northeastern University), Yu Yin (NU: Northeastern University), Sarah Ostadabbas10
Estimated H-index: 10
(NU: Northeastern University)
This paper presents a robust human posture and body parts detection method under a specific application scenario known as in-bed pose estimation. Although the human pose estimation for various computer vision (CV) applications has been studied extensively in the last few decades, the in-bed pose estimation using camera-based vision methods has been ignored by the CV community because it is assumed to be identical to the general purpose pose estimation problems. However, the in-bed pose estimatio...
Published on Oct 17, 2016 in MICCAI (Medical Image Computing and Computer-Assisted Intervention)
Felix Achilles5
Estimated H-index: 5
(LMU: Ludwig Maximilian University of Munich),
Alexandru Eugen Ichim5
Estimated H-index: 5
(EPFL: École Polytechnique Fédérale de Lausanne)
+ 3 AuthorsNassir Navab56
Estimated H-index: 56
(TUM: Technische Universität München)
Motion analysis is typically used for a range of diagnostic procedures in the hospital. While automatic pose estimation from RGB-D input has entered the hospital in the domain of rehabilitation medicine and gait analysis, no such method is available for bed-ridden patients. However, patient pose estimation in the bed is required in several fields such as sleep laboratories, epilepsy monitoring and intensive care units. In this work, we propose a learning-based method that allows to automatically...
Published on Jan 1, 2015in Laryngoscope 2.34
Chungwon Lee30
Estimated H-index: 30
(Seoul National University Hospital),
Dong K. Kim1
Estimated H-index: 1
(Sacred Heart Hospital)
+ 2 AuthorsTae Bin Won5
Estimated H-index: 5
(Seoul National University Hospital)
Objectives/Hypothesis This study aimed to evaluate changes in obstruction site in obstructive sleep apnea (OSA) patients according to sleep position. Study Design Prospective case series. Methods Eighty-five patients who had undergone level 1 sleep study and drug-induced sleep endoscopy in the supine and lateral positions were included. Obstruction sites were classified as soft palate (SP), tongue base (TB), lateral wall (LW), and larynx (LX). Subgroup analysis was performed according to lateral...
Published on Oct 1, 2014
Sarah Ostadabbas10
Estimated H-index: 10
(UTD: University of Texas at Dallas),
Maziyar Baran Pouyan3
Estimated H-index: 3
(UTD: University of Texas at Dallas)
+ 1 AuthorsNasser Kehtarnavaz31
Estimated H-index: 31
(UTD: University of Texas at Dallas)
We propose an algorithm that uses pressure image data to detect a person's sleeping posture and identifies different body limbs. Our algorithm can be used in monitoring bed-bound patients and assessing the risk of pressure ulceration. We used a GMM-based clustering approach for concurrent posture classifi- cation and limb identification. Our proposed technique, applied on 9 healthy subjects instructed to sleep in 13 different postures, resulted in 98.4% classification accuracy in distinguishing ...
Published on Jun 23, 2014 in CVPR (Computer Vision and Pattern Recognition)
Mykhaylo Andriluka26
Estimated H-index: 26
(MPG: Max Planck Society),
Leonid Pishchulin15
Estimated H-index: 15
(MPG: Max Planck Society)
+ 1 AuthorsBernt Schiele82
Estimated H-index: 82
(MPG: Max Planck Society)
Human pose estimation has made significant progress during the last years. However current datasets are limited in their coverage of the overall pose estimation challenges. Still these serve as the common sources to evaluate, train and compare different models on. In this paper we introduce a novel benchmark "MPII Human Pose" that makes a significant advance in terms of diversity and difficulty, a contribution that we feel is required for future developments in human body models. This comprehens...
Published on Aug 27, 2013 in CAIP (Computer Analysis of Images and Patterns)
Manuel Martinez6
Estimated H-index: 6
(KIT: Karlsruhe Institute of Technology),
Boris Schauerte11
Estimated H-index: 11
(KIT: Karlsruhe Institute of Technology),
Rainer Stiefelhagen45
Estimated H-index: 45
(KIT: Karlsruhe Institute of Technology)
We investigate computer vision methods to monitor Intensive Care Units ICU and assist in sedation delivery and accident prevention. We propose the use of a Bed Aligned Map BAM to analyze the patient's body. We use a depth camera to localize the bed, estimate its surface and divide it into 10 cm × 10 cm cells. Here, the BAM represents the average cell height over the mattress. This depth-based BAM is independent of illumination and bed positioning, improving the consistency between patients. This...
Published on Nov 1, 2012 in EMBC (International Conference of the IEEE Engineering in Medicine and Biology Society)
Sarah Ostadabbas10
Estimated H-index: 10
(UTD: University of Texas at Dallas),
Rasoul Yousefi7
Estimated H-index: 7
(UTD: University of Texas at Dallas)
+ 3 AuthorsMatthew Pompeo6
Estimated H-index: 6
Pressure ulcer is a critical problem for bed-ridden and wheelchair-bound patients, diabetics, and the elderly. Patients need to be regularly repositioned to prevent excessive pressure on a single area of body, which can lead to ulcers. Pressure ulcers are extremely costly to treat and may lead to several other health problems, including death. The current standard for prevention is to reposition at-risk patients every 2 h. Even if it is done properly, a fixed schedule is not sufficient to preven...
Published on Nov 1, 2011 in BIBM (Bioinformatics and Biomedicine)
Sarah Ostadabbas10
Estimated H-index: 10
(UTD: University of Texas at Dallas),
Rasoul Yousefi7
Estimated H-index: 7
(UTD: University of Texas at Dallas)
+ 3 AuthorsMatthew Pompeo6
Estimated H-index: 6
Pressure ulcer is a severe threat for immobilized and peripheral neuropathic patients such as bed-ridden, elderly, and diabetics. Once developed, the complication of pressure ulcer causes pain, suffering, and longer hospitalization for the patients. Additionally, pressure ulcer management imposes a serious burden on the health care providers. The optimal strategy to deal with pressure ulcers is prevention. The current standard for prevention is to reposition at-risk patients every two hours. But...
Published on Jun 1, 2011in Hand
Steven J. McCabe13
Estimated H-index: 13
(University of Louisville),
Amit Gupta14
Estimated H-index: 14
(University of Louisville)
+ 1 AuthorsJohn Myers16
Estimated H-index: 16
(University of Louisville)
Background Although carpal tunnel syndrome is the most common compressive neuropathy, there is no comprehensive theory of its etiology. Because of the prevalence of night symptoms, we are interested in the role of sleep position in the causation of carpal tunnel syndrome.
Published on Jan 1, 2010 in BMVC (British Machine Vision Conference)
Sam Johnson5
Estimated H-index: 5
(University of Leeds),
Mark Everingham24
Estimated H-index: 24
(University of Leeds)
We investigate the task of 2D articulated human pose estimation in unconstrained still images. This is extremely challenging because of variation in pose, anatomy, clothing, and imaging conditions. Current methods use simple models of body part appearance and plausible configurations due to limitations of available training data and constraints on computational expense. We show that such models severely limit accuracy. Building on the successful pictorial structure model (PSM) we propose richer ...
Cited By0
Newest