Posture Reconstruction Using Kinect with a Probabilistic Model

Posture Reconstruction Using Kinect with a Probabilistic Model

Abstract

Recent work has shown that depth image based 3D posture estimation hardware such as Kinect has made interactive applications more popular. However, it is still challenging to accurately recognize postures from a single depth camera due to the inherently noisy data derived from depth images and self-occluding action performed by the user. While previous research has shown that data-driven methods can be used to reconstruct the correct postures, they usually require a large posture database, which greatly limit the usability for systems with constrained hardware such as game console. To solve this problem, we present a new probabilistic framework to enhance the accuracy of the postures live captured by Kinect. We adopt the Gaussian Process model as a prior to leverage position data obtained from Kinect and marker-based motion capture system. We also incorporate a temporal consistency term into the optimization framework to constrain the velocity variations between successive frames. To ensure that the reconstructed posture resembles the observed input data from Kinect when its tracking result is good, we embed joint reliability into the optimization framework. Experimental results demonstrate that our system can generate high quality postures even under severe self-occlusion situations, which is beneficial for real-time posture based applications such as motion-based gaming and sport training.

Publication

Liuyang Zhou, Zhiguang Liu, Howard Leung and Hubert P. H. Shum,
"Posture Reconstruction Using Kinect with a Probabilistic Model",
Proceedings of the 2014 ACM Symposium on Virtual Reality Software and Technology (VRST)

Citation=19##

## Citation count from Google Scholar as of 2018

Downloads

YouTube

References

BibTeX

@inproceedings{zhou14posture,
 author={Zhou, Liuyang and Liu, Zhiguang and Leung, Howard and Shum, Hubert P. H.},
 booktitle={Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology},
 series={VRST '14},
 title={Posture Reconstruction Using Kinect with a Probabilistic Model},
 year={2014},
 month={Nov},
 pages={117--125},
 numpages={9},
 doi={10.1145/2671015.2671021},
 publisher={ACM},
 Address={New York, NY, USA},
 location={Edinburgh, UK},
}

EndNote/RefMan

TY  - CONF
AU  - Zhou, Liuyang
AU  - Liu, Zhiguang
AU  - Leung, Howard
AU  - Shum, Hubert P. H.
T2  - Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology
TI  - Posture Reconstruction Using Kinect with a Probabilistic Model
PY  - 2014
Y1  - Nov 2014
SP  - 117
EP  - 125
DO  - 10.1145/2671015.2671021
PB  - ACM
ER  - 

Plain Text

Liuyang Zhou, Zhiguang Liu, Howard Leung and Hubert P. H. Shum, "Posture Reconstruction Using Kinect with a Probabilistic Model," in VRST '14: Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology, pp. 117-125, Edinburgh, UK, ACM, Nov 2014.

Similar Research

 

         

Last update: 14/01/2019