Environment Capturing with Microsoft Kinect

Kevin Mackay, Hubert P. H. Shum and Taku Komura
Proceedings of the 2012 International Conference on Software, Knowledge, Information Management and Applications (SKIMA), 2012

Environment Capturing with Microsoft Kinect

Abstract

Constructing virtual scenes that incorporate human and object interaction has traditionally been a time consuming process in computer animation, whereby the motion of an actor is first recorded and any objects used in the scene are then intricately added by an animator. The Microsoft Kinect utilizes a synchronized RGBD stream to provide markerless skeletal tracking of humans, enabling efficient motion capture; however, the problem of capturing environment objects remains unsolved. In this paper, we propose a new framework to segment and track three major types of environment objects using Kinect, namely background planes, stationary objects and dynamic objects. We demonstrate that the motion of an actor and their surrounding environment can be obtained at the same time, saving considerable effort for the animators. Our proposed system is best to be applied to applications involving extensive human-object interactions, such as console games and animation designs.

Downloads

YouTube

Citations

BibTeX

@inproceedings{mackay12environment,
 author={Mackay, Kevin and Shum, Hubert P. H. and Komura, Taku},
 booktitle={Proceedings of the 2012 International Conference on Software, Knowledge, Information Management and Applications},
 series={SKIMA '12},
 title={Environment Capturing with Microsoft Kinect},
 year={2012},
 month={12},
 numpages={6},
 location={Dhaka, Bangladesh},
}

RIS

TY  - CONF
AU  - Mackay, Kevin
AU  - Shum, Hubert P. H.
AU  - Komura, Taku
T2  - Proceedings of the 2012 International Conference on Software, Knowledge, Information Management and Applications
TI  - Environment Capturing with Microsoft Kinect
PY  - 2012
Y1  - 12 2012
ER  - 

Plain Text

Kevin Mackay, Hubert P. H. Shum and Taku Komura, "Environment Capturing with Microsoft Kinect," in SKIMA '12: Proceedings of the 2012 International Conference on Software, Knowledge, Information Management and Applications, Dhaka, Bangladesh, Dec 2012.

Supporting Grants

Similar Research

Hubert P. H. Shum, "Serious Games with Human-Object Interactions using RGB-D Camera", Proceedings of the 2013 ACM International Conference on Motion in Games (MIG) Posters, 2013
Hubert P. H. Shum, Edmond S. L. Ho, Yang Jiang and Shu Takagi, "Real-Time Posture Reconstruction for Microsoft Kinect", IEEE Transactions on Cybernetics (TCyb), 2013
Zhiguang Liu, Liuyang Zhou, Howard Leung and Hubert P. H. Shum, "Kinect Posture Reconstruction Based on a Local Mixture of Gaussian Process Models", IEEE Transactions on Visualization and Computer Graphics (TVCG), 2016

 

 

Last updated on 4 June 2024
RSS Feed