Real-time Physical Modelling of Character Movements with Microsoft Kinect

Real-time Physical Modelling of Character Movements with Microsoft Kinect

Abstract

With the advancement of motion tracking hardware such as the Microsoft Kinect, synthesizing human-like characters with real-time captured movements becomes increasingly important. Traditional kinematics and dynamics approaches perform sub-optimally when the captured motion is noisy or even incomplete. In this paper, we proposed a unified framework to control physically simulated characters with live captured motion from Kinect. Our framework can synthesize any posture in a physical environment using external forces and torques computed by a PD controller. The major problem of Kinect is the incompleteness of the captured posture, with some degree of freedom (DOF) missing due to occlusions and noises. We propose to search for a best matched posture from a motion database constructed in a dimensionality reduced space, and substitute the missing DOF to the live captured data. Experimental results show that our method can synthesize realistic character movements from noisy captured motion. The proposed algorithm is computationally efficient and can be applied to a wide variety of interactive virtual reality applications such as motion-based gaming, rehabilitation and sport training.

Publication

Hubert P. H. Shum and Edmond S. L. Ho,
"Real-time Physical Modelling of Character Movements with Microsoft Kinect",
Proceedings of the 2012 ACM Symposium on Virtual Reality Software and Technology (VRST)

Citation=45##

## Citation count from Google Scholar as of 2018

Downloads

YouTube

References

BibTeX

@inproceedings{shum12realtime,
 author={Shum, Hubert P. H. and Ho, Edmond S. L.},
 booktitle={Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology},
 series={VRST '12},
 title={Real-time Physical Modelling of Character Movements with Microsoft Kinect},
 year={2012},
 month={Dec},
 pages={17--24},
 numpages={8},
 doi={10.1145/2407336.2407340},
 isbn={978-1-4503-1469-5},
 publisher={ACM},
 Address={New York, NY, USA},
 location={Toronto, Ontario, Canada},
}

EndNote/RefMan

TY  - CONF
AU  - Shum, Hubert P. H.
AU  - Ho, Edmond S. L.
T2  - Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology
TI  - Real-time Physical Modelling of Character Movements with Microsoft Kinect
PY  - 2012
Y1  - Dec 2012
SP  - 17
EP  - 24
DO  - 10.1145/2407336.2407340
SN  - 978-1-4503-1469-5
PB  - ACM
ER  - 

Plain Text

Hubert P. H. Shum and Edmond S. L. Ho, "Real-time Physical Modelling of Character Movements with Microsoft Kinect," in VRST '12: Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology, pp. 17-24, Toronto, Ontario, Canada, ACM, Dec 2012.

Similar Research

 

         

Last update: 10/03/2019