[Recruitment]
Associate/Assistant Professor in Artificial Intelligence for Space-Enabled Technologies, Durham University

We are looking for applicants in Artificial Intelligence, Computer Vision, Edge Computing, Digital Twins, Human Computer Interaction, User Modelling, Robotics or Resilient Computing with potentials/achievements in informing space applications.

The post hoder will enjoy 1) a permanent (equivalent to US tenured) position at a top 100 university, 2) significantly reduced teaching, 3) a fully-funded PhD, 4) travel budget, 5) chance for a 2-year fully-funded Post-Doc.

Real-Time Physical Modelling of Character Movements with Microsoft Kinect

Hubert P. H. Shum and Edmond S. L. Ho
Proceedings of the 2012 ACM Symposium on Virtual Reality Software and Technology (VRST), 2012

Core A Conference Core A Conference Citation: 66#

Real-Time Physical Modelling of Character Movements with Microsoft Kinect
‡ According to Core Ranking 2023"
# According to Google Scholar 2023"

Abstract

With the advancement of motion tracking hardware such as the Microsoft Kinect, synthesizing human-like characters with real-time captured movements becomes increasingly important. Traditional kinematics and dynamics approaches perform sub-optimally when the captured motion is noisy or even incomplete. In this paper, we proposed a unified framework to control physically simulated characters with live captured motion from Kinect. Our framework can synthesize any posture in a physical environment using external forces and torques computed by a PD controller. The major problem of Kinect is the incompleteness of the captured posture, with some degree of freedom (DOF) missing due to occlusions and noises. We propose to search for a best matched posture from a motion database constructed in a dimensionality reduced space, and substitute the missing DOF to the live captured data. Experimental results show that our method can synthesize realistic character movements from noisy captured motion. The proposed algorithm is computationally efficient and can be applied to a wide variety of interactive virtual reality applications such as motion-based gaming, rehabilitation and sport training.

Downloads

YouTube

Citations

BibTeX

@inproceedings{shum12realtime,
 author={Shum, Hubert P. H. and Ho, Edmond S. L.},
 booktitle={Proceedings of the 2012 ACM Symposium on Virtual Reality Software and Technology},
 series={VRST '12},
 title={Real-Time Physical Modelling of Character Movements with Microsoft Kinect},
 year={2012},
 month={12},
 pages={17--24},
 numpages={8},
 doi={10.1145/2407336.2407340},
 isbn={978-1-4503-1469-5},
 publisher={ACM},
 Address={New York, NY, USA},
 location={Toronto, Ontario, Canada},
}

RIS

TY  - CONF
AU  - Shum, Hubert P. H.
AU  - Ho, Edmond S. L.
T2  - Proceedings of the 2012 ACM Symposium on Virtual Reality Software and Technology
TI  - Real-Time Physical Modelling of Character Movements with Microsoft Kinect
PY  - 2012
Y1  - 12 2012
SP  - 17
EP  - 24
DO  - 10.1145/2407336.2407340
SN  - 978-1-4503-1469-5
PB  - ACM
ER  - 

Plain Text

Hubert P. H. Shum and Edmond S. L. Ho, "Real-Time Physical Modelling of Character Movements with Microsoft Kinect," in VRST '12: Proceedings of the 2012 ACM Symposium on Virtual Reality Software and Technology, pp. 17-24, Toronto, Ontario, Canada, ACM, Dec 2012.

Supporting Grants

The University of Worcester

Vacation Research Assistantship (Ref: ): £1,000, Principal Investigator ()
Received from The University of Worcester, UK, 2012-2012
Project Page

Similar Research

Hubert P. H. Shum, Ludovic Hoyet, Edmond S. L. Ho, Taku Komura and Franck Multon, "Preparation Behaviour Synthesis with Reinforcement Learning", Proceedings of the 2013 International Conference on Computer Animation and Social Agents (CASA), 2013
Hubert P. H. Shum, Ludovic Hoyet, Edmond S. L. Ho, Taku Komura and Franck Multon, "Natural Preparation Behavior Synthesis", Computer Animation and Virtual Worlds (CAVW), 2013
Edmond S. L. Ho, Hubert P. H. Shum, He Wang and Li Yi, "Synthesizing Motion with Relative Emotion Strength", Proceedings of the 2017 ACM SIGGRAPH Asia Workshop on Data-Driven Animation Techniques (D2AT), 2017
Liuyang Zhou, Lifeng Shang, Hubert P. H. Shum and Howard Leung, "Human Motion Variation Synthesis with Multivariate Gaussian Processes", Computer Animation and Virtual Worlds (CAVW) - Proceedings of the 2014 International Conference on Computer Animation and Social Agents (CASA), 2014
Naoya Iwamoto, Takuya Kato, Hubert P. H. Shum, Ryo Kakitsuka, Kenta Hara and Shigeo Morishima, "DanceDJ: A 3D Dance Animation Authoring System for Live Performance", Proceedings of the 2017 International Conference on Advances in Computer Entertainment Technology (ACE), 2017
Hubert P. H. Shum, Edmond S. L. Ho, Yang Jiang and Shu Takagi, "Real-Time Posture Reconstruction for Microsoft Kinect", IEEE Transactions on Cybernetics (TCyb), 2013
Edmond S. L. Ho, Hubert P. H. Shum, Yiu-ming Cheung and P. C. Yuen, "Topology Aware Data-Driven Inverse Kinematics", Computer Graphics Forum (CGF) - Proceedings of the 2013 Pacific Conference on Computer Graphics and Applications (PG), 2013

 

 

Last updated on 17 February 2024
RSS Feed