Preparation Behaviour Synthesis with Reinforcement Learning

Hubert P. H. Shum, Ludovic Hoyet, Edmond S. L. Ho, Taku Komura and Franck Multon
Proceedings of the 2013 International Conference on Computer Animation and Social Agents (CASA), 2013

Citation: 1##

Preparation Behaviour Synthesis with Reinforcement Learning
## Citation counts from Google Scholar as of 2022

Abstract

When humans perform a series of motions, they prepare for the next motion in advance so as to enhance the response time of their movements. This kind of preparation behaviour results in a natural and smooth transition of the overall movement. In this paper, we propose a new method to synthesize the behaviour using reinforcement learning. To create preparation movements, we propose a customized motion blending algorithm that is governed by a single numerical value, which we called the level of preparation. During the offline process, the system learns the optimal way to approach a target, as well as the realistic behaviour to prepare for interaction considering the level of preparation. At run-time, the trained controller indicates the character to move to a target with the appropriate level of preparation, resulting in human-like movements. We synthesized scenes in which the character has to move in a complex environment and interact with objects, such as a character crawling under and jumping over obstacles while walking. The method is useful not only for computer animation, but also for real-time applications such as computer games, in which the characters need to accomplish a series of tasks in a given environment.

Downloads

YouTube

Citations

BibTeX

@inproceedings{shum13preparation,
 author={Shum, Hubert P. H. and Hoyet, Ludovic and Ho, Edmond S. L. and Komura, Taku and Multon, Franck},
 booktitle={Proceedings of the 2013 International Conference on Computer Animation and Social Agents},
 series={CASA '13},
 title={Preparation Behaviour Synthesis with Reinforcement Learning},
 year={2013},
 month={May},
 numpages={10},
 publisher={John Wiley and Sons Ltd.},
 Address={Chichester, UK},
 location={Turkey, Istanbul},
}

RIS

TY  - CONF
AU  - Shum, Hubert P. H.
AU  - Hoyet, Ludovic
AU  - Ho, Edmond S. L.
AU  - Komura, Taku
AU  - Multon, Franck
T2  - Proceedings of the 2013 International Conference on Computer Animation and Social Agents
TI  - Preparation Behaviour Synthesis with Reinforcement Learning
PY  - 2013
Y1  - May 2013
PB  - John Wiley and Sons Ltd.
ER  - 

Plain Text

Hubert P. H. Shum, Ludovic Hoyet, Edmond S. L. Ho, Taku Komura and Franck Multon, "Preparation Behaviour Synthesis with Reinforcement Learning," in CASA '13: Proceedings of the 2013 International Conference on Computer Animation and Social Agents, Turkey, Istanbul, John Wiley and Sons Ltd., May 2013.

Similar Research

Hubert P. H. Shum, Ludovic Hoyet, Edmond S. L. Ho, Taku Komura and Franck Multon, "Natural Preparation Behavior Synthesis", Computer Animation and Virtual Worlds (CAVW), 2013
Hubert P. H. Shum, Taku Komura and Pranjul Yadav, "Angular Momentum Guided Motion Concatenation", Computer Animation and Virtual Worlds (CAVW) - Proceedings of the 2009 International Conference on Computer Animation and Social Agents (CASA), 2009
Edmond S. L. Ho, Hubert P. H. Shum, He Wang and Li Yi, "Synthesizing Motion with Relative Emotion Strength", Proceedings of the 2017 ACM SIGGRAPH Asia Workshop on Data-Driven Animation Techniques (D2AT), 2017
He Wang, Edmond S. L. Ho, Hubert P. H. Shum and Zhanxing Zhu, "Spatio-temporal Manifold Learning for Human Motions via Long-horizon Modeling", IEEE Transactions on Visualization and Computer Graphics (TVCG), 2021
Hubert P. H. Shum, Taku Komura and Shuntaro Yamazaki, "Simulating Competitive Interactions using Singly Captured Motions", Proceedings of the 2007 ACM Symposium on Virtual Reality Software and Technology (VRST), 2007
Hubert P. H. Shum and Taku Komura, "Generating Realistic Fighting Scenes by Game Tree", Proceedings of the 2006 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA) Posters, 2006
Hubert P. H. Shum and Taku Komura, "Technical Note: Generating Realistic Fighting Scenes by Game Tree", arXiv Preprint, 2006
Liuyang Zhou, Lifeng Shang, Hubert P. H. Shum and Howard Leung, "Human Motion Variation Synthesis with Multivariate Gaussian Processes", Computer Animation and Virtual Worlds (CAVW) - Proceedings of the 2014 International Conference on Computer Animation and Social Agents (CASA), 2014
Edmond S. L. Ho, Hubert P. H. Shum, Yiu-ming Cheung and P. C. Yuen, "Topology Aware Data-Driven Inverse Kinematics", Computer Graphics Forum (CGF) - Proceedings of the 2013 Pacific Conference on Computer Graphics and Applications (PG), 2013
Taku Komura, Hubert P. H. Shum and Edmond S. L. Ho, "Simulating Interactions of Characters", Proceedings of the 2008 International Conference on Motion in Games (MIG), 2008
Jacky C. P. Chan, Hubert P. H. Shum, He Wang, Li Yi, Wei Wei and Edmond S. L. Ho, "A Generic Framework for Editing and Synthesizing Multimodal Data with Relative Emotion Strength", Computer Animation and Virtual Worlds (CAVW), 2019

 

 
 

Last updated on 25 September 2022, RSS Feeds