Data-Driven Crowd Motion Control with Multi-touch Gestures

Data-Driven Crowd Motion Control with Multi-touch Gestures

Abstract

Controlling a crowd using multi-touch devices appeals to the computer games and animation industries, as such devices provide a high dimensional control signal that can effectively define the crowd formation and movement. However, existing works relying on pre-defined control schemes require the users to learn a scheme that may not be intuitive. We propose a data-driven gesture-based crowd control system, in which the control scheme is learned from example gestures provided by different users. In particular, we build a database with pairwise samples of gestures and crowd motions. To effectively generalize the gesture style of different users, such as the use of different numbers of fingers, we propose a set of gesture features for representing a set of hand gesture trajectories. Similarly, to represent crowd motion trajectories of different numbers of characters over time, we propose a set of crowd motion features that are extracted from a Gaussian mixture model. Given a run-time gesture, our system extracts the K nearest gestures from the database and interpolates the corresponding crowd motions in order to generate the run-time control. Our system is accurate and efficient, making it suitable for real-time applications such as real-time strategy games and interactive animation controls.

Publication

Yijun Shen, Joseph Henry, He Wang, Edmond S. L. Ho, Taku Komura and Hubert P. H. Shum,
"Data-Driven Crowd Motion Control with Multi-touch Gestures",
Computer Graphics Forum (CGF)

IF=2.046# Invited presentation at Eurographics 2019

# Impact factor from the Journal Citation Reports as of 2017

Downloads

YouTube

References

BibTeX

@article{shen18datadriven,
 author={Shen, Yijun and Henry, Joseph and Wang, He and Ho, Edmond S. L. and Komura, Taku and Shum, Hubert P. H.},
 journal={Computer Graphics Forum},
 title={Data-Driven Crowd Motion Control with Multi-touch Gestures},
 year={2018},
 volume={37},
 number={6},
 pages={382--394},
 numpages={14},
 doi={10.1111/cgf.13333},
 issn={1467-8659},
 publisher={John Wiley and Sons Ltd.},
 Address={Chichester, UK},
}

EndNote/RefMan

TY  - JOUR
AU  - Shen, Yijun
AU  - Henry, Joseph
AU  - Wang, He
AU  - Ho, Edmond S. L.
AU  - Komura, Taku
AU  - Shum, Hubert P. H.
T2  - Computer Graphics Forum
TI  - Data-Driven Crowd Motion Control with Multi-touch Gestures
PY  - 2018
VL  - 37
IS  - 6
SP  - 382
EP  - 394
DO  - 10.1111/cgf.13333
SN  - 1467-8659
PB  - John Wiley and Sons Ltd.
ER  - 

Plain Text

Yijun Shen, Joseph Henry, He Wang, Edmond S. L. Ho, Taku Komura and Hubert P. H. Shum, "Data-Driven Crowd Motion Control with Multi-touch Gestures," Computer Graphics Forum, vol. 37, no. 6, pp. 382-394, John Wiley and Sons Ltd., 2018.

Similar Research

 

         

Last update: 18/06/2019