Data-Driven Crowd Motion Control with Multi-touch Gestures

Data-Driven Crowd Motion Control with Multi-touch Gestures

Abstract

Controlling a crowd using multi-touch devices appeals to the computer games and animation industries, as such devices provide a high dimensional control signal that can effectively define the crowd formation and movement. However, existing works relying on pre-defined control schemes require the users to learn a scheme that may not be intuitive. We propose a data-driven gesture-based crowd control system, in which the control scheme is learned from example gestures provided by different users. In particular, we build a database with pairwise samples of gestures and crowd motions. To effectively generalize the gesture style of different users, such as the use of different numbers of fingers, we propose a set of gesture features for representing a set of hand gesture trajectories. Similarly, to represent crowd motion trajectories of different numbers of characters over time, we propose a set of crowd motion features that are extracted from a Gaussian mixture model. Given a run-time gesture, our system extracts the K nearest gestures from the database and interpolates the corresponding crowd motions in order to generate the run-time control. Our system is accurate and efficient, making it suitable for real-time applications such as real-time strategy games and interactive animation controls.

Publication

Yijun Shen, Joseph Henry, He Wang, Edmond S. L. Ho, Taku Komura and Hubert P. H. Shum,
"Data-Driven Crowd Motion Control with Multi-touch Gestures",
Computer Graphics Forum (CGF)
, 2018
Impact Factor: 2.078# Citation: 5## Invited presentation at Eurographics 2019

# Impact factors from the Journal Citation Reports 2020
## Citation counts from Google Scholar as of 2021

Downloads

Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail
Paper (1.2MB)
Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail
Video (84.9MB)
Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail Thumbnail
Presentation Slides (94.2MB)
Thumbnail
DOI - Publisher's Page

YouTube

References

BibTeX

@article{shen18datadriven,
 author={Shen, Yijun and Henry, Joseph and Wang, He and Ho, Edmond S. L. and Komura, Taku and Shum, Hubert P. H.},
 journal={Computer Graphics Forum},
 series={CGF '21},
 title={Data-Driven Crowd Motion Control with Multi-touch Gestures},
 year={2018},
 volume={37},
 number={6},
 pages={382--394},
 numpages={14},
 doi={10.1111/cgf.13333},
 issn={1467-8659},
 publisher={John Wiley and Sons Ltd.},
 Address={Chichester, UK},
}

EndNote/RefMan

TY  - JOUR
AU  - Shen, Yijun
AU  - Henry, Joseph
AU  - Wang, He
AU  - Ho, Edmond S. L.
AU  - Komura, Taku
AU  - Shum, Hubert P. H.
T2  - Computer Graphics Forum
TI  - Data-Driven Crowd Motion Control with Multi-touch Gestures
PY  - 2018
VL  - 37
IS  - 6
SP  - 382
EP  - 394
DO  - 10.1111/cgf.13333
SN  - 1467-8659
PB  - John Wiley and Sons Ltd.
ER  - 

Plain Text

Yijun Shen, Joseph Henry, He Wang, Edmond S. L. Ho, Taku Komura and Hubert P. H. Shum, "Data-Driven Crowd Motion Control with Multi-touch Gestures," Computer Graphics Forum, vol. 37, no. 6, pp. 382-394, John Wiley and Sons Ltd., 2018.

Similar Research

 

Last update: 23 September 2021