Large-Scale Multi-Character Interaction Synthesis

Ziyi Chang, He Wang, George Alex Koulieris and Hubert P. H. Shum
Proceedings of the 2025 ACM SIGGRAPH, 2025

Core A* Conference

Large-Scale Multi-Character Interaction Synthesis
‡ According to Core Ranking 2023

Abstract

Generating large-scale multi-character interactions is a challenging and important task in character animation. Multi-character interactions involve not only natural interactive motions but also characters are coordinated with each other for transition. For example, a dancing interaction involves characters that are dancing with partners and also characters that are coordinated to transit to new partners based on spatial and temporal observations. We term such transitions as coordinated interaction for multi-character interactions and decompose it into interaction synthesis and transition planning. Previous methods of single character animation do not consider interactions that are critical for multiple characters. Deep learning based interaction synthesis usually focuses on two characters and does not consider transition planning. Optimization-based interaction synthesis relies on manually designing objective function that may not generalize well. While crowd simulation involves more characters, their interactions are sparse and passive. We identify two challenges towards multi-character interaction synthesis, including the lack of data and the transition planning with close and dense interactions. Existing datasets either do not have multiple characters or do not have close and dense interactions. Planning transitions for multi-character close and dense interactions requires both spatial and temporal consideration. We propose a conditional generative pipeline, including a coordinatable multi-character interaction space for interaction synthesis and a transition planning network to plan transitions. Our experiments demonstrate the effectiveness of our proposed pipeline for multi-character interaction synthesis and the applications facilitated by our method show the scalability and transferability.


Downloads


YouTube


Cite This Research

Plain Text

Ziyi Chang, He Wang, George Alex Koulieris and Hubert P. H. Shum, "Large-Scale Multi-Character Interaction Synthesis," in Proceedings of the 2025 ACM SIGGRAPH, pp. Article 114, Vancouver, Canada, ACM, 2025.

BibTeX

@inproceedings{chang25largescale,
 author={Chang, Ziyi and Wang, He and Koulieris, George Alex and Shum, Hubert P. H.},
 booktitle={Proceedings of the 2025 ACM SIGGRAPH},
 title={Large-Scale Multi-Character Interaction Synthesis},
 year={2025},
 pages={Article 114},
 numpages={10},
 doi={10.1145/3721238.3730750},
 isbn={9.80E+12},
 publisher={ACM},
 location={Vancouver, Canada},
}

RIS

TY  - CONF
AU  - Chang, Ziyi
AU  - Wang, He
AU  - Koulieris, George Alex
AU  - Shum, Hubert P. H.
T2  - Proceedings of the 2025 ACM SIGGRAPH
TI  - Large-Scale Multi-Character Interaction Synthesis
PY  - 2025
SP  - Article 114
EP  - Article 114
DO  - 10.1145/3721238.3730750
SN  - 9.80E+12
PB  - ACM
ER  - 


Supporting Grants


Similar Research

Baiyi Li, Edmond S. L. Ho, Hubert P. H. Shum and He Wang, "Two-Person Interaction Augmentation with Skeleton Priors", Proceedings of the 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2024
Qianhui Men, Hubert P. H. Shum, Edmond S. L. Ho and Howard Leung, "GAN-Based Reactive Motion Synthesis with Class-Aware Discriminators for Human-Human Interaction", Computers and Graphics (C&G), 2022
Xiaotang Zhang, Ziyi Chang, Qianhui Men and Hubert P. H. Shum, "Real-time and Controllable Reactive Motion Synthesis via Intention Guidance", Computer Graphics Forum (CGF), 2025
Taku Komura, Hubert P. H. Shum and Edmond S. L. Ho, "Simulating Interactions of Characters", Proceedings of the 2008 ACM International Conference on Motion in Games (MIG), 2008
Hubert P. H. Shum and Taku Komura, "Generating Realistic Fighting Scenes by Game Tree", Proceedings of the 2006 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA) Posters, 2006
Hubert P. H. Shum and Taku Komura, "Technical Note: Generating Realistic Fighting Scenes by Game Tree", arXiv Preprint, 2006
Hubert P. H. Shum, Taku Komura and Shuntaro Yamazaki, "Simulating Multiple Character Interactions with Collaborative and Adversarial Goals", IEEE Transactions on Visualization and Computer Graphics (TVCG), 2012

HomeGoogle ScholarYouTubeLinkedInTwitter/XGitHubORCIDResearchGateEmail
 
Print