Automatic Dance Generation System Considering Sign Language Information

Wakana Asahina, Naoya Iwamoto, Hubert P. H. Shum and Shigeo Morishima
Proceedings of the 2016 ACM SIGGRAPH Posters, 2016

Automatic Dance Generation System Considering Sign Language Information

Abstract

In recent years, thanks to the development of 3DCG animation editing tools (e.g. MikuMikuDance), a lot of 3D character dance animation movies are created by amateur users. However, it is very difficult to create choreography from scratch without any technical knowledge. Shiratori et al. [2006] produced the dance automatic generation system considering rhythm and intensity of dance motions. However, each segment is selected randomly from database, so the generated dance motion has no linguistic or emotional meanings. Takano et al. [2010] produced a human motion generation system considering motion labels. However, they use simple motion labels like 'running' or 'jump', so they cannot generate motions that express emotions. In reality, professional dancers make choreography based on music features or lyrics in music, and express emotion or how they feel in music. In our work, we aim at generating more emotional dance motion easily. Therefore, we use linguistic information in lyrics, and generate dance motion.

Downloads

YouTube

Citations

BibTeX

@inproceedings{asahina16automatic,
 author={Asahina, Wakana and Iwamoto, Naoya and Shum, Hubert P. H. and Morishima, Shigeo},
 booktitle={Proceedings of the 2016 ACM SIGGRAPH},
 series={SIGGRAPH '16},
 title={Automatic Dance Generation System Considering Sign Language Information},
 year={2016},
 month={7},
 pages={23:1--23:2},
 numpages={2},
 doi={10.1145/2945078.2945101},
 isbn={978-1-4503-4371-8},
 publisher={ACM},
 Address={New York, NY, USA},
 location={Anaheim, California},
}

RIS

TY  - CONF
AU  - Asahina, Wakana
AU  - Iwamoto, Naoya
AU  - Shum, Hubert P. H.
AU  - Morishima, Shigeo
T2  - Proceedings of the 2016 ACM SIGGRAPH
TI  - Automatic Dance Generation System Considering Sign Language Information
PY  - 2016
Y1  - 7 2016
SP  - 23:1
EP  - 23:2
DO  - 10.1145/2945078.2945101
SN  - 978-1-4503-4371-8
PB  - ACM
ER  - 

Plain Text

Wakana Asahina, Naoya Iwamoto, Hubert P. H. Shum and Shigeo Morishima, "Automatic Dance Generation System Considering Sign Language Information," in SIGGRAPH '16: Proceedings of the 2016 ACM SIGGRAPH, pp. 23:1-23:2, Anaheim, California, ACM, Jul 2016.

Supporting Grants

The Ministry of Education, Culture, Sports, Science and Technology

MEXT Top Global University Project Scholarship (Ref: ): £5,500, Co-Applicant (PI: Prof. Shigeo Morishima, Japanese Partner)
Received from The Ministry of Education, Culture, Sports, Science and Technology, 2015-2016
Project Page

Similar Research

Naoya Iwamoto, Hubert P. H. Shum, Wakana Asahina and Shigeo Morishima, "Automatic Sign Dance Synthesis from Gesture-Based Sign Language", Proceedings of the 2019 ACM SIGGRAPH Conference on Motion, Interaction and Games (MIG), 2019
Naoya Iwamoto, Takuya Kato, Hubert P. H. Shum, Ryo Kakitsuka, Kenta Hara and Shigeo Morishima, "DanceDJ: A 3D Dance Animation Authoring System for Live Performance", Proceedings of the 2017 International Conference on Advances in Computer Entertainment Technology (ACE), 2017
Hubert P. H. Shum, Taku Komura and Pranjul Yadav, "Angular Momentum Guided Motion Concatenation", Computer Animation and Virtual Worlds (CAVW) - Proceedings of the 2009 International Conference on Computer Animation and Social Agents (CASA), 2009
Edmond S. L. Ho, Hubert P. H. Shum, He Wang and Li Yi, "Synthesizing Motion with Relative Emotion Strength", Proceedings of the 2017 ACM SIGGRAPH Asia Workshop on Data-Driven Animation Techniques (D2AT), 2017
Hubert P. H. Shum, Ludovic Hoyet, Edmond S. L. Ho, Taku Komura and Franck Multon, "Natural Preparation Behavior Synthesis", Computer Animation and Virtual Worlds (CAVW), 2013
Hubert P. H. Shum, Ludovic Hoyet, Edmond S. L. Ho, Taku Komura and Franck Multon, "Preparation Behaviour Synthesis with Reinforcement Learning", Proceedings of the 2013 International Conference on Computer Animation and Social Agents (CASA), 2013
Liuyang Zhou, Lifeng Shang, Hubert P. H. Shum and Howard Leung, "Human Motion Variation Synthesis with Multivariate Gaussian Processes", Computer Animation and Virtual Worlds (CAVW) - Proceedings of the 2014 International Conference on Computer Animation and Social Agents (CASA), 2014

 

 

Last updated on 14 April 2024
RSS Feed