Automatic Sign Dance Synthesis from Gesture-based Sign Language

Naoya Iwamoto, Hubert P. H. Shum, Wakana Asahina and Shigeo Morishima
Proceedings of the 2019 International Conference on Motion, Interactions and Games (MIG), 2019

Citation: 1##

Automatic Sign Dance Synthesis from Gesture-based Sign Language
## Citation counts from Google Scholar as of 2022

Abstract

Automatic dance synthesis has become more and more popular due to the increasing demand in computer games and animations. Existing research generates dance motions without much consideration for the context of the music. In reality, professional dancers make choreography according to the lyrics and music features. In this research, we focus on a particular genre of dance known as sign dance, which combines gesture-based sign language with full body dance motion. We propose a system to automatically generate sign dance from a piece of music and its corresponding sign gesture. The core of the system is a Sign Dance Model trained by multiple regression analysis to represent the correlations between sign dance and sign gesture/music, as well as a set of objective functions to evaluate the quality of the sign dance. Our system can be applied to music visualization, allowing people with hearing difficulties to understand and enjoy music.

Downloads

YouTube

Citations

BibTeX

@inproceedings{iwamoto19automatic,
 author={Iwamoto, Naoya and Shum, Hubert P. H. and Asahina, Wakana and Morishima, Shigeo},
 booktitle={Proceedings of the 2019 International Conference on Motion in Games},
 series={MIG '19},
 title={Automatic Sign Dance Synthesis from Gesture-based Sign Language},
 year={2019},
 month={Oct},
 pages={18:1--18:9},
 numpages={9},
 doi={10.1145/3359566.3360069},
 isbn={978-1-4503-6994-7},
 publisher={ACM},
 Address={New York, NY, USA},
 location={Newcastle upon Tyne, UK},
}

RIS

TY  - CONF
AU  - Iwamoto, Naoya
AU  - Shum, Hubert P. H.
AU  - Asahina, Wakana
AU  - Morishima, Shigeo
T2  - Proceedings of the 2019 International Conference on Motion in Games
TI  - Automatic Sign Dance Synthesis from Gesture-based Sign Language
PY  - 2019
Y1  - Oct 2019
SP  - 18:1
EP  - 18:9
DO  - 10.1145/3359566.3360069
SN  - 978-1-4503-6994-7
PB  - ACM
ER  - 

Plain Text

Naoya Iwamoto, Hubert P. H. Shum, Wakana Asahina and Shigeo Morishima, "Automatic Sign Dance Synthesis from Gesture-based Sign Language," in MIG '19: Proceedings of the 2019 International Conference on Motion in Games, pp. 18:1-18:9, Newcastle upon Tyne, UK, ACM, Oct 2019.

Similar Research

Wakana Asahina, Naoya Iwamoto, Hubert P. H. Shum and Shigeo Morishima, "Automatic Dance Generation System Considering Sign Language Information", Proceedings of the 2016 ACM SIGGRAPH (SIGGRAPH) Posters, 2016
Naoya Iwamoto, Takuya Kato, Hubert P. H. Shum, Ryo Kakitsuka, Kenta Hara and Shigeo Morishima, "DanceDJ: A 3D Dance Animation Authoring System for Live Performance", Proceedings of the 2017 International Conference on Advances in Computer Entertainment Technology (ACE), 2017
Hubert P. H. Shum, Taku Komura and Pranjul Yadav, "Angular Momentum Guided Motion Concatenation", Computer Animation and Virtual Worlds (CAVW) - Proceedings of the 2009 International Conference on Computer Animation and Social Agents (CASA), 2009

 

 
 

Last updated on 25 September 2022, RSS Feeds