DSPP: Deep Shape and Pose Priors of Humans

Shanfeng Hu, Hubert P. H. Shum and Antonio Mucherino
Proceedings of the 2019 ACM SIGGRAPH Conference on Motion, Interaction and Games (MIG), 2019

DSPP: Deep Shape and Pose Priors of Humans

Abstract

The prior knowledge of real human body shapes and poses is fundamental in computer games and animation (e.g. performance capture). Linear subspaces such as the popular SMPL model have a limited capacity to represent the large geometric variations of human shapes and poses. What is worse is that random sampling from them often produces non-realistic humans because the distribution of real humans is more likely to concentrate on a non-linear manifold instead of the full subspace. Towards this problem, we propose to learn human shape and pose manifolds using a more powerful deep generator network, which is trained to produce samples that cannot be distinguished from real humans by a deep discriminator network. In contrast to previous work that learn both the generator and discriminator in the original geometry spaces, we learn them in the more representative latent spaces discovered by a shape and a pose auto-encoder network respectively. Random sampling from our priors produces higher-quality human shapes and poses. The capacity of our priors is best applied to applications such as virtual human synthesis in games.

Downloads

YouTube

Citations

BibTeX

@inproceedings{hu19dspp,
 author={Hu, Shanfeng and Shum, Hubert P. H. and Mucherino, Antonio},
 booktitle={Proceedings of the 2019 ACM SIGGRAPH Conference on Motion, Interaction and Games},
 series={MIG '19},
 title={DSPP: Deep Shape and Pose Priors of Humans},
 year={2019},
 month={10},
 pages={1:1--1:6},
 numpages={6},
 doi={10.1145/3359566.3360051},
 isbn={978-1-4503-6994-7},
 publisher={ACM},
 Address={New York, NY, USA},
 location={Newcastle upon Tyne, UK},
}

RIS

TY  - CONF
AU  - Hu, Shanfeng
AU  - Shum, Hubert P. H.
AU  - Mucherino, Antonio
T2  - Proceedings of the 2019 ACM SIGGRAPH Conference on Motion, Interaction and Games
TI  - DSPP: Deep Shape and Pose Priors of Humans
PY  - 2019
Y1  - 10 2019
SP  - 1:1
EP  - 1:6
DO  - 10.1145/3359566.3360051
SN  - 978-1-4503-6994-7
PB  - ACM
ER  - 

Plain Text

Shanfeng Hu, Hubert P. H. Shum and Antonio Mucherino, "DSPP: Deep Shape and Pose Priors of Humans," in MIG '19: Proceedings of the 2019 ACM SIGGRAPH Conference on Motion, Interaction and Games, pp. 1:1-1:6, Newcastle upon Tyne, UK, ACM, Oct 2019.

Supporting Grants

The Royal Society
Modelling Human Motion for Synthesis and Recognition with Deep Learning on Surface Features
Royal Society International Exchanges (Ref: IES\R2\181024): £12,000, Principal Investigator ()
Received from The Royal Society, UK, 2019-2022
Project Page

Similar Research

Jingtian Zhang, Hubert P. H. Shum, Kevin D. McCay and Edmond S. L. Ho, "Prior-Less 3D Human Shape Reconstruction with an Earth Mover's Distance Informed CNN", Proceedings of the 2019 ACM SIGGRAPH Conference on Motion, Interaction and Games (MIG) Posters, 2019
Shanfeng Hu, Xiaohui Liang, Hubert P. H. Shum, Frederick W. B. Li and Nauman Aslam, "Sparse Metric-Based Mesh Saliency", Neurocomputing, 2020
Shanfeng Hu, Hubert P. H. Shum, Nauman Aslam, Frederick W. B. Li and Xiaohui Liang, "A Unified Deep Metric Representation for Mesh Saliency Detection and Non-Rigid Shape Matching", IEEE Transactions on Multimedia (TMM), 2020
Pengpeng Hu, Edmond S. L. Ho, Nauman Aslam, Taku Komura and Hubert P. H. Shum, "A New Method to Evaluate the Dynamic Air Gap Thickness and Garment Sliding of Virtual Clothes During Walking", Textile Research Journal (TRJ), 2019
Naoya Iwamoto, Hubert P. H. Shum, Longzhi Yang and Shigeo Morishima, "Multi-Layer Lattice Model for Real-Time Dynamic Character Deformation", Computer Graphics Forum (CGF) - Proceedings of the 2015 Pacific Conference on Computer Graphics and Applications (PG), 2015

 

 

Last updated on 14 April 2024
RSS Feed