Prior-less 3D Human Shape Reconstruction with an Earth Mover's Distance Informed CNN

Prior-less 3D Human Shape Reconstruction with an Earth Mover's Distance Informed CNN

Abstract

We propose a novel end-to-end deep learning framework, capable of 3D human shape reconstruction from a 2D image without the need of a 3D prior parametric model. We employ a "prior-less" representation of the human shape using unordered point clouds. Due to the lack of prior information, comparing the generated and ground truth point clouds to evaluate the reconstruction error is challenging. We solve this problem by proposing an Earth Mover’s Distance (EMD) function to find the optimal mapping between point clouds. Our experimental results show that we are able to obtain a visually accurate estimation of the 3D human shape from a single 2D image, with some inaccuracy for heavily occluded parts.

Publication

Jingtian Zhang, Hubert P. H. Shum, Kevin McCay and Edmond S. L. Ho,
"Prior-less 3D Human Shape Reconstruction with an Earth Mover's Distance Informed CNN",
Proceedings of the 2019 International Conference on Motion, Interaction and Games (MIG) Posters

Citation=1##

## Citation counts from Google Scholar as of 2020

Downloads

YouTube

References

BibTeX

@inproceedings{zhang19priorless,
 author={Zhang, Jingtian and Shum, Hubert P. H. and McCay, Kevin and Ho, Edmond S. L.},
 booktitle={Proceedings of the 2019 International Conference on Motion in Games},
 series={MIG '19},
 title={Prior-less 3D Human Shape Reconstruction with an Earth Mover's Distance Informed CNN},
 year={2019},
 pages={44:1--44:2},
 numpages={2},
 doi={10.1145/3359566.3364694},
 isbn={978-1-4503-6994-7},
 publisher={ACM},
 Address={New York, NY, USA},
 location={Newcastle upon Tyne, UK},
}

EndNote/RefMan

TY  - CONF
AU  - Zhang, Jingtian
AU  - Shum, Hubert P. H.
AU  - McCay, Kevin
AU  - Ho, Edmond S. L.
T2  - Proceedings of the 2019 International Conference on Motion in Games
TI  - Prior-less 3D Human Shape Reconstruction with an Earth Mover's Distance Informed CNN
PY  - 2019
SP  - 44:1
EP  - 44:2
DO  - 10.1145/3359566.3364694
SN  - 978-1-4503-6994-7
PB  - ACM
ER  - 

Plain Text

Jingtian Zhang, Hubert P. H. Shum, Kevin McCay and Edmond S. L. Ho, "Prior-less 3D Human Shape Reconstruction with an Earth Mover's Distance Informed CNN," in MIG '19: Proceedings of the 2019 International Conference on Motion in Games, pp. 44:1-44:2, Newcastle upon Tyne, UK, ACM, 2019.

Similar Research

 

Last update: 23 September 2020