Resolving Occlusion for 3D Object Manipulation with Hands in Mixed Reality

Qi Feng, Hubert P. H. Shum and Shigeo Morishima
Proceedings of the 2018 ACM Symposium on Virtual Reality Software and Technology (VRST) Posters, 2018

Citation: 9##

Resolving Occlusion for 3D Object Manipulation with Hands in Mixed Reality
## Citation counts from Google Scholar as of 2022

Abstract

Due to the need to interact with virtual objects, the hand-object interaction has become an important element in mixed reality (MR) applications. In this paper, we propose a novel approach to handle the occlusion of augmented 3D object manipulation with hands by exploiting the nature of hand poses combined with tracking-based and model-based methods, to achieve a complete mixed reality experience without necessities of heavy computations, complex manual segmentation processes or wearing special gloves. The experimental results show a frame rate faster than real-time and a great accuracy of rendered virtual appearances, and a user study verifies a more immersive experience compared to past approaches. We believe that the proposed method can improve a wide range of mixed reality applications that involve hand-object interactions.

Downloads

YouTube

Citations

BibTeX

@inproceedings{feng18resolving,
 author={Feng, Qi and Shum, Hubert P. H. and Morishima, Shigeo},
 booktitle={Proceedings of the 2018 ACM Symposium on Virtual Reality Software and Technology},
 series={VRST '18},
 title={Resolving Occlusion for 3D Object Manipulation with Hands in Mixed Reality},
 year={2018},
 month={Nov},
 numpages={2},
 doi={10.1145/3281505.3283390},
 isbn={9.78E+12},
 publisher={ACM},
 Address={New York, NY, USA},
 location={Tokyo, Japan},
}

RIS

TY  - CONF
AU  - Feng, Qi
AU  - Shum, Hubert P. H.
AU  - Morishima, Shigeo
T2  - Proceedings of the 2018 ACM Symposium on Virtual Reality Software and Technology
TI  - Resolving Occlusion for 3D Object Manipulation with Hands in Mixed Reality
PY  - 2018
Y1  - Nov 2018
DO  - 10.1145/3281505.3283390
SN  - 9.78E+12
PB  - ACM
ER  - 

Plain Text

Qi Feng, Hubert P. H. Shum and Shigeo Morishima, "Resolving Occlusion for 3D Object Manipulation with Hands in Mixed Reality," in VRST '18: Proceedings of the 2018 ACM Symposium on Virtual Reality Software and Technology, Tokyo, Japan, ACM, Nov 2018.

Supporting Grants

Similar Research

Qi Feng, Hubert P. H. Shum and Shigeo Morishima, "Occlusion for 3D Object Manipulation with Hands in Augmented Reality", Proceedings of the 2018 Meeting on Image Recognition and Understanding (MIRU), 2018
Qi Feng, Hubert P. H. Shum and Shigeo Morishima, "Resolving Hand-Object Occlusion for Mixed Reality with Joint Deep Learning and Model Optimization", Computer Animation and Virtual Worlds (CAVW) - Proceedings of the 2020 International Conference on Computer Animation and Social Agents (CASA), 2020

 

 

Last updated on 20 May 2023
RSS Feed