[Recruitment]
Associate/Assistant Professor in Artificial Intelligence for Space-Enabled Technologies, Durham University

We are looking for applicants in Artificial Intelligence, Computer Vision, Edge Computing, Digital Twins, Human Computer Interaction, User Modelling, Robotics or Resilient Computing with potentials/achievements in informing space applications.

The post hoder will enjoy 1) a permanent (equivalent to US tenured) position at a top 100 university, 2) significantly reduced teaching, 3) a fully-funded PhD, 4) travel budget, 5) chance for a 2-year fully-funded Post-Doc.

Geometric Features Informed Multi-Person Human-Object Interaction Recognition in Videos

Tanqiu Qiao, Qianhui Men, Frederick W. B. Li, Yoshiki Kubotani, Shigeo Morishima and Hubert P. H. Shum
Proceedings of the 2022 European Conference on Computer Vision (ECCV), 2022

Core A* Conference H5-Index: 238# Core A* Conference

Geometric Features Informed Multi-Person Human-Object Interaction Recognition in Videos
‡ According to Core Ranking 2023"

Abstract

Human-Object Interaction (HOI) recognition in videos is important for analysing human activity. Most existing work focusing on visual features usually suffer from occlusion in the real-world scenarios. Such a problem will be further complicated when multiple people and objects are involved in HOIs. Consider that geometric features such as human pose and object position provide meaningful information to understand HOIs, we argue to combine the benefits of both visual and geometric features in HOI recognition, and propose a novel Two-level Geometric feature-informed Graph Convolutional Network (2G-GCN). The geometric-level graph models the interdependency between geometric features of humans and objects, while the fusion-level graph further fuses them with visual features of humans and objects. To demonstrate the novelty and effectiveness of our method in challenging scenarios, we propose a new multi-person HOI dataset (MPHOI-72). Extensive experiments on MPHOI-72 (multi-person HOI), CAD-120 (single-human HOI) and Bimanual Actions (two-hand HOI) datasets demonstrate our superior performance compared to state-of-the-arts.

Downloads

YouTube

Citations

BibTeX

@inproceedings{qiao22geometric,
 author={Qiao, Tanqiu and Men, Qianhui and Li, Frederick W. B. and Kubotani, Yoshiki and Morishima, Shigeo and Shum, Hubert P. H.},
 booktitle={Proceedings of the 2022 European Conference on Computer Vision},
 series={ECCV '22},
 title={Geometric Features Informed Multi-Person Human-Object Interaction Recognition in Videos},
 year={2022},
 month={10},
 pages={474--491},
 numpages={18},
 doi={10.1007/978-3-031-19772-7_28},
 isbn={978-3-031-19772-7},
 publisher={Springer},
 location={Tel Aviv, Israel},
}

RIS

TY  - CONF
AU  - Qiao, Tanqiu
AU  - Men, Qianhui
AU  - Li, Frederick W. B.
AU  - Kubotani, Yoshiki
AU  - Morishima, Shigeo
AU  - Shum, Hubert P. H.
T2  - Proceedings of the 2022 European Conference on Computer Vision
TI  - Geometric Features Informed Multi-Person Human-Object Interaction Recognition in Videos
PY  - 2022
Y1  - 10 2022
SP  - 474
EP  - 491
DO  - 10.1007/978-3-031-19772-7_28
SN  - 978-3-031-19772-7
PB  - Springer
ER  - 

Plain Text

Tanqiu Qiao, Qianhui Men, Frederick W. B. Li, Yoshiki Kubotani, Shigeo Morishima and Hubert P. H. Shum, "Geometric Features Informed Multi-Person Human-Object Interaction Recognition in Videos," in ECCV '22: Proceedings of the 2022 European Conference on Computer Vision, pp. 474-491, Tel Aviv, Israel, Springer, Oct 2022.

Supporting Grants

Similar Research

Manli Zhu, Edmond S. L. Ho and Hubert P. H. Shum, "A Skeleton-Aware Graph Convolutional Network for Human-Object Interaction Detection", Proceedings of the 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2022
Qianhui Men, Howard Leung, Edmond S. L. Ho and Hubert P. H. Shum, "A Two-Stream Recurrent Network for Skeleton-Based Human Interaction Recognition", Proceedings of the 2020 International Conference on Pattern Recognition (ICPR), 2020
Qianhui Men, Edmond S. L. Ho, Hubert P. H. Shum and Howard Leung, "Focalized Contrastive View-Invariant Learning for Self-Supervised Skeleton-Based Action Recognition", Neurocomputing, 2023

 

 

Last updated on 17 February 2024
RSS Feed