Interaction-Based Human Activity Comparison

Yijun Shen, Longzhi Yang, Edmond S. L. Ho and Hubert P. H. Shum
IEEE Transactions on Visualization and Computer Graphics (TVCG), 2020

REF 2021 Submitted Output Impact Factor: 5.2 Top 25% Journal in Computer Science, Software Engineering Citation: 23#

Interaction-Based Human Activity Comparison
# According to Google Scholar 2023"


Traditional methods for motion comparison consider features from individual characters. However, the semantic meaning of many human activities is usually defined by the interaction between them, such as a high-five interaction of two characters. There is little success in adapting interaction-based features in activity comparison, as they either do not have a fixed topology or are in high dimensional. In this paper, we propose a unified framework for activity comparison from the interaction point of view. Our new metric evaluates the similarity of interaction by adapting the Earth Mover's Distance onto a customized geometric mesh structure that represents spatial-temporal interactions. This allows us to compare different classes of interactions and discover their intrinsic semantic similarity. We created five interaction databases of different natures, covering both two-characters (synthetic and real-people) and character-object interactions, which are open for public uses. We demonstrate how the proposed metric aligns well with the semantic meaning of the interaction. We also apply the metric in interaction retrieval and show how it outperforms existing ones. The proposed method can be used for unsupervised activity detection in monitoring systems and activity retrieval in smart animation systems.





 author={Shen, Yijun and Yang, Longzhi and Ho, Edmond S. L. and Shum, Hubert P. H.},
 journal={IEEE Transactions on Visualization and Computer Graphics},
 title={Interaction-Based Human Activity Comparison},


AU  - Shen, Yijun
AU  - Yang, Longzhi
AU  - Ho, Edmond S. L.
AU  - Shum, Hubert P. H.
T2  - IEEE Transactions on Visualization and Computer Graphics
TI  - Interaction-Based Human Activity Comparison
PY  - 2020
VL  - 26
IS  - 8
SP  - 115673
EP  - 115684
DO  - 10.1109/TVCG.2019.2893247
ER  - 

Plain Text

Yijun Shen, Longzhi Yang, Edmond S. L. Ho and Hubert P. H. Shum, "Interaction-Based Human Activity Comparison," IEEE Transactions on Visualization and Computer Graphics, vol. 26, no. 8, pp. 115673-115684, IEEE, 2020.

Supporting Grants

Northumbria University

Postgraduate Research Scholarship (Ref: ): £65,000, Principal Investigator ()
Received from Faculty of Engineering and Environment, Northumbria University, UK, 2015-2018
Project Page
The Engineering and Physical Sciences Research Council
Interaction-based Human Motion Analysis
EPSRC First Grant Scheme (Ref: EP/M002632/1): £123,819, Principal Investigator ()
Received from The Engineering and Physical Sciences Research Council, UK, 2014-2016
Project Page

Similar Research

Qianhui Men, Howard Leung, Edmond S. L. Ho and Hubert P. H. Shum, "A Two-Stream Recurrent Network for Skeleton-Based Human Interaction Recognition", Proceedings of the 2020 International Conference on Pattern Recognition (ICPR), 2020
Jeff K. T. Tang, Howard Leung, Taku Komura and Hubert P. H. Shum, "Emulating Human Perception of Motion Similarity", Computer Animation and Virtual Worlds (CAVW) - Proceedings of the 2008 International Conference on Computer Animation and Social Agents (CASA), 2008
Qianhui Men, Hubert P. H. Shum, Edmond S. L. Ho and Howard Leung, "GAN-Based Reactive Motion Synthesis with Class-Aware Discriminators for Human-Human Interaction", Computers and Graphics (C&G), 2022
Yijun Shen, He Wang, Edmond S. L. Ho, Longzhi Yang and Hubert P. H. Shum, "Posture-Based and Action-Based Graphs for Boxing Skill Visualization", Computers and Graphics (C&G), 2017



Last updated on 4 June 2024
RSS Feed