HOMEto discoverJOINING USto achievePUBLICATIONSto innovateGRANTSto establishACTIVITIESto engagePEOPLEto collaborateTEACHINGto inspireCONTACTSto explore

Research Publications - Video Analysis

Select a Topic:​ All​ Motion Analysis​ Character Animation​​ Interaction Modelling​ Video Analysis​ Action Recognition​ 3D Reconstruction​ Healthcare Diagnosis​ Crowd Modelling​ Environment Sensing​ Virtual Reality​ Surface Modelling​ Face Modelling​ Responsible AI​ Robotics​ Hands and Gestures​ Surveillance​ Cybersecurity​ Artwork Analysis​ Medical Imaging​ Air and Space​​

Sort By:​Year​Type​Citation​Impact Factor

We tackle the challenges of high-dimensional and high-volume data in video analysis through the extraction of representative geometric features and the fusion of multi-modality features.

Insterested in our research? Consider joining us.

2025

Adaptive Graph Learning from Spatial Information for Surgical Workflow Anticipation
Adaptive Graph Learning from Spatial Information for Surgical Workflow Anticipation  Impact Factor: 3.4†    
IEEE Transactions on Medical Robotics and Bionics (TMRB), 2025
Francis Xiatian Zhang, Jingjing Deng, Robert Lieck and Hubert P. H. Shum
 Webpage Cite This Paper GitHub YouTube

2024

MAGR: Manifold-Aligned Graph Regularization for Continual Action Quality Assessment
MAGR: Manifold-Aligned Graph Regularization for Continual Action Quality Assessment  Oral Paper (Top 2.3% of 8585 Submissions)   H5-Index: 206# Core A* Conference‡ 
Proceedings of the 2024 European Conference on Computer Vision (ECCV), 2024
Kanglei Zhou, Liyuan Wang, Xingxing Zhang, Hubert P. H. Shum, Frederick W. B. Li, Jianguo Li and Xiaohui Liang
 Webpage Cite This Paper Supplementary Material YouTube
Depth-Aware Endoscopic Video Inpainting
Depth-Aware Endoscopic Video Inpainting    H5-Index: 96# Core A Conference‡ 
Proceedings of the 2024 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2024
Francis Xiatian Zhang, Shuang Chen, Xianghua Xie and Hubert P. H. Shum
 Webpage Cite This Paper Supplementary Material GitHub
Pose-Based Tremor Type and Level Analysis for Parkinson’s Disease from Video
Pose-Based Tremor Type and Level Analysis for Parkinson’s Disease from Video  Impact Factor: 2.3†    
International Journal of Computer Assisted Radiology and Surgery (IJCARS), 2024
Haozheng Zhang, Edmond S. L. Ho, Francis Xiatian Zhang, Silvia Del Din and Hubert P. H. Shum
 Webpage Cite This Paper
From Category to Scenery: An End-to-End Framework for Multi-Person Human-Object Interaction Recognition in Videos
From Category to Scenery: An End-to-End Framework for Multi-Person Human-Object Interaction Recognition in Videos    H5-Index: 56#  
Proceedings of the 2024 International Conference on Pattern Recognition (ICPR), 2024
Tanqiu Qiao, Ruochen Li, Frederick W. B. Li and Hubert P. H. Shum
 Webpage Cite This Paper Supplementary Material
A Comprehensive Survey of Action Quality Assessment: Method and Benchmark
A Comprehensive Survey of Action Quality Assessment: Method and Benchmark      
arXiv Preprint, 2024
Kanglei Zhou, Ruizhi Cai, Liyuan Wang, Hubert P. H. Shum and Xiaohui Liang
 Webpage Cite This

2023

A Video-Based Augmented Reality System for Human-in-the-Loop Muscle Strength Assessment of Juvenile Dermatomyositis
A Video-Based Augmented Reality System for Human-in-the-Loop Muscle Strength Assessment of Juvenile Dermatomyositis  Impact Factor: 4.7† Top 25% Journal in Computer Science, Software Engineering†   Citation: 15#
IEEE Transactions on Visualization and Computer Graphics (TVCG) - Proceedings of the 2023 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2023
Kanglei Zhou, Ruizhi Cai, Yue Ma, Qingqing Tan, Xinning Wang, Jianguo Li, Hubert P. H. Shum, Frederick W. B. Li, Song Jin and Xiaohui Liang
 Webpage Cite This Paper YouTube
Hierarchical Graph Convolutional Networks for Action Quality Assessment
Hierarchical Graph Convolutional Networks for Action Quality Assessment  Impact Factor: 8.3† Top 10% Journal in Engineering, Electrical & Electronic†   Citation: 31#
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2023
Kanglei Zhou, Yue Ma, Hubert P. H. Shum and Xiaohui Liang
 Webpage Cite This Paper GitHub
Enhancing Perception and Immersion in Pre-Captured Environments through Learning-Based Eye Height Adaptation
Enhancing Perception and Immersion in Pre-Captured Environments through Learning-Based Eye Height Adaptation     Core A* Conference‡ 
Proceedings of the 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2023
Qi Feng, Hubert P. H. Shum and Shigeo Morishima
 Webpage Cite This Paper YouTube
Region-Based Appearance and Flow Characteristics for Anomaly Detection in Infrared Surveillance Imagery
Region-Based Appearance and Flow Characteristics for Anomaly Detection in Infrared Surveillance Imagery    H5-Index: 115#  
Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2023
Yona Falinie A. Gaus, Neelanjan Bhowmik, Brian K. S. Isaac-Medina, Hubert P. H. Shum, Amir Atapour-Abarghouei and Toby P. Breckon
 Webpage Cite This Paper

2022

A Pose-Based Feature Fusion and Classification Framework for the Early Prediction of Cerebral Palsy in Infants
A Pose-Based Feature Fusion and Classification Framework for the Early Prediction of Cerebral Palsy in Infants  Impact Factor: 4.8†    Citation: 37#
IEEE Transactions on Neural Systems and Rehabilitation Engineering (TNSRE), 2022
Kevin D. McCay, Pengpeng Hu, Hubert P. H. Shum, Wai Lok Woo, Claire Marcroft, Nicholas D. Embleton, Adrian Munteanu and Edmond S. L. Ho
 Webpage Cite This Paper GitHub
Geometric Features Informed Multi-Person Human-Object Interaction Recognition in Videos
Geometric Features Informed Multi-Person Human-Object Interaction Recognition in Videos    H5-Index: 206# Core A* Conference‡ Citation: 16#
Proceedings of the 2022 European Conference on Computer Vision (ECCV), 2022
Tanqiu Qiao, Qianhui Men, Frederick W. B. Li, Yoshiki Kubotani, Shigeo Morishima and Hubert P. H. Shum
 Webpage Cite This Paper Supplementary Material Dataset GitHub
Pose-Based Tremor Classification for Parkinson’s Disease Diagnosis from Video
Pose-Based Tremor Classification for Parkinson’s Disease Diagnosis from Video    H5-Index: 96# Core A Conference‡ Citation: 18#
Proceedings of the 2022 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2022
Haozheng Zhang, Edmond S. L. Ho, Francis Xiatian Zhang and Hubert P. H. Shum
 Webpage Cite This Paper Supplementary Material
360 Depth Estimation in the Wild - The Depth360 Dataset and the SegFuse Network
360 Depth Estimation in the Wild - The Depth360 Dataset and the SegFuse Network     Core A* Conference‡ Citation: 19#
Proceedings of the 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2022
Qi Feng, Hubert P. H. Shum and Shigeo Morishima
 Webpage Cite This Paper YouTube Part 1 YouTube Part 2
Towards Graph Representation Learning Based Surgical Workflow Anticipation
Towards Graph Representation Learning Based Surgical Workflow Anticipation  Oral Paper     
Proceedings of the 2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), 2022
Francis Xiatian Zhang, Noura Al Moubayed and Hubert P. H. Shum
 Webpage Cite This Paper GitHub YouTube

2021

Unmanned Aerial Vehicle Visual Detection and Tracking using Deep Neural Networks: A Performance Benchmark
Unmanned Aerial Vehicle Visual Detection and Tracking using Deep Neural Networks: A Performance Benchmark    H5-Index: 80#  Citation: 88#
Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), 2021
Brian K. S. Isaac-Medina, Matthew Poyser, Daniel Organisciak, Chris G. Willcocks, Toby P. Breckon and Hubert P. H. Shum
 Webpage Cite This Paper GitHub
Bi-Projection Based Foreground-Aware Omnidirectional Depth Prediction
Bi-Projection Based Foreground-Aware Omnidirectional Depth Prediction      
Proceedings of the 2021 Visual Computing (VC), 2021
Qi Feng, Hubert P. H. Shum and Shigeo Morishima
 Webpage Cite This Paper

2020

Abnormal Infant Movements Classification with Deep Learning on Pose-Based Features
Abnormal Infant Movements Classification with Deep Learning on Pose-Based Features  REF 2021 Submitted Output Impact Factor: 3.4†    Citation: 77#
IEEE Access, 2020
Kevin D. McCay, Edmond S. L. Ho, Hubert P. H. Shum, Gerhard Fehringer, Claire Marcroft and Nicholas Embleton
 Webpage Cite This Paper GitHub
Multi-Task Deep Learning with Optical Flow Features for Self-Driving Cars
Multi-Task Deep Learning with Optical Flow Features for Self-Driving Cars  Impact Factor: 2.3†    
IET Intelligent Transport Systems (ITS), 2020
Yuan Hu, Hubert P. H. Shum and Edmond S. L. Ho
 Webpage Cite This Paper
Foreground-Aware Dense Depth Estimation for 360 Images
Foreground-Aware Dense Depth Estimation for 360 Images      
Journal of WSCG - Proceedings of the 2020 International Conferences in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG), 2020
Qi Feng, Hubert P. H. Shum and Shigeo Morishima
 Webpage Cite This Paper Supplementary Material YouTube

2017

Unsupervised Abnormal Behaviour Detection with Overhead Crowd Video
Unsupervised Abnormal Behaviour Detection with Overhead Crowd Video      
Proceedings of the 2017 International Conference on Software, Knowledge, Information Management and Applications (SKIMA), 2017
Shoujiang Xu, Edmond S. L. Ho, Nauman Aslam and Hubert P. H. Shum
 Webpage Cite This Paper

2005

Tracking the Translational and Rotational Movement of the Ball Using High-Speed Camera Movies
Tracking the Translational and Rotational Movement of the Ball Using High-Speed Camera Movies    H5-Index: 66#  Citation: 58#
Proceedings of the 2005 IEEE International Conference on Image Processing (ICIP), 2005
Hubert P. H. Shum and Taku Komura
 Webpage Cite This Paper

2004

A Spatiotemporal Approach to Extract the 3D Trajectory of the Baseball from a Single View Video Sequence
A Spatiotemporal Approach to Extract the 3D Trajectory of the Baseball from a Single View Video Sequence     Core A Conference‡ Citation: 37#
Proceedings of the 2004 IEEE International Conference on Multimedia and Expo (ICME), 2004
Hubert P. H. Shum and Taku Komura
 Webpage Cite This Paper Software


† According to Journal Citation Reports 2023
‡ According to Core Ranking 2023
# According to Google Scholar 2024

 

RSS Feed