Action Recognition from Arbitrary Views Using Transferable Dictionary Learning

Action Recognition from Arbitrary Views Using Transferable Dictionary Learning

Abstract

Human action recognition is crucial to many practical applications, ranging from human-computer interaction to video surveillance. Most approaches either recognize the human action from a fixed view or require the knowledge of view angle, which is usually not available in practical applications. In this paper, we propose a novel end-to-end framework to jointly learn a view-invariance transfer dictionary and a view-invariant classifier. The result of the process is a dictionary that can project real-world 2D video into a view-invariant sparse representation, and a classifier to recognize actions with an arbitrary view. The main feature of our algorithm is the use of synthetic data to extract view-invariance between 3D and 2D videos during the pre-training phase. This guarantees the availability of training data, and removes the hassle of obtaining real-world videos in specific viewing angles. Additionally, for better describing the actions in 3D videos, we introduce a new feature set called the3D dense trajectoriesto effectively encode extracted trajectory information on 3D videos. Experimental results on the IXMAS, N-UCLA, i3DPost and UWA3DII data sets show improvements over existing algorithms.

Publication

Jingtian Zhang, Hubert P. H. Shum, Jungong Han and Ling Shao,
"Action Recognition from Arbitrary Views Using Transferable Dictionary Learning",
IEEE Transactions on Image Processing (TIP)

Citation=6## IF=6.790#

# Impact factor from the Journal Citation Reports as of 2017
## Citation count from Google Scholar as of 2018

Downloads

YouTube

References

BibTeX

@article{zhang18arbitrary,
 author={Zhang, Jingtian and Shum, Hubert P. H. and Han, Jungong and Shao, Ling},
 journal={IEEE Transactions on Image Processing},
 title={Action Recognition from Arbitrary Views Using Transferable Dictionary Learning},
 year={2018},
 volume={27},
 number={10},
 pages={4709--4723},
 numpages={15},
 doi={10.1109/TIP.2018.2836323},
 issn={1057-7149},
 publisher={IEEE},
}

EndNote/RefMan

TY  - JOUR
AU  - Zhang, Jingtian
AU  - Shum, Hubert P. H.
AU  - Han, Jungong
AU  - Shao, Ling
T2  - IEEE Transactions on Image Processing
TI  - Action Recognition from Arbitrary Views Using Transferable Dictionary Learning
PY  - 2018
VL  - 27
IS  - 10
SP  - 4709
EP  - 4723
DO  - 10.1109/TIP.2018.2836323
SN  - 1057-7149
PB  - IEEE
ER  - 

Plain Text

Jingtian Zhang, Hubert P. H. Shum, Jungong Han and Ling Shao, "Action Recognition from Arbitrary Views Using Transferable Dictionary Learning," IEEE Transactions on Image Processing, vol. 27, no. 10, pp. 4709-4723, IEEE, 2018.

Similar Research

 

         

Last update: 16/09/2019