Improved human action recognition approach based on two-stream convolutional neural network model

• DOI: 10.1007/s00371-020-01868-8
• Publication Date: 2020-06-05T08:06:00Z
• Authors: Congcong Liu; Jie Ying; Haima Yang; Xing Hu; Jin Liu
• Keywords: 0202 electrical engineering, electronic engineering, information engineering; 02 engineering and technology

In order to improve the accuracy of human abnormal behavior recognition, a two-stream convolution neural network model was proposed. This model includes two main parts, VMHI and FRGB. Firstly, the motion history images are extracted and input into VGG-16 convolutional neural network for training. Then, the RGB image is input into Faster R-CNN algorithm for training using Kalman filter-assisted data annotation. Finally, the two stream VMHI and FRGB results are fused. The algorithm can recognize not only single person behavior, but also two person interaction behavior and improve the recognition accuracy of similar actions. Experimental results on KTH, Weizmann, UT-interaction, and TenthLab dataset showed that the proposed algorithm has higher accuracy than the other literature.