Three-Stream Convolutional Neural Network with Squeeze-and-Excitation Block for Near-Infrared Facial Expression Recognition

• DOI: 10.3390/electronics8040385
• Publication Date: 2019-03-29T17:09:58Z
• Authors: Ying Chen; Zhihao Zhang; Lei Zhong; Tong Chen; Juxiang Chen; Yeda Yu
• Keywords: 02 engineering and technology; 004; MODEL; adaptive feature weights calibration; 3D CNN; Engineering; 0202 electrical engineering, electronic engineering, information engineering; Electrical & Electronic; SE block; NIR facial expression recognition; SYSTEM; 3D

Near-infrared (NIR) facial expression recognition is resistant to illumination change. In this paper, we propose a three-stream three-dimensional convolution neural network with a squeeze-and-excitation (SE) block for NIR facial expression recognition. We fed each stream with different local regions, namely the eyes, nose, and mouth. By using an SE block, the network automatically allocated weights to different local features to further improve recognition accuracy. The experimental results on the Oulu-CASIA NIR facial expression database showed that the proposed method has a higher recognition rate than some state-of-the-art algorithms.