ESKN: Enhanced selective kernel network for single image super-resolution

• DOI: 10.1016/j.sigpro.2021.108274
• Publication Date: 2021-07-31T14:56:46Z
• Authors: Zewei He; Guizhong Fu; Yanpeng Cao; Yanlong Cao; Jiangxin Yang; Xin Li
• Keywords: 0202 electrical engineering, electronic engineering, information engineering; 02 engineering and technology

Abstract For single image super-resolution (SISR), one recent research direction is to build an effective multi-scale context extraction pipeline via parallel convolutional streams. Although very competitive SR performance has been achieved, effective solutions for extracting and integrating multi-scale context are still under-explored. We propose an enhanced selective kernel module (ESKM) to address this challenging problem and build a network that achieves high-quality SISR. The key of the proposed ESKM is to perform self-learned filter-oriented weights re-calibration to better extract insignificant but important features which are critical for high-accuracy SISR tasks. Moreover, we replace the S o f t m a x operation with S i g m o i d for more flexible weights learning and remove the dimension reduction/expansion component to build a direct correspondence between channels and their weights. We also design a symmetric connection scheme (SCS) to better fuse the hierarchical features extracted from different convolutional stages. More specifically, the low-level features are adjusted via a spatial attention module to achieve more effective fusion with high-level semantic features. We then stack multiple ESKMs via SCS to build our new network, named Enhanced Selective Kernel Network (ESKN). Extensive experimental results demonstrate the effectiveness of our proposed ESKN model, outperforming the state-of-the-art SISR methods in terms of restoration quality and network complexity.