Fully Attentional Network for Semantic Segmentation

• DOI: 10.1609/aaai.v36i2.20126
• Publication Date: 2022-07-04T10:33:18Z
• Authors: Qi Song; Jie Li; Chenghong Li; Hao Guo; Rui Huang
• Keywords: Feature (linguistics); Pascal (unit); Attention network; Similarity (geometry)

Recent non-local self-attention methods have proven to be effective in capturing long-range dependencies for semantic segmentation. These usually form a similarity map of R^(CxC) (by compressing spatial dimensions) or R^(HWxHW) channels) describe the feature relations along either channel dimensions, where C is number channels, H and W are dimensions input map. However, such practices tend condense other hence causing attention missing, which might lead inferior results small/thin categories inconsistent segmentation inside large objects. To address this problem, we propose new approach, namely Fully Attentional Network (FLANet), encode both attentions single while maintaining high computational efficiency. Specifically, each map, our FLANet can harvest responses from all maps, associated positions as well, through novel fully attentional module. Our method has achieved state-of-the-art performance on three challenging datasets, i.e., 83.6%, 46.99%, 88.5% Cityscapes test set, ADE20K validation PASCAL VOC respectively.