Towards stronger illumination robustness of local feature detection and description based on auxiliary learning

• DOI: 10.1007/s11760-024-03175-4
• Publication Date: 2024-04-18T10:18:58Z
• Authors: Houqin Bian; Shihe Fan; Haolin Zhang; Lunming Qin; Haoyang Cui; Xi Wang
• Keywords: Robustness; Extractor; Feature Matching; Feature (linguistics); Homography

Abstract Local feature detection and description play a crucial role in various computer vision tasks, including image matching. Variations in illumination conditions significantly affect the accuracy of these applications. However, existing methods inadequately address this issue. In this paper, a novel algorithm based on Illumination Auxiliary Learning Module (IALM) is introduced. Firstly, a new local feature extractor named Illumination Auxiliary SuperPoint (IA-SuperPoint) is established, based on the integration of IALM and SuperPoint. Secondly, illumination-aware auxiliary training focuses on capturing the effects of illumination variations during feature extraction through tailored loss functions and jointly learning mechanisms. Lastly, in order to evaluate the illumination robustness of local features, a metric is proposed by simulating various illumination disturbances. Experiments on HPatches and RDNIM datasets demonstrate that the performance of local feature extraction is greatly improved by our method. Especially for matching local features with different illumination conditions, our method gains at most 16\% improvement on the state-of-the-art methods.