A lightweight underwater fish image semantic segmentation model based on U‐Net

• DOI: 10.1049/ipr2.13161
• Publication Date: 2024-06-26T06:56:31Z
• Authors: Zhenkai Zhang; Wanghua Li; Boon‐Chong Seet
• Keywords: 0301 basic medicine; oceanographic techniques; 600; computer vision; 620; 0906 Electrical and Electronic Engineering; 4603 Computer vision and multimedia computation; QA76.75-76.765; 03 medical and health sciences; convolutional neural nets; augmented reality and games; 0801 Artificial Intelligence and Image Processing; Photography; Artificial Intelligence & Image Processing; Computer software; TR1-1050; image segmentation; 4607 Graphics

AbstractSemantic segmentation of underwater fish images is vital for monitoring fish stocks, assessing marine resources, and sustaining fisheries. To tackle challenges such as low segmentation accuracy, inadequate real‐time performance, and imprecise location segmentation in current methods, a novel lightweight U‐Net model is proposed. The proposed model acquires more segmentation details by applying a multiple‐input approach at the first four encoder levels. To achieve both lightweight and high accuracy, a multi‐scale residual structure (MRS) module is proposed to reduce parameters and compensate for the accuracy loss caused by the reduction of channels. To improve segmentation accuracy, a multi‐scale skip connection (MSC) structure is further proposed, and the convolution block attention mechanism (CBAM) is introduced at the end of each decoder level for weight adjustment. Experimental results demonstrate a notable reduction in model volume, parameters, and floating‐point operations by 94.20%, 94.39%, and 51.52% respectively, compared to the original model. The proposed model achieves a high mean intersection over union (mIOU) of 94.44%, mean pixel accuracy (mPA) of 97.03%, and a frame rate of 43.62 frames per second (FPS). With its high precision and minimal parameters, the model strikes a balance between accuracy and speed, making it particularly suitable for underwater image segmentation.