Large scale instance segmentation of outdoor environment based on improved YOLACT

• DOI: 10.1002/cpe.7370
• Publication Date: 2022-10-06T02:31:12Z
• Authors: Zichen Zhao; Xiliang Tong; Ying Sun; Dongxu Bai; Xin Liu; Guojun Zhao; Hanwen Fan; Jun Li; Cejing Zou; Baojia Chen
• Keywords: 0202 electrical engineering, electronic engineering, information engineering; 02 engineering and technology

SummaryInstance segmentation is a challenging task that requires both instance‐level and pixel‐level prediction and it has a wide range of applications in autonomous driving, video analysis, scene understandingand so on. The currently dominant instance segmentation methods have excellent accuracy, but they are slow, and the processing speed will be even less satisfactory if the input is a large‐scale image. In order to improve the efficiency and accuracy of instance segmentation of large‐scale images, this article modifies the backbone network based on YOLACT network, adds a multi‐information fusion module and provides an improved BiFPN method to achieve multi‐scale feature fusion, while adding two branches to the first level detector RetinaNet to achieve instance segmentation. The network model is tested on Cityscapes dataset and the results of the experiments show that the improved instance segmentation network in this article improves the accuracy while ensuring the speed of segmentation. The optimized network model size was reduced by 17% compared to YOLACT, and the mAP, mAP50, and mAP75 were improved by 18.3%, 32.1%, and 24.6%, respectively.