Addressing multi-label imbalance problem of surgical tool detection using CNN

• DOI: 10.1007/s11548-017-1565-x
• Publication Date: 2017-03-29T15:46:24Z
• Authors: Manish Sahu; Anirban Mukhopadhyay; Angelika Szengel; Stefan Zachow
• Keywords: Image Processing, Computer-Assisted; 0202 electrical engineering, electronic engineering, information engineering; Humans; Endoscopy; Neural Networks, Computer; 02 engineering and technology; Foreign Bodies; Algorithms; Pattern Recognition, Automated

A fully automated surgical tool detection framework is proposed for endoscopic video streams. State-of-the-art surgical tool detection methods rely on supervised one-vs-all or multi-class classification techniques, completely ignoring the co-occurrence relationship of the tools and the associated class imbalance.In this paper, we formulate tool detection as a multi-label classification task where tool co-occurrences are treated as separate classes. In addition, imbalance on tool co-occurrences is analyzed and stratification techniques are employed to address the imbalance during convolutional neural network (CNN) training. Moreover, temporal smoothing is introduced as an online post-processing step to enhance runtime prediction.Quantitative analysis is performed on the M2CAI16 tool detection dataset to highlight the importance of stratification, temporal smoothing and the overall framework for tool detection.The analysis on tool imbalance, backed by the empirical results, indicates the need and superiority of the proposed framework over state-of-the-art techniques.