Unsupervised Attention-guided Image to Image Translation

• DOI: 10.48550/arxiv.1806.02311
• Publication Date: 2018-01-01
• Authors: Mejjati, Youssef A.; Richardt, Christian; Tompkin, James; Cosker, Darren; Kim, Kwang In
• Keywords: FOS: Computer and information sciences; 03 medical and health sciences; 0302 clinical medicine; Artificial Intelligence (cs.AI); Computer Science - Artificial Intelligence; Computer Vision and Pattern Recognition (cs.CV); Computer Science - Computer Vision and Pattern Recognition

Current unsupervised image-to-image translation techniques struggle to focus their attention on individual objects without altering the background or the way multiple objects interact within a scene. Motivated by the important role of attention in human perception, we tackle this limitation by introducing unsupervised attention mechanisms that are jointly adversarialy trained with the generators and discriminators. We demonstrate qualitatively and quantitatively that our approach is able to attend to relevant regions in the image without requiring supervision, and that by doing so it achieves more realistic mappings compared to recent approaches.