Roadmap on Deep Learning for Microscopy.

• DOI: 10.48550/arxiv.2303.03793
• Publication Date: 2023-01-01
• Authors: Volpe, Giovanni; Wählby, Carolina; Tian, Lei; Hecht, Michael; Yakimovich, Artur; Monakhova, Kristina; Waller, Laura; Sbalzarini, Ivo F.; Metzler, Christop...; Xie, Mingyang; Zhang, Kevin; Lenton, Isaac C. D.; Rubinsztein-Dunlo...; Brunner, Daniel; Bai, Bijie; Ozcan, Aydogan; Midtvedt, Daniel; Wang, Hao; Sladoje, Nataša; Lindblad, Joakim; Smith, Jason T.; Ochoa, Marien; Barroso, Margarida; Intes, Xavier; Qiu, Tong; Yu, Li-Yu; You, Sixian; Liu, Yongtao; Ziatdinov, Maxim A.; Kalinin, Sergei V.; Sheridan, Arlo; Manor, Uri; Nehme, Elias; Goldenberg, Ofri; Shechtman, Yoav; Moberg, Henrik K.; Langhammer, Chris...; Špačková, Barbora; Helgadottir, Saga; Midtvedt, Benjamin; Argun, Aykut; Thalheim, Tobias; Cichos, Frank; Bo, Stefano; Hubatsch, Lars; Pineda, Jesus; Manzo, Carlo; Bachimanchi, Hars...; Selander, Erik; Homs-Corbera, Antoni; Fränzl, Martin; de Haan, Kevin; Rivenson, Yair; Korczak, Zofia; Adiels, Caroline ...; Mijalkov, Mite; Veréb, Dániel; Chang, Yu-Wei; Pereira, Joana B.; Matuszewski, Damian; Kylberg, Gustaf; Sintorn, Ida-Maria; Caicedo, Juan C.; Cimini, Beth A; Bell, Muyinatu A....; Saraiva, Bruno M.; Jacquemet, Guillaume; Henriques, Ricardo; Ouyang, Wei; Le, Trang; Gómez-de-Mariscal...; Sage, Daniel; Muñoz-Barrutia, A...; Lindqvist, Ebba J...; Bergman, Johanna
• Keywords: Biological Physics (physics.bio-ph); Image and Video Processing (eess.IV); FOS: Electrical engineering, electronic engineering, information engineering; FOS: Physical sciences; Physics - Applied Physics; Physics - Biological Physics; Applied Physics (physics.app-ph); Electrical Engineering and Systems Science - Image and Video Processing; Physics - Optics; Optics (physics.optics)

Through digital imaging, microscopy has evolved from primarily being a means for visual observation of life at the micro- and nano-scale, to a quantitative tool with ever-increasing resolution and throughput. Artificial intelligence, deep neural networks, and machine learning are all niche terms describing computational methods that have gained a pivotal role in microscopy-based research over the past decade. This Roadmap is written collectively by prominent researchers and encompasses selected aspects of how machine learning is applied to microscopy image data, with the aim of gaining scientific knowledge by improved image quality, automated detection, segmentation, classification and tracking of objects, and efficient merging of information from multiple imaging modalities. We aim to give the reader an overview of the key developments and an understanding of possibilities and limitations of machine learning for microscopy. It will be of interest to a wide cross-disciplinary audience in the physical sciences and life sciences.