extracting quantitative biological information from bright field cell images using deep learning

• DOI: 10.48550/arxiv.2012.12986
• Publication Date: 2021-07-20
• Authors: Giovanni Volpe; Daniel Midtvedt; Alan Sabirsh; Caroline B. Adiels; Saga Helgadottir; Benjamin Midtvedt; Jesus Pineda; Stefano Romeo; Stefano Romeo; Stefano Romeo
• Keywords: 0301 basic medicine; 03 medical and health sciences; Image and Video Processing (eess.IV); FOS: Electrical engineering, electronic engineering, information engineering; FOS: Physical sciences; Physics - Applied Physics; Articles; Medical Physics (physics.med-ph); Applied Physics (physics.app-ph); Electrical Engineering and Systems Science - Image and Video Processing; Physics - Medical Physics; 3. Good health

Quantitative analysis of cell structures is essential for biomedical and pharmaceutical research. The standard imaging approach relies on fluorescence microscopy, where cell structures of interest are labeled by chemical staining techniques. However, these techniques are often invasive and sometimes even toxic to the cells, in addition to being time consuming, labor intensive, and expensive. Here, we introduce an alternative deep-learning–powered approach based on the analysis of bright-field images by a conditional generative adversarial neural network (cGAN). We show that this is a robust and fast-converging approach to generate virtually stained images from the bright-field images and, in subsequent downstream analyses, to quantify the properties of cell structures. Specifically, we train a cGAN to virtually stain lipid droplets, cytoplasm, and nuclei using bright-field images of human stem-cell–derived fat cells (adipocytes), which are of particular interest for nanomedicine and vaccine development. Subsequently, we use these virtually stained images to extract quantitative measures about these cell structures. Generating virtually stained fluorescence images is less invasive, less expensive, and more reproducible than standard chemical staining; furthermore, it frees up the fluorescence microscopy channels for other analytical probes, thus increasing the amount of information that can be extracted from each cell. To make this deep-learning–powered approach readily available for other users, we provide a Python software package, which can be easily personalized and optimized for specific virtual-staining and cell-profiling applications.