- Advanced Fluorescence Microscopy Techniques
- Optical Coherence Tomography Applications
- Photoacoustic and Ultrasonic Imaging
- Cell Image Analysis Techniques
- Advanced Electron Microscopy Techniques and Applications
- Image Processing Techniques and Applications
- Multimodal Machine Learning Applications
- Natural Language Processing Techniques
- Digital Holography and Microscopy
- Advanced X-ray and CT Imaging
- Integrated Circuits and Semiconductor Failure Analysis
- Topic Modeling
- Force Microscopy Techniques and Applications
- Advanced Radiotherapy Techniques
- Near-Field Optical Microscopy
- Advanced X-ray Imaging Techniques
- Photonic and Optical Devices
- Video Analysis and Summarization
- Medical Imaging Techniques and Applications
- CCD and CMOS Imaging Sensors
University of Michigan
2025
Zhejiang University
2021-2024
State Key Laboratory of Modern Optical Instruments
2022-2023
Observing subcellular structural dynamics in living cells has become the goal of super-resolution (SR) fluorescence microscopy. Among typical SRM techniques, structured illumination microscopy (SIM) stands out for its fast imaging speed and low photobleaching. However, 2D-SIM requires nine raw images to obtain a SR image, leading undesirable artifacts live-cell imaging. In this paper, we propose single-frame (SF-SIM) method based on deep learning that achieves using only single image...
Modulation-enhanced localization microscopy (MELM) has demonstrated significant improvements in both lateral and axial precision compared to conventional single-molecule (SMLM). However, modulated illumination based MELM (MELMxy) remains fundamentally limited two-dimensional imaging. Here we present three-dimensional Single-Molecule Modulated Illumination Localization Estimator (SMILE) that synergistically integrates modulation with point spread function engineering. By simultaneously...
Imaging three-dimensional, subcellular structures with high axial resolution has always been the core purpose of fluorescence microscopy. However, trade-offs exist between and other important technical indicators, such as temporal resolution, optical power density, imaging process complexity. We report a new modality, interference structured illumination microscopy (FI-SIM), which is based on three-dimensional for wide-field lateral reconstruction. FI-SIM can acquire images quickly within...
Structured-illumination microscopy (SIM) offers a twofold resolution enhancement beyond the optical diffraction limit. At present, SIM requires several raw structured-illumination (SI) frames to reconstruct super-resolution (SR) image, especially time-consuming reconstruction of speckle SIM, which hundreds SI frames. Considering this, we herein propose an untrained neural network (USRNN) with known illumination patterns reduce amount data that is required for by 20 times and thus improve its...
Three-dimensional structured illumination microscopy (3D-SIM) plays an essential role in biological volumetric imaging with the capabilities of improving lateral and axial resolution. However, traditional linear 3D algorithm is sensitive to noise generates artifacts, while low temporal resolution hinders live-cell imaging. In this paper, we propose a novel 3D-SIM based on total variation (TV) fast iterative shrinkage threshold (FISTA), termed TV-FISTA-SIM. Compared conventional algorithms,...
Optical microscopy is an essential tool for exploring the structures and activities of cells tissues. To break limit resolution caused by diffraction, researchers have made continuous advances innovations to improve optical since 1990s. These contributions, however, still make sub-10[Formula: see text]nm imaging obstacle. Here, we name a series technologies as modulated illumination localization (MILM), which makes ultra-high-resolution practical. Besides, review recent progress 2017 when...
Single-molecule localization microscopy (SMLM) gradually plays an important role in deep tissue imaging. However, current SMLM methods primarily rely on fiducial marks, neglecting aberrations introduced by thick samples, thereby resulting decreased image quality tissues. Here, we introduce vectorial situ point spread function (PSF) retrieval (VISPR), a method that retrieves precise PSF model considering both system- and sample-induced under conditions. By employing the theory of maximum...
Three-dimensional structured illumination microscopy (3D-SIM) is an essential tool for volumetric fluorescence imaging, which improves both axial and lateral resolution by down-modulating high-frequency information of the sample into passband optical transfer function (OTF). And when combining with 4Pi structure, performance 3D-SIM can be further improved. The reconstruction results generally used linear 3D algorithm, however, are lack high-fidelity proneess to generate artifacts. In this...
Structured illumination microscopy (SIM) achieves super-resolution (SR) by modulating the high-frequency information of sample into passband optical system and subsequent image reconstruction. The traditional Wiener-filtering-based reconstruction algorithm operates in Fourier domain, it requires prior knowledge sinusoidal patterns which makes time-consuming procedure parameter estimation to raw datasets necessary, besides, is sensitive noise or aberration-induced pattern distortion leads...
As a supplement to optical super-resolution microscopy techniques, computational methods have demonstrated remarkable results in alleviating the spatiotemporal imaging trade-off. However, they commonly suffer from low structural fidelity and universality. Therefore, we herein propose deep-physics-informed sparsity framework designed holistically synergize strengths of physical models (image blurring processes), prior knowledge (continuity constraints), back-end optimization algorithm...
This paper introduces a novel probabilistic mapping algorithm, Latent BKI, which enables open-vocabulary with quantifiable uncertainty. Traditionally, semantic algorithms focus on fixed set of categories limits their applicability for complex robotic tasks. Vision-Language (VL) models have recently emerged as technique to jointly model language and visual features in latent space, enabling recognition beyond predefined, classes. BKI recurrently incorporates neural embeddings from VL into...
Abstract Spatial resolution is crucial for imaging subcellular structures. The advent of three-dimensional structured illumination microscopy (3D-SIM) greatly benefits the biology community providing a powerful tool organelles with two-fold enhancement in all three dimensions. However, axial 3D-SIM limited to around 300 nm, which inferior its lateral resolution. Here we report novel method, image interference SIM(I 2 SIM), utilizes two oppositely positioned objectives detect fluorescence...
The dipole orientation of fluorescent molecules reveals the structural organization at subcellular level, and imaging its distribution is important for fundamental cell biology studies. Using conventional fluorescence microscopy, dipoles can be obtained by demodulating polarization states through excitation or emission processes. recent introduction structured illumination microscopy (SIM) has improved axial lateral resolution to around 300 100 nm, respectively. However, still very limited,...
In recent years, modulated illumination localization microscopy (MILM) methods have been proposed to provide around two-fold improvement in lateral precision over conventional single molecule with the same photon budget. However, MILM laterally was so far reported two-dimensional imaging modalities. To fully exploit its three-dimensional (3D) potential, we propose a 3D Single-Molecule Modulated Illumination Localization Estimator (3D-SMILE) that uses raw data measured from MILM, which has...
Abstract In single-molecule localization microscopy (SMLM), achieving precise hinges on obtaining an authentic point spread function (PSF) influenced by system and sample-induced aberrations. Here, we introduce VISPR (Vectorial in-situ PSF retrieval) retrieving 3D models considering both aberrations under SMLM conditions. By employing the theory of vectorial model maximum likelihood estimation (MLE) phase retrieval, is capable reconstructing accurate theoretically minimum uncertainty...