Publications

Journal Article Epublish 5 citations
Electronic publication date
July 6, 2022

View on Pubmed.gov 35781968 | View on doi.org 10.1364/BOE.459...

PCIe-based FPGA-GPU heterogeneous computation for real-time multi-emitter fitting in super-resolution localization microscopy.

Search for publications in this journal Biomed Opt Express - 13(6):3401-3415

Abstract

Real-time multi-emitter fitting is a key technology for advancing super-resolution localization microscopy (SRLM), especially when it is necessary to achieve dynamic imaging quality control and/or optimization of experimental conditions. However, with the increase of activation densities, the requirements in the computing resources would increase rapidly due to the complexity of the fitting algorithms, making it difficult to realize real-time multi-emitter fitting for emitter density more than 0.6 mol/µm in large field of view (FOV), even after acceleration with the popular Graphics Processing Unit (GPU) computation. Here we adopt the task parallelism strategy in computer science to construct a Peripheral Component Interconnect Express (PCIe) based all-in-one heterogeneous computing platform (AIO-HCP), where the data between two major parallel computing hardware, Field Programmable Gate Array (FPGA) and GPU, are interacted directly and executed simultaneously. Using simulated and experimental data, we verify that AIO-HCP could achieve a data throughput of up to ∼ 1.561 GB/s between FPGA and GPU. With this new platform, we develop a multi-emitter fitting method, called AIO-STORM, under big data stream parallel scheduling. We show that AIO-STORM is capable of providing real-time image processing on raw images with 100 µm × 100 µm FOV, 10 ms exposure time and 5.5 mol/µm structure density, without scarifying image quality. This study overcomes the data throughput limitation of heterogeneous devices, demonstrates the power of the PCIe-based heterogeneous computation platform, and offers opportunities for multi-scale stitching of super-resolution images.

References

Biomed Opt Express. 2011 Apr 29;2(5):1377-93

Nat Methods. 2014 Mar;11(3):253-66

Opt Express. 2012 Jul 2;20(14):16039-49

Nat Methods. 2015 Aug;12(8):717-24

Cited by 5 citations (total)

Journal Article

Quality control maps: Real-time quantitative control of single-molecule localization microscopy data.

Electronic publication date April 3, 2025

Search for publications in this journal Biophys J

Sébastien Mailfert [...] Nicolas Bertaux et al.

Single-molecule localization microscopy (SMLM) has revolutionized the understanding of cellular organization by reconstructing informative images with quantifiable spatial distributions of...

Journal Article

Enabling real-time reconstruction for large field-of-view single-molecule localization microscopy using discrete field-dependent point-spread function.

Electronic publication date February 17, 2025

Search for publications in this journal Biomed Opt Express

Jun Lu [...] Biqin Dong et al.

Single-molecule localization microscopy (SMLM) is a powerful super-resolution imaging technique that offers resolution far beyond the optical diffraction limit. The...

Conflict of interest statement

Chinese patent (No. 201810410930.2).

MeSH

Specialties

Copyright

© 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement.