当前位置:科学网首页 > 小柯机器人 >详情
事件相机集成傅立叶光场显微镜用于超快速3D成像
作者:小柯机器人 发布时间:2024/6/29 15:59:19

近日,美国波士顿大学的Lei Tian及其研究团队取得一项新进展。经过不懈努力,他们利用EventLFM即事件相机集成傅立叶光场显微镜实现超快速3D成像。相关研究成果已于2024年6月26日在国际知名学术期刊《光:科学与应用》上发表。

据悉,超快三维成像是可视化复杂和动态的生物过程必不可少的。传统的基于扫描的技术需要在采集速度和空间带宽乘积(SBP)之间进行固有的权衡。新兴的单镜头3D宽视场技术提供了一个很有前途的替代方案,但由于传统CMOS系统的同步读出限制,从而限制了在有限帧速率下保持高SBP的数据吞吐量。

为了解决这个问题,该研究团队推出了EventLFM,这是一种简单而经济的系统,通过将事件相机与傅里叶光场显微镜(LFM)(一种最先进的单镜头3D宽视场成像技术)集成在一起,克服了这些挑战。事件相机在一种新颖的异步读出架构上运行,从而绕过了传统CMOS系统固有的帧率限制。研究人员进一步开发了一种简单且鲁棒的事件驱动LFM重建算法,该算法可以从EventLFM捕获的独特时空测量数据中可靠地重建3D动态。实验结果表明,EventLFM可以在kHz帧率下鲁棒地重建快速运动和快速闪烁的3D荧光样本。

此外,研究人员强调了EventLFM在散射小鼠脑组织中闪烁神经元信号的成像能力和在自由运动的秀丽隐杆线虫中GFP标记神经元的3D跟踪能力。研究人员相信,EventLFM提供的超快速度和大3D SBP相结合,可能为许多生物医学应用开辟新的可能性。

附:英文原文

Title: EventLFM: event camera integrated Fourier light field microscopy for ultrafast 3D imaging

Author: Guo, Ruipeng, Yang, Qianwan, Chang, Andrew S., Hu, Guorong, Greene, Joseph, Gabel, Christopher V., You, Sixian, Tian, Lei

Issue&Volume: 2024-06-26

Abstract: Ultrafast 3D imaging is indispensable for visualizing complex and dynamic biological processes. Conventional scanning-based techniques necessitate an inherent trade-off between acquisition speed and space-bandwidth product (SBP). Emerging single-shot 3D wide-field techniques offer a promising alternative but are bottlenecked by the synchronous readout constraints of conventional CMOS systems, thus restricting data throughput to maintain high SBP at limited frame rates. To address this, we introduce EventLFM, a straightforward and cost-effective system that overcomes these challenges by integrating an event camera with Fourier light field microscopy (LFM), a state-of-the-art single-shot 3D wide-field imaging technique. The event camera operates on a novel asynchronous readout architecture, thereby bypassing the frame rate limitations inherent to conventional CMOS systems. We further develop a simple and robust event-driven LFM reconstruction algorithm that can reliably reconstruct 3D dynamics from the unique spatiotemporal measurements captured by EventLFM. Experimental results demonstrate that EventLFM can robustly reconstruct fast-moving and rapidly blinking 3D fluorescent samples at kHz frame rates. Furthermore, we highlight EventLFM’s capability for imaging of blinking neuronal signals in scattering mouse brain tissues and 3D tracking of GFP-labeled neurons in freely moving C. elegans. We believe that the combined ultrafast speed and large 3D SBP offered by EventLFM may open up new possibilities across many biomedical applications.

DOI: 10.1038/s41377-024-01502-5

Source: https://www.nature.com/articles/s41377-024-01502-5

期刊信息

Light: Science & Applications《光:科学与应用》,创刊于2012年。隶属于施普林格·自然出版集团,最新IF:19.4

官方网址:https://www.nature.com/lsa/
投稿链接:https://mts-lsa.nature.com/cgi-bin/main.plex