近日，北京航空航天大学的王琼华及其研究团队取得一项新进展。经过不懈努力，他们利用端到端物理模型驱动网络，实现用于获取真实三维场景全息图的液体透镜基全息相机。相关研究成果已于2024年2月29日在国际知名学术期刊《光：科学与应用》上发表。

该研究团队提出了一种基于液体透镜的全息相机，并利用端到端物理模型驱动网络(EEPMD-Net)获取真实的3D场景全息图。作为液体相机的核心部件，研究人员采用特制的溶液，研制出首个10mm大口径电润湿液态镜头。液体照相机的设计保证了真实三维场景的多层快速获得，成像性能好。EEPMD-Net以真实三维场景信息为输入，采用编码器和解码器网络两种新型结构实现低噪声相位生成。

研究人员通过对比深度融合后重建图像与目标场景的强度信息，构建复合损失函数进行相位优化，首次实现了三维场景真实深度全息图的高保真度训练。该全息相机实现了真实三维场景全息图的高保真度和快速生成，并通过重建实验证明了全息图像具有低噪声的优点。这项研究所提出的全息相机具有独特的特点，可用于三维显示、测量、加密等领域。

据悉，随着人工智能的发展，神经网络为全息照相提供了高保真度和动态计算等独特的机会。如何获取真实的三维场景并实时生成高保真全息图是一个亟待解决的问题。

附：英文原文

Title: Liquid lens based holographic camera for real 3D scene hologram acquisition using end-to-end physical model-driven network

Author: Wang, Di, Li, Zhao-Song, Zheng, Yi, Zhao, You-Ran, Liu, Chao, Xu, Jin-Bo, Zheng, Yi-Wei, Huang, Qian, Chang, Chen-Liang, Zhang, Da-Wei, Zhuang, Song-Lin, Wang, Qiong-Hua

Issue&Volume: 2024-02-29

Abstract: With the development of artificial intelligence, neural network provides unique opportunities for holography, such as high fidelity and dynamic calculation. How to obtain real 3D scene and generate high fidelity hologram in real time is an urgent problem. Here, we propose a liquid lens based holographic camera for real 3D scene hologram acquisition using an end-to-end physical model-driven network (EEPMD-Net). As the core component of the liquid camera, the first 10mm large aperture electrowetting-based liquid lens is proposed by using specially fabricated solution. The design of the liquid camera ensures that the multi-layers of the real 3D scene can be obtained quickly and with great imaging performance. The EEPMD-Net takes the information of real 3D scene as the input, and uses two new structures of encoder and decoder networks to realize low-noise phase generation. By comparing the intensity information between the reconstructed image after depth fusion and the target scene, the composite loss function is constructed for phase optimization, and the high-fidelity training of hologram with true depth of the 3D scene is realized for the first time. The holographic camera achieves the high-fidelity and fast generation of the hologram of the real 3D scene, and the reconstructed experiment proves that the holographic image has the advantage of low noise. The proposed holographic camera is unique and can be used in 3D display, measurement, encryption and other fields.

DOI: 10.1038/s41377-024-01410-8

Source: https://www.nature.com/articles/s41377-024-01410-8