Current augmented reality (AR) and virtual reality (VR) displays only show 2D images. They need to be perceptually realistic. Now, researchers are trying to bridge this gap between simulation and reality while creating more visually appealing displays. The study describes a method for decreasing the speckling distortion seen in traditional laser-based holographic displays – neural holography – for more faithfully representing the physics that would apply to the 3D scene in the actual world.
The neural holography display required a neural network to match the real-world physics of what was happening in the VR display to achieve real-time images. They combined this with a “camera-in-the-loop” calibration method, which delivers near-instantaneous input to guide modifications and improvements.
The neural holography algorithm and calibration approach that operates in real-time with the observed image obtained more realistic-looking images with enhanced color, contrast, and clarity.
Related Content: Spatial Neglect Treatment With Immersive VR