Diffractive Decoder Display for Super-Resolved Low-SBP Projection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current holographic display systems face limitations in space-bandwidth product (SBP) due to the resolution of spatial light modulators (SLMs), leading to limited image size and viewing angles, and are hindered by issues of power consumption, memory usage, computational burden, and complex optical architectures.
Innovation Solution
A deep learning-enabled diffractive super-resolution (SR) image display system using a jointly-trained electronic encoder and all-optical decoder, which projects super-resolved images by encoding high-resolution images into low-resolution representations, processed by a passive diffractive network to achieve a significant increase in SBP without increasing computational burden.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If the resolution of spatial light modulators (SLMs) is increased to improve space-bandwidth product (SBP), then image size and viewing angles are improved, but power consumption, memory usage, computational burden, and device complexity increase significantly
Solution Approach 1:
The system divides the high-resolution image processing into two stages: an electronic encoder that processes the input image and a diffractive optical decoder that reconstructs the super-resolved image. This segmentation allows the SLM to operate at lower resolution while achieving high effective SBP through the combined electronic-optical processing pipeline.
Solution Approach 2:
The patent replaces the traditional all-electronic high-resolution image processing system with a hybrid electronic-optical system. The diffractive optical decoder uses optical diffraction and interference phenomena to perform parallel computational operations that would otherwise require significant electronic computational resources, thereby reducing power consumption and computational burden.
2Quantity of substance
If multiple spatial light modulators are used to increase SBP through spatial-multiplexing, then space-bandwidth product is improved, but optical architecture complexity and alignment difficulty increase
Solution Approach 1:
The patent merges electronic image processing with optical diffraction in a unified encoder-decoder framework. The electronic encoder prepares the image data, and the diffractive optical decoder performs the reconstruction in a single integrated optical path, eliminating the need for multiple separate SLMs and their associated alignment requirements.
3Quantity of substance
If time-multiplexing methods with rotating mirrors are used to increase SBP, then space-bandwidth product is improved, but optical setup complexity and synchronization requirements increase
Solution Approach 1:
The patent replaces mechanical time-multiplexing components (rotating mirrors, moving optomechanical elements) with a static diffractive optical decoder. The high SBP is achieved through the spatial encoding capabilities of the diffractive structure rather than temporal multiplexing, eliminating moving parts and synchronization requirements.
4Quantity of substance
If random diffusers are introduced to enhance SBP, then viewing angles are improved, but image quality deteriorates due to background noise and speckle
Solution Approach 1:
The patent transforms the random diffuser approach by using a precisely engineered diffractive optical decoder with controlled phase profiles. Instead of relying on random scattering, the system uses deterministic diffraction patterns designed through optimization algorithms to achieve high SBP while maintaining image quality and eliminating speckle noise.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system achieves a 16-fold increase in SBP, reducing computational requirements and enabling high-resolution image projection with maintained field-of-view, suitable for next-generation 3D display technologies like head-mounted AR/VR devices.
Implementation Method 1
holographic displays that use spatial light modulators (SLMs) and coherent illumination with, e.g., lasers, constitute a promising alternative that allows precise control and manipulation of the optical wavefront
Implementation Method 2
an all-optical decoder network including one or more optically transmissive and/or reflective substrate layers arranged in an optical path... receive light resulting from the low resolution modulation patterns or images representative of the one or more high-resolution images and optically generate corresponding high-resolution image projections
Data Source
AI summary
A deep learning-enabled system for the display or projection of high-resolution images is disclosed that is based on a jointly-trained pair of an electronic encoder network and an all-optical decoder network to synthesize/project super-resolved images using low-resolution wavefront modulators. The electronic encoder network rapidly pre-processes the high-resolution images of interest so that their spatial information is encoded into low-resolution (LR) modulation patterns, projected via a low SBP wavefront modulator. The all-optical decoder network processes this LR encoded information using thin transmissive layers that are structured using deep learning to all-optically synthesize and project super-resolved images at its output FOV. Results indicate that this diffractive image display system can achieve a super-resolution factor of ˜4, demonstrating a ˜16-fold increase in SBP. The system can be scaled to operate at visible wavelengths and be used for large FOV and high-resolution displays that are compact, low-power, and computationally efficient.