Patch Scanning Display Spatiotemporal Resolution Enhancement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current display technologies face challenges in achieving high pixel density and frame rates necessary for enhanced spatiotemporal quality, particularly in head-mounted displays, due to manufacturing limitations and the physical constraints of conventional pixel elements like LCDs and OLEDs, which restrict the effective resolution and refresh rates.
Innovation Solution
A patch scanning technique is employed to reconstruct target image frames by analyzing the image to determine basis functions and transforming them into modulation signals for a spatial light modulator, combined with a high-speed incoherent light source to increase perceived spatio-temporal resolution, using a decomposition model like projective non-negative matrix factorization to generate image patches and backlight signals for projection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If pixel density is increased to improve resolution, then effective resolution improves, but manufacturing difficulty and defect rates increase
Solution Approach 1:
The image is divided into multiple sub-frames that are displayed sequentially at different spatial positions. Instead of requiring a single high-density pixel array, the system segments the display task across multiple temporal frames, each using a lower-density SLM that is easier to manufacture with fewer defects.
Solution Approach 2:
The patent transitions from a purely spatial resolution approach to a spatio-temporal approach by adding the time dimension. Multiple sub-frames are displayed in sequence at different positions, allowing the system to achieve high effective resolution through temporal multiplexing rather than requiring high spatial pixel density.
2Productivity
If frame presentation rate is increased to improve temporal quality, then viewing perception improves, but the requirements for SLM refresh rate and manufacturing precision increase
Solution Approach 1:
Each frame is segmented into multiple sub-frames that are displayed sequentially. The SLM only needs to refresh at a lower rate for each individual sub-frame, while the overall system achieves higher effective frame rates through the sequence of sub-frames, reducing the manufacturing precision requirements for the SLM.
Solution Approach 2:
The system uses periodic display of multiple sub-frames in sequence, with each sub-frame displayed for a brief period. This periodic action allows the SLM to operate at a lower refresh rate while the overall system achieves high temporal quality through the rapid sequential presentation of multiple sub-frames.
3Measurement precision
If multiple cascaded spatial light modulators are used to increase pixel density, then spatial resolution improves, but device complexity and manufacturing cost increase
Solution Approach 1:
Instead of adding more SLMs in the spatial dimension, the patent uses temporal multiplexing to achieve high spatial resolution. A single SLM displays multiple sub-frames in sequence at different positions, achieving super-resolution through time-based techniques rather than spatial stacking.
Solution Approach 2:
The same SLM is used to display multiple copies of image data in the form of sub-frames at different temporal and spatial positions. These multiple copies are combined through the persistence of vision effect to create a high-resolution perceived image, eliminating the need for multiple physical SLMs.
4Measurement precision
If pixel size is reduced to increase pixel density, then resolution improves, but the likelihood of pixel defects increases
Solution Approach 1:
The display task is segmented across multiple sub-frames displayed at different positions, allowing the use of larger, more reliable pixels in each sub-frame. The segmentation approach distributes the resolution requirement across multiple temporal frames rather than concentrating it in a single high-density pixel array.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This method enhances the perceived spatio-temporal resolution of displays by effectively combining slow spatial light modulators with fast incoherent light sources, overcoming manufacturing limitations and improving the viewing experience by increasing pixel density and frame rates without significant hardware upgrades.
Implementation Method 1
transforming them into modulation signals for a spatial light modulator
Data Source
AI summary
A patch scanning display apparatus and a technique for reconstructing a target image frame on a projection surface is disclosed. The patch scanning display apparatus includes a backlight and a spatial light modulator (SLM). An optical scanning device scans the image projected by the SLM across the projection surface in accordance with a scan trajectory. A decomposition model is used to generate a set of image patches based on the target image frame and the scan trajectory. In an embodiment, the decomposition model is a projective non-negative matrix factorization model. The set of image patches are utilized to generate a modulation signal for the SLM and a binary backlight signal is then generated for each time step of the scan trajectory within a frame period to activate or deactivate the light-emitting elements of the backlight during the frame period at a high refresh rate while the projected image is scanned.


