Patch Scanning Display Spatiotemporal Resolution Enhancement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display technologies face challenges in achieving high pixel density and frame rates necessary for enhanced spatiotemporal quality, particularly in head-mounted displays, due to manufacturing limitations and the physical constraints of conventional pixel elements like LCDs and OLEDs, which restrict the effective resolution and refresh rates.

Innovation Solution

A patch scanning technique is employed to reconstruct target image frames by analyzing the image to determine basis functions and transforming them into modulation signals for a spatial light modulator, combined with a high-speed incoherent light source to increase perceived spatio-temporal resolution, using a decomposition model like projective non-negative matrix factorization to generate image patches and backlight signals for projection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If pixel density is increased to improve resolution, then effective resolution improves, but manufacturing difficulty and defect rates increase

Engineering Contradiction:
Improveeffective resolutionVSAvoidmanufacturing difficulty
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The image is divided into multiple sub-frames that are displayed sequentially at different spatial positions. Instead of requiring a single high-density pixel array, the system segments the display task across multiple temporal frames, each using a lower-density SLM that is easier to manufacture with fewer defects.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a purely spatial resolution approach to a spatio-temporal approach by adding the time dimension. Multiple sub-frames are displayed in sequence at different positions, allowing the system to achieve high effective resolution through temporal multiplexing rather than requiring high spatial pixel density.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If frame presentation rate is increased to improve temporal quality, then viewing perception improves, but the requirements for SLM refresh rate and manufacturing precision increase

Engineering Contradiction:
Improveframe presentation rateVSAvoidSLM refresh rate requirement
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

Each frame is segmented into multiple sub-frames that are displayed sequentially. The SLM only needs to refresh at a lower rate for each individual sub-frame, while the overall system achieves higher effective frame rates through the sequence of sub-frames, reducing the manufacturing precision requirements for the SLM.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses periodic display of multiple sub-frames in sequence, with each sub-frame displayed for a brief period. This periodic action allows the SLM to operate at a lower refresh rate while the overall system achieves high temporal quality through the rapid sequential presentation of multiple sub-frames.

Inventive Principle:
Principle #19Periodic action

3Measurement precision

If multiple cascaded spatial light modulators are used to increase pixel density, then spatial resolution improves, but device complexity and manufacturing cost increase

Engineering Contradiction:
Improvespatial resolutionVSAvoidnumber of SLMs
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of adding more SLMs in the spatial dimension, the patent uses temporal multiplexing to achieve high spatial resolution. A single SLM displays multiple sub-frames in sequence at different positions, achieving super-resolution through time-based techniques rather than spatial stacking.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The same SLM is used to display multiple copies of image data in the form of sub-frames at different temporal and spatial positions. These multiple copies are combined through the persistence of vision effect to create a high-resolution perceived image, eliminating the need for multiple physical SLMs.

Inventive Principle:
Principle #26Copying

4Measurement precision

If pixel size is reduced to increase pixel density, then resolution improves, but the likelihood of pixel defects increases

Engineering Contradiction:
Improvepixel densityVSAvoiddefect-free probability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The display task is segmented across multiple sub-frames displayed at different positions, allowing the use of larger, more reliable pixels in each sub-frame. The segmentation approach distributes the resolution requirement across multiple temporal frames rather than concentrating it in a single high-density pixel array.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This method enhances the perceived spatio-temporal resolution of displays by effectively combining slow spatial light modulators with fast incoherent light sources, overcoming manufacturing limitations and improving the viewing experience by increasing pixel density and frame rates without significant hardware upgrades.

Implementation Method 1

transforming them into modulation signals for a spatial light modulator

Methodology Applied
Scientific EffectLight modulation:

Data Source

PatentUS11663945B2Method and apparatus for spatiotemporal enhancement of patch scanning displays
Publication Date: 2023.05.30 NVIDIA CORP
  • US11663945B2 patent drawing
  • US11663945B2 patent drawing
  • US11663945B2 patent drawing

AI summary

A patch scanning display apparatus and a technique for reconstructing a target image frame on a projection surface is disclosed. The patch scanning display apparatus includes a backlight and a spatial light modulator (SLM). An optical scanning device scans the image projected by the SLM across the projection surface in accordance with a scan trajectory. A decomposition model is used to generate a set of image patches based on the target image frame and the scan trajectory. In an embodiment, the decomposition model is a projective non-negative matrix factorization model. The set of image patches are utilized to generate a modulation signal for the SLM and a binary backlight signal is then generated for each time step of the scan trajectory within a frame period to activate or deactivate the light-emitting elements of the backlight during the frame period at a high refresh rate while the projected image is scanned.