Optical Super Resolution Display Rendering via Half-Pixel Shifts

Solution Overview

Problem

Augmented and virtual reality headsets face challenges in enhancing user experience through display resolution without increasing the size and cost of the device, while also managing battery life effectively.

Innovation Solution

The implementation of optical super resolution (OSR) by rendering spatially offset image frames quickly, using a graphics processing unit (GPU) to create frames with half-pixel diagonal shifts, and applying anti-aliasing filters to enhance perceived resolution without adding physical pixels, thereby utilizing existing hardware efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If physical pixels are added to increase display resolution, then image quality improves, but device size and cost increase

Engineering Contradiction:

Improvedisplay resolutionVSAvoiddevice size

Core Design Contradiction:

Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent creates multiple copies of the same physical pixel at different sub-pixel positions (offset by half-pixel diagonally) through rapid frame cycling. Each frame contains a subset of pixels that are spatially offset from the previous frame, and the human eye integrates these temporal copies into a single high-resolution perception, effectively creating virtual pixels without adding physical ones.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system uses periodic action by rapidly cycling through multiple frames with different sub-pixel offset patterns at a frequency above the critical flicker fusion threshold. This temporal periodicity allows the display to present different pixel subsets in sequence, which the human visual system integrates into a single high-resolution image, achieving super-resolution without increasing physical pixel count.

Inventive Principle:

Principle #19Periodic action

2Measurement precision

If physical pixels are added to increase display resolution, then image quality improves, but device cost increases

Engineering Contradiction:

Improvedisplay resolutionVSAvoiddevice cost

Core Design Contradiction:

Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent creates multiple copies of the same physical pixel at different sub-pixel positions (offset by half-pixel diagonally) through rapid frame cycling. Each frame contains a subset of pixels that are spatially offset from the previous frame, and the human eye integrates these temporal copies into a single high-resolution perception, effectively creating virtual pixels without adding physical ones.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system uses periodic action by rapidly cycling through multiple frames with different sub-pixel offset patterns at a frequency above the critical flicker fusion threshold. This temporal periodicity allows the display to present different pixel subsets in sequence, which the human visual system integrates into a single high-resolution image, achieving super-resolution without increasing physical pixel count.

Inventive Principle:

Principle #19Periodic action

3Measurement precision

If high resolution display is implemented, then image quality improves, but battery life decreases

Engineering Contradiction:

Improvedisplay resolutionVSAvoidbattery life

Core Design Contradiction:

Measurement precisionVSDuration of action of moving object

Solution Approach 1:

The patent segments the full-resolution image into multiple lower-resolution frames, each containing a different subset of pixels at different spatial offsets. Instead of driving all physical pixels at full resolution simultaneously, the system displays segmented frames sequentially, reducing the instantaneous power demand while maintaining perceived high resolution through temporal integration by the human visual system.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system uses periodic action by rapidly cycling through multiple frames with different sub-pixel offset patterns at a frequency above the critical flicker fusion threshold. This temporal periodicity allows the display to present different pixel subsets in sequence, which the human visual system integrates into a single high-resolution image, achieving super-resolution without increasing physical pixel count.

Inventive Principle:

Principle #19Periodic action

Data Source

PatentUS11487118B2Rendered optical super resolution display

Publication Date: 2022.11.01 TEXAS INSTRUMENTS INC

AI summary

A method includes rendering, by at least one processor, a first sub-frame of an image, where the first sub-frame includes a first subset of pixels of the image. The method includes displaying the first sub-frame on a display. The method also includes rendering, by the at least one processor, a second sub-frame of the image, where the second sub-frame includes a second subset of pixels of the image, and where the second sub-frame is shifted a half-pixel diagonally from the first sub-frame. The method also includes displaying the second sub-frame on the display after displaying the first sub-frame, where the display is optically shifted a half-pixel diagonally to display the second sub-frame.