Beam Steering Optics for VR Super-Resolution

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Head-mounted displays (HMDs) and near-eye display systems face challenges due to the limited pixel density of current displays, particularly OLED-based displays, which result in a visible 'screen-door effect' caused by the low pixel fill factor and magnification by optics, disrupting user immersion in VR and AR experiences.

Innovation Solution

A beam steering assembly is implemented between the display panel and the user's eye, using time-multiplexed image display and optical beam steering elements to create a super-resolution image by shifting and replicating pixels, effectively filling in non-emissive spaces and increasing perceived pixel size, thereby reducing the screen-door effect.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If OLED-based displays are used in HMDs, then the display can be placed close to the user's eyes, but the low pixel fill factor causes visible black space between pixels, creating a screen-door effect

Engineering Contradiction:

Improvedisplay brightnessVSAvoidpixel fill factor

Core Design Contradiction:

Illumination intensityVSManufacturing precision

Solution Approach 1:

The patent uses optical beam steering elements to create multiple copies of each pixel and shift them to different positions. By displaying sequential images with shifted pixel positions and combining them through the beam steering optics, the system synthesizes a super-resolution image that fills the gaps between original pixels, effectively eliminating the screen-door effect while maintaining OLED display advantages

Inventive Principle:

Principle #26Copying

2Length of stationary object

If optics are placed close to the user's eyes in HMDs, then the display proximity is reduced, but the optics magnify the spacing between pixels, exacerbating the screen-door effect

Engineering Contradiction:

Improvedisplay-to-eye distanceVSAvoidperceived pixel spacing

Core Design Contradiction:

Length of stationary objectVSManufacturing precision

Solution Approach 1:

The beam steering assembly creates multiple positional copies of pixel images and combines them to synthesize higher resolution. This optical copying approach effectively reduces perceived pixel spacing by distributing pixel information across multiple positions, counteracting the magnification effect of close-proximity optics

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system combines multiple sequential images with different pixel positions into a composite super-resolution image. By integrating information from multiple frames through the beam steering optics, the system creates a composite image that fills gaps between pixels, reducing the screen-door effect despite close display-to-eye distance

Inventive Principle:

Principle #40Composite materials

3Manufacturing precision

If the display resolution is increased to reduce the screen-door effect, then the pixel density must be increased, but current display technology limits the achievable pixel density

Engineering Contradiction:

Improvepixel densityVSAvoiddisplay structure

Core Design Contradiction:

Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system uses periodic display of sequential images at different pixel positions, combining multiple frames over time to synthesize a single super-resolution image. This temporal multiplexing approach achieves high effective resolution without requiring correspondingly high spatial pixel density, avoiding the need for complex high-density display structures

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The patent changes the temporal parameter by displaying multiple images in sequence rather than relying solely on spatial pixel density. By varying the display timing and using beam steering to shift pixel positions between frames, the system achieves higher effective resolution through time-multiplexed super-resolution rather than through increased spatial density

Inventive Principle:

Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enhances the perceived resolution of the display, reducing the visibility of non-emissive spaces and improving user immersion by creating a higher effective resolution image that conceals the screen-door effect, allowing for a more immersive VR and AR experience.

Implementation Method 1

Methodology Applied

Scientific EffectOptical beam steering: Refraction

Implementation Method 2

The beam steering assembly includes an array of optical beam steering elements, each optical beam steering element configured to replicate and laterally displace incident light beams

Methodology Applied

Scientific EffectLight replication and lateral displacement: Diffraction

Data Source

PatentUS11181801B2Beam steering optics for virtual reality systems

Publication Date: 2021.11.23 GOOGLE LLC

AI summary

A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. A method of operation of the near-eye display system includes configuring the beam steering assembly in a first configuration state so that the beam steering assembly displaces a light beam incident on the beam steering assembly, such that the displaced light beam is laterally shifted relative to an optical path of the light beam.