Foveated MEMS Scanning Display With Dynamic Pixel Density

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional scanning display devices maintain uniform pixel density across images, leading to increased processing and power consumption when attempting to enhance resolution, as they require increasing the pixel density uniformly across the entire image.

Innovation Solution

The implementation of a scanning display system that dynamically adjusts pixel density by using two light beams to raster scan the foveal region with higher line density and only one light beam for the non-foveal region, allowing for increased resolution in the foveal area while reducing computational and power requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If pixel density is increased uniformly across the entire image, then image resolution is improved, but processing cost and power consumption increase

Engineering Contradiction:
Improveimage resolutionVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by differentiating pixel density across different regions of the display. The foveal region (center of visual field) receives high pixel density while peripheral regions receive lower pixel density. This is achieved by controlling the MEMS scanner to spend more time scanning the foveal region, thereby concentrating computational resources where they are most needed for perceived image quality while reducing processing load in peripheral areas.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamic pixel density adjustment by making the foveal region location movable rather than fixed. The system dynamically identifies the foveal region based on eye tracking data and adjusts the scanning parameters in real-time to maintain high resolution at the user's current point of gaze. This allows the high-resolution region to move across the display as the user's attention shifts, optimizing power consumption while maintaining perceived quality.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If pixel density is increased uniformly across the entire image, then image resolution is improved, but processing cost increases

Engineering Contradiction:
Improveimage rendering precisionVSAvoidprocessing cost
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent reduces processing cost by applying local quality differentiation to image rendering. Instead of processing the entire image at high resolution, the system processes only the foveal region at high pixel density while using lower pixel density for peripheral regions. This significantly reduces the total number of pixels that require high-fidelity processing, thereby lowering computational complexity and processing costs while maintaining perceived image quality.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent applies partial action by rendering only the necessary portion of the image at high quality. The system identifies the foveal region and allocates high processing resources specifically to that area, while using reduced processing resources for peripheral regions. This partial processing approach avoids the excessive processing cost of rendering the entire image at maximum resolution while maintaining acceptable overall image quality.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If high resolution is maintained across the entire image, then image quality is improved, but power consumption increases

Engineering Contradiction:
Improveline densityVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by stationary object

Solution Approach 1:

The patent applies local quality by maintaining high line density only in the foveal region while using lower line density in peripheral regions. The MEMS scanner is controlled to spend more time scanning the foveal region, creating higher line density there, while scanning peripheral regions more quickly with lower line density. This localized approach to line density optimization reduces the total energy required for image rendering while maintaining high perceived quality in the region where the user's vision is most acute.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces power consumption and processing load by maintaining high resolution only in the foveal region, where it is most needed, while maintaining lower resolution in peripheral areas, thereby optimizing image rendering efficiency.

Implementation Method 1

one or more optical elements that are configured to combine the red, green and blue light into a light beam

Methodology Applied
Scientific EffectOptical superposition:

Implementation Method 2

The light that is coupled into the one or more optical waveguides via the input-coupler(s) of the one or more optical waveguide(s) travels at least in part by way of total internal reflection (TIR) from the input-coupler(s) to the output-coupler(s)

Methodology Applied
Scientific EffectTotal internal reflection: Total Internal Reflection

Data Source

PatentEP3610318B1Foveated MEMS scanning display
Publication Date: 2023.04.19 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3610318B1 patent drawingFigure 1
  • EP3610318B1 patent drawingFigure 2
  • EP3610318B1 patent drawingFigure 3

AI summary

A scanning display device includes a MEMS scanner, a controller, light source drivers, light sources and an image processor. The controller controls rotation of MEMS mirror(s) of the MEMS scanner. Each light source driver selectively drives a respective one of the light sources to thereby produce a respective light beam that is directed towards and incident on a MEMS mirror of the MES scanner. The image processor causes two of the light source drivers to drive two of the light sources to thereby produce two light beams, when a first portion of an image is being raster scanned by the MEMS scanner. The image processor causes only one of the light source drivers to drive only one of the light sources to thereby produce only one light beam, when a second portion of the image is being raster scanned by the MEMS scanner. Related methods and systems are also disclosed.