Multiplexing Optical Assembly for HMD Foveal Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional head-mounted displays (HMDs) in artificial reality systems waste resources by emitting high resolution images outside the foveal region of the human eye, where they cannot be perceived at full resolution, due to the limited acute vision angle of 15 degrees around the fovea, resulting in inefficient use of power, memory, and processing time.

Innovation Solution

A display assembly comprising an inset high-resolution display and a peripheral lower-resolution display, combined with a multiplexing optical assembly (MOA) that directs high-resolution images to the foveal region and lower-resolution images to the peripheral retina, optimizing resource usage and field-of-view while maintaining high resolution in the central foveal region.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If high resolution images are emitted across the entire field of view in conventional HMDs, then the image quality in the central region is maintained, but resources (power, memory, processing time) are wasted in the peripheral regions where high resolution cannot be perceived

Engineering Contradiction:
Improveimage resolutionVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent applies local quality by emitting high resolution image light only in the central foveal region (within approximately 15 degrees of the optical axis) where human vision has high acuity, while emitting lower resolution image light in the peripheral retinal regions. This matches the spatial variation of human visual sensitivity, providing high resolution where needed and reducing resource consumption in regions where it cannot be perceived.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If high resolution images are emitted across the entire field of view, then central vision quality is maintained, but processing time and computational resources are inefficiently used

Engineering Contradiction:
Improveimage resolutionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system processes and emits high resolution image data only for the central foveal region while using lower resolution data for peripheral regions, reducing the total computational burden and processing time required to generate and render the complete field of view image.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If a single high resolution display covers the entire field of view, then uniform image quality is achieved, but device complexity and resource requirements increase

Engineering Contradiction:
Improveimage resolutionVSAvoiddisplay system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The display system is segmented into at least two separate displays: a first display positioned to emit high resolution image light to the foveal region, and a second display positioned to emit lower resolution image light to the peripheral retinal region. This segmentation allows each display to be optimized for its specific function, reducing the overall complexity and resource requirements compared to a single full-field high resolution display.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent combines multiple displays with different resolution characteristics and positions them within the same optical system, using optical elements to direct their respective image light to appropriate regions of the user's retina, creating a unified visual experience that leverages the strengths of each display type.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution achieves a wide field-of-view with high resolution in the central foveal region, reducing resource wastage and enhancing user experience by directing high-resolution images only to the area where they can be effectively perceived, thus optimizing power consumption and processing efficiency.

Implementation Method 1

The MOA then transforms the image light of the first polarization into a first portion of image light having a third polarization. The MOA also transforms the image light of the second polarization into a second portion of image light having the third polarization.

Methodology Applied
Scientific EffectPolarization transformation: Polarisation

Data Source

PatentUS11604315B1Multiplexing optical assembly with a high resolution inset
Publication Date: 2023.03.14 META PLATFORMS TECHNOLOGIES LLC
  • US11604315B1 patent drawing
  • US11604315B1 patent drawing
  • US11604315B1 patent drawing

AI summary

A display assembly presented herein includes an inset display, a peripheral display, and a multiplexing optical assembly (MOA). The inset display has a first resolution and emits image light of a first polarization. The peripheral display has a second resolution and emits image light of a second polarization. The MOA receives the image light of the first polarization and the image light of the second polarization. The MOA then transforms the image light of the first polarization into a first portion of image light of a third polarization, and transforms the image light of the second polarization into a second portion of image light of the third polarization. The MOA directs the first portion of image light and the second portion of image light toward an eye-box. The display assembly can be implemented as a component of a head-mounted display of an artificial reality system.