Fixed-Function Display Pipeline Reduces M2P Latency

Solution Overview

Problem

Conventional head-mounted display (HMD) systems experience high total motion-to-photon (M2P) latency, leading to observable judder and a non-immersive experience due to the GPU performing composition, chromatic correction, scaling, and barreling operations, which increases power consumption and limits battery operation.

Innovation Solution

The improved rendering architecture employs a display pipeline as a fixed-function unit to perform composition, chromatic correction, scaling, and barreling, reducing the need for the GPU to handle these operations, thereby decreasing M2P latency and power consumption, allowing for battery-powered operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the GPU performs composition, chromatic correction, scaling, and barreling operations, then the rendering quality is maintained, but the M2P latency increases and power consumption rises

Engineering Contradiction:

Improverendering qualityVSAvoidM2P latency

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the rendering pipeline into two distinct parts: a fixed-function display pipeline that handles composition, chromatic correction, scaling, and barreling operations, and a GPU that handles only graphic-intensive rendering. This segmentation allows the display pipeline to process images with deterministic low latency while the GPU focuses on high-quality rendering, thereby reducing overall M2P latency without sacrificing rendering quality.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The fixed-function display pipeline acts as an intermediary between the GPU and the display device. It receives rendered images from the GPU and performs necessary display-specific operations (composition, chromatic correction, scaling, barreling) before output to the display. This intermediary approach offloads deterministic processing from the GPU, reducing M2P latency while maintaining rendering quality through the GPU's high-quality rendering capability.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Measurement precision

If the GPU performs composition, chromatic correction, scaling, and barreling operations, then the rendering quality is maintained, but the power consumption increases limiting battery operation

Engineering Contradiction:

Improverendering qualityVSAvoidpower consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent segments the rendering pipeline into two distinct parts: a fixed-function display pipeline that handles composition, chromatic correction, scaling, and barreling operations, and a GPU that handles only graphic-intensive rendering. This segmentation allows the display pipeline to process images with deterministic low latency while the GPU focuses on high-quality rendering, thereby reducing overall M2P latency without sacrificing rendering quality.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The fixed-function display pipeline acts as an intermediary between the GPU and the display device. It receives rendered images from the GPU and performs necessary display-specific operations (composition, chromatic correction, scaling, barreling) before output to the display. This intermediary approach offloads deterministic processing from the GPU, reducing M2P latency while maintaining rendering quality through the GPU's high-quality rendering capability.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Adaptability or versatility

If the GPU handles all rendering operations including composition and distortion, then flexibility is maintained, but the device complexity and power requirements increase

Engineering Contradiction:

ImproveflexibilityVSAvoiddevice complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the rendering pipeline into two distinct parts: a fixed-function display pipeline that handles composition, chromatic correction, scaling, and barreling operations, and a GPU that handles only graphic-intensive rendering. This segmentation allows the display pipeline to process images with deterministic low latency while the GPU focuses on high-quality rendering, thereby reducing overall M2P latency without sacrificing rendering quality.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS11800083B2Barreling and compositing of images

Publication Date: 2023.10.24 INTEL CORP

AI summary

Systems, apparatuses and methods may provide for technology that includes a substrate, and a display pipeline coupled to the substrate. The display pipeline may to barrel an initial image to form a barreled image.