Extended Reality Encoding for Predicted Display Window Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current VR and XR systems face limitations in communication speed and capacity between devices, leading to issues such as reduced frame rates, compression artifacts, and discrepancies between image generation and display due to processing delays, causing user discomfort.

Innovation Solution

A system that generates and transmits an oversized image frame sequence, including predicted display window locations, allowing for static image boundaries and efficient compression using LCEVC, with adjustments made at the display device to account for user movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If compression techniques are used to reduce transmission data, then transmission capacity is improved, but image quality deteriorates due to compression artifacts

Engineering Contradiction:
Improvetransmission dataVSAvoidimage quality
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by predicting the display window location in advance before transmission. The image source predicts where the display device will need to show content, pre-processes or pre-compresses the image data accordingly, and transmits only the necessary portions. This allows optimization of compression parameters for the predicted region of interest, maintaining image quality in critical areas while reducing overall transmission data.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If frame rate is reduced to minimize processing time, then processing speed is improved, but user experience deteriorates due to motion artifacts

Engineering Contradiction:
Improveprocessing speedVSAvoiduser experience
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary action by predicting future display window locations and preparing image data in advance. This allows the system to process and transmit image data for multiple future frames simultaneously, effectively increasing the processing throughput without compromising the perceived frame rate. The prediction mechanism enables the system to anticipate user viewing needs and prepare content proactively, maintaining smooth user experience even with reduced instantaneous processing demands.

Inventive Principle:
Principle #10Preliminary action

3Loss of time

If image generation time is reduced to minimize delay, then processing speed is improved, but image quality deteriorates due to reduced rendering time

Engineering Contradiction:
Improvedisplay delayVSAvoidimage quality
Core Design Contradiction:
Loss of timeVSManufacturing precision

Solution Approach 1:

The patent applies local quality by differentiating the processing level for different regions of the image. Instead of uniformly reducing rendering time across the entire image, the system identifies the predicted display window location and allocates more processing resources to that specific region. Critical areas within the predicted display window receive higher quality rendering, while peripheral or less important areas use reduced processing, thus maintaining overall image quality perception while reducing total generation time.

Inventive Principle:
Principle #3Local quality

4Quantity of substance

If transmission data is reduced to fit communication capacity, then communication efficiency is improved, but frame rate deteriorates due to data bottlenecks

Engineering Contradiction:
Improvetransmission dataVSAvoidframe rate
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The system uses preliminary action to predict display window locations and pre-determine which image data portions are most critical for transmission. By anticipating future display needs, the system can prioritize transmission of essential image data and compress or omit less critical portions, optimizing the data transmission rate to match communication capacity constraints while maintaining acceptable frame rates.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250239027A1Extended reality encoding
Publication Date: 2025.07.24 V NOVA INT LTD
  • US20250239027A1 patent drawing
  • US20250239027A1 patent drawing
  • US20250239027A1 patent drawing

AI summary

A system for displaying an image frame sequence, the system comprising an image source and a display device, wherein the image source is configured to: generate an image (3); obtain a predicted display window location (2a); and transmit the generated image (3) and the predicted display window location (2a) to the display device; and wherein the display device is configured to: receive the generated image (3) and the predicted display window location (2a) from the image source; and adjust the generated image to obtain a first adjusted image (1 a) corresponding to the predicted display window location (2a).