Extended Reality Encoding for Predicted Display Window Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR and XR systems face limitations in communication speed and capacity between devices, leading to issues such as reduced frame rates, compression artifacts, and discrepancies between image generation and display due to processing delays, causing user discomfort.
Innovation Solution
A system that generates and transmits an oversized image frame sequence, including predicted display window locations, allowing for static image boundaries and efficient compression using LCEVC, with adjustments made at the display device to account for user movements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If compression techniques are used to reduce transmission data, then transmission capacity is improved, but image quality deteriorates due to compression artifacts
Solution Approach 1:
The patent applies preliminary action by predicting the display window location in advance before transmission. The image source predicts where the display device will need to show content, pre-processes or pre-compresses the image data accordingly, and transmits only the necessary portions. This allows optimization of compression parameters for the predicted region of interest, maintaining image quality in critical areas while reducing overall transmission data.
2Productivity
If frame rate is reduced to minimize processing time, then processing speed is improved, but user experience deteriorates due to motion artifacts
Solution Approach 1:
The system performs preliminary action by predicting future display window locations and preparing image data in advance. This allows the system to process and transmit image data for multiple future frames simultaneously, effectively increasing the processing throughput without compromising the perceived frame rate. The prediction mechanism enables the system to anticipate user viewing needs and prepare content proactively, maintaining smooth user experience even with reduced instantaneous processing demands.
3Loss of time
If image generation time is reduced to minimize delay, then processing speed is improved, but image quality deteriorates due to reduced rendering time
Solution Approach 1:
The patent applies local quality by differentiating the processing level for different regions of the image. Instead of uniformly reducing rendering time across the entire image, the system identifies the predicted display window location and allocates more processing resources to that specific region. Critical areas within the predicted display window receive higher quality rendering, while peripheral or less important areas use reduced processing, thus maintaining overall image quality perception while reducing total generation time.
4Quantity of substance
If transmission data is reduced to fit communication capacity, then communication efficiency is improved, but frame rate deteriorates due to data bottlenecks
Solution Approach 1:
The system uses preliminary action to predict display window locations and pre-determine which image data portions are most critical for transmission. By anticipating future display needs, the system can prioritize transmission of essential image data and compress or omit less critical portions, optimizing the data transmission rate to match communication capacity constraints while maintaining acceptable frame rates.
Data Source
AI summary
A system for displaying an image frame sequence, the system comprising an image source and a display device, wherein the image source is configured to: generate an image (3); obtain a predicted display window location (2a); and transmit the generated image (3) and the predicted display window location (2a) to the display device; and wherein the display device is configured to: receive the generated image (3) and the predicted display window location (2a) from the image source; and adjust the generated image to obtain a first adjusted image (1 a) corresponding to the predicted display window location (2a).


