Distance-Adaptive Video Resolution Control for Lower Bitrate Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing viewing paradigms and technologies struggle to support natural user interactions and mobility for viewing content at varying distances, particularly with high-resolution displays, leading to increased bitrates and computational load, and issues like vergence-accommodation conflict in stereoscopic content.
Innovation Solution
A multi-resolution approach that decomposes captured scenes into depth-dependent focal planes, adjusting image resolution based on viewer distance, using video-plus-depth format to enhance 2D content delivery, with modes like enhanced quality and zoom to improve user experience and reduce bitrate and processing power.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If higher resolution is used to support viewing content from varying distances, then viewing quality is improved, but bitrate and computational load increase
Solution Approach 1:
The patent applies local quality by decomposing the image into multiple depth layers and assigning different resolution levels to different depth ranges. Distant layers are encoded at higher resolutions while closer layers use lower resolutions, optimizing the overall viewing experience across varying distances without uniformly increasing bitrate for the entire image.
Solution Approach 2:
The patent segments the image into multiple depth-dependent layers, allowing independent resolution control for each layer. This segmentation enables selective allocation of bitrate to different spatial regions based on their depth, resolving the contradiction between maintaining high viewing quality and reducing overall bitrate requirements.
2Measurement precision
If higher resolution is used to support viewing content from varying distances, then viewing quality is improved, but computational load increases
Solution Approach 1:
By applying local quality, the patent avoids the computational burden of processing entire high-resolution images uniformly. Instead, computation is focused only on distant layers that require higher resolution, while closer layers are processed at lower resolutions, significantly reducing overall computational load while maintaining viewing quality where it matters most.
3Stability of the object's composition
If fixed distances are used for capturing and displaying content, then existing viewing paradigms are maintained, but user experience is limited
Solution Approach 1:
The patent introduces dynamics by making the display resolution adaptive to the viewer's distance from the screen. Using depth information and estimated viewing distance, the system dynamically adjusts the resolution of different image layers, transitioning from static fixed-distance viewing to dynamic distance-adaptive viewing, thereby enhancing user experience while maintaining compatibility with existing viewing paradigms.
4Measurement precision
If uniform high resolution is used across all depth layers, then viewing quality is maintained, but bitrate efficiency decreases
Solution Approach 1:
The patent resolves this contradiction by applying local quality principles, where each depth layer receives resolution allocation matched to its viewing characteristics. Distant layers that require higher resolution for quality receive it, while closer layers that can maintain quality at lower resolutions receive reduced resolution, optimizing bitrate efficiency without sacrificing overall viewing quality.
Data Source
AI summary
Systems and methods relate to viewing distance based resolution and/or quality control for video coding. An illustrative system receives, such as at a server, a distance between a user and a device. The system includes selecting, based at least in part on the distance between the user and the device, a resolution and/or quality level for each layer of a plurality of layers of an image. The system transmits a version of each layer at the selected quality level to the device to cause the device to reconstruct the image based on the transmitted version of each layer and generate for display the reconstructed image.