Dynamic Resolution Allocation for Immersive 3D Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge is to provide higher-resolution 3D video content without increasing file size, as higher resolution leads to impractical storage and transmission burdens, while maintaining an immersive viewing experience.
Innovation Solution
The method involves identifying a region of interest within a virtual scene and dynamically adjusting the image quality based on the viewer's focus, using lower-quality representations for objects and areas outside the region of interest, achieved through gaze tracking and contextual analysis, with pre-generated images of different resolutions combined to generate the final display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If higher-resolution 3D video content is provided to improve immersion, then the viewing quality and immersive experience are enhanced, but the file size increases to an unusable level
Solution Approach 1:
The patent applies local quality by rendering different regions of the 3D video content at different resolutions. The region of interest (where the user is looking) is rendered at high resolution, while other regions are rendered at lower resolutions. This resolves the contradiction by maintaining high image resolution only where needed, thereby reducing overall file size while preserving immersive experience in the critical viewing area.
Solution Approach 2:
The patent implements dynamics by dynamically adjusting the resolution allocation based on the user's gaze direction and head position. As the user moves their eyes or head, the high-resolution region dynamically follows their attention. This dynamic adaptation allows the system to maintain high resolution where the user is actually looking while keeping file size manageable through selective downsampling of other regions.
2Manufacturing precision
If high-quality display elements with large field of view are used to improve immersion, then the viewing resolution and field of view are enhanced, but the storage and transmission burdens increase significantly
Solution Approach 1:
The patent applies local quality by providing high display quality only in the region of interest while using lower quality for peripheral regions. This selective quality approach allows the system to use high-quality display elements effectively without storing and transmitting full high-quality data for the entire large field of view, thereby reducing storage and transmission burdens while maintaining perceived display quality where it matters most.
3Quantity of substance
If lower-quality representations are used for areas outside the region of interest, then the overall file size is reduced, but the immersion experience may be compromised
Solution Approach 1:
The patent applies local quality by strategically rendering only the region of interest at high resolution while using lower resolution for other areas. This approach maintains data efficiency by reducing the amount of high-quality data that needs to be stored and transmitted, while preserving overall image quality sufficiency since the human visual system primarily focuses on a limited area at any given time.
Solution Approach 2:
The patent implements partial action by providing full high-quality rendering only for the partial region that the user is currently looking at, rather than rendering the entire scene at high quality. This partial rendering approach achieves data efficiency while maintaining acceptable overall image quality, as the unrendered or low-resolution areas fall outside the user's current visual attention.
Data Source
AI summary
An image generation system includes a region of interest identifying unit operable to identify a region of interest within a piece of content, the piece of content comprising one or more objects, and an image generation unit operable to generate an image for display comprising one or more of the one or more objects such that objects at a different visual depth to the region of interest are present in the generated image at a lower quality.