Atlas Processing Unit for Selective 3DoF Video Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Client devices without reproduction capability for "3DoF+" videos struggle to render the 3DoF region from the "3DoF+" stream, limiting user viewing experience.
Innovation Solution
An atlas processing unit generates atlas identification information associating texture and depth images with post decoding information, allowing client devices to selectively render either the 3DoF or "3DoF+" regions based on their capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the client device renders the entire 3DoF+ stream to produce 3DoF video, then the 3DoF video can be reproduced, but the processing complexity increases and devices without 3DoF+ capability cannot reproduce the video
Solution Approach 1:
The texture layer is segmented into two distinct regions: the 3DoF region and the 3DoF+ region. This segmentation allows client devices to selectively process only the 3DoF region when they lack 3DoF+ capability, while still being able to reproduce 3DoF videos. The segmentation reduces unnecessary processing complexity for devices that only need 3DoF functionality.
Solution Approach 2:
Different regions of the texture layer are assigned different functional qualities: the 3DoF region contains texture data suitable for standard 3DoF rendering, while the 3DoF+ region contains additional texture data for extended viewing. This local quality differentiation enables devices to use only the appropriate region based on their capabilities, improving adaptability without requiring full 3DoF+ processing.
2Ease of operation
If the 3DoF region is separated and identified in the 3DoF+ stream, then client devices can selectively render appropriate regions, but the data structure and processing requirements become more complex
Solution Approach 1:
The 3DoF region is pre-identified and marked within the texture layer during stream generation. This preliminary action includes setting specific flags or metadata that indicate the boundaries and characteristics of the 3DoF region. When client devices receive the stream, they can quickly locate and process only the relevant 3DoF region without needing to analyze the entire texture layer, thereby simplifying their operation while maintaining selective rendering capability.
3Reliability
If the entire 3DoF+ stream is processed by all client devices, then consistent video quality can be achieved, but devices with limited capability cannot reproduce the video
Solution Approach 1:
The texture layer is designed to serve multiple functions through its dual-region structure. The 3DoF region ensures universal compatibility with standard 3DoF rendering devices, while the 3DoF+ region provides enhanced functionality for advanced devices. This multi-functionality allows the same stream to reliably produce 3DoF video on basic devices while offering improved experiences on capable devices, thus achieving both reliability and adaptability.
Data Source
AI summary
An atlas processing unit generates atlas identification information associating a texture image that forms a reference two-dimensional image corresponding to each projection direction formed by projecting three-dimensional data from a predetermined viewpoint position in a plurality of projection directions and a complementary image for generating, from the reference two-dimensional image, a moved two-dimensional image based on a viewpoint position moved within a limited range from the predetermined viewpoint position, with a depth image corresponding to the texture image, and each piece of post decoding information for rendering each reference two-dimensional image and each moved two-dimensional image, the post decoding information including first post decoding information indicating that the first post decoding information is information of a “3DoF+” region in which the complementary image in the texture image is stored. An encoding unit encodes the texture image and the depth image to generate a texture layer and a depth layer.