Birdview Stream Grouping for Adaptive 3D Content Reproduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face difficulties in selecting and acquiring appropriate combinations of Birdview (BV) streams for seamless reproduction of 3D object content, particularly in MPEG-DASH distribution, leading to inadequate viewing experiences due to unclear stream combinations and adaptive acquisition challenges.
Innovation Solution
An image processing apparatus and file generation apparatus that group BV streams based on selection criteria, utilizing metadata and descriptors within MPD files to inform clients of necessary stream combinations for reproduction, enhancing image quality and adaptability to transmission bandwidth and viewing direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all BV streams are acquired in advance for MPEG-DASH distribution, then complete reproduction is possible, but transmission bandwidth consumption increases and adaptive acquisition becomes inefficient
Solution Approach 1:
The patent segments BV streams into multiple groups (first group, second group, third group) based on their functional roles in 3D model reconstruction. Each group contains specific combinations of texture, mesh, and depth streams. This segmentation allows the client to selectively acquire only the necessary groups based on bandwidth conditions and viewing requirements, rather than acquiring all streams in advance.
Solution Approach 2:
The patent enables dynamic selection of BV stream groups based on transmission bandwidth and viewing direction. The client can adaptively choose which groups to acquire in real-time, making the acquisition process flexible and responsive to changing network conditions and user preferences, thereby optimizing bandwidth usage while ensuring complete reproduction when needed.
2Adaptability or versatility
If individual BV streams are selected based on transmission band or viewing direction, then adaptive acquisition is improved, but the client cannot determine appropriate combinations for proper reproduction
Solution Approach 1:
The patent performs preliminary organization of BV streams into designated groups with clear functional definitions before distribution. Each group is pre-configured with specific combinations of texture, mesh, and depth streams that can independently contribute to 3D model reproduction. This preliminary structuring provides the client with ready-to-use combination information, eliminating the need to determine appropriate stream combinations during runtime.
Solution Approach 2:
The patent introduces group information as an intermediary layer between the server and client. This group information acts as a guide that tells the client which streams to acquire together to achieve proper reproduction. The intermediary structure preserves the adaptability benefits of individual stream selection while solving the information loss problem by providing clear combination guidance.
3Adaptability or versatility
If multiple combinations of BV streams are available, then adaptability increases, but the complexity of selecting the appropriate combination increases
Solution Approach 1:
The patent divides the large set of available BV streams into multiple smaller, well-defined groups. Each group represents a coherent combination of streams with a specific functional purpose. This segmentation reduces the complexity of selection by presenting the client with a manageable set of predefined options rather than requiring complex analysis of individual stream combinations.
Solution Approach 2:
The patent changes the parameter of stream organization from individual stream identification to group-based identification. By introducing group information as a new organizational parameter, the system simplifies the selection process while maintaining adaptability. The client can select groups based on simple criteria such as bandwidth availability or viewing direction without needing to analyze complex individual stream relationships.
Data Source
AI summary
The present technology relates to an image processing apparatus and a file generation apparatus that make it possible to appropriately reproduce a BV content. An image processing apparatus includes a file processor that selects, from a plurality of streams included in a 3D object content, a plurality of the streams to be used for reproduction of the 3D object content on the basis of group information for selection of the stream appropriate for reproduction of the 3D object content, a file including the group information. The present technology is applicable to a client apparatus.