Birdview Stream Grouping for Decoder Compatibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current decoders do not support MVC with depth, MV HEVC, and similar technologies, making it difficult to reproduce Birdview (BV) content effectively, and there is no defined method for storing BV streams using HEVC and AVC codecs, which limits the ability to select appropriate tracks for viewing BV content.
Innovation Solution
The technology involves an image processing apparatus and a file generation apparatus that group BV streams necessary for configuring BV content, allowing clients to select and acquire appropriate combinations of BV streams for reproduction, even with general-purpose decoders. This is achieved by extending MPD files for MPEG-DASH distribution and modifying ISOBMFF file formats to define new metadata descriptors for signaling BV content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If BV streams are encoded using MVC with depth, MV HEVC, or 3D HEVC, then the 3D model quality and viewing experience are improved, but decoder compatibility and ease of operation deteriorate because current market decoders do not support these codecs
Solution Approach 1:
The patent segments BV streams into multiple tracks, with each track containing a specific combination of BV streams (texture, mesh, depth) that can be decoded by general-purpose decoders. This allows the system to provide high-quality 3D content while maintaining decoder compatibility by dividing the content into manageable, independently decodable units.
Solution Approach 2:
The patent creates multiple copies of BV content encoded in different ways - some tracks use advanced codecs (MVC with depth, MV HEVC) for high quality, while other tracks use widely supported codecs (HEVC, AVC) for compatibility. Clients can select appropriate tracks based on their decoder capabilities, effectively copying the same content in multiple encoding formats.
2Adaptability or versatility
If BV streams are stored in tracks without defined grouping methods, then storage flexibility is improved, but the ability to select appropriate tracks for reproduction deteriorates
Solution Approach 1:
The patent performs preliminary grouping of BV streams into tracks with defined combinations before distribution. Each track is pre-configured with specific BV stream combinations (e.g., texture+depth, texture+mesh) and marked with appropriate identifiers, so that clients can immediately select suitable tracks without needing to analyze or determine compatibility themselves.
Solution Approach 2:
The patent introduces track grouping information as an intermediary layer between the raw BV streams and the client selection process. This intermediary structure organizes BV streams into meaningful groups with clear identifiers, enabling clients to easily find and select appropriate tracks for their decoder capabilities while preserving storage flexibility.
3Quantity of substance
If multiple BV streams are provided without defined combinations, then content completeness is improved, but the complexity of selecting appropriate combinations increases
Solution Approach 1:
The patent merges multiple BV streams into predefined track combinations, where each track contains a complete set of BV streams needed for a specific decoding scenario (e.g., one track for HEVC decoders, another for AVC decoders). This merging approach maintains content completeness while reducing selection complexity by presenting organized, ready-to-use combinations rather than individual stream components.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present technology relates to an image processing apparatus and a file generation apparatus that make it possible to appropriately reproduce a BV content. An image processing apparatus includes: a file acquisition unit that acquires a file having a management region where information for management of a 3D object content is stored and a data region where a track in which streams included in the 3D object content are stored is stored, group information for selection, from a plurality of the streams included in the 3D object content, of the stream appropriate for reproduction of the 3D object content being stored in the management region; and a file processor that selects a plurality of the streams to be used for reproduction of the 3D object content on the basis of the group information. The present technology is applicable to a client apparatus.