Sub-picture Stream Selection via Control File Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for selecting and reproducing sub-pictures in adaptive content distribution systems, such as those using MPEG-DASH, increase processing loads due to the need to distinguish between region-wise packing and sub-picture division information, especially when omnidirectional videos are divided into sub-pictures.

Innovation Solution

An information processing apparatus and method that generates and uses a control file to manage image encoded data for sub-pictures, including region-related information distinct from arrangement information, facilitating easier selection of sub-picture streams by clients.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If sub-picture division information and arrangement information are combined in the same control structure (Sub Picture Composition Box), then comprehensive control of sub-picture tracks is achieved, but processing complexity increases when selecting and reproducing sub-picture streams

Engineering Contradiction:
Improvecontrol capabilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent separates sub-picture division information and arrangement information into distinct control structures. Sub-picture division information is placed in Sub Picture Composition Box while arrangement information is placed in Region Wise Packing Box, allowing independent processing and selection of each type of information without requiring parsing of combined data structures.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts arrangement information from the Sub Picture Composition Box and places it in a separate Region Wise Packing Box. This extraction allows the selection process to focus only on sub-picture division information when selecting sub-picture tracks, reducing processing complexity while maintaining full control capability.

Inventive Principle:
Principle #2Taking out (Extraction)

2Reliability

If arrangement information is included in Sub Picture Composition Box, then complete control information is available, but selection of sub-picture streams requires parsing to distinguish between different types of information

Engineering Contradiction:
Improvecontrol information completenessVSAvoidstream selection ease
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent segments control information into distinct boxes with clear functional separation. Sub Picture Composition Box contains only sub-picture division information while Region Wise Packing Box contains only arrangement information. This segmentation enables straightforward selection of sub-picture streams by parsing only the relevant Sub Picture Composition Box without needing to distinguish arrangement information within the same structure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts arrangement information from the Sub Picture Composition Box into a separate Region Wise Packing Box. This extraction simplifies the stream selection process by allowing clients to directly use sub-picture division information for selection without additional parsing to distinguish arrangement information, while maintaining complete control information availability.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11729366B2Information processing apparatus and method
Publication Date: 2023.08.15 SONY GROUP CORP
  • US11729366B2 patent drawing
  • US11729366B2 patent drawing
  • US11729366B2 patent drawing

AI summary

The present disclosure relates to an information processing apparatus and method that allows a stream of sub-pictures to be more easily selected.A control file is generated that manages image encoded data for each of a plurality of sub-pictures into which an entire picture is divided and which is then encoded, the control file including region-related information related to a region in the entire picture corresponding to the sub-picture, as information different from arrangement information for each of picture regions, the control file being used for controlling distribution of the image encoded data. The present disclosure can be applied to, for example, an information processing apparatus, an image processing apparatus, an image encoding apparatus, a file generating apparatus, a file transmission apparatus, a distribution apparatus, a file reception apparatus, an image decoding apparatus, or a reproduction apparatus.