Multi-Layer Image Tile Management for Adaptive Partial Delivery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional MPEG-DASH standards face difficulties in adaptively providing partial image data by selecting an arbitrary partial image in an arbitrary layer of an image constituted by multiple layers, due to a lack of efficient tile structures and layer encoding mechanisms.
Innovation Solution
An information processing device and method that generate files and metadata storing information on whole and partial areas of base and enhancement layers, with each layer's information stored in separate tracks, including encoding information and references, allowing adaptive provision of partial images by utilizing tile structures and layer encoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional MPEG-DASH standards are used for image distribution, then bitrate switching is supported, but adaptive provision of partial image data in arbitrary layers is difficult
Solution Approach 1:
The image data is divided into multiple layers (base layer and enhancement layers) and each layer is further segmented into tile structures. This segmentation enables independent selection and transmission of specific partial images from specific layers, allowing adaptive provision of partial image data according to terminal capabilities and network conditions.
Solution Approach 2:
The patent introduces a new organizational dimension by creating a hierarchical structure with layers as the first dimension and tiles as the second dimension. This two-dimensional structure allows flexible selection of any combination of layers and tiles, enabling adaptive partial image provision that goes beyond conventional single-dimension bitrate switching.
2Loss of substance
If entire images are distributed instead of partial images, then complete image data is provided, but transmission data volume and processing loads increase
Solution Approach 1:
The patent extracts only the necessary portions of image data by selecting specific tiles from specific layers based on terminal capabilities and network conditions. This extraction approach transmits only the required partial image data instead of entire images, reducing transmission data volume while maintaining ease of operation through automated selection based on capability information.
Solution Approach 2:
The system dynamically selects which layers and tiles to transmit based on real-time terminal capability information and network conditions. This dynamic adaptation allows the system to optimize transmission data volume by providing only the appropriate level of detail and resolution needed, rather than always transmitting complete images.
3Productivity
If layer encoding is not used, then encoding complexity is reduced, but efficiency in encoding multi-layer images is lower
Solution Approach 1:
The encoding process is segmented into multiple layers with a base layer and enhancement layers. This segmentation enables efficient encoding by allowing progressive refinement of image quality, where the base layer provides essential information and enhancement layers add incremental improvements, increasing overall encoding efficiency.
Solution Approach 2:
The patent introduces layering as an additional dimension to the encoding structure, creating a hierarchical organization where base layer and enhancement layers can be independently encoded and decoded. This multi-dimensional encoding approach improves encoding efficiency by enabling selective transmission and decoding of layers based on requirements.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present technology relates to an information processing device and a method capable of adaptively providing a partial image of an image in each layer of an image constituted by a plurality of layers. The information processing device of the present technology generates a file that stores information on a whole of a base layer of encoded data produced by layer encoding of image data, information on each of partial areas of an image of the base layer, information on a whole of an enhancement layer of the encoded data, and information on each of partial areas of an image of the enhancement layer such that each of the information is stored in corresponding one of tracks different from each other. The present technology is applicable to an information processing device, an image processing device, an image encoding device, or an image decoding device, for example.