MP4 File Generating Unit for Partial Image Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current decoding technologies require a decoder with an unnecessarily high level to decode partial images, leading to inefficient resource utilization and limited application distribution, as they assume whole image decoding capabilities.

Innovation Solution

An information processing apparatus and method that generates an MP4 file format with specific metadata indicating the location, size, and NAL units of partial images, allowing independent decoding and storage, enabling accurate performance recognition for decoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a decoder with high level capability is used to decode partial images, then decoding reliability is improved, but device complexity and resource usage increase unnecessarily

Engineering Contradiction:
Improvedecoding reliabilityVSAvoiddecoder level requirement
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the image data into independent tiles that can be decoded separately. Each tile is encoded with its own header information, allowing the decoder to process only the required tile region rather than the entire image. This segmentation enables the use of a decoder with lower level capability, as the decoding complexity is reduced to that of a single tile rather than the whole image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by providing specific header information for each tile region in the bitstream. This allows the decoder to adapt its processing to the local requirements of each tile, using only the necessary decoding parameters for that specific region. Consequently, the decoder does not need to maintain high level capabilities for the entire image, reducing overall device complexity while maintaining reliable decoding for each local region.

Inventive Principle:
Principle #3Local quality

2Reliability

If whole image decoding is assumed for all applications, then decoding reliability is improved, but productivity and application distribution are limited

Engineering Contradiction:
Improvedecoding reliabilityVSAvoidapplication distribution efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

By segmenting the image into independently decodable tiles with dedicated header information, the patent enables different applications to select and decode only the tiles they need. This segmentation allows for optimized application distribution where each application can be tailored to decode specific regions, improving productivity by avoiding unnecessary decoding of entire images while maintaining reliability through proper tile-level encoding standards.

Inventive Principle:
Principle #1Segmentation

3Reliability

If buffer capacity is calculated for whole image, then decoding reliability is improved, but use of energy increases unnecessarily

Engineering Contradiction:
Improvebuffer capacity reliabilityVSAvoiddecoder energy consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent segments the buffer requirements to match the tile structure. Each tile has its own buffer allocation based on its specific size and complexity rather than allocating buffer capacity for the entire image. This segmentation reduces the total buffer capacity needed and consequently reduces energy consumption, as the decoder only processes and buffers data for the currently active tile region.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality to buffer management by allocating buffer resources according to the specific requirements of each tile region. This localized buffer allocation ensures sufficient capacity for reliable decoding of each tile while avoiding the energy waste associated with maintaining large buffer capacity for the entire image when only partial regions are being decoded.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3026901B1Image processing device and method
Publication Date: 2021.04.14 SONY GROUP CORP
  • EP3026901B1 patent drawingFigure 1
  • EP3026901B1 patent drawingFigure 2
  • EP3026901B1 patent drawingFigure 3

AI summary

The present disclosure relates to an information processing apparatus and an information processing method that enable recognition of performance required for decoding more accurately. A file of an MP4 file format, in which information indicating a location of a partial image in a whole image is stored in moov, the partial image being able to be independently decoded in the whole image, and the encoded partial image is stored in mdat, is generated, and the generated file is stored. The present disclosure can be applied to, for example, an information processing apparatus such as an image encoding apparatus or an image decoding apparatus.