Image Decoder Access Unit Multiplexing for 4:0:0 Color Components

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing AVC standard faces challenges in encoding and decoding images with a 4:4:4 format, where three color components are encoded independently, making it difficult to achieve random access reproduction and editing processing in picture units due to the inability to set uniform time information and use a uniform encoding mode across components.

Innovation Solution

The method involves multiplexing encoded data from each color component with a parameter indicating its corresponding component in the bit stream, allowing for the inclusion of data from all components in one access unit and using a uniform encoding mode, which enables easy random access reproduction and editing by including a parameter like colour_id in the slice header or NAL unit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If encoding processing is independently performed for each color component using the 4:0:0 format, then parallel processing is possible, but it is impossible to set the same time information and use a uniform encoding mode among the respective color components

Engineering Contradiction:
Improveparallel processing capabilityVSAvoiduniform encoding mode setting
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent divides the color image into separate color components (R, G, B) and encodes them independently as separate monochrome images using the 4:0:0 format. This segmentation enables parallel processing of each color component while maintaining the ability to set uniform time information through the access unit structure that groups corresponding blocks from different color components together.

Inventive Principle:
Principle #1Segmentation

2Productivity

If three color components are encoded by the 4:0:0 format using the present AVC system, then independent processing is possible, but one picture is constituted by three access units making it impossible to easily extract data for one picture

Engineering Contradiction:
Improveindependent processing capabilityVSAvoidpicture data extraction
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent introduces an access unit as an intermediary structure that contains blocks from multiple color components. The access unit delimiter acts as a marker to identify the boundaries of complete picture data across all color components, enabling easy extraction of full picture data by detecting these delimiters even though processing is done independently for each component.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If data of three color components are included in one macro-block and processed in order, then uniform encoding mode is used, but parallel processing is not possible

Engineering Contradiction:
Improveuniform encoding modeVSAvoidparallel processing capability
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent segments the color image into separate color components and processes them independently in parallel. The access unit structure then reassembles corresponding blocks from different color components to maintain uniform encoding mode application across all components, achieving both parallel processing and uniform encoding through this two-stage approach.

Inventive Principle:
Principle #1Segmentation

4Ease of operation

If access unit delimiters are arranged in boundaries of respective pictures, then independent and easy extraction of one access unit is possible, but this structure cannot accommodate independently encoded color components in one picture

Engineering Contradiction:
Improveaccess unit extractionVSAvoidmulti-component picture support
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent extends the access unit concept to serve multiple functions: it can contain blocks from a single color component or from multiple color components (R, G, B). The access unit delimiter universally marks the boundaries of complete picture data regardless of how many color components are involved, making the structure adaptable to both traditional and independent color component encoding scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP2228997B1Image decoding method, Image decoder.
Publication Date: 2017.10.18 MITSUBISHI ELECTRIC CORP
  • EP2228997B1 patent drawing
  • EP2228997B1 patent drawing
  • EP2228997B1 patent drawing

AI summary

The present invention makes it possible to include, when encoding processing is applied to three color components using a 4:0:0 format, data for one picture in one access unit and makes it possible to set the same time information or the same set encoding modes among the respective color components. In an image encoding system for applying compression processing to an input image signal including a plurality of color components, encoded data obtained by independently subjecting an input image signal of each of the color components to encoding processing and a parameter indicating which color component the encoded data corresponds to are multiplexed with a bit stream. In an image decoding system for inputting a bit stream in which an image signal including a plurality of color components is compressed to perform decoding processing, decoding processing of the encoded data of each of the color components is performed using a parameter indicating which color component the encoded data corresponds to.