Coding Scheme Layer for Image Data Components

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current compression and decompression techniques for image data, such as video codecs, are limited in supporting additional image features like depth information, infrared signals, and transparency, leading to inefficient coding and increased complexity due to the inability to exploit redundancies between different data layers.

Innovation Solution

A coding scheme that allows specifying additional components, such as depth and transparency, in the same layer as color components, enabling improved encoding and decoding by grouping these components for common processing configurations or individual processing with different configurations, thereby optimizing coding efficiency and reducing complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If additional image features (depth, infrared, transparency) are encoded as separate layers in advanced codecs, then the color gamut and information completeness are improved, but the device complexity and decoding complexity increase due to inability to exploit redundancies between layers

Engineering Contradiction:
Improveinformation completenessVSAvoiddecoding complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent combines multiple image components (color components Y, Cb, Cr and additional components such as depth, transparency, or infrared) into a single coded layer. This merging allows the encoder and decoder to process all components together, exploiting redundancies between them through joint prediction, transformation, and quantization operations, thereby reducing decoding complexity while preserving all image information.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a universal coding framework that can handle both traditional color components and additional image features (depth, transparency, infrared) within the same layer structure. This multi-functional approach allows a single decoder to process diverse component types using unified prediction and transformation mechanisms, reducing the need for separate decoding paths and lowering overall device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If additional image features are encoded as separate layers, then the representation of wider color ranges and additional features is improved, but the memory requirements and processing complexity increase

Engineering Contradiction:
Improvecolor gamutVSAvoidmemory requirements
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

By merging color components and additional image features into a single layer, the patent enables shared memory structures and unified buffer management. The decoder can use a single set of reference buffers and processing memory for all components, reducing total memory requirements compared to maintaining separate memory spaces for each layer.

Inventive Principle:
Principle #5Merging (Combining)

3Loss of information

If basic codecs support additional components like RGBA format, then the transparency information is preserved, but the coding efficiency is reduced due to lack of advanced compression mechanisms

Engineering Contradiction:
Improvetransparency informationVSAvoidcoding efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent merges transparency (alpha) channel with color components (RGB) in a single coded layer, enabling advanced compression techniques to operate on all components jointly. The encoder can exploit correlations between color and transparency data through inter-component prediction and joint transformation, significantly improving coding efficiency compared to treating them as completely independent channels.

Inventive Principle:
Principle #5Merging (Combining)

4Device complexity

If point cloud attributes are grouped in subgroups or layers and encoded independently, then the decoding can be simplified, but the coding efficiency is reduced due to inability to exploit redundancies between groups

Engineering Contradiction:
Improvedecoding simplicityVSAvoidcoding efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent combines multiple point cloud attributes (geometry, RGB color, transparency, reflectance, material ID) into a single coded layer with unified syntax structures. This allows the encoder to exploit redundancies across all attribute types through joint prediction and transformation operations, significantly improving coding efficiency while maintaining a relatively simple decoding structure through unified processing.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11606569B2Extending supported components for encoding image data
Publication Date: 2023.03.14 APPLE INC
  • US11606569B2 patent drawing
  • US11606569B2 patent drawing
  • US11606569B2 patent drawing

AI summary

Support for additional components may be specified in a coding scheme for image data. A layer of a coding scheme that specifies color components may also specify additional components. Characteristics of the components may be specified in the same layer or a different layer of the coding scheme. An encoder or decoder may identify the specified components and determine the respective characteristics to perform encoding and decoding of image data.