Embedded Codec Pixel-Domain Pre-Processing for Image Block Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image encoding circuitry requires excessive computing resources and time due to the need for repeated encoding, reconstruction, and comparison of image blocks to find the optimal coding mode, leading to inefficiencies in processing and memory usage.

Innovation Solution

An embedded codec (EBC) circuitry that performs pixel-domain pre-processing operations to select the optimal encoding mode for image blocks before the transform-domain coding stage, reducing the need for full reconstruction and minimizing resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional image encoding circuitry performs repeated encoding, reconstruction, and comparison of image blocks to find optimal coding mode, then the visual quality of the encoded image is improved, but the computing resources and processing time are excessively consumed

Engineering Contradiction:
Improvevisual qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent applies preliminary action by performing mode selection in the pixel domain before transform-domain coding. The encoder calculates prediction errors for different coding modes (intra prediction, inter prediction, skip mode) directly from pixel data and selects the optimal mode beforehand, avoiding the need for full reconstruction and comparison in conventional approaches. This preliminary mode selection reduces computing resources and processing time while maintaining visual quality.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If conventional image encoding circuitry performs full reconstruction of image blocks from multiple bit-streams to determine optimal coding mode, then the accuracy of mode selection is improved, but the memory resources are excessively consumed

Engineering Contradiction:
Improvemode selection accuracyVSAvoidmemory resources
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the necessary information for mode selection from the encoding process. Instead of performing full reconstruction of image blocks from multiple bit-streams, the method extracts prediction errors directly from pixel data in the pixel domain for different coding modes. This extraction approach determines optimal coding mode with sufficient accuracy while minimizing memory resource consumption by avoiding storage and processing of multiple reconstructed bit-streams.

Inventive Principle:
Principle #2Taking out (Extraction)

3Manufacturing precision

If conventional image encoding circuitry performs repeated encoding and reconstruction operations for each image block, then the optimal coding mode is accurately determined, but the computing resources are excessively utilized

Engineering Contradiction:
Improvecoding mode optimizationVSAvoidcomputing resources
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent uses cheap short-living objects by performing lightweight pixel-domain operations for mode selection instead of expensive transform-domain reconstruction. The method calculates prediction errors directly from pixel data using simple arithmetic operations that consume minimal computing resources. These temporary pixel-domain calculations are discarded after mode selection, avoiding the need for resource-intensive repeated encoding and reconstruction operations while still determining optimal coding mode accurately.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentUS10893272B2Image block coding based on pixel-domain pre-processing operations on image block
Publication Date: 2021.01.12 SONY GROUP CORP
  • US10893272B2 patent drawing
  • US10893272B2 patent drawing
  • US10893272B2 patent drawing

AI summary

Embedded Codec (EBC) circuitry for image block coding based on pixel-domain pre-processing operations on image block is provided. The EBC circuitry includes memory that stores a first image block and encoder circuitry that computes a first sum of absolute differences (SAD) from a first prediction block of row-wise residual values and a second SAD from a second prediction block of column-wise residual values in pixel-domain. The encoder circuitry selects a residual prediction type from a set of residual prediction types as an optimal residual prediction type and a set of quantization parameters as optimal quantization parameters for each of a first encoding mode and a second encoding mode. The encoder circuitry generates a set of bit-streams of encoded first image block in the first encoding mode and the second encoding mode, respectively, based on the selected residual prediction type and the selected set of quantization parameters.