Macro-Pixel Processing Circuitry for YUV 4:2:0 Color Space Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing methods face inefficiencies in converting and processing images between RGB and YUV color spaces, particularly in reducing noise and performing operations on macro-pixels, which affects image quality and processing speed.

Innovation Solution

The method involves converting macro-pixels from a first color space, such as Bayer, to a YUV 4:2:0 color space and applying operations like luminance noise reduction, chrominance noise reduction, matrixing, cropping, scaling, brightness, and saturation adjustments on a macro-pixel level within a single clock cycle using image processing circuitry.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional raster-based processing methods are used to convert and process images between RGB and YUV color spaces, then processing can be performed on individual pixels, but computational complexity and power consumption increase

Engineering Contradiction:
Improveprocessing speedVSAvoidcomputational complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges multiple pixel processing operations into a single macro-pixel processing unit. The macro-pixel processor handles conversion from Bayer color space to YUV 4:2:0 color space, applies noise reduction, and performs other operations on a block of pixels simultaneously, reducing computational complexity and power consumption while improving processing throughput

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent segments the image processing task by dividing the image into macro-pixels (blocks of pixels) that are processed independently. This segmentation allows parallel processing of multiple pixels within each macro-pixel block, improving productivity while managing computational complexity through localized processing

Inventive Principle:
Principle #1Segmentation

2Reliability

If noise reduction operations are applied to individual pixels in RGB color space, then processing can be performed sequentially, but image quality improvement is limited

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent changes the color space parameter from RGB to YUV 4:2:0, which separates luminance (Y) and chrominance (UV) components. This parameter change enables more effective noise reduction by allowing independent processing of luminance and chrominance channels, improving image quality while the macro-pixel parallel processing reduces the time loss

Inventive Principle:
Principle #35Parameter changes

3Productivity

If multiple processing operations are applied sequentially to macro-pixels, then each operation can be performed carefully, but processing speed decreases

Engineering Contradiction:
Improveprocessing speedVSAvoidprocessing precision
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent implements continuous macro-pixel processing where multiple operations (color space conversion, noise reduction, deblocking) are performed in a continuous pipeline on macro-pixel blocks. This maintains processing precision through systematic operation sequences while improving productivity through parallel execution and eliminated idle time between operations

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS10068342B2Macropixel processing system, method and article
Publication Date: 2018.09.04 STMICROELECTRONICS (GRENOBLE 2) SAS
  • US10068342B2 patent drawing
  • US10068342B2 patent drawing
  • US10068342B2 patent drawing

AI summary

Digital image processing circuitry converts images in a color filter array (CFA) color space to images in a luminance-chrominance (YUV) 4:2:0 color space, and the images in the YUV 4:2:0 color space are processed by the digital image processing circuitry in the YUV 4:2:0 color space, for example, to apply noise filtering, etc. The converting includes simultaneously receiving pixel data defining a macro-pixel in the CFA color space. The processing in the YUV color space is applied on a macro-pixel level to the macro-pixel of the image in the YUV color space.