Image Demosaicing Circuitry Sharing Buffer for Color Restoration and Brightness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing technologies face challenges in effectively performing color restoration and image enhancement simultaneously, leading to side effects like zippering, color overlapping, and low regional contrast, while also requiring significant storage space and increased costs due to the need for additional modules and large buffer occupancy.

Innovation Solution

A circuitry for image demosaicing and enhancement that shares a limited storage buffer space for both color restoration and brightness reconstruction, utilizing a color restoration circuit, global mapping circuit, brightness estimation circuit, edge texture feature decision circuit, image segmentation circuit, and image blending circuit to perform color and brightness processing efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a line buffer is occupied for storing data for color restoration processing, then color restoration can be performed based on surrounding color information, but the buffer occupies more space, higher costs and a larger area of the integrated circuit

Engineering Contradiction:
Improvecolor restoration qualityVSAvoidbuffer area
Core Design Contradiction:
Manufacturing precisionVSArea of stationary object

Solution Approach 1:

The patent segments the buffer usage by dividing it into multiple banks (first bank and second bank) that can be independently accessed. This allows parallel processing of different pixel data segments, reducing the required buffer area while maintaining color restoration quality through selective data storage and retrieval.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The buffer is designed to serve multiple functions: storing original pixel data, storing interpolated color data, and providing surrounding color information for restoration. This multi-functionality eliminates the need for separate dedicated buffers for each processing stage, reducing overall buffer area requirements.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Manufacturing precision

If conventional color restoration technologies are used, then color values can be reproduced, but side effects such as zippering, color overlapping, moiré pattern, and false color occur on vertical horizontal edges

Engineering Contradiction:
Improvecolor reproduction accuracyVSAvoidimage artifacts
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent implements dynamic processing by adaptively selecting interpolation methods and adjusting processing parameters based on local image characteristics such as edge detection results and color variation patterns. This dynamic adaptation prevents artifacts like zippering and false colors that occur with static conventional methods.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Different processing strategies are applied to different regions of the image based on local characteristics. For example, edge regions use different interpolation weights compared to flat regions, and different color channels may use different restoration methods. This local quality approach eliminates artifacts while preserving color accuracy in each specific region.

Inventive Principle:
Principle #3Local quality

3Illumination intensity

If additional modules are used to adjust brightness for regional contrast enhancement, then brightness can be adjusted dynamically, but the area of storage and the cost are increased due to occupying additional buffer space

Engineering Contradiction:
Improvebrightness controlVSAvoidstorage area
Core Design Contradiction:
Illumination intensityVSArea of stationary object

Solution Approach 1:

The patent merges the brightness adjustment function into the existing buffer structure by utilizing the same buffer space for both color restoration data and brightness processing. The buffer manages multiple data types (color channels, brightness values, intermediate results) through intelligent memory management, eliminating the need for separate brightness adjustment modules and their associated storage.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11645734B2Circuitry for image demosaicing and contrast enhancement and image-processing method
Publication Date: 2023.05.09 REALTEK SEMICON CORP
  • US11645734B2 patent drawing
  • US11645734B2 patent drawing
  • US11645734B2 patent drawing

AI summary

A circuitry for image demosaicing and contrast enhancement and an image-processing method thereof are provided. The circuitry includes a storage device that is used to temporarily store an image and is jointly used by circuits that perform color restoration and brightness reconstruction. The circuitry includes a color restoration circuit for performing image interpolation and a global mapping circuit that performs mapping to obtain brightness of an image according to restored red, green and blue information of every pixel. Further, an edge texture feature decision circuit is provided to obtain each pixel's directionality for color restoration. A brightness estimation circuit utilizes green information of the pixels as the brightness for an area. After that, a color image with the color restoration and brightness reconstruction is outputted.