One-Chip Camera Image Processing for Resolution and False Color Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in obtaining high-resolution image signals from one-chip cameras without degrading image quality, particularly due to low correlation among pixel values and the introduction of false colors or artifacts during Bayer conversion.

Innovation Solution

An image processing apparatus that calculates representative values for color components, performs class classification, reads stored coefficients, and uses product and sum calculations to convert pixel values, effectively addressing the low correlation and image degradation issues by offsetting pixel values and using prior learning to optimize coefficients.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If linear interpolation processing is performed to generate color signals from one-chip camera output, then image resolution is improved, but false colors and artifacts are introduced degrading image quality

Engineering Contradiction:
Improveimage resolutionVSAvoidfalse colors and artifacts
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent performs preliminary classification of pixels into flat and non-flat regions before interpolation. By identifying flat regions where color values are uniform and performing targeted processing on these regions, the method prevents false color generation while maintaining high resolution. The classification step prepares the data structure needed for subsequent selective interpolation operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies different interpolation strategies to different regions of the image. Flat regions undergo one type of processing while non-flat regions undergo another. This local differentiation allows optimal handling of each region's characteristics, preventing artifacts in flat areas while preserving edge details in non-flat areas.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If image sensor area is increased to improve resolution, then image quality improves, but optical system size and weight increase

Engineering Contradiction:
Improveimage resolutionVSAvoidoptical system weight
Core Design Contradiction:
Measurement precisionVSWeight of moving object

Solution Approach 1:

The patent uses interpolation to generate missing color information at each pixel location by copying and combining data from neighboring pixels. This computational approach creates high-resolution color images without requiring physically larger sensors or multiple stacked sensors, thereby avoiding increased optical system weight and size.

Inventive Principle:
Principle #26Copying

3Measurement precision

If three-chip camera is used to obtain accurate color signals, then image quality improves, but device complexity and size increase

Engineering Contradiction:
Improvecolor signal accuracyVSAvoidcamera system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces classification logic as an intermediary step between raw sensor data and final color interpolation. This intermediary process identifies regional characteristics and directs appropriate processing, achieving three-chip camera quality with one-chip simplicity. The classification mechanism mediates between the limited hardware capabilities and the high quality output requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9256923B2Image processing apparatus, image processing method, and program
Publication Date: 2016.02.09 SONY GROUP CORP
  • US9256923B2 patent drawing
  • US9256923B2 patent drawing
  • US9256923B2 patent drawing

AI summary

An image processing apparatus includes: a representative value calculation unit that selects a designation area from a first image, and that calculates a representative value of each of the color components in the designation area, a class classification unit that performs class classification on the designation area, a coefficient reading unit that reads a coefficient that is stored in advance, a color component conversion unit that sets the pixel value relating to a predetermined pixel within the designation area to be a prediction tap, sets the pixel value of one color component, to be a reference, and converts the pixel value of each color component into a conversion value, and a product and sum calculation unit that sets the conversion value to be a variable and calculates each of the pixel values of a second image, by performing product and sum calculation which uses the coefficient which is read.