Dual Sensor Image Processing for High Frame Rate

Solution Overview

Problem

The challenge is to efficiently process high-resolution images while minimizing power consumption and bandwidth requirements in electronic devices, particularly in portable terminals, which often require high-performance lenses and image sensors, increasing production costs and resource usage.

Innovation Solution

The solution involves using a combination of black and white and color image sensors to acquire images under different conditions, with the processor generating composite color images by combining black and white images and color information, allowing for high-frame-rate image processing without the need for high-resolution color sensors, thereby reducing resource usage and costs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If high-resolution color image sensors are used to improve image quality, then picture quality is improved, but production costs and power consumption increase

Engineering Contradiction:

Improvepicture qualityVSAvoidpower consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The image acquisition system is segmented into two specialized sensors: a black and white image sensor dedicated to capturing luminance information at high frame rates, and a color image sensor dedicated to capturing color information. This segmentation allows each sensor to be optimized for its specific function, enabling high-quality image processing with reduced power consumption compared to using a single high-resolution color sensor for all tasks.

Inventive Principle:

Principle #1Segmentation

2Measurement precision

If high-resolution color image sensors are used to improve image quality, then picture quality is improved, but production costs increase

Engineering Contradiction:

Improvepicture qualityVSAvoidproduction costs

Core Design Contradiction:

Measurement precisionVSEase of manufacture

Solution Approach 1:

The image acquisition system is segmented into two specialized sensors: a black and white image sensor dedicated to capturing luminance information at high frame rates, and a color image sensor dedicated to capturing color information. This segmentation allows each sensor to be optimized for its specific function, enabling high-quality image processing with reduced power consumption compared to using a single high-resolution color sensor for all tasks.

Inventive Principle:

Principle #1Segmentation

3Productivity

If high-frame-rate processing is implemented to improve image processing speed, then processing speed is improved, but resource usage increases

Engineering Contradiction:

Improveprocessing speedVSAvoidresource usage

Core Design Contradiction:

ProductivityVSQuantity of substance

Solution Approach 1:

The image acquisition system is segmented into two specialized sensors: a black and white image sensor dedicated to capturing luminance information at high frame rates, and a color image sensor dedicated to capturing color information. This segmentation allows each sensor to be optimized for its specific function, enabling high-quality image processing with reduced power consumption compared to using a single high-resolution color sensor for all tasks.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent merges the high-frame-rate capability of the black and white sensor with the color information from the color sensor through image processing. The processor combines the luminance data from the black and white images with the color data from the color image to generate high-quality color images at high frame rates, thereby achieving both high processing speed and efficient resource usage.

Inventive Principle:

Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the acquisition of high-frame-rate color images with improved resolution while optimizing resource usage and reducing production costs by leveraging the higher light receiving capabilities of black and white sensors and the color information from color sensors.

Implementation Method 1

a first black and white (BW) image sensor... acquiring a first black and white image corresponding to a first time for a subject and a second black and white image corresponding to a second time for the subject

Methodology Applied

Scientific EffectLight detection: Photoelectric Effect

Implementation Method 2

a second image sensor... acquiring a color image for the subject

Methodology Applied

Scientific EffectLight detection: Photoelectric Effect

Implementation Method 3

generating a first color image generated by composing the first black and white image and a first color determined based on at least some of color information of the color image, and generating a second color image generated by composing the second black and white image and a second color determined based on at least some of the color information

Methodology Applied

Scientific EffectImage processing and composition: Image Processing

Data Source

PatentUS11195304B2Image processing apparatus and method

Publication Date: 2021.12.07 SAMSUNG ELECTRONICS CO LTD

AI summary

Various embodiments of the present disclosure propose an apparatus and a method for processing an image for converting a frame rate. To this end, the present invention is capable of providing an apparatus and a method for processing an image, configured to convert a frame rate on the basis of monochrome image frames acquired through a monochrome sensor, and perform an image synthesis with the frame rate converted monochrome image frame by using a downsampled color image frame acquired through a color sensor.