Dual-Sensor Camera Module Monochrome Color Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional smartphone camera modules require a color filter array, which degrades performance, especially in low illumination, and processors must interpolate pixel values, resulting in low-quality color images.

Innovation Solution

A photographing apparatus with a first image sensor capturing a monochrome image and a second image sensor capturing a color image, where a processor generates a high-resolution color image by using contour information from the monochrome image and color information from the color image, determining luminance differences and adjusting pixel values accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If a color filter array is used in the camera module, then color images can be captured, but the display quality in low illumination deteriorates

Engineering Contradiction:
Improvecolor image capture capabilityVSAvoiddisplay quality in low illumination
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The camera module is segmented into two separate imaging systems: one dedicated to capturing monochrome images with high sensitivity (without color filter) and another for capturing color images. This segmentation allows each sensor to be optimized for its specific function, resolving the contradiction between color capture capability and low-illumination performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The processor acts as an intermediary that combines the monochrome image data (providing luminance information) with the color image data (providing chrominance information) to generate the final high-quality color image. This intermediary processing step allows the system to leverage the strengths of both imaging paths.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of manufacture

If a color filter array is used, then color information is obtained, but image resolution and clarity deteriorate due to pixel value interpolation

Engineering Contradiction:
Improvecolor information acquisitionVSAvoidimage resolution and clarity
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The processor serves as an intermediary that intelligently combines data from both the monochrome sensor (providing high-resolution luminance) and the color sensor (providing color information). This combination produces a final image that maintains high resolution and clarity while incorporating accurate color data, avoiding the need for simple interpolation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If a single image sensor with color filter is used, then device complexity is reduced, but image quality in different lighting conditions cannot be optimized

Engineering Contradiction:
Improvesensor configuration simplicityVSAvoidimage quality across different illumination conditions
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The imaging system is segmented into two specialized sensors: a monochrome sensor optimized for low-illumination conditions and a color sensor optimized for color accuracy in normal lighting. This segmentation allows each sensor to excel in its intended operating condition, improving overall reliability across different lighting scenarios.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically selects and processes data from different sensors based on lighting conditions. The processor analyzes the input from both sensors and adaptively combines them, allowing the system to optimize performance for the current illumination conditions rather than being fixed in a single configuration.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3429198B1Photographing apparatus and control method thereof
Publication Date: 2021.06.23 SAMSUNG ELECTRONICS CO LTD
  • EP3429198B1 patent drawingFigure 1
  • EP3429198B1 patent drawingFigure 2
  • EP3429198B1 patent drawingFigure 3

AI summary

A photographing apparatus is disclosed. A photographing apparatus according to one embodiment comprises: a first image sensor; a second image sensor; and at least one processor functionally coupled to the first image sensor and the second image sensor, wherein the at least one processor may be configured to: obtain, by using the first image sensor, a first image which includes a first pixel, a second pixel adjacent to the first pixel, and a third pixel adjacent to the second pixel in an area other than the area in which the second pixel and the first pixel are adjacent; obtain, by using the second image sensor, a second image which includes a fourth pixel associated with the first pixel on the basis of the position thereof, and a fifth pixel adjacent to the fourth pixel and associated with the second pixel on the basis of the position thereof; determine whether a difference in luminance between the first pixel and the second pixel falls within a designated range; and, when the difference in the luminance between the first pixel and the second pixel falls within the designated range, generate color information corresponding to at least one of the first pixel and the second pixel at least on the basis of the color information of the fourth pixel and the color information of the fifth pixel.