Image Sensor Correction Using Dual Light Paths

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image sensors placed under display panels in electronic devices experience deteriorated image quality due to light passing through the display, necessitating a method to enhance image quality and reliability.

Innovation Solution

An electronic device incorporating a first image sensor to capture light passing through the display and a second image sensor to capture light that does not pass through, with a processor generating optical values from the second image signal to correct the first image signal based on specific conditions, including luminance and color temperature values.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If an image sensor is disposed under a display panel to sense light, then the image sensor can capture light information, but the image quality deteriorates due to light passing through the display panel

Engineering Contradiction:
Improveimage qualityVSAvoidlight passing through display panel
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent introduces a second image sensor that captures light without passing through the display panel, creating a reference copy of the actual light conditions. This copy is then used to correct and compensate for the degraded image data from the first sensor, effectively replacing the need for direct high-quality light capture through the display.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The processor acts as an intermediary that receives degraded image signals from the first sensor and corrected optical values from the second sensor, then synthesizes improved image output. The second sensor serves as an intermediary measurement device that provides reference data to compensate for the display panel's harmful effect on the first sensor.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If a single image sensor is used under the display panel, then the device structure is simple, but the image quality is deteriorated

Engineering Contradiction:
Improveimage sensor configurationVSAvoidimage quality
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent divides the image sensing function into two separate sensors: a first image sensor positioned to capture light through the display panel for display-related applications, and a second image sensor positioned to capture actual ambient light conditions. This segmentation allows each sensor to serve its specific purpose optimally while the processor integrates their data.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system achieves multi-functionality by using the second image sensor for multiple purposes: capturing reference optical values, determining color temperature, measuring luminance, and providing correction data for the first sensor. This single sensor performs multiple functions that would otherwise require separate dedicated components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Improves image quality and reliability by accurately correcting image signals based on optical values, enhancing the overall performance of image sensors in electronic devices.

Implementation Method 1

Each of the plurality of pixels may include, for example, a photodiode (PD). The photodiode may serve to convert incident light into an electrical signal.

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11412197B2Electronic device including image sensor
Publication Date: 2022.08.09 SAMSUNG ELECTRONICS CO LTD
  • US11412197B2 patent drawing
  • US11412197B2 patent drawing
  • US11412197B2 patent drawing

AI summary

An electronic device includes: a display; a first image sensor configured to output a first image signal based on sensing a first light passing through the display; a second image sensor configured to output a second image signal based on sensing a second light that does not pass through the display; and a processor configured to: generate a first optical value and a second optical value based on the second image signal, the second optical value being different from the first optical value; based on the first optical value satisfying a first condition, correct the first image signal by using the second optical value.