Under-Display Camera Signal Processing for Flare Artifact Suppression

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In electronic equipment, such as smartphones and tablets, the placement of a camera on the bezel can lead to image quality degradation due to flare and diffraction effects caused by the display surface, resulting in discomfort and poor image quality during video calls.

Innovation Solution

The camera module is positioned on the side opposite to the display surface, equipped with on-chip lenses and pixels arranged in a Bayer array, along with a signal processing unit that corrects for flare by adding and processing output values from photoelectric conversion units, using learned models and noise removal techniques to enhance image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If the camera is disposed in the bezel of the display unit, then the outer size can be made compact, but image quality deteriorates due to flare and diffraction effects from the display surface

Engineering Contradiction:
Improveouter sizeVSAvoidimage quality
Core Design Contradiction:
Volume of moving objectVSReliability

Solution Approach 1:

The camera module is moved from the traditional bezel location to the back surface of the display unit, utilizing the z-dimension (depth) rather than the x-y plane. This spatial reconfiguration allows the camera to capture light transmitted through the display from the rear, avoiding flare and diffraction issues while maintaining compact form factor.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If light passes through the display unit to reach the camera, then the camera can be positioned on the back surface, but image quality deteriorates due to artifacts from reflection and diffraction

Engineering Contradiction:
Improvecamera positioningVSAvoidimage quality
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The harmful optical effects (reflection and diffraction artifacts) are extracted and isolated to specific regions of the display structure. By designing the display with specific optical characteristics in certain areas, the patent separates the light transmission function from the artifact generation, allowing the camera to receive clean light from the back surface.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent modifies optical parameters of the display unit, such as refractive indices, layer thicknesses, and surface characteristics, to control light transmission while minimizing reflection and diffraction. These parameter adjustments optimize the optical path for rear-camera imaging without compromising display performance.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration effectively suppresses image quality degradation by correcting for flare and diffraction artifacts, providing improved image quality and user experience during video calls without the need for a narrow bezel.

Implementation Method 1

the first pixel includes a plurality of photoelectric conversion units

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS12035058B2Electronic equipment
Publication Date: 2024.07.09 SONY SEMICON SOLUTIONS CORP
  • US12035058B2 patent drawing
  • US12035058B2 patent drawing
  • US12035058B2 patent drawing

AI summary

To suppress image quality degradation due to artifacts. Electronic equipment includes a display unit, an imaging unit disposed on a side opposite to a display surface of the display unit, and a signal processing unit. The imaging unit includes a plurality of on-chip lenses and a plurality of pixels, in which the on-chip lens includes a first on-chip lens, the plurality of pixels includes a first pixel, the first pixel is disposed to overlap the first on-chip lens, and the first pixel includes a plurality of photoelectric conversion units. The signal processing unit processes signals output from the plurality of pixels.