Under-display Camera Artifact Reduction via Light Source Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Portable electronic devices with under-display camera modules face issues such as light blurring, light splitting, and rainbow artifacts due to the structural characteristics of the display, which affect image quality and visibility.

Innovation Solution

An electronic device equipped with a camera module under the display and a processor that analyzes the light source intensity and presence to detect and reduce artifacts, such as light source artifacts, rainbow artifacts, and under-display camera flare artifacts, through image processing techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a camera module is disposed under the display to maximize screen proportion, then the display area is increased and complete form is achieved, but artifacts such as light blurring, light splitting, and rainbow patterns occur in captured images

Engineering Contradiction:
Improvedisplay areaVSAvoidimage artifacts
Core Design Contradiction:
Area of stationary objectVSObject-affected harmful factors

Solution Approach 1:

The processor performs preliminary analysis of the captured image to detect artifacts caused by the under-display camera arrangement. By identifying artifacts in advance through image analysis, the system can then apply appropriate correction algorithms to remove or reduce these artifacts, resolving the contradiction between maximizing display area and preventing image quality degradation

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent converts the harmful diffraction and reflection effects caused by the display structure into detectable patterns. By analyzing the characteristics of artifacts (such as rainbow patterns and light splitting), the system identifies their presence and applies targeted processing to eliminate them, thereby transforming the harmful structural characteristics into opportunities for automated artifact detection and correction

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

2Object-affected harmful factors

If artifact detection and removal processing is applied to all captured images, then image quality is improved, but processing time and computational resources are wasted on images without artifacts

Engineering Contradiction:
Improveimage artifactsVSAvoidprocessing time
Core Design Contradiction:
Object-affected harmful factorsVSLoss of time

Solution Approach 1:

Instead of applying artifact removal processing to all captured images, the processor performs partial action by first conducting a quick analysis to detect whether artifacts are present. Only when artifacts are detected does the system proceed with the full artifact removal processing. This selective approach avoids wasting computational resources on images that do not require processing, while still ensuring that images with artifacts receive the necessary correction

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively detects and minimizes artifacts in images captured by the under-display camera module, improving image quality and maintaining the complete form of the display without intermediate areas, thereby enhancing the user experience.

Implementation Method 1

a camera module disposed under the display and configured to generate an image by sensing light passing through the display

Methodology Applied
Scientific EffectLight transmission: Light

Implementation Method 2

there may be light blurring and/or light splitting occurring due to strong diffraction around a light source

Methodology Applied
Scientific EffectDiffraction: Diffraction

Implementation Method 3

there may be a pattern in the image that is based on a structural shape of the display occurring due to internally reflected light that is not intended

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS11962911B2Electronic device for performing image processing and operation method thereof to reduce artifacts in an image captured by a camera through a display
Publication Date: 2024.04.16 SAMSUNG ELECTRONICS CO LTD
  • US11962911B2 patent drawing
  • US11962911B2 patent drawing
  • US11962911B2 patent drawing

AI summary

According to an embodiment, an electronic device, comprises a display; a camera module disposed under the display and configured to generate an image by sensing light passing through the display; and a processor configured to determine an intensity of a light source in the image, determine whether the light source is present in a preset area in the image when the intensity of the light source is greater than a preset threshold value, and reduce one or more artifacts from or in the image when the one or more artifacts are detected in the image based on results of the determining.