Under-display Camera Image Correction via Display Light Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In electronic devices with a camera module positioned below the display, flare caused by diffraction and light from the display surface entering the camera module leads to image deterioration, particularly when imaging regions with high luminance or during video calls where the camera position needs to be closer to the display center.
Innovation Solution
An electronic device comprising a display surface, an imaging element, and a processing circuit that acquires data not caused by the imaging element, such as data from the display surface, and corrects the image signal using this data to suppress image deterioration. The processing circuit can also utilize information from a focus driver, display driver, and gyro sensor to enhance image correction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Length of moving object
If the camera module is disposed below the display to reduce bezel width, then the bezel width is reduced, but flare and image deterioration occur due to light diffraction and reflection from the display surface
Solution Approach 1:
The patent captures the harmful reflected light from the display surface using the imaging element, converts it into useful information about the display's optical characteristics, and uses this information through image processing to correct and remove the flare effects from captured images, thereby transforming the harmful interference into a beneficial correction mechanism
Solution Approach 2:
The system uses the imaging element to capture light reflected from the display surface, processes this feedback information to characterize the display's optical properties, and applies this feedback to correct subsequent images by removing flare artifacts, creating a closed-loop correction system
2Ease of operation
If the camera is positioned closer to the display center for video calls, then the camera positioning is optimized for video calls, but light from the display surface more directly enters the imaging element causing increased image deterioration
Solution Approach 1:
The patent captures the harmful reflected light from the display surface using the imaging element, converts it into useful information about the display's optical characteristics, and uses this information through image processing to correct and remove the flare effects from captured images, thereby transforming the harmful interference into a beneficial correction mechanism
Solution Approach 2:
The system uses the imaging element to capture light reflected from the display surface, processes this feedback information to characterize the display's optical properties, and applies this feedback to correct subsequent images by removing flare artifacts, creating a closed-loop correction system
3Object-affected harmful factors
If the display is darkened during camera imaging to prevent light from entering the imaging element, then light interference is reduced, but the displayed content becomes invisible and user experience deteriorates
Solution Approach 1:
The patent captures the harmful reflected light from the display surface using the imaging element, converts it into useful information about the display's optical characteristics, and uses this information through image processing to correct and remove the flare effects from captured images, thereby transforming the harmful interference into a beneficial correction mechanism
Solution Approach 2:
The system uses the imaging element to capture light reflected from the display surface, processes this feedback information to characterize the display's optical properties, and applies this feedback to correct subsequent images by removing flare artifacts, creating a closed-loop correction system
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution effectively corrects image signal degradation caused by the display surface, improving image quality by reducing flare and other forms of image deterioration, while allowing for optimal camera positioning during video calls and other applications.
Implementation Method 1
flare due to diffraction of the display
Implementation Method 2
reflection on the display surface
Implementation Method 3
light emitted from a light emitting element
Data Source
AI summary
An image signal is corrected on the basis of an output from a sensor or a driver. An electronic device includes a display surface, an imaging element, and a processing circuit. The display surface displays information on the basis of light emitted from the light emitting element. The imaging element is disposed on an opposite side of the display surface. The processing circuit processes a signal output from the imaging element. More specifically, the processing circuit acquires data not caused by the imaging element, and corrects an image signal received and output by the imaging element using the acquired data not caused by the imaging element.