Under-display Camera Image Correction via Infrared Reference
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices with camera modules disposed below the display panel face issues with low visible light transmittance through the display panel layers, leading to dark or blurred images, and are susceptible to flare and diffraction effects, especially in low-light conditions.
Innovation Solution
An electronic device equipped with a first imaging unit capturing infrared light and a second imaging unit capturing visible light, both disposed opposite to the display surface, along with a correction unit that adjusts image data from the second imaging unit based on data from the first imaging unit to improve image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If the camera module is disposed immediately below the display panel to narrow the bezel width, then the outer size of the electronic device can be made compact, but the captured image becomes dark or blurred due to low visible light transmittance through the display panel layers
Solution Approach 1:
The imaging function is segmented into two independent imaging units: one for infrared light and one for visible light. This allows each imaging unit to be optimized for its specific wavelength band, with the visible light imaging unit compensating for the light loss through the display panel.
Solution Approach 2:
The system changes the wavelength parameter of light detection by using both infrared and visible light imaging units. Infrared light has better penetration through the display panel layers, and by capturing images in both wavelength bands and combining them, the system compensates for the light loss in the visible band.
2Volume of moving object
If the camera module is disposed on the surface of a small electronic device, then the device size can be reduced, but the lens diameter cannot be increased causing the captured image to become dark and unclear in low-light conditions
Solution Approach 1:
The imaging system is divided into two specialized imaging units that work together. The infrared imaging unit captures images in low-light conditions where visible light is insufficient, and this information is used to correct and enhance the visible light image, thereby improving overall image quality without increasing device size.
Solution Approach 2:
The infrared light acts as an intermediary to provide additional information about the scene in low-light conditions. By capturing infrared light that can penetrate better and providing this as a reference for correction, the system improves visible light image quality without needing a larger lens.
3Device complexity
If the subject light passes through the display panel to capture images, then the camera can be disposed below the display, but flare or diffraction effects deteriorate the image quality
Solution Approach 1:
The infrared light captured through the display panel serves as an intermediary reference that is less affected by flare and diffraction. This reference image is used to correct the visible light image, removing the harmful optical effects that occur when visible light passes through the display panel layers.
Solution Approach 2:
Instead of relying solely on optical mechanisms to prevent flare and diffraction, the system uses computational processing to substitute for optical imperfections. By capturing infrared light that experiences less flare and diffraction and using it to correct the visible light image, the system replaces optical solution with a computational one.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables the capture of high-quality images even in low-light conditions by correcting for sensitivity, resolution, flare, and diffraction, thereby enhancing image clarity and reducing the impact of display panel layers on image quality.
Implementation Method 1
a first imaging unit that is disposed on a side opposite to a display surface of the display unit and is capable of capturing an image of light in an infrared light wavelength band that has passed through the display unit
Implementation Method 2
a second imaging unit that is disposed on a side opposite to the display surface and is capable of capturing an image of light in a visible light wavelength band that has passed through the display unit
Implementation Method 3
The correction unit may correct sensitivity of the image data imaged by the second imaging unit on the basis of the image data imaged by the first imaging unit
Implementation Method 4
The correction unit may correct resolution of the image data imaged by the second imaging unit on the basis of the image data imaged by the first imaging unit
Implementation Method 5
The correction unit may correct at least one of a flare component or a diffracted light component included in the image data imaged by the second imaging unit on the basis of the image data imaged by the first imaging unit
Implementation Method 6
The correction unit may correct at least one of a flare component or a diffracted light component included in the image data imaged by the second imaging unit on the basis of the image data imaged by the first imaging unit
Data Source
AI summary
Even in a case where the amount of incident light is small, a high-Quality captured image can be obtained.An electronic device includes: a display unit; a first imaging unit that is disposed on a side opposite to a display surface of the display unit and is capable of capturing an image of light in an infrared light wavelength band that has passed through the display unit; a second imaging unit that is disposed on a side opposite to the display surface of the display unit and is capable of capturing as image of light in a visible light wavelength band that has passed through the display unit; and a correction unit that corrects image data imaged by the second imaging unit on the basis of image data imaged by the first imaging unit.