Under Display Camera Image Correction via Cross-Camera Similarity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Under display cameras (UDC) face challenges due to varying light transmittance across different wavelengths through the display, leading to discrepancies between captured images and actual scenes, requiring frequent calibration when device components are replaced.
Innovation Solution
An electronic device with a first camera, a display, and a second camera positioned below the display, utilizing a processor to acquire image data and environment information from both cameras, determine the need for correction values, and adjust these values based on similarity between the two sets of data to improve image quality without the need for recalibration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a calibration process is performed during production to correct image discrepancies, then image quality is improved, but device complexity increases and recalibration is needed when components are replaced
Solution Approach 1:
The patent applies preliminary action by pre-calibrating the under display camera with the display during the manufacturing process and storing the correction values in memory. This preliminary calibration eliminates the need for recalibration when components are replaced, as the correction values are already embedded in the system. The processor retrieves these pre-stored correction values to correct images captured by the under display camera, thereby improving image quality without adding operational complexity.
Solution Approach 2:
The patent uses copying by creating a digital model of the optical characteristics through calibration data. Instead of physically adjusting components during replacement, the system copies the correction information from the calibration process into stored correction values that can be applied software-based. This copying approach allows the system to maintain image quality without requiring physical recalibration when displays or camera modules are replaced.
2Area of stationary object
If the display area is increased for better user experience, then consumer satisfaction improves, but light transmittance to the under display camera decreases
Solution Approach 1:
The patent applies parameter changes by measuring and compensating for the optical characteristics of the display at different wavelengths. The calibration process determines how the display affects light transmission across the spectrum, and correction values are applied to compensate for reduced light transmittance. This allows the system to maintain image quality even when the display area is increased and light transmittance is reduced.
Solution Approach 2:
The patent converts the harmful effect of reduced light transmittance into a benefit by using the calibration process to characterize the display's optical properties. Instead of viewing the display's light-blocking effect as purely detrimental, the system uses it to create accurate correction models that compensate for the transmittance reduction. The display's effect on light is transformed from a problem into a known parameter that can be corrected.
3Measurement precision
If correction values are stored during manufacturing, then image quality is improved, but the system cannot adapt when components are replaced
Solution Approach 1:
The patent applies universality by designing the correction value storage system to work with any display or camera module combination. The calibration process creates generic correction values that can be applied across different component variations. When components are replaced, the system can retrieve appropriate correction values from memory without requiring recalibration, making the system universally adaptable to different component configurations while maintaining image quality.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables improved image quality by dynamically correcting for light transmittance variations, allowing for updated correction values during use even without initial calibration, thus enhancing the UDC's performance and user experience.
Implementation Method 1
incident light has a different degree of transmittance through the display with regard to each wavelength
Data Source
AI summary
An electronic device is provided. The electronic device includes a first camera, a display, a second camera disposed below the display, and at least one processor, wherein the at least one processor is configured to acquire first image data and first environment information associated with the first image data by using the first camera, acquire second image data and second environment information associated with the second image data by using the second camera, determine whether to correct a correction value related to the second camera based on the second image data, the correction value including at least one of a white balance correction value for correcting white balance of the second camera or a lens shading correction value for correcting lens shading of the second camera, identify a similarity between the first environment information and the second environment information in response to determining to correct the correction value related to the second camera, and correct the correction value related to the second camera by using at least the similarity based on the first image data.