Under Display Camera Multi-Frame Fusion and Light Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Under display camera (UDC) systems face challenges in image quality due to low light transmission, diffraction effects, and noise caused by display panels, which current technologies have not effectively addressed, leading to degraded image quality and user experience.
Innovation Solution
The implementation of an electronic device with a UDC controller that determines the optimal number of frames and camera parameters for multi-frame fusion, applies light source spread correction, and compensates for light transmission loss, using AI models to enhance image quality by analyzing ambient light and display panel characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If an under display camera (UDC) is used to enable bezel-less display, then the display area is increased, but image quality deteriorates due to low light transmission and diffraction effects
Solution Approach 1:
The system performs preliminary actions by capturing multiple frames before final image processing. The method captures N frames with different exposure settings and performs multi-frame fusion in advance to compensate for light transmission loss and diffraction effects, thereby improving image quality while maintaining the UDC configuration
Solution Approach 2:
The system changes parameters by adjusting exposure settings for multiple frames (different exposure values) and dynamically selecting fusion parameters based on scene characteristics. The method also adjusts camera parameters such as gain and exposure time to optimize image quality under different lighting conditions
2Measurement precision
If multiple frames are captured and fused to improve image quality, then image sharpness is enhanced, but the complexity of the processing system increases
Solution Approach 1:
The system applies dynamics by dynamically selecting the number of frames (N) to capture based on scene characteristics and lighting conditions. The method also dynamically adjusts fusion parameters and camera settings, allowing the processing complexity to adapt to actual needs rather than always using maximum frames
Solution Approach 2:
The system uses partial action by capturing only the necessary number of frames (N) required to achieve desired image quality, rather than always capturing a fixed large number of frames. The method determines optimal N based on scene analysis, avoiding excessive processing when fewer frames suffice
3Illumination intensity
If camera parameters are adjusted to compensate for light transmission loss, then image brightness is improved, but the difficulty of determining optimal parameters increases
Solution Approach 1:
The system uses feedback by analyzing the captured frames to determine scene characteristics, ambient light conditions, and dominant light sources. This feedback information is then used to adjust camera parameters (exposure, gain, color temperature) and fusion parameters optimally for the specific scene
Solution Approach 2:
The system performs preliminary scene analysis and parameter determination before final image fusion. The method analyzes ambient light parameters and scene characteristics in advance to pre-determine optimal camera settings and fusion parameters, reducing the complexity of real-time optimization
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution improves UDC image quality by optimizing frame capture settings, compensating for light transmission losses, and enhancing image sharpness, thereby improving the overall user experience and content-aware sharpness in various lighting conditions.
Implementation Method 1
the UDC images suffer from low transmission of light, blur, noise, haze, and flare like degradation... light diffracts as it propagates through obstacles with sizes that are similar to its wavelength
Data Source
AI summary
An electronic device includes a UDC and a UDC controller configured to determine an optimal number of frames required to be captured for a scene to compensate at least one parameter to optimize an output media using the UDC, obtain a multi-frame fusion media by performing at least one multi-frame fusion on the determined optimal number of frames, perform a light source spread correction on the multi-frame fusion media, and optimize the output media based on the light source spread correction on the multi-frame fusion media.