Under-screen Camera Image Correction via Depth-based Fringe Removal
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The under-screen camera in mobile phones captures images with poor quality due to interference fringes generated by two beams meeting and overlapping in the target region, caused by the physical properties of the display screen.
Innovation Solution
An image correction method that involves obtaining interference fringe images at different photographing distances, calculating depth values for each pixel in the to-be-corrected image, selecting the appropriate interference fringe image based on the depth values, extracting pixel values from these images, and correcting the pixel values to produce a high-quality image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If an illumination source is used to illuminate a target object through a display screen, then the under-screen camera can capture images, but interference fringes are generated due to beam splitting and overlapping, resulting in poor image quality
Solution Approach 1:
The patent captures reference images at multiple photographing distances before capturing the actual target image. These reference images are processed in advance to build a depth-map and interference fringe correction model, which is then used to correct the target image. This preliminary preparation enables effective correction of interference fringes in the final image.
Solution Approach 2:
The patent introduces depth information as an additional dimension by capturing reference images at multiple photographing distances. This multi-distance approach creates a depth-map that adds a third dimension (depth) to the traditional 2D image correction process, enabling the system to distinguish and correct interference fringes based on their depth characteristics.
2Manufacturing precision
If multiple interference fringe images at different photographing distances are captured and processed, then image quality can be improved, but the system complexity and processing time increase
Solution Approach 1:
The patent segments the interference fringe correction process into distinct stages: capturing reference images at multiple distances, processing these images to extract interference patterns, building a depth-map, and finally applying correction to the target image. This segmentation allows each stage to be optimized independently and facilitates efficient implementation.
Solution Approach 2:
The patent creates simplified representations (copies) of the complex interference patterns by capturing reference images at multiple distances. These reference images serve as copies that contain the interference characteristics, which are then processed to create a depth-map model. This model copy is used to correct the actual target image without requiring complex real-time processing of the original interference patterns.
3Measurement precision
If reference images at multiple photographing distances are captured to correct interference fringes, then correction accuracy improves, but the time required for image capture and processing increases
Solution Approach 1:
The patent performs the time-consuming operations of capturing multiple reference images, processing them to extract interference patterns, and building the depth-map model in advance, before capturing the actual target image. This preliminary preparation allows the final correction to be applied quickly using the pre-computed model, reducing the time loss for the critical target image capture.
Solution Approach 2:
The patent implements a dynamic correction approach where the system adaptively selects and applies correction parameters based on the depth-map and interference characteristics of each specific scene. The correction process dynamically adjusts to match the actual interference patterns, improving accuracy while optimizing processing time through intelligent parameter selection.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The method effectively alleviates the issue of poor image quality caused by interference fringes by accurately correcting pixel values based on the interference fringe images, resulting in improved image capture and quality.
Implementation Method 1
an illumination source to supplement light for a target object through a display screen
Implementation Method 2
a beam emitted by the illumination source through the display screen is split into two beams
Implementation Method 3
the other beam is reflected on the display screen and emitted after being reflected for many times
Implementation Method 4
The two beams meet and overlap in a target region to generate interference fringes
Data Source
AI summary
A method for correcting interference fringes includes: obtaining interference fringe images with different photographing distances; obtaining a to-be-corrected image including to-be-corrected pixels, and calculating a depth value of each to-be-corrected pixel in the to-be-corrected image; selecting, from the interference fringe images with different photographing distances, an interference fringe image corresponding to the depth value of each to-be-corrected pixel as a target interference fringe image; extracting first pixel values of target coordinate positions in the target interference fringe image; and correcting second pixel values of to-be-corrected pixels according to the first pixel values corresponding to the to-be-corrected pixels to obtain a corrected image.