Under-Display Camera PSFI Processing for Corner Noise Suppression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile electronic devices with under-display cameras suffer from noise and artifacts in captured images due to the display obstructing the camera lens, leading to severe issues in image quality, particularly in the corners.
Innovation Solution
A software/firmware and hardware co-designed feature utilizing an artificial intelligence/machine learning agent that applies a point spread function inversion (PSFI) radial coring algorithm, chroma suppression, and dither algorithm to reduce noise and artifacts, especially in image corners, by enhancing image quality through PSFI correction and attenuation gains.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a display is placed in front of the camera lens to provide a full-screen display, then the display area is improved, but image quality deteriorates due to noise and artifacts
Solution Approach 1:
The patent applies preliminary action by performing PSFI correction and radial coring processing on the captured image data before final image output. The processor identifies regions with radially-increasing distortion patterns and applies targeted deconvolution operations to remove noise and artifacts introduced by the display overlay, thereby preserving image quality while maintaining the full-screen display configuration
Solution Approach 2:
The patent implements local quality by applying different processing strategies to different regions of the image. Specifically, it identifies regions exhibiting radially-increasing distortion characteristics and applies PSFI correction only to those affected areas, while leaving regions without such distortion patterns unprocessed. This selective approach removes noise and artifacts from problematic regions while preserving image quality in unaffected areas
2Object-affected harmful factors
If PSFI correction is applied to remove noise, then image quality is improved, but computational complexity increases
Solution Approach 1:
The patent reduces computational complexity by applying PSFI correction only to specific regions exhibiting radially-increasing distortion patterns rather than processing the entire image. The processor identifies affected regions and applies deconvolution operations selectively, significantly reducing the computational burden while maintaining effective noise removal in problematic areas
Solution Approach 2:
The patent applies partial action by performing PSFI correction on only the portion of the image that exhibits radially-increasing distortion characteristics. Rather than applying full-strength processing to the entire image, it uses radial coring to identify and treat only the necessary regions, reducing overall computational complexity while maintaining effective noise removal where needed
Data Source
Figure 1A
Figure 1B~2
Figure 3
AI summary
A system and method are provided to improve quality in an under-display camera (UDC) system with radially-increasing distortion. At least one processor receives an image and performs multi-frame processing, image signal processing, and a point spread function inversion (PSFI) on the image to produce a processed image. A PSFI radial coring is applied on the processed image to reduce noise in the processed image resulting from the PSFI. The at least one processor can apply a chroma suppression to the processing of the image to reduce brightness and color saturation is select areas in the processed image. Image restoration can be performed on the processed image to produce an output image. The image restoration may include generating a dither signal, applying a dither signal corner attenuation to the dither signal, combining the attenuated dither signal with a sharpened denoised signal, and applying a halo suppression on the combined signals.