Under-Display Camera Image Sensor with Neural Network Restoration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Under-display cameras face challenges in capturing high-quality images due to occlusion by pixel regions, leading to low brightness and significant noise, along with artifacts like blur and flare, which degrade image quality.
Innovation Solution
An image acquisition apparatus with a display layer featuring hole regions and pixel regions, where the processor generates a raw image by sensing external light through the hole regions and performs image processing based on blur information, including image preprocessing and restoration using a neural network-based model, to enhance image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the image sensor is disposed under the display layer to enable under-display camera functionality, then the device integration is improved, but the image quality deteriorates due to occlusion by pixel regions causing low brightness and significant noise
Solution Approach 1:
The display layer is segmented into multiple types of regions: first pixel regions for display, second pixel regions for sensing external light, and hole regions. This segmentation allows the display layer to simultaneously serve display and imaging functions, enabling under-display camera functionality while maintaining image quality by providing dedicated light sensing areas
Solution Approach 2:
The display layer is designed to perform multiple functions: it serves as both the display interface and the light sensing component for the camera. The pixel regions and hole regions within the display layer can sense external light, eliminating the need for a separate camera module and achieving multi-functionality
2Adaptability or versatility
If the image sensor is disposed under the display layer, then the device integration is improved, but the image quality deteriorates due to artifacts like blur and flare
Solution Approach 1:
A light shielding layer is introduced as an intermediary component between the display layer and the image sensor. This layer includes light shielding regions that block stray light and prevent flare artifacts, while allowing controlled light passage to the sensor through designated areas, thus improving image quality without compromising the under-display integration
Solution Approach 2:
The light shielding layer is designed with spatially varying properties: light shielding regions are positioned to block harmful stray light paths, while light transmission regions allow desired light to reach the sensor. This local differentiation of light control properties helps eliminate artifacts like blur and flare while maintaining proper light sensing
3Measurement precision
If hole regions are arranged between pixel regions to allow external light reception, then the light sensing capability is improved, but the display area is reduced
Solution Approach 1:
The pixel regions are designed to serve dual purposes: they function as display elements when activated and as light sensing elements when receiving external light. This multi-functionality allows the entire pixel region area to contribute to both display and imaging, eliminating the need for separate hole regions and preserving display area
Solution Approach 2:
The display function and light sensing function are merged into a single integrated structure. The pixel regions combine display capabilities with photodetector functionality, allowing the same physical area to serve both purposes simultaneously or in different modes, thus maximizing space utilization
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution effectively restores image quality to a level comparable to traditional cameras, reducing blur and noise, and producing high-definition images even in environments with occlusion by pixel regions.
Implementation Method 1
an image sensor disposed under the display layer and configured to generate a raw image by sensing the external light received through the hole regions
Implementation Method 2
a processor configured to perform image processing on the raw image based on blur information based on an arrangement of the hole regions
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The application concerns an electronic apparatus comprising a display layer comprising hole regions and pixel regions arranged in a predetermined pattern, an image sensor disposed under the display layer and configured to generate a raw image by capturing light through the hole regions, and a processor configured to process the raw image based on blur information of the hole regions. The application further concerns a method for image acquisition, preferably using the electronic device, the method comprising obtaining a raw image by sensing external light received through hole regions arranged in a display layer using an image sensor disposed under the display layer, and performing image processing on the raw image based on blur information based on an arrangement of the hole regions. Furthermore, the application covers an image acquisition apparatus includes a display layer including hole regions through which external light is received and pixel regions arranged between the hole regions, an image sensor disposed under the display layer and configured to generate a raw image by sensing the external light received through the hole regions, and a processor configured to perform image processing on the raw image based on blur information based on an arrangement of the hole regions.