Under-display Camera Image Sensor with Hole Region Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Under-display cameras (UDCs) face challenges in capturing high-quality images due to the presence of pixel regions in the display layer, which cause image degradation such as blur and noise, as external light passes through hole regions, leading to suboptimal image quality.

Innovation Solution

The image acquisition apparatus incorporates a display layer with alternately arranged pixel and hole regions, where the hole regions are larger and optimized in size and spacing to minimize image degradation, and a processor performs image processing using blur information based on the hole regions' arrangement, including preprocessing and neural network-based image restoration to enhance image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If hole regions are made larger to allow more external light to be received, then light reception capability is improved, but image degradation such as blur and noise increases

Engineering Contradiction:
Improvelight reception capabilityVSAvoidimage degradation
Core Design Contradiction:
Illumination intensityVSObject-affected harmful factors

Solution Approach 1:

The patent applies parameter changes by systematically optimizing multiple parameters of the hole regions including size, shape, depth, and spacing arrangements. By adjusting these parameters, the system achieves optimal balance between light reception capability and image quality, allowing larger effective aperture while controlling optical degradation through precise parameter control.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces depth as an additional dimension by controlling the depth of hole regions in the display layer. This vertical dimension allows optimization of light reception area while managing optical path characteristics to reduce blur and noise, effectively resolving the contradiction between aperture size and image quality.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If hole regions are arranged closer to pixel regions to maximize light reception, then light gathering efficiency is improved, but optical interference and image quality deteriorate

Engineering Contradiction:
Improvelight gathering efficiencyVSAvoidoptical interference
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by creating spatially varying arrangements of hole regions with different characteristics in different areas. The hole regions are positioned and sized differently based on local optical requirements, allowing optimal light gathering in some areas while maintaining image quality in others, thus resolving the contradiction between efficiency and interference.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If image processing algorithms are applied to correct blur and noise, then image quality is improved, but processing complexity and computational load increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing blur information based on the known hole region arrangements before actual image capture. This pre-computed optical characteristic data is then used during image processing to guide deconvolution and restoration algorithms, reducing real-time computational complexity while maintaining high image quality correction effectiveness.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enables the generation of high-definition images by reducing image degradation factors like blur and noise, resulting in improved image quality comparable to traditional camera captures, even in UDC configurations.

Implementation Method 1

an image sensor disposed under the display layer and configured to generate a raw image by sensing the external light received through the hole regions

Methodology Applied
Scientific EffectLight sensing: Photoelectric Effect

Data Source

PatentUS11272106B1Method and apparatus for image acquisition including image sensor
Publication Date: 2022.03.08 SAMSUNG ELECTRONICS CO LTD
  • US11272106B1 patent drawing
  • US11272106B1 patent drawing
  • US11272106B1 patent drawing

AI summary

An image acquisition apparatus includes a display layer including hole regions through which external light is received and pixel regions arranged between the hole regions, an image sensor disposed under the display layer and configured to generate a raw image by sensing the external light received through the hole regions, and a processor configured to perform image processing on the raw image based on blur information based on an arrangement of the hole regions.