Under-Panel Camera Transmittance and Super-Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Under panel cameras (UPCs) in electronic devices, such as smartphones and tablets, typically capture images of inferior quality compared to rear-facing cameras due to the structural limitations of the display panel and camera module arrangement.

Innovation Solution

An electronic device design that includes a display panel with a first region of standard pixels and a second region of higher transmittance, where the camera module and actuator are positioned under the second region to capture multiple images at different locations, and a processor uses a super-resolution algorithm to generate a high-resolution image from these images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the camera module is arranged under the display panel (UPC structure), then the device achieves a more integrated design and front-facing functionality, but the image quality deteriorates due to reduced light transmittance through the display panel

Engineering Contradiction:
Improveintegration of camera and displayVSAvoidimage quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The display panel is divided into a first region with standard pixels and a second region with higher transmittance. The camera module is positioned to overlap specifically with the second region, allowing selective optimization of light transmission in the camera area while maintaining normal display functionality in other areas.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The display panel employs different transmittance characteristics in different regions: the first region has standard pixel density and transmittance for normal display, while the second region has higher transmittance specifically optimized for camera light transmission. This local differentiation resolves the contradiction between integration and image quality.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If multiple images are captured at different locations to improve resolution, then the image resolution improves through super-resolution algorithms, but the capture time and processing complexity increase

Engineering Contradiction:
Improveimage resolutionVSAvoidimage capture and processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The actuator pre-positions the camera module at multiple predetermined locations within the second region before image capture. These locations are optimized in advance to maximize light transmission while enabling effective super-resolution processing, reducing both capture time and processing complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of capturing images across the entire display panel, the system captures images only at multiple locations within the optimized second region. This partial action approach achieves sufficient resolution improvement while minimizing capture time and processing requirements.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances image quality by overcoming the transmittance reduction issues inherent in UPC structures, allowing for improved image capture and resolution without the need for additional hardware modifications.

Implementation Method 1

a lens configured to collect light emitted from the subject and an image sensor configured to obtain the first images using the collected light

Methodology Applied
Scientific EffectLight transmission: Light

Implementation Method 2

The actuator is configured to move the camera module while capturing each of the plurality of first images

Methodology Applied
Scientific EffectMechanical movement: Displacement

Implementation Method 3

The processor is configured to obtain a second image having a second resolution higher than the first resolution using the first images captured

Methodology Applied
Scientific EffectImage processing: Image Processing

Data Source

PatentUS11743568B2Electronic device and driving method of electronic device
Publication Date: 2023.08.29 SAMSUNG DISPLAY CO LTD
  • US11743568B2 patent drawing
  • US11743568B2 patent drawing
  • US11743568B2 patent drawing

AI summary

A electronic device includes a display panel including a first region in which a plurality of pixels and a second region having a higher transmittance than the first region, and an electronic module disposed under the display panel and overlapping the second region. The electronic module includes a camera module configured to image a subject to obtain a plurality of first images having a first resolution, an actuator configured to move the camera module while capturing each of the plurality of first images, and a processor configured to obtain a second image having a second resolution higher than the first resolution using the first images captured.