Camera Behind Semi-Transparent Display Panel

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The increasing complexity of front-facing camera systems in electronic devices leads to a reduction in display resolution and viewing area, as space designated for cameras is expanded, resulting in limited graphical user interfaces and aesthetic quality.

Innovation Solution

The electronic device captures images through a semi-transparent region of the display panel using a camera disposed behind the display, determining point spread functions for each color component and performing deconvolution using Richardson-Lucy or Tikhonov regularized inverse filter deconvolution to generate a reconstructed image, thereby removing blurring effects and enhancing image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the camera system complexity is increased to improve imaging functionality, then the camera capabilities are enhanced, but the display area and resolution are reduced

Engineering Contradiction:

Improvecamera system capabilitiesVSAvoiddisplay area

Core Design Contradiction:

Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The camera system is nested behind the display panel, with the camera lens positioned behind the semi-transparent display. This allows the camera to be integrated within the display structure itself, eliminating the need for separate camera housing space and enabling full-screen display area while maintaining camera functionality.

Inventive Principle:

Principle #7Nested doll (Nesting)

Solution Approach 2:

The camera system transitions from a lateral arrangement (side-by-side with display) to a depth arrangement (behind the display). By moving the camera to the z-dimension (behind the display panel), the display can occupy the full front surface area without camera obstructions, resolving the space conflict between camera and display.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If the camera system complexity is increased to improve imaging functionality, then the camera capabilities are enhanced, but the display resolution is reduced

Engineering Contradiction:

Improvecamera system capabilitiesVSAvoiddisplay resolution

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The camera is nested behind the display panel, allowing the display to maintain its full resolution without being compromised by camera cutouts or reduced pixel density. The camera and display operate in different spatial planes, enabling both high-resolution display and advanced camera capabilities simultaneously.

Inventive Principle:

Principle #7Nested doll (Nesting)

3Area of stationary object

If the camera is disposed behind the display, then the display area is maximized, but image quality degradation occurs due to blurring effects

Engineering Contradiction:

Improvedisplay areaVSAvoidimage quality

Core Design Contradiction:

Area of stationary objectVSManufacturing precision

Solution Approach 1:

A semi-transparent display panel serves as an intermediary medium between the external scene and the camera sensor. This semi-transparent panel allows light to pass through to the camera while maintaining display functionality, enabling the camera to capture images through the display without complete opacity blocking the view.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The display panel's transparency parameter is optimized to allow sufficient light transmission for camera imaging while maintaining adequate display visibility. By adjusting the transparency parameter of the display material, the system achieves a balance between display area maximization and image quality preservation.

Inventive Principle:

Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach increases the viewing area and resolution of the display, allowing for full-screen views and improved user experiences, including the ability to place cameras centrally, enhancing graphical user interfaces and aesthetic quality.

Implementation Method 1

capturing, by a camera disposed behind a display panel of the electronic device, an original image through a semi-transparent pixel region of the display panel

Methodology Applied

Scientific EffectLight transmission through semi-transparent material: Absorption (EM radiation)

Implementation Method 2

performing, for a plurality of pixel regions of the original image, a deconvolution of each of the number of color components of the original image based on their respective PSFs

Methodology Applied

Scientific EffectDeconvolution filtering: Image Processing

Data Source

PatentUS11575865B2Processing images captured by a camera behind a display

Publication Date: 2023.02.07 SAMSUNG ELECTRONICS CO LTD

AI summary

A method includes capturing, by a camera disposed behind a display panel of an electronic device, an original image through a semi-transparent pixel region of the display panel. The original image includes one or more color components. The method further includes determining, for a plurality of pixel regions of the original image, a point spread function (PSF) for each of the one or more color components. The method further includes performing, for the plurality of pixel regions of the original image, a deconvolution of each of the one or more color components of the original image based at least in part on their respective PSFs. The method thus includes generating a reconstructed image corresponding to the original image based on the deconvolutions of the one or more color components of the plurality of pixel regions of the original image.