Under-display Camera with Porous Screen and Depth Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional electronic devices with integrated cameras and displays often require a large, unsightly black border or cutout to accommodate the camera, limiting the screen-to-body ratio and aesthetics.

Innovation Solution

The implementation of an under-display imaging system that includes a first and second camera configured to capture images through a porous display, with a depth map generator using stereopsis to extract depth information, eliminating the need for a black border by utilizing the display's holes or gaps to transmit light and filter out noise with a neural network model.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the camera is disposed adjacent to the display within a notch or cutout, then the camera can capture images, but the screen-to-body ratio is limited and the appearance is degraded due to black borders

Engineering Contradiction:
Improvescreen-to-body ratioVSAvoidimage quality
Core Design Contradiction:
Area of stationary objectVSDifficulty of detecting and measuring

Solution Approach 1:

The camera is nested behind the display, with the imaging sensor positioned in a recessed area beneath the display surface. This allows the camera to be integrated within the display structure itself, eliminating the need for notches or cutouts while maintaining imaging functionality through the display's porous structure

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

The display utilizes a porous structure with holes or gaps that allow light to pass through from the external environment to the camera sensor positioned behind the display. This porous configuration enables the camera to capture images while being hidden beneath the display surface, achieving both aesthetic integration and functional performance

Inventive Principle:
Principle #31Porous materials

2Area of stationary object

If the camera is disposed behind the display, then the screen-to-body ratio is improved and infinity display design is enabled, but the camera must capture images through a porous display which partially occludes light

Engineering Contradiction:
Improvedisplay areaVSAvoidlight transmission
Core Design Contradiction:
Area of stationary objectVSIllumination intensity

Solution Approach 1:

A light source is positioned proximate to the display to pre-illuminate the scene before light reaches the camera. This preliminary lighting action compensates for the light occlusion caused by the porous display structure, ensuring sufficient illumination reaches the sensor positioned behind the display

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The porous display structure acts as an intermediary between the external environment and the camera sensor. While it partially occludes light, it also provides structural support and integration, allowing the camera to be positioned behind the display while maintaining a functional optical path through the porous structure

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enhances the screen-to-body ratio, supports infinity display designs, and enables effective depth sensing and image processing without the visual obstructions of traditional camera placements.

Implementation Method 1

configured to capture a first image through a porous display, wherein capturing the first image includes detecting reflections of light emitted by the first light source

Methodology Applied
Scientific EffectLight transmission through porous material: Porosity

Data Source

PatentUS11516374B2Under-display image sensor
Publication Date: 2022.11.29 SYNAPTICS INC
  • US11516374B2 patent drawing
  • US11516374B2 patent drawing
  • US11516374B2 patent drawing

AI summary

A device includes a display and a first light source configured to emit light, wherein the first light source is proximate to the display. The device further includes a first camera disposed behind the display, wherein the first camera is configured to detect reflections of the light emitted by the first light source. The first camera is further configured to capture a first image based at least in part on the reflections, wherein the reflections are partially occluded by the display. The device also includes a second camera proximate to the display, wherein the second camera is configured to capture a second image. In addition, the device includes a depth map generator configured to generate depth information about one or more objects in a field-of-view (FOV) of the first and second cameras based at least in part on the first and second images.