Camera Behind Display Pixel Density Gap Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge is to implement a camera behind a display of a mobile electronic device without obstructing the light path, as existing solutions result in degraded image quality due to pixel and subpixel arrangements in the display technology.

Innovation Solution

A device with a digital camera unit positioned behind the display layer, where sensor pixels are arranged in a matrix with specific densities and gaps, allowing subsets of pixels to capture image data through or around display pixels, optimizing light capture and image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the front-facing camera is placed behind the display surface to increase display area, then the display area is increased, but the image quality is degraded due to pixel and subpixel arrangements obstructing the light path

Engineering Contradiction:
Improvedisplay areaVSAvoidimage quality
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The sensor pixels are segmented into different subsets (first subset covered by display pixels, second subset exposed through gaps, third subset partially covered) to capture image data through different paths, allowing the system to overcome the obstruction caused by display pixels while maintaining high display area coverage

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the sensor matrix have different characteristics - some pixels are fully covered, some are fully exposed, and some are partially covered. This local differentiation allows each pixel to optimize for its specific light capture conditions, improving overall image quality despite the display overlay

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If the sensor pixel density is increased to improve image quality, then the image quality is improved, but the obstruction by display pixels becomes more significant

Engineering Contradiction:
Improveimage qualityVSAvoidlight path obstruction
Core Design Contradiction:
Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

The patent utilizes the vertical dimension by placing the camera sensor behind the display layer, creating a three-dimensional arrangement where light must pass through the display pixels. This dimensional change allows the system to achieve high sensor pixel density while managing the light obstruction issue through the gap structure and multi-subset pixel arrangement

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Manufacturing precision

If the display pixels are made smaller to increase pixel density, then the display resolution is improved, but the gaps between pixels become smaller reducing light capture

Engineering Contradiction:
Improvedisplay resolutionVSAvoidlight capture efficiency
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent changes the parameter of pixel density relationship between display and sensor layers. By making the sensor pixel density at least twice the display pixel density and creating a specific gap pattern, the system optimizes light capture efficiency while maintaining high display resolution

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration enhances image capture quality by ensuring that a higher density of sensor pixels can capture image data through gaps in the display pixels, increasing the effective light capture and reducing visual obstructions, thus improving the display area without compromising image quality.

Implementation Method 1

a second subset of sensor pixels align with, and are exposed through, the gaps between the display pixels

Methodology Applied
Scientific EffectLight transmission: Light

Data Source

PatentUS11076071B2Device having a camera overlaid by display and method for implementing same
Publication Date: 2021.07.27 LENOVO SWITZERLAND INTERNATIONAL GMBH
  • US11076071B2 patent drawing
  • US11076071B2 patent drawing
  • US11076071B2 patent drawing

AI summary

A device, method and computer program product are provided. The device includes a housing having display and back surfaces. A digital camera unit (DCU) is held in the housing and is oriented to face the display surface. The DCU includes sensor pixels to capture image data for a scene in a field of view of the DCU. The sensor pixels are arranged in a sensor matrix with a sensor pixel density. A display layer is held in the housing proximate to the display surface. The display layer includes display pixels arranged in a display matrix having a first pixel density. The display pixels are separated by gaps arranged in rows and columns. The display layer overlays the DCU such that a first subset of the sensor pixels aligns with, and are covered by, the display pixels and a second subset of the sensor pixels align with, and are exposed through, the gaps between the display pixels. The device includes a processor and memory storing program instructions accessible by the processor. Responsive to execution of the program instructions, the processor performs graphical user interface (GUI) related operations to display content on the display layer and performs an image capture operation to obtain image data utilizing the DCU.