Integrated Display Image Sensor Luminance Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display devices for augmented reality and virtual reality applications face challenges in controlling display luminance, leading to issues like flare and ghosting when an image sensor is integrated, which affects the quality of the imaged image.

Innovation Solution

A display device configuration that integrates an image sensor into a silicon substrate with a semiconductor layer, including a pixel circuit and light emitting elements, where a display driver controls the pixel circuit and luminance, generating black image data to minimize luminance impact during imaging, and an image sensor activation signal determines the imaging frame based on counting black image data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If the image sensor is integrated into the display panel, then the device size is reduced, but flare and ghosting occur during imaging

Engineering Contradiction:
Improvedevice sizeVSAvoidflare and ghosting
Core Design Contradiction:
Volume of moving objectVSObject-generated harmful factors

Solution Approach 1:

The patent extracts the harmful light by introducing a light shielding layer that blocks light from reaching the image sensor during display operation. This separates the display function from the imaging function by selectively blocking light paths, thereby eliminating flare and ghosting while maintaining the integrated structure.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The light shielding layer is positioned in advance to prevent harmful light from reaching the image sensor before it can cause flare or ghosting. This preliminary blocking action occurs during the display phase to ensure clean imaging when the sensor operates.

Inventive Principle:
Principle #9Preliminary anti-action

2Illumination intensity

If display luminance is high, then display quality is improved, but image quality deteriorates due to flare and ghosting

Engineering Contradiction:
Improvedisplay luminanceVSAvoidimage quality
Core Design Contradiction:
Illumination intensityVSManufacturing precision

Solution Approach 1:

The patent implements dynamic control of the light shielding layer, which can be selectively activated or deactivated based on whether the device is in display mode or imaging mode. This allows the system to maintain high display luminance when needed while eliminating light interference during imaging operations.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The light shielding layer is strategically positioned only in regions where light interference would affect the image sensor, allowing other regions to maintain full display luminance. This localized approach preserves overall display quality while eliminating specific harmful light paths.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If the display panel and image sensor are packaged separately, then imaging performance is maintained, but device complexity increases

Engineering Contradiction:
Improveimaging performanceVSAvoidpackage structure
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent merges the display panel and image sensor into a single integrated package, sharing common structural elements and control circuits. This integration maintains imaging performance by using the light shielding layer to prevent interference, while simultaneously reducing device complexity compared to separate packaging.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The integrated structure serves multiple functions: the display panel provides visual output, the image sensor captures images, and the light shielding layer manages light paths between them. This multi-functional design eliminates the need for separate packaging while maintaining both display and imaging capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration allows for an ultra-small display device, reduces flare and ghosting, and improves image quality by integrating the image sensor and display panel as a single package, enabling effective control of display luminance during imaging.

Implementation Method 1

an image sensor is integrated into display-on silicon

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Implementation Method 2

light emitting elements disposed on the semiconductor layer and electrically connected to the pixel circuit

Methodology Applied
Scientific EffectElectroluminescence: Electroluminescence

Data Source

PatentUS11955086B2Display device and electronic device including the same
Publication Date: 2024.04.09 SAMSUNG DISPLAY CO LTD
  • US11955086B2 patent drawing
  • US11955086B2 patent drawing
  • US11955086B2 patent drawing

AI summary

A display device includes a silicon substrate; a semiconductor layer provided on the silicon substrate and including a pixel circuit; an image sensor provided on the silicon substrate and activated based on an imaging instruction; light emitting elements disposed on the semiconductor layer and electrically connected to the pixel circuit; and a display driver electrically connected to the pixel circuit to control the pixel circuit and to control image luminance of an imaging frame in which the image sensor is activated.