Under-Display LIDAR Masking Pixel Array for Depth Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Spatial limitations in devices make it difficult to integrate light ranging systems and content displays simultaneously, as traditional light ranging systems are often obtrusive and exposed to potential damage.

Innovation Solution

An under-display LIDAR system that uses an array of light-sensitive pixels, a content display with an array of masking pixels that can switch between opaque and transparent states, and a light source aligned with the masking pixels to project light through the content display, allowing for simultaneous content display and light ranging by selecting the states of the masking pixels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a traditional light ranging system is integrated into a device, then depth sensing capability is achieved, but the system becomes obtrusive and exposed to potential damage

Engineering Contradiction:
Improveprotection of light ranging systemVSAvoidintegration of light ranging system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The light ranging system is nested underneath the content display, with the light source and light-sensitive pixels positioned beneath the display structure. This nesting approach protects the light ranging components from damage while eliminating the need for separate exposed housings, effectively resolving the contradiction between protection and integration complexity.

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

The patent merges the light ranging system with the content display by positioning both components within the same device structure. The light source and light-sensitive pixels are integrated with the display assembly, allowing simultaneous content display and depth sensing functions without requiring separate external housings, thus reducing overall device complexity while achieving protection.

Inventive Principle:
Principle #5Merging (Combining)

2Area of stationary object

If a light ranging system and content display are integrated simultaneously, then spatial constraints are reduced, but the system requires complex coordination of light paths

Engineering Contradiction:
Improvespace for light ranging systemVSAvoidlight path coordination
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The light ranging function is segmented into distinct light source and light-sensitive pixel arrays that are separately positioned beneath the content display. This segmentation allows independent optimization of each component while simplifying the coordination of light paths, as each segment operates independently through the semi-transparent display structure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The content display itself acts as an intermediary element between the light source and the external environment. By positioning the light source beneath the semi-transparent display, the display structure mediates the light path, allowing light to pass through to the target and reflect back to the light-sensitive pixels without requiring complex external optical paths.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If masking pixels are used to enable light passage, then simultaneous content display and light ranging is achieved, but the display structure becomes more complex

Engineering Contradiction:
Improvesimultaneous content display and light rangingVSAvoidmasking pixel array
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The masking pixel array serves multiple functions: it controls light passage for depth sensing, maintains display content visibility, and enables selective transparency regions. By making the display structure itself multi-functional, the patent achieves simultaneous content display and light ranging without adding separate complex control mechanisms, thus resolving the contradiction between versatility and structural complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the integration of light ranging capabilities underneath a content display, reducing spatial constraints and potential damage while allowing for effective data collection and display, with the use of compressed sensing to enhance data efficiency.

Implementation Method 1

a light source aligned with the array of masking pixels so light may be projected through the content display from the light source in illumination patterns

Methodology Applied
Scientific EffectLight projection: Light

Implementation Method 2

an array of light-sensitive pixels aligned with the array of masking pixels to receive light passing through the content display from a three-dimensional environment

Methodology Applied
Scientific EffectLight detection: Photoelectric Effect

Implementation Method 3

an array of masking pixels individually selectable to switch between an opaque state and a transparent state

Methodology Applied
Scientific EffectTransparency switching:

Implementation Method 4

Depth information may be determined from the time of flight between light emission from a light source and detection at a sensor

Methodology Applied
Scientific EffectTime of flight measurement: Time of Flight

Data Source

PatentUS20230221436A1Sparse under display lidar
Publication Date: 2023.07.13 STMICROELECTRONICS (RES & DEV) LTD
  • US20230221436A1 patent drawing
  • US20230221436A1 patent drawing
  • US20230221436A1 patent drawing

AI summary

A system to sample light including an array of light-sensitive pixels and a content display. The content display includes an array of content-display pixels; and an array of masking pixels individually selectable to switch between an opaque state and a transparent state, the array of masking pixels being aligned with the array of light-sensitive pixels so light-sensitive pixels may be selected to receive light passing through the content display by selecting the states of the array of masking pixels.