Translucent Display Depth Measurement with Diffracted Structured Light

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 3D imaging systems face challenges when integrated under transparent or translucent displays due to microstructure interference, low light transmission, and diffraction effects, which hinder reliable depth measurement.

Innovation Solution

A display device with an illumination source projecting an illumination pattern, an optical sensor capturing reflection features, and an evaluation device analyzing beam profiles to generate a depth map, utilizing a translucent display with an integrated 3D imaging system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a 3D imaging system is placed under a translucent display, then the display area can be maximized and frame can be minimized, but the microstructure of the display causes diffraction effects that degrade measurement precision

Engineering Contradiction:
Improvedisplay areaVSAvoiddepth measurement precision
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent converts the harmful diffraction effect caused by the display's microstructure into a useful measurement signal. By analyzing the diffraction pattern generated when structured light passes through the display, the system retrieves depth information while compensating for the display's interference, thus transforming the obstacle into an advantageous measurement mechanism

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Solution Approach 2:

The system changes the parameters of the illumination light (wavelength, angle, pattern) to optimize the diffraction effect for measurement purposes. By adjusting these parameters, the system can distinguish between diffraction caused by the display microstructure and actual depth information, maintaining measurement precision while using the display's full area

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If the display structure is made transparent or translucent, then the display can be integrated with the 3D imaging system, but the light transmission through the display is reduced, requiring higher illumination power

Engineering Contradiction:
Improveintegration capabilityVSAvoidillumination power
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent replaces traditional high-power illumination mechanisms with a more efficient optical approach. By using structured light patterns and analyzing diffraction effects, the system achieves effective depth measurement with lower illumination power, substituting mechanical intensity increase with optical pattern optimization

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system uses composite illumination strategies combining multiple wavelengths and patterns to optimize light transmission through the translucent display. This composite approach allows the display to maintain its transparent/translucent properties for integration while compensating for light loss through intelligent illumination design

Inventive Principle:
Principle #40Composite materials

3Area of stationary object

If traditional structured light with many projection points is used, then complete scene coverage is achieved, but the low light transmission of the display requires very high output power that may not be detectable by the imager

Engineering Contradiction:
Improvescene coverageVSAvoidprojector output power
Core Design Contradiction:
Area of stationary objectVSPower

Solution Approach 1:

The patent segments the illumination into structured light patterns that exploit the display's diffraction properties. By dividing the scene coverage into manageable diffraction orders and using the display's microstructure as a diffraction grating, the system achieves complete scene coverage with lower power requirements while maintaining detection capability

Inventive Principle:
Principle #1Segmentation

4Measurement precision

If 3D-ToF sensors are used behind the display, then depth measurement can be performed, but reflections on the display surfaces and multiple reflections prevent robust functionality

Engineering Contradiction:
Improvedepth measurement capabilityVSAvoidfunctionality robustness
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

Instead of placing the 3D-ToF sensor behind the display (which causes multiple reflections), the patent inverts the approach by placing the sensor in front of the display and using the display as a diffraction element. This inversion eliminates the multiple reflection problem while maintaining depth measurement capability through diffraction-based structured light analysis

Inventive Principle:
Principle #13The other way round (Inversion)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables reliable depth measurement through displays with reduced technical effort and resource requirements, overcoming microstructure interference and diffraction issues.

Implementation Method 1

The microstructure of the transparent or translucent display works like a diffraction grating structure for laser light

Methodology Applied
Scientific EffectDiffraction: Diffraction

Implementation Method 2

the low light transmission through the display

Methodology Applied
Scientific EffectLight transmission: Absorption (EM radiation)

Implementation Method 3

an optical sensor having at least one light sensitive area, wherein the optical sensor is configured for determining at least one first image comprising a plurality of reflection features

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Implementation Method 4

evaluating the first image comprises identifying the reflection features of the first image and sorting the identified reflection features with respect to brightness

Methodology Applied
Scientific EffectTriangulation:

Data Source

PatentUS12406384B2Depth measurement through display
Publication Date: 2025.09.02 TRINAMIX GMBH
  • US12406384B2 patent drawing
  • US12406384B2 patent drawing
  • US12406384B2 patent drawing

AI summary

Disclosed herein is a display device includinga. at least one illumination source configured for projecting at least one illumination pattern comprising a plurality of illumination features on at least one scene;b. at least one optical sensor having at least one light sensitive area, wherein the optical sensor is configured for determining at least one first image comprising a plurality of reflection features generated by the scene in response to illumination by the illumination features;c. at least one translucent display configured for displaying information, wherein the illumination source and the optical sensor are placed in direction of propagation of the illumination pattern in front of the display; andd. at least one evaluation device for analyzing the first image, wherein the evaluation device is configured for unambiguously matching of reflection features with corresponding illumination features.