Display-Integrated Optical Channels for Hyper-Resolution Dot Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies for depth-map determination in facial recognition, such as face ID or face recognition, rely on methods like structured illumination or active stereo, which require projecting a non-regular dot pattern and capturing it with imaging devices, leading to distortion and a need for compact means to integrate dot pattern capture with display devices.

Innovation Solution

A device with multiple imaging optical channels and detector pixel arrangements is integrated with a display, allowing for hyper-resolution evaluation of a projected dot pattern by comparing signal intensities of different detector pixels, enabling compact devices capable of depth-map production and facial recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple imaging devices are used to capture the projected dot pattern with high accuracy, then depth-map determination precision is improved, but device size and complexity increase

Engineering Contradiction:
Improvedepth-map determination precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple imaging functions into a single integrated device by merging the display means with the imaging optical channels and detector pixel arrangements. The display pixels serve both as display elements and as reference points for depth measurement, while the imaging channels capture both the projected dot pattern and the reflected light from the display, eliminating the need for separate imaging devices and reducing overall system complexity while maintaining measurement precision

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The display pixels are given dual functionality: they serve as graphic display elements and simultaneously as calibration reference points for the depth-sensing system. The imaging optical channels perform both dot pattern capture and display pattern recognition. This multi-functionality reduces the number of separate components needed, thereby reducing device complexity while preserving measurement accuracy

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If traditional separate imaging devices are used for dot pattern capture, then imaging function is achieved, but integration with display device is poor and overall size increases

Engineering Contradiction:
Improveintegration with display deviceVSAvoidoverall device size
Core Design Contradiction:
Adaptability or versatilityVSVolume of moving object

Solution Approach 1:

The patent merges the display device and imaging device into a single integrated unit. The display means and imaging optical channels are positioned such that the optical channels pass through the display plane, allowing both functions to share the same physical space. This integration dramatically reduces the overall device volume while improving adaptability, as the system can now function as both a display and a depth-sensing device without requiring separate housings or mounting structures

Inventive Principle:
Principle #5Merging (Combining)

3Volume of moving object

If display pixels are used for both display and imaging reference, then device compactness is improved, but signal intensity comparison complexity increases

Engineering Contradiction:
Improvedevice compactnessVSAvoidsignal evaluation complexity
Core Design Contradiction:
Volume of moving objectVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary evaluation process that compares signal intensities between detector pixels receiving reflected light from the display pixels and detector pixels receiving light from the projected dot pattern. This intermediary comparison step serves as a mediator that resolves the complexity by providing a systematic method to differentiate between display pixel signals and dot pattern signals, enabling compact integration while managing evaluation complexity through structured signal processing

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This integration allows for accurate depth-map determination and facial recognition without the need for large optical systems, providing a compact and efficient solution for devices like smart watches.

Implementation Method 1

each of which includes an optic and at least one detector pixel arrangement; the plurality of optical channels being configured to obtain an image of a dot pattern of a field of view by imaging said field of view

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS12380665B2Device and method of capturing a projected dot pattern in a display device
Publication Date: 2025.08.05 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US12380665B2 patent drawing
  • US12380665B2 patent drawing
  • US12380665B2 patent drawing

AI summary

A device includes a plurality of imaging optical channels inclined in relation to one another, each of which includes an optic and at least one detector pixel arrangement. The plurality of optical channels are configured to obtain an image of a dot pattern of a field of view by imaging said field of view. The optical channels pass through the display plane and are set up for imaging (projecting) the field of view between the display pixels. The device includes an evaluator that is coupled to detector pixels of the detector pixel arrangements and configured to evaluate the dot pattern on the basis of a comparison, which causes hyper resolution, of signal intensities of different detector pixels so as to obtain an evaluation result, and to control the device at least partly on the basis of the evaluation result.