Spatial Light Modulator Projection for Integrated Gesture Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing projection systems for vehicles and interactive surfaces require complex and costly additional sensor modules for gesture and touch recognition, which increase system complexity, cost, and limit compact design, while also struggling with angular offsets and unwanted reflections.

Innovation Solution

An optical arrangement using a spatial modulator for light, a light source, and a sensor to detect changes in modulated light, allowing for user interaction without additional sensor modules, enabling cost-effective and compact design with improved reflection management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If additional sensor modules (laser scanner, ToF sensors, infrared sensors) are integrated to enable gesture and touch recognition, then interaction capability is improved, but device complexity and cost increase significantly

Engineering Contradiction:
Improveinteraction capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the projection function and detection function into a single optical system. The projector uses a spatial modulator (DMD or LCD) that can be driven with modulated light signals, and the same modulator serves as the detection element by analyzing backscattered light. This eliminates the need for separate sensor modules while maintaining interaction capability.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The spatial modulator in the projector is given dual functionality: it acts as both the projection element (by modulating light to create images) and the detection element (by analyzing changes in backscattered modulated light to detect gestures and touches). This multi-functionality reduces system complexity and component count.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If additional sensor modules are physically separated from the projector to enable detection, then detection function is improved, but compact design becomes difficult and system complexity increases

Engineering Contradiction:
Improvedetection functionVSAvoidcompact design
Core Design Contradiction:
Adaptability or versatilityVSVolume of moving object

Solution Approach 1:

The detection function is merged into the existing projector structure by utilizing the spatial modulator's ability to both project and detect. No separate sensor module is needed, allowing for a compact integrated design where projection and detection coexist within the same device footprint.

Inventive Principle:
Principle #5Merging (Combining)

3Adaptability or versatility

If camera is used to detect gestures and movements, then interaction detection is improved, but angular offset between projector and camera lens occurs causing detection accuracy to deteriorate

Engineering Contradiction:
Improvegesture detectionVSAvoidangular offset accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The spatial modulator serves as both projector and detector, eliminating the angular offset problem that occurs with separate camera systems. Since the same optical element performs both functions, there is no misalignment between projection and detection axes, improving measurement precision for gesture and touch detection.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Measurement precision

If additional illumination unit with pulsed laser beam is used for ToF sensing, then touch detection accuracy is improved, but cost and device complexity increase

Engineering Contradiction:
Improvetouch detection accuracyVSAvoidillumination unit complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The illumination function and detection function are merged into the projector system. The projector's light source provides the illumination, and the spatial modulator modulates this light. The same modulator then detects the backscattered modulated light, eliminating the need for separate pulsed laser units and complex illumination systems while maintaining touch detection accuracy.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient and cost-effective user interaction with projections by detecting changes in modulated light, reducing system complexity and eliminating the need for additional sensor modules, while allowing simultaneous detection on both sides of a pane and improved resistance to environmental reflections.

Implementation Method 1

The sensor is formed in such a way that it is able to detect the light emitted by the light source, in particular backscattered and/or scattered light, of the projection region

Methodology Applied
Scientific EffectBackscattering: Scattering

Implementation Method 2

The sensor is formed in such a way that it is able to detect the light emitted by the light source, in particular backscattered and/or scattered light, of the projection region

Methodology Applied
Scientific EffectScattering: Scattering

Implementation Method 3

The light source can be at least temporarily modulated and the modulator can be driven such that at least one partial area or operating range of the projection region can be irradiated with the modulated light

Methodology Applied
Scientific EffectLight modulation: Phase Modulation

Data Source

PatentUS12081918B2Optical arrangement and method
Publication Date: 2024.09.03 AMS OSRAM AUTOMOTIVE LIGHTING SYST GMBH
  • US12081918B2 patent drawing
  • US12081918B2 patent drawing
  • US12081918B2 patent drawing

AI summary

The invention relates to an optical arrangement comprising at least one spatial modulator for light, comprising at least one light source and comprising at least one projection region, it being possible for the spatial modulator to be irradiated by the light from the light source and the projection region being connected downstream of the spatial modulator in the beam path of the light, characterized in that the light source can be at least temporarily modulated and the modulator can be controlled such that at least one portion of the projection region can be irradiated by the modulated light, and in that the optical arrangement comprises at least one sensor, by means of which a change to the modulatable light owing to a body approaching and/or retreating and/or being arranged at or in the portion can be detected. The invention further relates to a method using the optical device.