Smart Glasses Facial Expression Sensing With LFI Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Camera-based systems for facial expression detection require significant installation space and high power consumption, and their functionality is compromised by excessive light exposure.

Innovation Solution

The use of laser feedback interferometer (LFI) sensors, particularly vertical cavity surface-emitting lasers (VCSELs), to emit and capture laser radiation for facial expression analysis, enabling robust detection through optical feedback interferometry and self-mixing interference, allowing miniaturization and reduced energy consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If camera-based systems are used for facial expression detection, then facial expression information can be captured and analyzed, but the installation space required increases and power consumption becomes high

Engineering Contradiction:
Improvefacial expression detection accuracyVSAvoidinstallation space
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent replaces camera-based optical systems with laser feedback interferometer sensors that use laser radiation and optical feedback interferometry to detect facial expressions. This substitution of the detection mechanism enables miniaturization while maintaining measurement precision, directly resolving the contradiction between detection accuracy and installation space requirements

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the detection parameter from broad spectral camera detection to specific laser wavelength detection using LFI sensors. This parameter change allows for more compact sensor design while preserving facial expression detection capability, addressing the space versus precision contradiction

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If camera-based systems are used for facial expression detection, then facial expression information can be captured and analyzed, but power consumption becomes high

Engineering Contradiction:
Improvefacial expression detection accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by stationary object

Solution Approach 1:

The patent substitutes camera-based detection with laser feedback interferometer sensors that consume lower power while achieving comparable or superior measurement precision for facial expression detection, directly resolving the power consumption versus detection accuracy contradiction

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent employs periodic modulation of laser radiation emission and evaluation cycles, allowing the system to achieve accurate facial expression detection through intermittent measurement rather than continuous operation, thereby reducing overall power consumption while maintaining detection precision

Inventive Principle:
Principle #19Periodic action

3Measurement precision

If camera-based systems are used for facial expression detection, then facial expression information can be captured, but functionality is limited when excessive light is present

Engineering Contradiction:
Improvefacial expression detection capabilityVSAvoidlight interference
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent changes the detection wavelength to specific laser wavelengths that are less susceptible to interference from ambient light conditions. This parameter change enables the system to maintain facial expression detection capability across varying lighting environments, resolving the contradiction between detection capability and light interference

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces camera-based detection with LFI sensors that use coherent laser light and optical feedback interferometry, which are inherently more resistant to ambient light interference. This substitution resolves the vulnerability to light conditions while preserving detection precision

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Area of stationary object

If LFI sensors are used for facial expression detection, then installation space and power consumption are reduced, but the system must accurately process optical feedback signals

Engineering Contradiction:
Improvedevice sizeVSAvoidsignal processing complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent combines the laser light source, photodetector, and signal processing functions into an integrated LFI sensor module. This merging reduces the overall device size while consolidating the complexity into a compact, unified structure that maintains accurate signal processing capability

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent employs self-mixing interference where the laser cavity itself serves as the detection element. The laser's own output interferes with reflected light from the target, eliminating the need for separate local oscillators and complex external interference patterns, thereby reducing device complexity while maintaining miniaturization

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The LFI sensors provide efficient and robust facial expression detection, minimizing space and power requirements while maintaining accuracy, even in varying lighting conditions, and enabling integration into smart glasses for real-time facial expression analysis.

Implementation Method 1

The evaluation of the backscattered and/or reflected radiation is particularly advantageously carried out on the basis of optical feedback interferometry

Methodology Applied
Scientific EffectOptical feedback interferometry: Interference

Implementation Method 2

The measurement principle underlying the method is preferably based on the method that is also referred to as self-mixing interference (SMI). Laser radiation is reflected by an object, for example the reference area, and scattered or reflected back into the laser cavity that generates the laser. The reflected light then interferes with the beam generated in the laser cavity

Methodology Applied
Scientific EffectSelf-mixing interference: Interference

Implementation Method 3

Laser radiation is reflected by an object, for example the reference area, and scattered or reflected back into the laser cavity that generates the laser

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 4

Laser radiation is reflected by an object, for example the reference area, and scattered or reflected back into the laser cavity that generates the laser

Methodology Applied
Scientific EffectScattering: Scattering

Implementation Method 5

If a reference point moves in relation to the LFI sensor, for example, this causes a change in the frequency of the backscattered laser light due to the Doppler effect

Methodology Applied
Scientific EffectDoppler effect: Doppler Effect

Data Source

PatentUS20260099198A1Smart glasses with facial expression detection
Publication Date: 2026.04.09 ROBERT BOSCH GMBH
  • US20260099198A1 patent drawing
  • US20260099198A1 patent drawing
  • US20260099198A1 patent drawing

AI summary

A device, in particular smart glasses, which, when worn by a user as intended, is configured to be worn on the body of the user, in particular the head of the user, and a method for operating such a device. The device is configured to use reflected laser radiation to derive information about a reference area, and to provide the information about the reference area for the purpose of displaying a virtual target object, in particular an avatar that represents the user of the device, in particular to a further device.