Facial Expression Tracking via Photon Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing facial tracking systems require cameras and complex image data processing, leading to high costs and computational overhead, making them inefficient for real-time facial expression tracking in VR, AR, and MR applications.
Innovation Solution
A facial tracking system utilizing an illuminator and photon detectors without lenses, coupled with processors and software algorithms to reconstruct facial expressions based on light characteristics, reducing the need for cameras and complex image processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If cameras and complex image data processing are used for facial tracking, then facial expression tracking capability is achieved, but system cost and computational overhead increase significantly
Solution Approach 1:
The patent extracts and removes the camera component from the facial tracking system, replacing it with photon detectors that directly sense light reflected from facial muscles. This eliminates the need for complex image processing while maintaining facial expression tracking capability through direct optical measurement of muscle movements.
Solution Approach 2:
The patent replaces the mechanical/optical system of cameras and image processing algorithms with a direct photodetection system. Photon detectors directly convert reflected light into electrical signals that correspond to facial muscle movements, substituting complex computational imaging with simpler optical detection and electronic signal processing.
2Reliability
If cameras and complex image processing are used, then facial tracking function is achieved, but real-time processing efficiency decreases due to high computational overhead
Solution Approach 1:
The patent removes the computationally intensive image processing pipeline from the system. By extracting the camera and replacing it with photon detectors that directly measure facial muscle movements through reflected light, the system eliminates the need for complex real-time image analysis while maintaining tracking reliability.
Solution Approach 2:
The patent substitutes the computational image processing mechanism with a direct optical-to-electrical signal conversion mechanism. Photon detectors convert reflected light patterns into electrical signals that directly represent facial expressions, replacing the slow process of capturing, processing, and analyzing images with immediate optical detection and electronic signal generation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution provides a low-cost, low-computational overhead facial recognition system capable of real-time facial expression tracking, suitable for wearable devices and various reality systems, without the need for cameras or complex image processing.
Implementation Method 1
a photon detector disposed with the element and configured to receive light reflected from at least a second portion of the head
Data Source
AI summary
A facial tracking device including an illuminator and a photon detector. The illuminator configured to project a light toward a first portion of a head of a user and the photon detector configured to detect light reflected from a second portion of the head of the user. The facial tracking device further including a processor that is connected to the illuminator and photon detector and configured to cause the illuminator to project the light toward the head of the user, receive information from the photon detector, and determine a facial expression of the user.