Head-Mounted Multispectral Camera System for Physiological Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Collecting thermal measurements of a user's face over time while performing daily activities is challenging due to bulky equipment and confounding factors like facial movements and substances, which affect accuracy in detecting physiological responses.
Innovation Solution
A system using inward-facing head-mounted thermal and visible-light cameras to collect data, accounting for confounding factors through image analysis and machine learning-based models, allowing for accurate detection of physiological responses despite movements and environmental influences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If thermal cameras are used to collect facial measurements, then physiological responses can be detected, but the equipment becomes bulky and expensive
Solution Approach 1:
The patent combines multiple camera types (thermal camera, visible-light camera, and optionally near-infrared camera) into a single head-mounted device that simultaneously captures multiple types of facial data. This integration allows the system to detect physiological responses through multiple modalities while maintaining a compact form factor that can be worn on the user's head.
Solution Approach 2:
The head-mounted device is designed to perform multiple functions: it can detect physiological responses through thermal measurements, capture visible-light images for facial expression analysis, and optionally acquire near-infrared data. This multi-functional approach eliminates the need for separate specialized equipment for each measurement type.
2Productivity
If thermal cameras are continuously pointed at the face to collect data, then measurements can be gathered, but the system becomes complex requiring image registration and face tracking
Solution Approach 1:
The system merges thermal imaging data with visible-light camera data in a unified processing pipeline. The visible-light camera provides reference information that simplifies the alignment and registration of thermal measurements, reducing the computational complexity required for accurate physiological response detection.
Solution Approach 2:
The visible-light camera acts as an intermediary that provides additional contextual information about facial features and expressions. This intermediary data source helps simplify the complex task of tracking and registering thermal measurements by providing easier-to-process visual references.
3Measurement precision
If confounding factors like facial movements and substances are present, then measurement accuracy decreases, but adding more sensors to detect these factors increases device complexity
Solution Approach 1:
The patent combines data from multiple camera types (thermal, visible-light, and near-infrared) to detect and account for confounding factors such as facial movements, makeup, and other substances. By merging information from these different modalities, the system can distinguish between actual physiological responses and artifacts caused by confounding factors without requiring additional specialized sensors.
Solution Approach 2:
The system uses a composite approach by integrating multiple types of optical sensing capabilities into a unified measurement system. This composite sensing strategy allows the device to capture complementary information that helps differentiate between true physiological signals and confounding factors, improving measurement accuracy without linearly increasing device complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and continuous collection of thermal measurements from various facial regions, improving the detection of physiological responses by accounting for confounding factors and enhancing the system's ability to differentiate between true emotional states and facial expressions.
Implementation Method 1
an inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of a first region of interest (ROI) on the user's face
Data Source
AI summary
Described herein are systems and methods for detecting a physiological response based on multispectral data. In one embodiment, a system includes an inward-facing head-mounted thermal camera (CAM) that takes thermal measurements of a first region of interest (THROI1) on a user's face, and an inward-facing head-mounted visible-light camera (VCAM) that takes images of a second region of interest (IMROI2) on the face. The first and second regions of interest overlap, and the system includes a computer that detects the physiological response based on THROI1, IMROI2, and a model. Optionally, the model was trained based on previous THROI1 and IMROI2 of the user taken during different days. Optionally, the physiological response is indicative of an occurrence of an emotional state of the user, such as joy, fear, sadness or anger.