Video Biometric Extraction via Temporal Color Variation Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for capturing biometric data during video recording are limited to the biometric data from sensors attached to individuals, requiring additional sensors for each person and cooperation, which is inefficient and impractical for applications like surveillance.
Innovation Solution
A method that extracts signals characterizing local temporal variations in light intensity and color from video data before compression, allowing for the inclusion of metadata characterizing biological phenomena in compressed video, enabling efficient biometric data collection without additional sensors and cooperation from subjects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If additional biometric sensors are attached to each individual for capturing biometric data, then the accuracy and reliability of biometric data collection is improved, but the device complexity and cost increase significantly
Solution Approach 1:
The video camera system is designed to perform multiple functions: capturing video data for surveillance purposes and simultaneously extracting biometric signals (heart rate, respiration rate) from the same video data. This eliminates the need for separate biometric sensors on each individual, resolving the contradiction between reliable biometric data collection and device complexity
Solution Approach 2:
The system uses the video camera's own captured data to extract biometric information without requiring external sensors or subject cooperation. The biometric data is derived self-service style from the existing video feed, maintaining reliability while avoiding additional hardware complexity
2Productivity
If video data is compressed to reduce transmission bandwidth, then the data transmission efficiency is improved, but the ability to extract accurate biometric signals from the video data deteriorates
Solution Approach 1:
Biometric signals are extracted from video data before compression is applied. By performing the signal extraction action preliminarily, the system captures the necessary biometric information from the full-resolution video, ensuring measurement precision is maintained while still allowing compressed video to be transmitted efficiently
3Measurement precision
If high-definition cameras are used to capture detailed video data for accurate biometric extraction, then the measurement precision of biometric signals is improved, but the data transmission requirements and storage needs increase
Solution Approach 1:
The system extracts only the essential biometric information (heart rate, respiration rate) from the video data as metadata, separating this critical information from the full video stream. This allows standard-definition video to be used for transmission while maintaining biometric measurement precision through the extracted signals
4Ease of operation
If biometric data is collected without subject cooperation using remote methods, then the ease of operation is improved, but the reliability of the collected data may deteriorate
Solution Approach 1:
The system replaces contact-based mechanical sensors with optical detection methods that analyze subtle color and intensity variations in video data. This substitution maintains ease of operation by requiring no subject cooperation while achieving reliable biometric data through advanced signal processing of the optical information
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for reliable biometric data collection from multiple individuals without additional sensors, reducing the need for high-definition cameras and enabling efficient data transmission, while allowing for adaptive compression and improved data accuracy in surveillance applications.
Implementation Method 1
light intensity and color captured from the subject
Implementation Method 2
video camera captured a sequence of images
Data Source
AI summary
A method of providing a combination of video data (37) and metadata (34) includes obtaining a sequence (23) of images captured by a video camera (5). At least one signal (24) is extracted from the sequence (23) of images, wherein each extracted signal (24) characterizes local temporal variations in at least one of light intensity and color. At least one video compression technique is applied on image data of images from the sequence (23) to obtain compressed video data (37). The extracted signals (24) are extracted from images in a state prior to the application of the at least one compression technique to image data from those images. The compressed video data (37) is provided with metadata (34) for characterizing at least one process in a subject represented in at least part of the images, which process causes local temporal variations in at least one of color and intensity of light captured from the subject. The metadata (34) is at least based on at least one of the extracted signals (24).