Remote Photoplethysmography Signal Extraction via Segmentation and Intermediary Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current remote photoplethysmography (rPPG) and transdermal optical imaging (TOI) techniques face challenges in accurately extracting vital health metrics due to low spatial and temporal resolution, lighting variations, motion artifacts, and skin differences, leading to errors in heart rate estimation and limited scope of computed vital signs.
Innovation Solution
The system employs advanced software modules and mathematical models to process color channel information from video data, using techniques like the Plane Orthogonal to Skin (POS) method and peak detection modules to enhance heart rate accuracy, and incorporates deep learning and classical computer vision to mitigate noise and artifacts, enabling comprehensive measurement of vital signs such as heart rate, heart rate variability, oxygen saturation, and blood pressure.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If remote photoplethysmography (rPPG) and transdermal optical imaging (TOI) techniques are used to extract vital health metrics from facial videos, then contactless measurement capability is achieved, but measurement precision deteriorates due to low spatial and temporal resolution, lighting variations, motion artifacts, and skin differences
Solution Approach 1:
The system segments the facial video into multiple regions of interest (ROIs) including forehead, cheeks, nose, and chin areas. Each ROI is processed independently to extract photoplethysmographic signals, then combined to improve overall measurement precision while maintaining contactless operation
Solution Approach 2:
The patent introduces intermediate processing steps including color space conversion (RGB to YCbCr), spatial filtering, and temporal smoothing as mediators between the raw video data and vital sign extraction. These intermediaries filter out lighting variations and motion artifacts before signal analysis
2Device complexity
If standard video recording devices are used for rPPG measurement, then device complexity is reduced and accessibility is improved, but measurement precision deteriorates due to low spatial and temporal resolution
Solution Approach 1:
The system changes the temporal parameter by applying frame sampling and temporal smoothing with optimized window sizes. Spatial parameters are adjusted through ROI selection and color channel weighting to enhance the weak photoplethysmographic signals from standard video recordings
Solution Approach 2:
The patent applies preliminary actions including motion compensation, lighting normalization, and signal filtering before heart rate extraction. These pre-processing steps prepare the low-resolution video data to maximize measurement precision from standard devices
3Device complexity
If existing peak detection modules are used in rPPG systems, then device complexity is minimized, but measurement precision deteriorates due to errors in heart rate estimation and false negative peaks
Solution Approach 1:
The system implements feedback mechanisms where detected peaks are validated against physiological constraints (e.g., reasonable heart rate ranges, consistent RR intervals). Invalid peaks are rejected and the search continues, reducing false positives while maintaining simple processing architecture
Solution Approach 2:
The patent employs dynamic threshold adjustment for peak detection based on the local signal characteristics and expected heart rate variability. The detection criteria adapt to changing signal conditions while keeping the overall module structure simple
4Adaptability or versatility
If comprehensive vital signs measurement is implemented using video data, then adaptability is improved, but device complexity increases due to need for multiple specialized modules
Solution Approach 1:
The patent creates a universal processing pipeline that extracts photoplethysmographic signals once, then derives multiple vital signs (heart rate, heart rate variability, oxygen saturation, respiration rate, blood pressure) from the same signal source. This multi-functional approach increases adaptability while avoiding redundant processing modules
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system provides accurate and reliable contactless measurement of vital signs, even in non-controlled video environments, with improved precision and robustness across diverse skin tones and lighting conditions, reducing errors in heart rate estimation and offering detailed health insights.
Implementation Method 1
remote photoplethysmography (rPPG)...extract the R, G, B signal from these MSTMaps...subtle changes in skin color from the difference in the re-emitted light between hemoglobin and melanin chromophores
Data Source
AI summary
The present disclosure concerns a method and system for remote photoplethysmography (rPPG). The system uses a camera to capture images of a subject and processes these images to monitor physiological parameters such as heart rate and respiratory rate. This is achieved by analyzing subtle changes in skin color that occur due to blood volume changes in the skin. The system allows for contactless, remote, video-based vital signs measurements.