Skin Detection via Temporal Clustering of Segmented Video Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current camera-based vital signs monitoring systems face challenges in reliably detecting skin areas under varying illumination conditions and differentiating skin from other objects, especially in low-light environments, which affects the accuracy of vital sign extraction.
Innovation Solution
A three-step approach involving image segmentation, tracking, and clustering using temporal features to identify skin areas, where initial segmentation over-identifies potential skin segments, tracking uses motion estimation and feature points, and clustering is performed based on temporal color variations and inner product analysis to accurately distinguish skin from non-skin regions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If RGB-based skin color detection and segmentation is used, then detection speed is improved, but reliability under varying illumination conditions deteriorates
Solution Approach 1:
The patent segments the video sequence into multiple frames and divides skin detection into two stages: initial skin area detection using RGB color information from a single frame, followed by temporal tracking across subsequent frames. This segmentation allows fast initial detection while maintaining reliability through temporal consistency checking, resolving the contradiction between speed and illumination robustness.
Solution Approach 2:
The patent performs preliminary skin area detection using RGB color segmentation on the first frame to identify candidate skin regions. This preliminary action provides initial detection speed, while subsequent tracking and validation steps ensure reliability under varying illumination by comparing temporal consistency of detected skin areas across multiple frames.
2Reliability
If PPG-based skin detection is used, then robustness in differentiating real skin areas is improved, but computational complexity increases
Solution Approach 1:
The patent applies PPG-based temporal analysis only to the skin areas initially detected by RGB segmentation, rather than performing full PPG analysis on the entire video sequence. This partial application maintains the robustness of PPG in differentiating real skin areas while significantly reducing computational complexity by limiting processing to relevant regions only.
Solution Approach 2:
The patent uses RGB-based skin detection as an intermediary step to identify candidate skin areas before applying the more computationally intensive PPG-based temporal analysis. This intermediary approach enables robust skin differentiation through PPG while managing computational complexity by pre-filtering the analysis scope.
3Adaptability or versatility
If skin detection is performed under low illumination conditions, then unobtrusive monitoring capability is improved, but detection accuracy deteriorates
Solution Approach 1:
The patent continuously tracks skin areas across multiple video frames, maintaining detection throughout the sequence rather than relying on a single frame. This continuity allows the system to overcome low illumination conditions by accumulating temporal information, improving detection accuracy while maintaining unobtrusive monitoring capability across varying lighting conditions.
Solution Approach 2:
The patent uses temporal tracking feedback to validate and refine skin area detection across frames. Under low illumination conditions, the system compares detected skin areas across multiple frames, using temporal consistency as feedback to maintain detection accuracy even when individual frame quality is poor, thus preserving both unobtrusive monitoring and measurement precision.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This method enables reliable, accurate, and fast detection of skin areas, even under challenging lighting conditions, improving the robustness and efficiency of vital sign monitoring systems.
Implementation Method 1
Photoplethysmography (PPG) is an optical measurement technique that evaluates a time-variant change of light reflectance or transmission of an area or volume of interest
Implementation Method 2
By evaluating the transmittance and/or reflectivity at different wavelengths (typically red and infrared), the blood oxygen saturation can be determined
Data Source
AI summary
An input unit (20) obtains a sequence of image frames over time. A segmentation unit (22) segments image frames of the sequence of image frames. A tracking unit (24) tracks segments of the segmented image frame over time in the sequence of image frames. A clustering unit (26) clusters the tracked segments to obtain clusters representing skin of a subject by use of one or more image features of the tracked segments.