Face Detection Using Dynamic Color Gain Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current face tracking systems are compromised in poorly lit conditions, failing to reliably detect and track facial expressions due to inadequate depth and color image capture.
Innovation Solution
The method and system dynamically adjust the red, green, and blue gain levels and exposure time of an image-based capture device based on the image region containing the user's face, using an IR camera and IR laser projector for depth information, and provide feedback to users for lighting adjustments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If active stereo techniques are used for depth sensing, then three-dimensional reconstruction quality is improved, but face tracking reliability deteriorates in poor lighting conditions
Solution Approach 1:
The system dynamically adjusts the gain levels of color channels based on detected face intensity. The gain adjustment is continuous and adaptive, allowing the color camera to optimize its sensitivity in real-time according to lighting conditions, thereby maintaining face tracking reliability across varying illumination environments.
Solution Approach 2:
The invention changes the operational parameters of the color camera by adjusting gain levels of individual color channels. This parameter modification allows the system to compensate for poor lighting conditions without altering the fundamental active stereo depth sensing mechanism, thus maintaining both 3D reconstruction quality and face tracking reliability.
2Reliability
If the color camera gain is increased to improve face detection in low light, then face tracking reliability is improved, but color accuracy deteriorates
Solution Approach 1:
The system applies different gain levels to different color channels (red, green, blue) based on the specific lighting conditions and face intensity requirements. This localized adjustment of gain per channel allows optimization for face detection while maintaining relative color relationships, thus preserving color accuracy while improving face tracking reliability.
Solution Approach 2:
The system uses feedback from the detected face intensity and depth information to dynamically adjust color channel gain levels. This closed-loop control ensures that gain adjustments are made based on actual face detection needs rather than fixed settings, maintaining color accuracy while enabling reliable face tracking in varying lighting conditions.
3Reliability
If dynamic gain adjustment is applied to the color camera, then face detection reliability is improved, but device complexity increases
Solution Approach 1:
The system performs self-adjustment by automatically detecting face presence and intensity, then autonomously modifying its own color camera gain settings. This self-service capability eliminates the need for manual intervention or complex external control systems, improving face detection reliability while keeping the added complexity minimal and integrated within the existing processing pipeline.
Data Source
AI summary
Methods and systems for face detection and tracking using an image-based capture device are disclosed herein. The method includes generating a depth image of a scene, generating a mask image from the depth image, and detecting a position of a face of a user in the scene using the mask image. The method also includes determining an intensity of the face using a first color channel of the mask image and adjusting a gain level of a first color channel of the image-based capture device directed at the scene to achieve a target intensity of the face.