Face Contour Detection Using Lidar and Video Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for detecting face contours from 2D video images are not robust to varying skin colors, lighting, and exposure conditions, limiting their effectiveness in accurately determining face contours.
Innovation Solution
A combined system that integrates lidar and video subsystems to generate a three-dimensional image of a target by resolving six degrees of freedom trajectory, using lidar measurements and video images to determine the face contour and facial features, thereby overcoming the limitations of 2D image processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If conventional 2D video image processing algorithms are used to detect face contours, then the system is simple and easy to implement, but the detection accuracy deteriorates under varying skin colors, lighting, and exposure conditions
Solution Approach 1:
The patent combines 2D video imaging system with 3D lidar measurement system to detect face contours. The video system provides 2D facial feature locations while the lidar system provides 3D depth information, and their integration enables accurate face contour detection that overcomes the limitations of either system alone under varying lighting and skin color conditions
Solution Approach 2:
The patent transitions from 2D video image processing to 3D face contour detection by incorporating lidar depth measurements. This dimensional enhancement allows the system to accurately detect face contours in three-dimensional space, making the detection robust to lighting and skin color variations that affect 2D image processing
2Productivity
If conventional 2D skin detection algorithms are used, then the processing is fast and simple, but the robustness to different skin colors, lighting, and exposure conditions deteriorates
Solution Approach 1:
The patent merges 2D video imaging with 3D lidar scanning to create a hybrid detection system. The video subsystem captures 2D facial features while the lidar subsystem captures 3D geometric information, and their combination provides robust face contour detection that maintains reliability across different skin colors and lighting conditions without significantly compromising processing efficiency
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables accurate detection of face contours and facial features, improving robustness to variations in skin colors, lighting, and exposure conditions, and providing a more precise three-dimensional representation of the target.
Implementation Method 1
a lidar system...to generate a three-dimensional image of the target
Implementation Method 2
a lidar system...to generate a three-dimensional image of the target
Implementation Method 3
images generated by a video system
Data Source
AI summary
A system uses range and Doppler velocity measurements from a lidar system and images from a video system to estimate a six degree-of-freedom trajectory of a target. The system may determine a skin area or face contour based on the 3D measurements from a lidar subsystem and information regarding the location of various facial features from the 2D video images of a video subsystem.