Spectral Reflectance Skin Detection in Augmented Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented reality systems face challenges in accurately distinguishing between skin and non-skin inputs, such as clothing or jewelry, which hinders effective gesture recognition and interaction in mixed reality environments.
Innovation Solution
The system employs a projector and camera configuration to illuminate objects with wavelength modulated light, acquiring spectral reflectance data to differentiate between skin and non-skin based on unique spectral signatures stored in a skin reflectance reference database, allowing for precise identification of skin inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional imaging methods are used to detect gestures, then the system can capture visual information, but it cannot accurately distinguish between skin and non-skin inputs (clothing, jewelry)
Solution Approach 1:
The system changes the detection parameter from conventional visible light imaging to spectral reflectance measurement across multiple wavelengths (UV, blue, green, red, infrared). By measuring reflectance across this spectral range, the system can distinguish skin from non-skin materials based on their unique spectral signatures, resolving the material differentiation difficulty while maintaining detection accuracy.
Solution Approach 2:
The patent replaces conventional mechanical/optical imaging systems with a spectral analysis system that uses wavelength-modulated light sources and spectral sensors. This substitution enables material differentiation based on spectral properties rather than just visual appearance, allowing accurate skin detection even when skin tone or lighting conditions vary.
2Measurement precision
If the system uses multiple spectral bands for skin detection, then material differentiation improves, but the device complexity increases
Solution Approach 1:
The system employs a multi-functional approach where a single spectral imaging system performs multiple tasks: capturing reflectance data across five spectral bands (UV, blue, green, red, infrared), storing the data in a structured reference database, and using this data for skin detection. This universal system handles both data collection and analysis functions, reducing overall system complexity while maintaining high measurement precision.
Solution Approach 2:
The system performs preliminary action by pre-storing spectral reflectance data for skin and non-skin materials in a reference database before actual detection occurs. This pre-prepared reference data enables rapid comparison and identification during operation, reducing the computational complexity required during real-time skin detection while maintaining high accuracy.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables accurate differentiation of skin from non-skin objects, enhancing the interpretation of user inputs and improving the overall responsiveness and accuracy of augmented reality systems.
Implementation Method 1
The projector is configured to provide illumination to an object within the scene with wavelength modulated light having a known spectral signature
Implementation Method 2
The camera is configured to acquire spectral reflectance data resulting from reflectance of the projector light from the object
Implementation Method 3
A skin recognition module is configured to compare the spectral reflectance data with spectral reflectance data in a skin reflectance reference datastore to determine when at least a portion of the object is skin
Data Source
AI summary
An augmented reality environment allows interaction between virtual and real objects. Wavelength modulated light with a known spectral signature available within the augmented reality environment is used to generate spectral reflectance data for objects within the environment. This reflectance data is used to determine whether objects or portions thereof are skin.