Specular Surface Mapping Using NIR Reflection Clustering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D mapping systems struggle to accurately detect and differentiate highly specular surfaces such as glass and mirrors, which are often misidentified as open spaces due to their reflective nature, posing safety risks in extended reality environments.
Innovation Solution
Employing near-infrared (NIR) light sources and signal processing techniques to project and analyze NIR dot patterns, leveraging the spatio-temporal distribution of reflections on a celestial sphere to identify and classify specular surfaces, filtering out false positives and determining their extent and distance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional 3D mapping systems are used to detect surfaces, then the system complexity remains low, but the measurement precision deteriorates because specular surfaces are misidentified as open spaces
Solution Approach 1:
The patent introduces NIR light sources and cameras as intermediary devices to detect specular surfaces. The NIR light projects patterns that reflect off specular surfaces in predictable ways, allowing the system to distinguish glass and mirrors from open spaces without requiring complex mechanical modifications to the overall mapping system.
Solution Approach 2:
The patent replaces conventional visible-light-based detection mechanisms with near-infrared optical detection. By using NIR light sources and cameras instead of standard cameras, the system exploits the different reflectivity properties of specular surfaces in the NIR spectrum to achieve accurate detection without mechanical changes.
2Reliability
If conventional mapping methods are used, then the ease of operation is maintained, but the reliability deteriorates due to safety risks from misidentifying glass doors and mirrors as open spaces
Solution Approach 1:
The patent changes the operational parameter from visible light to near-infrared light. This parameter change allows the system to exploit the different optical properties of specular surfaces in the NIR spectrum, improving reliability by enabling detection of glass and mirrors that are invisible to conventional cameras.
Solution Approach 2:
The NIR camera acts as an intermediary detection device that specifically targets specular surfaces. By introducing this specialized sensor between the light source and the processing system, the patent enables reliable detection of hazardous surfaces while maintaining the overall system architecture.
3Measurement precision
If NIR light sources and celestial sphere projection are used, then the measurement precision of specular surfaces improves, but the device complexity increases
Solution Approach 1:
The patent projects reflections onto a celestial sphere, which is a spherical coordinate system. This dimensional transformation allows the system to aggregate multiple 2D camera observations into a unified 3D representation, improving measurement precision by exploiting the geometric constraints of specular reflections from multiple viewing angles.
Solution Approach 2:
The patent uses a spherical (celestial sphere) coordinate system to represent reflection directions instead of a planar grid. This curved geometry naturally accommodates the angular nature of light reflections and allows for more accurate aggregation of observations from different camera positions and orientations.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances the accuracy of 3D mapping by correctly identifying specular surfaces, improving safety in extended reality systems by preventing misidentification of obstacles like glass doors and mirrors.
Implementation Method 1
a property of highly specular surfaces including glass and mirrors whereby 850 nm or similar wavelength NIR light strongly reflects at nearly perfectly orthogonal angles
Data Source
AI summary
Methods and apparatus for specular surface mapping in which a camera detects reflections of a light source from a specular surface. The detected light sources may be projected onto a celestial sphere as virtual point sources. True positive observations should be tightly clustered on the celestial sphere; thus, false positives may be identified and removed. Specular surface information may then be determined from clusters of the virtual point sources on the celestial sphere. The clusters of virtual point sources on the celestial sphere may be identified and used to identify a surface as a specular surface. The clusters may also be used to extract other information regarding the specular surface, including but not limited to distance to and extent of the specular surface.