Facial Spectral Scanning for Accurate 3D Reflection Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current object digitization methods fail to accurately capture the spectral characteristics of physical objects, leading to spectral distortion and inefficiencies in digital representations, particularly in applications like the metaverse and healthcare, where authentic digitization is crucial for effective analysis and evaluation.
Innovation Solution
The method employs multi-node illumination light sources with N-color-channel spectral light sources to recover reflection spectra and construct a detailed point cloud, using a reflection database and weighted least squares to ensure accurate spectral and geometric representation, integrating LED light sources, collimators, microlens arrays, and semi-transparent mirrors for uniform illumination and high-resolution imaging.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional single-light-source illumination is used, then device complexity is low, but spectral distortion occurs and measurement precision deteriorates
Solution Approach 1:
The illumination system is segmented into multiple independent light sources (first light source, second light source, third light source, fourth light source) positioned at different locations. Each light source emits light with different spectral characteristics, allowing the system to capture comprehensive spectral information by combining data from all sources, thereby eliminating spectral distortion without requiring a single complex light source.
Solution Approach 2:
The patent merges the illumination functions of multiple light sources with different spectral characteristics into a unified illumination system. By combining the light from these multiple sources during the imaging process, the system achieves comprehensive spectral coverage and accurate material characterization, resolving the contradiction between device complexity and measurement precision.
2Measurement precision
If multi-node illumination light sources are used, then spectral accuracy is improved, but device complexity increases
Solution Approach 1:
The illumination system is divided into multiple independent light sources positioned at different nodes (first, second, third, fourth light sources). Each source contributes specific spectral information, and the system processes data from all sources separately before integrating results, thereby achieving high spectral accuracy while maintaining manageable system complexity through modular design.
Solution Approach 2:
The patent introduces a reflection database as an intermediary component that stores reference reflection spectra. During processing, the system compares captured spectral data with database entries to recover accurate reflection spectra. This intermediary database simplifies the complex task of spectral recovery by providing pre-computed reference data, reducing the computational burden of processing multi-source illumination data.
3Measurement precision
If spectral images are obtained under multi-node illumination, then object digitization accuracy is improved, but processing time increases
Solution Approach 1:
The patent performs preliminary actions by capturing spectral images from multiple light sources in advance and storing them in a structured format. The reflection database is pre-computed with reference spectra. During actual processing, the system retrieves pre-processed data from the database and combines it with captured images, significantly reducing real-time processing time while maintaining high digitization accuracy.
Solution Approach 2:
The system creates digital copies of spectral information from multiple illumination sources and combines them to reconstruct accurate reflection spectra. By working with pre-acquired spectral data copies rather than performing real-time spectral analysis, the system reduces processing time while maintaining the accuracy benefits of multi-node illumination.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables authentic digital avatars and precise facial health monitoring, allowing for effective cosmetic analysis and enhanced digitization convenience across various digital fields, including the metaverse, VR/AR, and healthcare.
Implementation Method 1
A light beam emitted by the LED light source sequentially passes through the LED collimator, the microlens array, the projection lens, and the semi-transparent mirror, and the light beam is then vertically incident on the target object
Implementation Method 2
an LED collimator
Implementation Method 3
a projection lens
Implementation Method 4
controlling the N-color-channel spectral light sources to illuminate channel by channel to obtain N-color-channel multi-node spectral images of the target object
Implementation Method 5
Each of the spectral light sources includes an LED light source
Implementation Method 6
recovering reflection spectra of the target object based on the response function and a reflection database
Implementation Method 7
obtaining spectral images of a target object under multi-node illumination light sources; obtaining a response function of the spectral images; recovering reflection spectra of the target object based on the response function and a reflection database
Implementation Method 8
obtaining a detailed point cloud of the target object
Data Source
AI summary
The present disclosure provides an object digitization method and device, a facial scanning method and device and a handheld digitization device, including: obtaining spectral images of a target object under multi-node illumination light sources; obtaining a response function of the spectral images; recovering reflection spectra of the target object based on the response function and a reflection database; obtaining a detailed point cloud of the target object and digitizing the target object based on the detailed point cloud and the recovered reflection spectra of the target object. The present disclosure can rapidly recover the true reflection spectra and high-resolution three-dimensional shape of the target object, thereby creating a realistic digital avatar, applicable to digital domains such as the metaverse. Based on this, the present disclosure can effectively acquire the reflection spectra and three-dimensional information of a face, enabling personal facial health monitoring and beauty applications.