Handheld Scanner Texture Fusion for Reflective Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing scanning methods for dark or reflective objects, such as cultural relics, suffer from poor real-time performance and limited scanning breadth, particularly when powder spraying treatment is not applicable.
Innovation Solution
A handheld scanner equipped with a texture camera, two black-and-white cameras spaced apart, and a laser projector, along with an optional speckle projector, allows for simultaneous texture and three-dimensional reconstruction, improving real-time scanning performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If laser scanner or articulated arm laser color scanning is used for dark or reflective objects, then three-dimensional data can be acquired, but real-time scanning performance is poor and scanning breadth is limited
Solution Approach 1:
The patent combines multiple scanning functions (laser line scanning, speckle scanning, and color imaging) into a single handheld scanner device. The laser projector, speckle projector, multiple cameras (depth camera, color camera, infrared camera), and processing unit are integrated into one handheld unit, enabling simultaneous acquisition of three-dimensional geometry and color information in real-time, thereby improving productivity while managing device complexity through functional integration
Solution Approach 2:
The handheld scanner is designed with multi-functionality to handle various scanning scenarios. It can switch between laser line scanning mode and speckle scanning mode, and simultaneously capture depth information, color information, and infrared information. This universal design allows the device to adapt to different object types (dark, reflective, transparent) and scanning requirements, significantly expanding scanning breadth and real-time performance
2Measurement precision
If powder spraying treatment is applied to dark or reflective objects, then scanning quality improves, but the treatment process adds time and complexity
Solution Approach 1:
The patent converts the harmful effects of dark and reflective surfaces into beneficial scanning opportunities. By using speckle scanning technology, the system can actually utilize the reflective properties of surfaces to create detectable speckle patterns. The multi-camera setup with different spectral sensitivities (visible, infrared) allows the system to capture information from surfaces that would traditionally be difficult to scan, eliminating the need for powder spraying while maintaining or improving scanning quality
Solution Approach 2:
The system changes the scanning parameters dynamically based on surface properties. It switches between different lighting sources (laser, speckle projector), different camera modes (depth, color, infrared), and different scanning algorithms according to the object's characteristics. This parameter adaptation allows high-precision scanning of dark and reflective objects without requiring physical modification of the objects through powder spraying, thereby saving preprocessing time
3Measurement precision
If separate laser scanning and color mapping processes are used, then three-dimensional data can be acquired, but the scanning process is time-consuming and not real-time
Solution Approach 1:
The patent merges the previously separate laser scanning and color mapping processes into a single simultaneous operation. The handheld scanner captures depth information (via laser or speckle scanning with depth camera) and color information (via color camera) at the same time during one scanning motion. The processing unit fuses these data streams in real-time to generate complete three-dimensional models with accurate color mapping, eliminating the need for sequential processing and achieving real-time scanning performance while maintaining high precision
Solution Approach 2:
The system maintains continuous data acquisition for both geometric and color information throughout the scanning process. Unlike sequential methods where scanning stops between depth and color capture, this system continuously captures both types of data simultaneously as the scanner moves. This continuous dual-mode operation ensures that no scanning time is wasted and that the resulting three-dimensional model has both accurate geometry and faithful color representation
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The handheld scanner achieves improved real-time scanning and texture reconstruction for dark or reflective objects without the need for powder spraying, enabling direct and quick acquisition of three-dimensional data and color information.
Implementation Method 1
employing the laser projector to project laser light onto a surface of an object to be measured, and synchronously acquiring laser light patterns modulated by the surface of the object to be measured
Implementation Method 2
employing the speckle projector to project a speckle pattern onto a surface of an object to be measured, and synchronously acquiring a target speckle pattern modulated by the surface of the object to be measured
Implementation Method 3
acquiring a texture image of the surface of the object to be measured by using the texture camera
Data Source
AI summary
The present disclosure discloses a handheld scanner and a scanning method for the handheld scanner. The handheld scanner includes a texture camera, a first black-and-white camera and a second black-and-white camera, where the first black-and-white camera and the second black-and-white camera are spaced apart from each other; and the handheld scanner further includes a laser projector, and the texture camera and the first black-and-white camera are respectively arranged at two sides of the laser projector. When a highly reflective or dark object is scanned, textures are obtained by the texture camera while laser scanning is performed; and after point cloud fusion is completed, texture images are screened and fused according to a shooting angle and the highlight degree of the image, so that the overall texture image of point cloud is obtained.