3D Metrology Surface Display Using Photorealistic Image Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current non-contact three-dimensional metrology techniques face challenges in interpreting 3D surface measurement data, particularly when one surface layer is obscured by another, as 3D point clouds displayed on monitors are difficult to interpret and require additional processing for clear visualization.
Innovation Solution
A method and apparatus that transform and map images from camera coordinate space to 3D point cloud coordinate space to generate a display of the object's surface, using a metrology system, imaging system, and processor to create a more interpretable representation of the 3D metrology surface, potentially using artificial shading or triangular surfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If 3D point cloud data is displayed directly on a monitor, then the measurement data is captured accurately, but the display is difficult to interpret especially when surface layers overlap
Solution Approach 1:
The patent creates a photorealistic copy of the object surface by mapping a captured photograph onto the 3D point cloud data. This copy preserves the visual appearance of the actual surface while integrating it with the measurement data, allowing users to interpret the 3D structure more easily without losing measurement accuracy. The photograph serves as a visual replica that overlays the complex point cloud data with familiar visual cues.
Solution Approach 2:
The patent applies color information from the captured photograph to the 3D point cloud representation. By mapping the color data onto the point cloud, the display gains visual depth cues and surface recognition capabilities that make overlapping surface layers more distinguishable and interpretable, while maintaining the precise 3D measurement information.
2Ease of operation
If artificial shading or coloring is applied to 3D point cloud, then interpretation ability improves, but the resulting images appear significantly different from direct observation of the object surface
Solution Approach 1:
Instead of applying synthetic shading algorithms that create artificial appearances, the patent uses an actual photograph of the object as the visual overlay. This photograph is a true copy of the object's appearance, preserving authentic visual information while improving interpretability. The result is a display that looks like the actual object rather than an artificially rendered version.
Solution Approach 2:
The patent changes the parameter of visual representation from synthetic shading to photographic realism. By using actual photographic data captured from the object, the system transforms the visual appearance parameter to match the true look of the object surface, eliminating the disconnect between measurement data and visual appearance.
3Ease of operation
If triangular surfaces are generated between 3D points, then surface interpretation is improved, but the complexity of data processing increases
Solution Approach 1:
The patent combines the 3D point cloud data with a 2D photograph in a unified coordinate system. By merging these two data types and mapping them together, the system achieves improved surface interpretation without requiring complex triangular surface generation. The photograph provides the visual context that makes the point cloud easier to interpret, while avoiding the computational overhead of creating artificial surface meshes.
Data Source
Figure 1~2
Figure 3~4
Figure 5
AI summary
Described are a method and apparatus for generating a display of a three-dimensional ("3D") metrology surface. The method includes determining a 3D point cloud representation of a surface of an object in a point cloud coordinate space. An image of the object is acquired in a camera coordinate space and then transformed from the camera coordinate space to the point cloud coordinate space. The transformed image is mapped onto the 3D point cloud representation to generate a realistic display of the surface of the object. In one embodiment, a metrology camera used to acquire images for determination of the 3D point cloud is also used to acquire the image of the object so that the transformation between coordinate spaces is not performed. The display includes a grayscale or color shading for the pixels or surface elements in the representation.