Volumetric Image Texturing via 2D Surface Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Volumetric scanners cannot reproduce the surface texture of a subject, leading to challenges in creating accurate multimodal representations that combine internal volumetric data with external surface texture, which is essential for applications like plastic surgery and orthodontics, due to registration issues between independently generated data sets.
Innovation Solution
A method and system that use a two-dimensional imager and a volumetric scanner with a known physical position relative to each other to generate combined image data, where two-dimensional surface image data is mapped onto external surface mesh data, allowing for the creation of a volumetric image with a color textured external surface without the need for additional registration steps.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a volumetric scanner is used to obtain internal structure data, then volumetric imaging capability is improved, but surface texture reproduction capability deteriorates
Solution Approach 1:
The patent combines a volumetric scanner and a two-dimensional imager into an integrated scanning system. The volumetric scanner provides internal structure data while the two-dimensional imager captures surface texture and color information. Both data sets are merged through coordinate system transformation and registration to create a unified volumetric image with textured external surface, resolving the contradiction between volumetric imaging capability and surface texture reproduction.
2Loss of information
If an integrated scanner system with multiple imaging devices is used, then surface texture reproduction is improved, but device complexity increases
Solution Approach 1:
The integrated scanning system is designed with multi-functionality, where a single system performs both volumetric scanning and surface imaging. The coordinate system transformation and registration mechanisms enable the system to handle multiple data types (volumetric data and surface texture data) using unified processing procedures, reducing operational complexity despite the increased hardware integration.
3Loss of information
If separate volumetric scanner and surface scanner are used, then surface texture quality is improved, but registration accuracy deteriorates
Solution Approach 1:
By integrating the volumetric scanner and two-dimensional imager into a single system with known physical positions relative to each other, the patent eliminates the registration problems associated with separate scanners. The coordinate system transformation uses the known physical relationships between devices to accurately align volumetric data with surface texture data, ensuring high registration accuracy while maintaining surface texture quality.
Data Source
AI summary
Embodiments of the invention provide systems and methods for generating combined image data representing a volumetric image of a subject and a color textured external surface of the subject. According to one embodiment, two-dimensional image data and volumetric data of a subject is obtained using it two-dimensional imager and a volumetric scanner, respectively. The two-dimensional image data represent color texture of the subject, and the volumetric data represents both an internal and external structure of the subject. An opacity threshold of the volumetric data is set to render an external surface of the subject without generating external surface mesh data. An array ray is extended from a view point of the two-dimensional image data to the external surface of the subject such that the external surface of the subject has an opacity level higher than the opacity threshold. The two-dimensional image data is mapped to the external surface of the subject based on the extended array ray, and combined image data comprising the two-dimensional image data and the volumetric data is generated.