3D Model Image Superimposition for Surgical Visualization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The integration of 3D model images with 3D surgical images often results in texture mismatches and brightness inconsistencies, leading to unnatural visual representations for surgeons, which can impede the accurate spatial recognition of 3D model images within the surgical context.
Innovation Solution
A medical image processing system that acquires real-time 3D surgical images and 3D model images, and employs a superimposition unit to enhance the spatial positioning of 3D model images within the 3D surgical images, using techniques such as depth movement, color adjustment, and spatial frequency modification to improve visual alignment and recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a 3D model image is superimposed on a 3D surgical image, then navigation information is provided to the surgeon, but texture mismatch and brightness inconsistencies cause unnatural visual representation and difficulty in spatial recognition
Solution Approach 1:
The patent applies parameter changes by adjusting the spatial frequency of the 3D model image to match the spatial frequency of the 3D surgical image. This involves modifying frequency parameters through filtering operations to achieve visual consistency between the model image and surgical image, thereby improving spatial recognition while maintaining visual naturalness.
Solution Approach 2:
The patent applies local quality by performing localized spatial frequency adjustment on the 3D model image. Instead of uniformly processing the entire image, the system selectively modifies the spatial frequency characteristics of specific regions or features within the model image to match corresponding regions in the surgical image, enhancing local visual harmony and spatial recognition.
2Measurement precision
If the 3D model image is enhanced for better recognition, then spatial awareness is improved, but visual unnaturalness increases due to texture and brightness mismatches
Solution Approach 1:
The patent resolves this contradiction by changing the spatial frequency parameter of the 3D model image to align with the surgical image. This parameter adjustment enhances the recognizability of spatial positions while maintaining visual naturalness through frequency matching, avoiding the harmful effect of visual unnaturalness.
Solution Approach 2:
The patent applies copying by transferring the spatial frequency characteristics from the 3D surgical image to the 3D model image. By copying the frequency profile of the surgical image and applying it to the model image, the system achieves consistent visual appearance that improves spatial recognition without creating visual unnaturalness.
Data Source
AI summary
A medical image processing system includes an acquisition unit that acquires a real-time 3D surgical image of an operation site stereoscopically viewable by a surgeon and a 3D model image that is a stereoscopic CG image associated with the 3D surgical image, and a superimposition unit that performs enhancement such that the location of the 3D model image at predetermined spatial positions is enhanced with respect to the 3D surgical image or the 3D model image at the start of superimposition of the 3D model image at the predetermined spatial positions when the 3D surgical image is stereoscopically viewed on the basis of information set for the 3D model image.