3D Surgical Image Overlay for Ultrasound Probe Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing medical technologies face challenges in accurately adjusting the position and orientation of ultrasound probes during endoscopic surgeries due to differences in imaging viewpoints and ranges between surgical field images and ultrasound images, requiring high skill levels.
Innovation Solution
A medical support device and method that acquires a three-dimensional model of the target part, superimposes internal images on this model, and adjusts the display aspect based on position and orientation information, using markers and cameras to enhance alignment and visibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If ultrasound images are superimposed on surgical field images using conventional methods, then internal structure visibility is improved, but alignment accuracy deteriorates due to different imaging viewpoints and ranges
Solution Approach 1:
The patent introduces a three-dimensional model of the surgical field that integrates both optical and ultrasound imaging data. This 3D model serves as a common reference frame, allowing ultrasound images to be accurately positioned and oriented relative to the surgical field regardless of viewpoint differences. The 3D model adds a spatial dimension that reconciles the 2D limitations of conventional superimposition methods.
Solution Approach 2:
The patent employs markers placed in the surgical field as intermediary reference objects. These markers are detectable by both the optical camera and ultrasound probe, serving as a bridge between the two different imaging modalities. By tracking marker positions and orientations, the system can accurately transform coordinates between the optical and ultrasound reference frames, achieving precise alignment.
2Measurement precision
If markers are used to track medical instrument position and orientation, then alignment accuracy is improved, but device complexity increases
Solution Approach 1:
The markers serve multiple functions simultaneously: they provide reference points for 3D model construction, enable tracking of medical instrument positions and orientations, and facilitate real-time alignment between different imaging modalities. This multi-functionality reduces the need for separate systems for each task, thereby limiting the increase in device complexity.
3Measurement precision
If real-time superimposed images are displayed, then surgical precision is improved, but processing time increases
Solution Approach 1:
The system performs preliminary construction of the three-dimensional surgical field model before the actual surgery begins. During surgery, the system only needs to track marker positions and perform coordinate transformations based on the pre-established 3D model, rather than constructing the entire model in real-time. This preliminary action significantly reduces the processing time required during the surgical procedure while maintaining high precision.
Data Source
AI summary
A medical support device including a processor, wherein the processor is configured to: acquire a three-dimensional model showing a surface shape of a target part inside a body; acquire an internal image showing an internal structure of the target part; acquire position and orientation information indicating a position and an orientation of a medical instrument inserted into the body in a surgical field including the target part and the medical instrument; and control display of a first superimposed image that is obtained by superimposing the internal image on the three-dimensional model and in which a display aspect of the internal image is adjusted based on the position and orientation information.