Marker-Based 3D Surgical Field Modeling for Ultrasound Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing medical imaging technologies face challenges in accurately adjusting the position and orientation of ultrasound probes during endoscopic surgeries due to differences in viewpoints and imaging ranges between surgical field images and ultrasound images, requiring high skill levels.
Innovation Solution
A medical support device and method that uses multiple cameras to capture images from different viewpoints, detects a marker pattern, generates a three-dimensional model, and superimposes ultrasound images onto this model for precise alignment and display, facilitating easier navigation and observation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If surgical field images and ultrasound images are displayed separately with different viewpoints and imaging ranges, then each image can be captured independently, but it becomes difficult to appropriately adjust the position and orientation of the ultrasound probe
Solution Approach 1:
The patent merges the surgical field image and ultrasound image into a single composite display that shows both images simultaneously with their respective viewpoints and imaging ranges. This allows the operator to visually correlate the position and orientation of the ultrasound probe relative to the surgical field without mentally transforming between separate images, thereby improving position adjustment precision while maintaining ease of operation.
2Loss of information
If multiple cameras are used to capture images from different viewpoints, then three-dimensional model generation becomes possible, but the device complexity increases
Solution Approach 1:
The patent introduces a marker as an intermediary object that is imaged by multiple cameras. The marker serves as a common reference point that enables the system to calculate relative positional relationships between different camera viewpoints without requiring direct complex calibration between the cameras themselves. This intermediary approach preserves complete spatial information while simplifying the overall system complexity.
3Measurement precision
If a marker is used to specify relative positional relationships, then three-dimensional model accuracy improves, but the surgical field requires additional components
Solution Approach 1:
The patent employs a marker that can be a simple, inexpensive, and temporary component in the surgical field. The marker serves its purpose of enabling precise relative position specification for three-dimensional model generation, and can be easily added or removed without permanent modification to the surgical system. This approach achieves high measurement precision while minimizing the impact on device complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances the ability to accurately position and orient ultrasound probes, improving surgical precision and operability by providing clear, aligned visualizations of internal structures.
Implementation Method 1
acquire a first image and a second image by optically imaging a surgical field including a target part inside a body from different viewpoints using a first camera and a second camera
Data Source
AI summary
A medical support device including a processor, wherein the processor is configured to: acquire a first image and a second image by optically imaging a surgical field including a target part inside a body from different viewpoints using a first camera and a second camera; detect a marker composed of an optically detectable pattern disposed in the surgical field from at least the first image; and generate a three-dimensional model showing a surface shape of the target part based on a relative positional relationship between the viewpoint of the first camera and the viewpoint of the second camera, the first image, and the second image, the relative positional relationship being specified based on the marker.