Multi-Camera Surgical Assistance for Wider Views and Tool Obstruction Removal
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Endoscopic surgeries face challenges in ensuring a wide field of view due to the inability to capture images outside the camera's field of view and complex image synthesis, leading to potential vascular injuries and insufficient visibility during operations.
Innovation Solution
A surgery support system with a surgical assistance device equipped with multiple image capturing units that capture images inside the body cavity, synthesizes these images to generate a wider field of view, and removes obstructing tool images using machine learning and obstructing object removal processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If multiple cameras are arranged at the tip of trocars to capture images inside the body cavity, then the field of view is improved, but the complexity of image synthesis increases due to the need for position markers and position sensors
Solution Approach 1:
The patent extracts the position detection function from complex position sensors and position markers, replacing them with a simplified approach where the surgical instrument itself serves as the reference object. The image synthesis system only needs to detect the position of the surgical instrument relative to the body surface, eliminating the need for separate position markers and complex sensor systems on each camera.
Solution Approach 2:
The surgical instrument serves multiple functions: it is both the tool for surgical intervention and the reference object for position detection. This multi-functionality eliminates the need for separate position markers, as the instrument's own position and orientation provide the necessary reference information for synthesizing images from multiple cameras.
2Measurement precision
If cameras are arranged at the tip of trocars to capture surgical field images, then the visibility of the surgical site is improved, but the ability to view areas outside the camera range is lost
Solution Approach 1:
The patent merges multiple image data from different cameras positioned at various trocars into a single synthesized image that displays the entire surgical field. By combining the visual information from multiple limited fields of view, the system achieves a comprehensive panoramic view that shows both the detailed surgical site and the broader surgical context.
3Adaptability or versatility
If surgical instruments are inserted into the body cavity for treatment, then the treatment capability is improved, but the instruments obstruct the view of the surgical field
Solution Approach 1:
The patent uses the surgical instrument's position information as an intermediary to manage the conflict between instrument presence and field of view. By detecting and displaying the instrument's position, the system allows surgeons to understand instrument location even when the instrument blocks the direct visual field, effectively mediating between the need for instrument insertion and the need for clear visualization.
Data Source
AI summary
An object is to provide a surgery support system that can ensure a better field. The object can be achieved by a surgery support system including a surgical assistance device, an image processing unit, and a display unit. The image capturing units are configured such that a plurality of image capturing units are provided to the surgical assistance device, the image capturing units captures an image so that inside of the body cavity appears in the image, and when the treatment tool is inserted in the body cavity, the image capturing units captures an image so that the inside of the body cavity including the treatment tool appears in the image, and the image processing unit is configured to synthesize images obtained from image capturing units to generate synthesized image, and perform an obstructing object removal process of removing at least a part of image of the treatment tool.