Surgical Assistance System Low Latency Annotation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing surgery assistance systems face challenges in providing real-time, low-latency display of endoscope images with superimposed instruction contents to both surgical operators and instructors, which is critical for ensuring patient safety and effective surgical guidance.
Innovation Solution
The proposed assistance system includes an operation-side system and an instruction-side system, each equipped with information processing devices that transmit and generate drawing information, annotation image data, and combined image data. This configuration allows for the real-time transmission and display of endoscope images with superimposed annotations, ensuring minimal latency and effective communication between the surgical operator and the instructor.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If annotation image data is transmitted from the instruction-side system to the operation-side system, then the instructor can provide real-time guidance, but the transmission latency increases
Solution Approach 1:
The patent divides the annotation data transmission into two segments: drawing information (coordinates, colors, line types) is transmitted from the instruction-side system, and annotation image data is generated locally at the operation-side system. This segmentation reduces transmission data volume and latency while maintaining real-time guidance accuracy.
Solution Approach 2:
The operation-side system acts as an intermediary by receiving drawing information and locally generating annotation image data. This intermediary process eliminates the need for the instruction-side system to generate and transmit complete annotation images, reducing transmission latency while preserving guidance accuracy.
2Measurement precision
If complete annotation image data is generated and transmitted, then annotation accuracy is improved, but communication bandwidth consumption increases
Solution Approach 1:
The patent extracts only the essential drawing information (coordinates, colors, line types) from the complete annotation image data and transmits this extracted information. The operation-side system then reconstructs the annotation image data locally, reducing communication bandwidth consumption while maintaining annotation accuracy.
Solution Approach 2:
Instead of transmitting the original annotation image data, the system transmits drawing information that serves as a template. The operation-side system creates a local copy of the annotation image data based on this template, reducing bandwidth usage while preserving annotation fidelity.
3Productivity
If real-time image processing is performed at both systems, then collaboration effectiveness is improved, but system complexity increases
Solution Approach 1:
The patent implements different processing capabilities at different locations: the instruction-side system performs simple drawing information generation, while the operation-side system performs the more complex annotation image data generation. This local quality differentiation improves collaboration effectiveness while managing system complexity through asymmetric resource allocation.
Data Source
AI summary
An information processing device in an instruction-side system of an assistance system comprising an operation-side system and the instruction-side system separated from the operation-side system, the information processing device comprising a processor configured to transmit drawing information based on an operation input to the operation-side system, generate annotation image data based on the drawing information, and receive image data from the operation-side system and combine the image data with the annotation image data.