Surgical Robot Image Reconstruction for Console Operation Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing surgical robot systems lack the ability to easily and accurately confirm the motion of surgical instruments and the operation of the console during surgeries, making it difficult for operators to improve their skills and for observers to learn from skilled operators.
Innovation Solution
A method and system that generates a surgical image by obtaining a state log of the operation device, reconstructing an image to visualize the operation, and associating it with a motion image of the surgical robot or instruments, allowing for easy and accurate confirmation of the operator's actions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If only the captured image showing the state of surgery is provided, then the surgical procedure can be documented, but the operator's console operations and skill development cannot be effectively analyzed
Solution Approach 1:
The system segments the visualization into distinct components: the captured surgical image and the separately generated reconstructed image showing console operations. This segmentation allows each image type to serve its specific purpose without cluttering the other, preserving operator information while maintaining system clarity.
Solution Approach 2:
The system introduces an intermediary reconstructed image that mediates between the raw captured image and the operator's operations. This reconstructed image acts as a bridge, translating console operation data into visual form that can be overlaid or associated with the surgical imagery, thereby recovering lost operator information without directly modifying the capture system.
2Ease of operation
If detailed operation logs are collected and visualized, then operator skill improvement can be facilitated, but the system complexity and data processing requirements increase
Solution Approach 1:
The system creates a copied visual representation (reconstructed image) of the operator's console operations based on state log data. Instead of directly analyzing raw operational data, the system generates a visual copy that mirrors the operator's actions, making skill analysis easier while keeping the data processing system relatively simple.
Solution Approach 2:
The reconstructed image provides visual feedback to operators and observers about the console operations performed during surgery. This feedback mechanism enables skill improvement by allowing comparison of operational techniques, while the feedback is generated through straightforward visualization of existing state log data rather than complex real-time processing.
Data Source
AI summary
Disclosed is a surgical image providing method using a surgical robot for providing an image of a surgery performed by the surgical robot, the surgical robot including an arm device to which a surgical instrument is attached, and an operation device that an operator operates to drive the arm device. The method includes: obtaining a state log indicating a state of an operation target of the operation device, the state being changed according to an operation of the operator to the operation target; generating a reconstructed image visualizing the operation of the operator to the operation target, on the basis of the state log; and providing a surgical image in which a motion image showing a motion of the surgical robot or the surgical instrument is associated with the reconstructed image.