Surgical Robot Image Reconstruction for Console Motion Review
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing surgical robot systems lack the ability to easily and accurately confirm the motion of surgical instruments and the operation of the console during surgeries, making it difficult for operators to improve their skills and for observers to learn from skilled operators.
Innovation Solution
A method and system that generate a surgical image by obtaining a state log of the operation device, generating a reconstructed image visualizing the operator's motion, and associating it with a motion image of the surgical robot or instruments, using an information processing system to store and provide this image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If only the captured image showing the state of surgery is provided, then the surgical procedure can be recorded, but it is difficult to confirm how the operator was operating the console during the surgery
Solution Approach 1:
The surgical image is segmented into multiple components: motion image (surgical field), reconstructed image (console operation states), and state log data. This segmentation allows each component to serve its specific function while collectively providing complete surgical information including operator actions.
Solution Approach 2:
A state log is introduced as an intermediary data structure that records operator operations on the console. This state log serves as a mediator between the physical console operations and the visual representation in the reconstructed image, enabling accurate recording and playback of operator actions without requiring direct complex sensing of console states.
2Measurement precision
If detailed operation logs are recorded to improve skill analysis, then learning effectiveness increases, but data processing complexity increases
Solution Approach 1:
The system creates a simplified copy of the console operation states through the state log, which records essential operation information without requiring complex sensing or processing of all console parameters. This copy enables precise measurement of operator actions while keeping the data processing system relatively simple.
Solution Approach 2:
The patent replaces complex mechanical sensing systems that would physically monitor console operations with an information-based approach using state logs and software processing. This substitution reduces hardware complexity while maintaining or improving measurement precision through digital recording and reconstruction of operation states.
Data Source
AI summary
Disclosed is a surgical image providing method using a surgical robot for providing an image of a surgery performed by the surgical robot, the surgical robot including an arm device to which a surgical instrument is attached, and an operation device that an operator operates to drive the arm device. The method includes: obtaining a state log indicating a state of an operation target of the operation device, the state being changed according to an operation of the operator to the operation target; generating a reconstructed image visualizing the operation of the operator to the operation target, on the basis of the state log; and providing a surgical image in which a motion image showing a motion of the surgical robot or the surgical instrument is associated with the reconstructed image.


