Surgical Robot Console Interface for In-View Instrument Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current surgical robot control systems face challenges in efficiently managing multiple instruments and reducing operator error, particularly when the operator needs to shift attention from the video stream to check the status of the arms or instruments, leading to potential errors during complex tasks like surgery.
Innovation Solution
A control system that allows a surgeon console to receive state signals from multiple instruments, determine a graphical arrangement of icons for display, and modify the display to indicate selectable instruments, enabling seamless selection and control of instruments without diverting attention from the primary task, using a combination of mode change signals, select signals, and visual processing to highlight and transition icons.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the operator shifts attention from the video stream to check the status of arms or instruments, then the operator can monitor system status, but the operator is not paying sufficient attention to the video stream which risks operator error
Solution Approach 1:
The system provides continuous visual feedback through the video stream showing instrument status, arm position, and operational state directly in the operator's field of view. This allows the operator to monitor system status without diverting attention from the primary video feed, maintaining both safety and ease of operation.
Solution Approach 2:
The system uses color-coded visual indicators (such as colored overlays or highlights in the video stream) to indicate different instrument states, arm positions, or operational modes. These visual cues allow rapid status assessment without requiring the operator to shift attention away from the video stream.
2Loss of information
If the robot presents visual indication of the state of the robot to help the operator understand inputs required, then the operator can understand robot state, but the operator still needs to shift attention away from the video stream to check status or change instruments
Solution Approach 1:
The system merges the instrument status display and video stream into a single integrated visual interface. Information about robot state and instrument status is overlaid or integrated directly onto the video feed, eliminating the need for separate displays that would require the operator to shift attention between multiple sources.
Solution Approach 2:
The system adds informational dimensions to the existing video stream by overlaying graphical elements, icons, or data layers that provide instrument status and robot state information. This allows multiple types of information to be presented simultaneously in the same visual space without requiring the operator to switch between separate displays.
3Adaptability or versatility
If the operator needs to change which instrument they are controlling, then the operator can select different instruments, but the operator must shift attention from the video stream which increases risk of error
Solution Approach 1:
The system provides immediate visual feedback in the video stream to confirm instrument selection status, showing which instrument is currently active or selectable. This feedback mechanism allows the operator to verify selections without diverting attention from the video feed, maintaining reliability while enabling versatile instrument switching.
Data Source
Figure 1
Figure 2~3A
Figure 3B
AI summary
A control system for controlling a surgical robot by a surgeon console remote from the surgical robot, the control system being configured to: receive one or more state signal associated with a plurality of instruments, each of the plurality of instruments being attachable to the surgical robot, the one or more state signal indicating a selectability of each of the plurality of instruments for control by the surgeon console, and a control mode of each of the plurality of instruments from a group of modes, the group of modes comprising a manipulation mode in which an instrument of the plurality of instruments is controllable by the surgeon console, and a selection mode in which an instrument of the plurality of instruments is selectable for control by the surgeon console; determine a graphical arrangement of icons for display in dependence on the received one or more state signal, where each icon represents a respective one of the plurality of instruments, and output a display signal to cause the graphical arrangement of icons to be displayed; receive a mode change signal indicating a change of mode to the selection mode; modify, in response to the received mode change signal, the graphical arrangement of icons to permit identification of selectable instruments of the plurality of instruments; receive a select signal from the surgeon console indicating a selection of one of the selectable instruments; modify,in response to the received select signal, the graphical arrangement of icons to permit identification of the selected instrument; and enable control of the selected instrument by the surgeon console.