Augmented Mirror Display for Surgical Robot Arm Setup
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The setup and correct configuration of robotic arms in surgical robotic systems are complex tasks, making it difficult for medical staff to visualize the correct pose and navigate around obstacles in the surgical environment.
Innovation Solution
A system using augmented reality (AR) that includes a camera and an AR processor to capture and process live video of robotic arm setup, rendering a virtual robotic arm in a target pose onto the live video, and streaming the augmented video to a display for visual guidance and feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If conventional methods are used to set up robotic arms, then the setup process becomes complex and time-consuming, but the medical staff cannot visualize the correct pose and spatial relationships
Solution Approach 1:
The patent introduces an augmented reality display as an intermediary between the medical staff and the robotic arm setup process. The display overlays virtual images showing correct poses and spatial relationships onto the real-world view, providing visual guidance without adding physical complexity to the robotic system itself.
Solution Approach 2:
The patent creates virtual copies of the robotic arm and surgical environment that are displayed through the augmented reality system. These virtual copies show the desired pose and configuration, allowing medical staff to visually compare and align the actual robotic arm with the virtual representation.
2Manufacturing precision
If the robotic arm setup is made more complex to achieve precise pose, then the setup time increases, but the correctness and reliability of the pose is improved
Solution Approach 1:
The augmented reality display provides real-time visual feedback to the medical staff during the setup process. By showing the current pose of the robotic arm overlaid with the target pose, the system enables continuous monitoring and adjustment, reducing the time needed to achieve precise positioning through iterative refinement.
Solution Approach 2:
The system pre-calculates and displays the target pose and configuration of the robotic arm before the actual setup begins. This preliminary visualization allows medical staff to plan and execute the positioning more efficiently, reducing setup time while maintaining precision.
3Ease of operation
If more visual information is provided to guide the setup, then the spatial awareness is improved, but the system complexity increases
Solution Approach 1:
The patent merges the real-world view with virtual guidance information in a single augmented reality display. By combining the actual camera feed of the surgical environment with overlaid virtual images showing correct poses and spatial relationships, the system provides comprehensive visual guidance without requiring separate displays or interfaces.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Assisting robotic arm setup in a surgical robotic system using augmented reality can include capturing a live video of a user setting up a robotic arm in a surgical robotic system. A visual guide representing a target pose of the robotic arm can be rendered onto the live video, resulting in an augmented live video for guiding the arm setup. The augmented live video can be displayed to the user while the user is following the visual guide to set up the robotic arm. The captured live video can be continuously processed to determine whether the robotic arm has reached the target pose.