Simulated Transparent Display Anchoring Annotations to Surgical Field
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current telementoring systems impose significant cognitive load on surgeons due to the need to shift focus between the operating field and a monitor displaying annotations, leading to potential surgery delays or errors, as static annotations can become disassociated from the operating field elements.
Innovation Solution
A simulated transparent display with augmented reality is used to superimpose annotations directly onto the surgical field of view, ensuring they remain anchored to specific elements even as the viewpoint or view field changes, allowing for real-time guidance without disrupting natural hand-eye coordination.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If annotations are displayed on a separate monitor, then the information can be clearly presented, but the surgeon must shift focus between the monitor and the operating field, increasing cognitive load and potentially causing delays
Solution Approach 1:
The patent merges the annotation display with the surgeon's direct view of the operating field by projecting annotations onto a transparent display overlay. This allows the surgeon to see both the surgical field and annotations simultaneously without shifting focus between separate monitors, eliminating the time loss associated with refocusing while maintaining clear presentation of annotation information.
Solution Approach 2:
The patent introduces a transparent display overlay as an intermediary between the surgeon and the operating field. This intermediary layer presents annotations directly in the surgeon's visual path without blocking the view of the surgical field, allowing simultaneous perception of both the operating field and annotation information, thereby eliminating focus shifts and associated time losses.
2Loss of information
If static annotations are used on a monitor, then the information can be displayed, but the annotations become disassociated from the operating field elements as the view changes
Solution Approach 1:
The patent implements dynamic annotations that automatically track and reposition themselves relative to the operating field elements as the camera view or surgical field changes. Unlike static annotations on a monitor, these annotations move with the referenced surgical elements, maintaining their association and relevance throughout the procedure regardless of viewpoint changes.
Solution Approach 2:
The system continuously monitors the position of operating field elements and uses this feedback to automatically adjust the position of annotations in real-time. This feedback mechanism ensures annotations remain correctly associated with their referenced elements even as the surgical field or camera角度 changes, maintaining adaptability without requiring manual repositioning.
3Loss of information
If the surgeon shifts focus to a monitor to view annotations, then the annotation information can be acquired, but natural hand-eye coordination is interfered with
Solution Approach 1:
The patent creates an equipotential visual environment where both the operating field and annotations are presented at the same visual plane and focus distance. By displaying annotations on a transparent overlay in the surgeon's direct line of sight rather than on a separate monitor requiring focus shifts, the system maintains constant hand-eye coordination without creating visual focal plane differences that would disrupt surgical performance.
Data Source
AI summary
A method and system for remote collaboration and remote instruction utilizing computing devices at trainee site and mentor sites are disclosed. Annotations are superimposed onto a trainee's view of a view field displayed using a simulated transparent display with augmented reality (“AR”). By tracking the position of the trainee's view point, the position of the trainee's computing device, and the geometry of the view field, the annotations remain anchored to the image of the view field when the trainee device moves and/or when the view field deforms or becomes occluded.