Mixed and Augmented Reality Workflow for Remote Procedure Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems and methods for using extended reality technology in procedures, such as medical and construction procedures, do not fully utilize its capabilities and can create barriers to adoption, particularly for individuals involved in the procedures.
Innovation Solution
Systems and methods that integrate mixed reality and augmented reality systems with computing devices, optical tracking devices, and workpiece registration members to enhance information sharing and procedure performance, allowing for interactive virtual elements and real-time tracking of physical items.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If extended reality technology is used in procedures, then information sharing and procedure performance are enhanced, but device complexity and barriers to adoption increase
Solution Approach 1:
The system is divided into separate mixed reality and augmented reality components, each serving specific functions. The mixed reality system handles procedural guidance and tracking, while the augmented reality system provides additional information layers, reducing the complexity burden on any single device
Solution Approach 2:
The extended reality system is designed to serve multiple functions including information sharing, procedural guidance, real-time tracking, and collaboration. This multi-functionality consolidates what would otherwise require multiple separate systems into a unified platform
2Loss of information
If mixed reality and augmented reality systems are integrated, then information sharing capability is improved, but device complexity increases
Solution Approach 1:
A computing device acts as an intermediary between the mixed reality and augmented reality systems, managing data flow and coordination. This mediator handles the complexity of integration while presenting simplified interfaces to users
Solution Approach 2:
The mixed reality and augmented reality systems are merged through shared communication links and coordinated processing. This integration allows seamless information sharing between different reality environments while maintaining unified system management
Data Source
AI summary
The technical description relates to mixed reality, augmented reality, and their use in the sharing of information about a procedure and in the performing of a procedure. A method for sharing information about a procedure and performing the procedure includes using a mixed reality system in a first location to display a mixed reality image having a virtual element representing information related to the procedure, instructing an information recipient to use an augmented reality system to view the virtual element, interacting with the virtual element to create a transformed virtual element, and manipulating a physical element in a second location while performing the procedure. Specific examples described herein relate to the field of medicine, and to orthopedics in particular.