Mixed Reality Control Layer for Legacy 2D Medical Interfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 2D interfaces in medical environments are not intuitive for augmented reality tools, increasing operational complexity and complexity in user tasks.
Innovation Solution
A device and method for controlling a 2D application in mixed reality by identifying and translating interactive elements from a 2D interface to a mixed reality display using a processor, allowing user input to control the 2D application through a mixed reality interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional 2D interfaces are used in augmented reality, then existing applications can be displayed, but the operational complexity and user task complexity increase
Solution Approach 1:
The patent introduces a processor as an intermediary that receives data from the 2D application, identifies interactive elements, translates them to mixed reality user interface features, and maps user inputs back to control the 2D application. This mediator layer enables compatibility without directly integrating 2D interfaces into AR, thereby reducing operational complexity while maintaining versatility.
2Adaptability or versatility
If traditional 2D interfaces are integrated into augmented reality tools, then functionality is maintained, but the interface becomes less intuitive
Solution Approach 1:
The patent changes the parameters of the user interface by translating 2D interactive elements into mixed reality-specific features. The processor identifies elements like buttons or controls and transforms them into appropriate 3D or spatial representations, changing the interaction parameters to match AR capabilities and making the interface more intuitive while retaining original functionality.
3Adaptability or versatility
If 2D applications are displayed in mixed reality, then existing software can be accessed, but the integration complexity increases
Solution Approach 1:
The patent extracts the core functionality of 2D applications by identifying interactive elements through data processing, then separates this functionality into a translation layer that converts it to mixed reality-compatible formats. This extraction approach allows access to existing applications while managing integration complexity through modular processing rather than direct integration.
Data Source
Figure 1~2
Figure 3
Figure 4~6
AI summary
The present invention relates to controlling a 2D application in a mixed reality application. In order to provide further simplification in terms of operating devices and equipment for the medical personnel, a device (10) for controlling a 2D application in a mixed reality application is provided. The device comprises a 2D application interface (12), a processor (14), a mixed reality application interface (16) and a control interface (18). The 2D application interface receives data representative of a 2D application. The application comprises interactive elements providing commands for user control of the 2D application. The processor identifies and extracts the interactive elements based on the data representative of the 2D application. The processor also translates the interactive elements to user interface features of a mixed reality display application. The processor further generates data for presenting the mixed reality display application and maps user input to commands for user control of the 2D application. The mixed reality application interface provides the mixed reality display application to a user as mixed reality. The control interface receives input from the user for the user interface features and provides the commands to the 2D application in order to control the 2D application. Hence, augmented reality interfaces are mapped to traditional 2D screen interfaces. This allows to integrate applications that only provided the interaction on a monitor with a mouse or the like to be operated in today's augmented reality environment.