Input Mapping for Hologram and 2D Display Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems face challenges in allowing users to seamlessly interact with both three-dimensional holograms displayed on head-mounted devices and two-dimensional images on desktop or laptop computers using the same input device, such as a mouse, without requiring a switch to hand gestures.
Innovation Solution
A computing system that maps user input from a device like a mouse to either a two-dimensional or three-dimensional coordinate space based on the user's focus, allowing the same input device to be used for both holographic and flat panel displays by determining the user's gaze direction and mapping inputs accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a single input device is used to interact with both holograms and two-dimensional displays, then ease of operation is improved, but device complexity increases due to the need for coordinate space mapping and focus determination
Solution Approach 1:
The system introduces an intermediary processing layer that includes a focus determination module and a coordinate mapping module. These intermediaries translate between the user's natural input actions and the different coordinate systems of holographic and flat panel displays, resolving the contradiction by adding intelligent translation layers rather than requiring separate input devices
Solution Approach 2:
The system dynamically changes parameters including coordinate system type (2D vs 3D), active display device, and mapping transformation based on detected user focus. This allows a single input device to adapt to different interaction contexts without requiring physical reconfiguration or multiple devices
2Productivity
If the system automatically determines user focus to map inputs correctly, then productivity is improved, but device complexity increases due to gaze tracking and focus determination requirements
Solution Approach 1:
The system employs self-service mechanisms where the user's own gaze naturally indicates focus without requiring explicit commands. The focus determination module passively detects where the user is looking and automatically routes input to the appropriate display, allowing the system to serve itself by utilizing the user's natural behavior patterns
Solution Approach 2:
The system implements feedback loops where gaze detection results are fed back to adjust coordinate mapping in real-time. This continuous feedback mechanism enables automatic adaptation to user focus without manual intervention, improving productivity while managing complexity through closed-loop control
Data Source
AI summary
Various embodiments relating to editing holograms by extending real world interfaces are disclosed. One embodiment includes a computing device configured to communicatively couple to a head mounted display device having an at least partially see-through display. The computing device includes a non-see-through display, a user input device, and a processor configured to determine whether a user focus is on an image or a hologram, if a determination is made that the user focus is on the image, map the user input to a first coordinate space of the non-see-through display, and if a determination is made that the user focus is the on the hologram, map the user input to a second coordinate space of the head mounted display device.