Mixed Reality Device Virtual Object Visibility Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mixed reality devices struggle to efficiently display virtual objects in real space, leading to reduced work efficiency and increased risk of accidents when virtual objects are not within the wearer's visible region.
Innovation Solution
The mixed reality device sets an origin for a virtual space using a prescribed object in the real space, acquires the display position of virtual objects in a three-dimensional coordinate system, and displays a guide indicating the direction of the virtual object when it is not within the visible region.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If virtual objects are displayed in a three-dimensional coordinate system without visibility guidance, then the device complexity is reduced, but the ease of operation deteriorates because users cannot efficiently locate virtual objects outside the visible region
Solution Approach 1:
A guide object is introduced as an intermediary element between the user and the virtual object. The guide object displays directional information indicating where to look for the virtual object, serving as a mediator that resolves the spatial disorientation without requiring complex system-level changes. This intermediary provides visibility guidance while maintaining relatively simple device architecture.
Solution Approach 2:
The system implements feedback by continuously monitoring the user's visible region and comparing it with the position of virtual objects. When a virtual object is detected outside the visible region, the system provides feedback through the guide object that indicates the direction and distance to the virtual object. This feedback loop enables users to efficiently locate virtual objects without increasing overall device complexity.
2Productivity
If the system continuously monitors and adjusts virtual object display positions, then the productivity is improved, but the use of energy increases due to continuous processing and rendering
Solution Approach 1:
Instead of continuous monitoring and adjustment, the system employs periodic detection of the user's visible region and virtual object positions. The guide object is updated only when necessary - specifically when a virtual object enters or exits the visible region. This periodic action maintains productivity by ensuring virtual objects remain locatable while significantly reducing energy consumption compared to continuous processing.
Solution Approach 2:
The system performs partial monitoring by focusing only on detecting whether virtual objects are within the visible region, rather than continuously tracking all aspects of the virtual environment. The guide object provides directional information without requiring full re-rendering of the virtual scene. This partial action approach maintains work efficiency while avoiding the energy costs of complete system-wide processing.
3Loss of time
If virtual objects are displayed without directional guidance, then the device complexity is reduced, but the loss of time increases as users search for virtual objects outside the visible region
Solution Approach 1:
The system performs preliminary detection of virtual object positions relative to the user's visible region before the user needs to search. By proactively identifying when virtual objects are outside the visible region and pre-displaying directional guidance through the guide object, the system eliminates the time users would otherwise spend searching. This preliminary action reduces time loss without requiring complex real-time tracking systems.
Solution Approach 2:
The guide object serves as an intermediary that provides directional information to users, enabling them to quickly locate virtual objects without extensive searching. This intermediary element bridges the gap between the user's current view and the virtual object's location, significantly reducing the time required to find virtual objects while maintaining relatively simple device architecture.
Data Source
AI summary
According to one embodiment, a mixed reality device is configured to display a virtual space to overlap a real space. The mixed reality device is configured to set an origin of the virtual space by using a prescribed object imaged in the real space. The mixed reality device is configured to acquire a display position of a virtual object in a three-dimensional coordinate system based on the origin. The mixed reality device is configured to determine whether or not the display position is present inside a visible region set in front of the mixed reality device. The mixed reality device is configured to display a guide indicating a direction of the display position when the display position is not present inside the visible region.


