Mixed Reality Device Virtual Object Visibility Guidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mixed reality devices struggle to efficiently display virtual objects in real space, leading to reduced work efficiency and increased risk of accidents when virtual objects are not within the wearer's visible region.

Innovation Solution

The mixed reality device sets an origin for a virtual space using a prescribed object in the real space, acquires the display position of virtual objects in a three-dimensional coordinate system, and displays a guide indicating the direction of the virtual object when it is not within the visible region.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If virtual objects are displayed in a three-dimensional coordinate system without visibility guidance, then the device complexity is reduced, but the ease of operation deteriorates because users cannot efficiently locate virtual objects outside the visible region

Engineering Contradiction:
Improveease of locating virtual objectsVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

A guide object is introduced as an intermediary element between the user and the virtual object. The guide object displays directional information indicating where to look for the virtual object, serving as a mediator that resolves the spatial disorientation without requiring complex system-level changes. This intermediary provides visibility guidance while maintaining relatively simple device architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback by continuously monitoring the user's visible region and comparing it with the position of virtual objects. When a virtual object is detected outside the visible region, the system provides feedback through the guide object that indicates the direction and distance to the virtual object. This feedback loop enables users to efficiently locate virtual objects without increasing overall device complexity.

Inventive Principle:
Principle #23Feedback

2Productivity

If the system continuously monitors and adjusts virtual object display positions, then the productivity is improved, but the use of energy increases due to continuous processing and rendering

Engineering Contradiction:
Improvework efficiencyVSAvoidenergy consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

Instead of continuous monitoring and adjustment, the system employs periodic detection of the user's visible region and virtual object positions. The guide object is updated only when necessary - specifically when a virtual object enters or exits the visible region. This periodic action maintains productivity by ensuring virtual objects remain locatable while significantly reducing energy consumption compared to continuous processing.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system performs partial monitoring by focusing only on detecting whether virtual objects are within the visible region, rather than continuously tracking all aspects of the virtual environment. The guide object provides directional information without requiring full re-rendering of the virtual scene. This partial action approach maintains work efficiency while avoiding the energy costs of complete system-wide processing.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of time

If virtual objects are displayed without directional guidance, then the device complexity is reduced, but the loss of time increases as users search for virtual objects outside the visible region

Engineering Contradiction:
Improvetime to locate virtual objectsVSAvoiddevice complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system performs preliminary detection of virtual object positions relative to the user's visible region before the user needs to search. By proactively identifying when virtual objects are outside the visible region and pre-displaying directional guidance through the guide object, the system eliminates the time users would otherwise spend searching. This preliminary action reduces time loss without requiring complex real-time tracking systems.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The guide object serves as an intermediary that provides directional information to users, enabling them to quickly locate virtual objects without extensive searching. This intermediary element bridges the gap between the user's current view and the virtual object's location, significantly reducing the time required to find virtual objects while maintaining relatively simple device architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20250123676A1Mixed reality device, processing method, and storage medium
Publication Date: 2025.04.17 KK TOSHIBA
  • US20250123676A1 patent drawing
  • US20250123676A1 patent drawing
  • US20250123676A1 patent drawing

AI summary

According to one embodiment, a mixed reality device is configured to display a virtual space to overlap a real space. The mixed reality device is configured to set an origin of the virtual space by using a prescribed object imaged in the real space. The mixed reality device is configured to acquire a display position of a virtual object in a three-dimensional coordinate system based on the origin. The mixed reality device is configured to determine whether or not the display position is present inside a visible region set in front of the mixed reality device. The mixed reality device is configured to display a guide indicating a direction of the display position when the display position is not present inside the visible region.