Portable Holographic Interface for AR Object Relocation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Holographic objects in AR-HMD devices can be difficult for users to find and interact with when they are not designed to follow the user or maintain a consistent position and orientation in a 3D physical space, leading to usability issues such as losing track of menu items or struggling to read settings from across a room.

Innovation Solution

A portable holographic user interface, such as a holographic toolbox, that can be 'dropped' and unfolded in a location, allowing users to create and modify holographic objects, and automatically follows the user or maintains a consistent relative position and orientation, with features like automatic relocation and visual cues for location indication.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If holographic objects are displayed at fixed positions in 3D physical space, then users can locate them easily, but users cannot access them from different locations in the environment

Engineering Contradiction:
ImproveAccessibility of holographic objectsVSAvoidSystem complexity for tracking and relocating holographic objects
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The holographic container object is made dynamic by enabling it to automatically relocate to follow the user's position and orientation changes. The system continuously updates the container's position in 3D space based on user movement, transforming a static display system into a dynamic one that adapts to user location, thereby maintaining accessibility from different positions in the environment.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If multiple holographic user interface objects are displayed independently, then users can manipulate them separately, but users lose track of their locations and relationships

Engineering Contradiction:
ImproveManipulability of holographic objectsVSAvoidSpatial memory of object locations
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

Multiple independent holographic user interface objects are merged into a single holographic container object. This consolidation allows users to interact with one unified object rather than searching for multiple scattered objects. The container maintains the ability to hold and organize multiple objects internally while presenting a single external interface, reducing cognitive load and improving spatial awareness.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The holographic container object serves multiple functions: it acts as a locatable marker in the environment, a portable workspace, and a organizer for multiple user interface objects. By combining these functions into a single object, the system eliminates the need for users to remember multiple separate object locations while still providing full access to all contained objects.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If holographic objects are relocated to follow the user, then users can access them from any location, but the system requires continuous tracking and updating of object positions

Engineering Contradiction:
ImprovePortability of holographic workspaceVSAvoidAutomatic tracking and relocation functionality
Core Design Contradiction:
Adaptability or versatilityVSExtent of automation

Solution Approach 1:

The holographic container object implements self-service by automatically tracking the user's position and orientation and relocating itself accordingly without requiring explicit user commands for each movement. The system autonomously updates the container's position based on user navigation, reducing the need for complex continuous control while maintaining portability and accessibility.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9952656B2Portable holographic user interface for an interactive 3D environment
Publication Date: 2018.04.24 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9952656B2 patent drawing
  • US9952656B2 patent drawing
  • US9952656B2 patent drawing

AI summary

Disclosed are a method and corresponding apparatus to enable a user of a display system to manipulate holographic objects. Multiple holographic user interface objects capable of being independently manipulated by a user are displayed to the user, overlaid on a real-world view of a 3D physical space in which the user is located. In response to a first user action, the holographic user interface objects are made to appear to be combined into a holographic container object that appears at a first location in the 3D physical space. In response to the first user action or a second user action, the holographic container object is made to appear to relocate to a second location in the 3D physical space. The holographic user interface objects are then made to appear to deploy from the holographic container object when the holographic container object appears to be located at the second location.