Context-Aware AR Command Interface for Dynamic Object State Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented reality computing devices, users face complexity in navigating interactions due to varying commands associated with different objects and their states, making it difficult to keep track of available actions in real-time.

Innovation Solution

A see-through display system presents to the user a dynamic set of commands based on the identity and state of selected objects, using sensors for object detection and state changes, allowing only current available commands to be displayed, facilitating intuitive interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If all possible commands are always presented to the user, then the user has access to complete functionality, but the interface complexity and difficulty of operation increase significantly

Engineering Contradiction:
Improvecommand availabilityVSAvoiduser interaction complexity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The user interface dynamically adjusts the set of presented commands based on the current state of the augmented reality environment and the selected object. Instead of statically displaying all possible commands, the system filters and presents only those commands that are currently applicable, reducing cognitive load while maintaining full functionality when needed.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Different sets of commands are presented based on the local context - specifically, the type of object selected and its current state. Each object type (e.g., image, video, contact) has its own relevant command set, allowing the interface to be simplified for each specific situation rather than presenting a universal complex menu for all scenarios.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If the system provides comprehensive command options for all object states, then functionality is complete, but the learning curve increases and usability decreases

Engineering Contradiction:
Improvecommand coverageVSAvoidinterface complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The interface complexity dynamically adapts to the current operational context. When an object is selected, the system determines its state and automatically filters the command set to show only relevant options. This dynamic filtering reduces the perceived complexity while maintaining comprehensive functionality across different object states.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The command interface is segmented into context-specific subsets based on object type and state. Rather than presenting a single comprehensive menu, the system divides commands into multiple smaller, context-relevant groups, making the interface less overwhelming while ensuring all necessary functions remain accessible through appropriate context.

Inventive Principle:
Principle #1Segmentation

3Loss of information

If the system displays all available commands at all times, then users have full information, but the information overload makes navigation difficult

Engineering Contradiction:
Improvecommand information completenessVSAvoidcommand navigation ease
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

Information is tailored to the local context of the selected object and its state. The system presents only the command information that is relevant to the current situation, preventing information overload while ensuring that complete information is available when needed for the specific context at hand.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The information presented to the user dynamically changes based on the current state of the selected object. As the object state changes or different objects are selected, the command information automatically updates to reflect only what is currently applicable, maintaining information completeness for the relevant context while avoiding irrelevant information.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10705602B2Context-aware augmented reality object commands
Publication Date: 2020.07.07 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10705602B2 patent drawing
  • US10705602B2 patent drawing
  • US10705602B2 patent drawing

AI summary

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes receiving a user input selecting an object in a field of view of the see-through display system, determining a first group of commands currently operable based on one or more of an identification of the selected object and a state of the object, and presenting the first group of commands to a user. The method may further include receiving a command from the first group of commands, changing the state of the selected object from a first state to a second state in response to the command, determining a second group of commands based on the second state, where the second group of commands is different than the first group of commands, and presenting the second group of commands to the user.