Context Adaptive AR User Interface for Visual Distraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality displays often present user interface elements out-of-context with the real-world environment, leading to a distracting user experience as they do not integrate well with the physical surroundings.

Innovation Solution

A method and system for a see-through augmented reality display that identifies appearance characteristics of real objects and selects virtual objects to appear as if they have a physical connection with real objects, using graphical design rules to ensure contextually appropriate placement and appearance, such as size, shape, color, and orientation, to create a more integrated user interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If virtual interface elements are overlaid on the real-world view in augmented reality displays, then user interface functionality is provided, but the interface elements appear out-of-context with the real-world environment causing visual distraction

Engineering Contradiction:
Improveuser interface functionalityVSAvoidvisual distraction
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by analyzing specific surface properties of real-world objects (color, texture, geometry, material) and matching virtual interface elements to corresponding local characteristics. For example, virtual buttons are rendered with colors and textures that match the underlying real-world surface, creating localized visual integration that reduces distraction while maintaining interface functionality.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically changes visual parameters of virtual interface elements based on the real-world environment. This includes adjusting color, brightness, size, and opacity of UI elements to match the luminance and color temperature of the real-world scene, allowing the interface to blend seamlessly with varying environmental conditions and reduce visual distraction.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If virtual objects are displayed with consistent appearance regardless of real-world context, then interface design simplicity is maintained, but context awareness and integration with the environment are reduced

Engineering Contradiction:
Improveinterface design simplicityVSAvoidcontext awareness
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamics by making virtual interface elements adaptive rather than static. The system continuously monitors real-world environmental parameters (lighting conditions, background color, texture patterns) and dynamically adjusts the appearance of virtual objects to match. This allows a single interface design to automatically adapt to diverse contexts without requiring multiple specialized designs.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent creates a universal interface system that can function across diverse real-world environments. By using general appearance-matching algorithms that analyze common surface properties (color, texture, luminance), the same virtual interface elements can be deployed in various contexts (indoor/outdoor, different lighting conditions, various backgrounds) while automatically adapting to each environment's characteristics.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10019962B2Context adaptive user interface for augmented reality display
Publication Date: 2018.07.10 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10019962B2 patent drawing
  • US10019962B2 patent drawing
  • US10019962B2 patent drawing

AI summary

A user interface includes a virtual object having an appearance in context with a real environment of a user using a see-through, near-eye augmented reality display device system. A virtual type of object and at least one real world object are selected based on compatibility criteria for forming a physical connection like attachment, supporting or integration of the virtual object with the at least one real object. Other appearance characteristics, e.g. color, size or shape, of the virtual object are selected for satisfying compatibility criteria with the selected at least one real object. Additionally, a virtual object type and appearance characteristics of the virtual object may be selected based on a social context of the user, a personal context of the user or both.