Dynamic UI Prominence Adjustment for AR Overlay Visibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

User interface (UI) elements often lack visual prominence when overlaid on underlying content, particularly in environments with similar colors, and may become invisible when the user's field of view changes, such as during eye or head movement, leading to critical UI elements being overlooked.

Innovation Solution

A method that utilizes environmental sensors to determine the visual prominence of UI elements based on environmental characteristics, modifying their appearance and location to ensure visibility, even when the user's field of view changes, by adjusting factors like color, size, and position based on the prominence criterion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If UI elements are displayed with standard visual characteristics, then device complexity is reduced, but visual prominence and visibility are insufficient when overlaid on certain environmental backgrounds

Engineering Contradiction:
Improvevisibility of UI elementVSAvoidcomplexity of determining and modifying visual characteristics
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system dynamically changes visual parameters (color, size, font weight) of UI elements based on environmental characteristics detected by sensors. The processor modifies at least one visual characteristic of the UI element in response to determining environmental characteristics, ensuring the UI element maintains visual prominence across different backgrounds without requiring complex device architecture

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The UI element automatically adapts its visual characteristics based on environmental feedback. The system uses environmental sensors to detect background characteristics and automatically adjusts UI element properties without requiring manual intervention or complex external control systems, making the adaptation self-service nature

Inventive Principle:
Principle #25Self-service

2Loss of information

If UI elements are displayed only when objects are within field-of-view, then loss of information is reduced, but visibility is lost when user moves their head or eyes

Engineering Contradiction:
Improveinformation about objects leaving field-of-viewVSAvoidcontinuous visibility of critical UI elements
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The system performs preliminary actions by detecting when an object is at the boundary of the field-of-view and proactively maintains the UI element's visibility before the object completely leaves view. The processor determines to continue displaying the UI element based on object characteristics and environmental context, preventing information loss before it occurs

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from environmental sensors and field-of-view detection to continuously adjust UI element visibility. When an object leaves the field-of-view, the system receives feedback about the object's characteristics and environmental context, then determines whether to maintain UI element display based on this feedback loop

Inventive Principle:
Principle #23Feedback

3Reliability

If UI elements use small font size, then device complexity is reduced, but visual prominence is insufficient when overlaid on cluttered physical environments

Engineering Contradiction:
Improvevisual prominence of UI elementVSAvoidcomplexity of adjusting font size and visual characteristics
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system dynamically adjusts font size, color, and other visual parameters of UI elements based on environmental characteristics. The processor modifies these parameters in response to detecting environmental factors such as background clutter, ensuring UI elements maintain adequate visual prominence without requiring permanently complex device architecture

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11699412B2Application programming interface for setting the prominence of user interface elements
Publication Date: 2023.07.11 APPLE INC
  • US11699412B2 patent drawing
  • US11699412B2 patent drawing
  • US11699412B2 patent drawing

AI summary

In one implementation, a method includes: displaying a UI element as an overlay in a UI associated with a first FOV, wherein the first FOV is characterized by a first viewing vector of a physical environment; detecting a change from the first FOV to a second FOV, wherein the second FOV is characterized by a second viewing vector of the physical environment; and in response to detecting the change from the first FOV to the second FOV, determining a prominence-display value for the UI element; if the prominence-display value for the UI element exceeds a prominence threshold, displaying the UI element as the overlay in the UI associated with the second FOV; and if the prominence-display value for the UI element does not exceed the prominence threshold, ceasing display of the UI element in the UI associated with the second FOV.