Object-Based Glint Grouping for AR Visual Clutter Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The field-of-view becomes overcrowded with glints in electronic devices equipped with cameras, diminishing the user experience due to the detection of multiple actionable items, which can lead to clutter and inaccuracies in selecting the correct glint.

Innovation Solution

Glints are grouped into groups represented by group glints, which when selected, expand to display the constituent glints, with grouping methods based on proximity or association with objects, reducing visual clutter and improving selection accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple glints are displayed to indicate detected actionable items, then the system provides comprehensive information about detected objects, but the field-of-view becomes overcrowded and user experience deteriorates

Engineering Contradiction:
Improveinformation about actionable itemsVSAvoiduser experience
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

Multiple individual glints representing actionable items associated with the same object are merged into a single group glint. This combining approach maintains the information about multiple actionable items while presenting a unified visual indicator that prevents field-of-view clutter, thus resolving the contradiction between providing comprehensive information and maintaining ease of operation.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The group glint serves multiple functions simultaneously: it indicates the presence of an object, shows that multiple actionable items are detected, and provides a selectable interface element. This multi-functionality allows the system to convey comprehensive information about actionable items while using a single visual element that maintains user experience quality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple glints are displayed for each actionable item, then complete action options are presented to the user, but selection accuracy decreases due to clutter

Engineering Contradiction:
Improveaction optionsVSAvoidselection accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

Multiple glints for actionable items related to the same object are combined into a single group glint, reducing visual clutter and improving selection accuracy. The group glint maintains adaptability by representing multiple action options, allowing users to select from comprehensive action sets without the confusion of scattered individual indicators.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The group glint acts as an intermediary between the multiple actionable items and the user interface. It consolidates multiple action options into a single selectable element, improving selection accuracy while preserving the versatility of available actions through hierarchical expansion or contextual display.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If glints are grouped by proximity, then visual clutter is reduced through spatial organization, but association with specific objects may become ambiguous

Engineering Contradiction:
Improvevisual clarityVSAvoidobject association
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

Glints are merged into groups based on spatial proximity to their associated objects, creating visually organized clusters that reduce clutter. The grouping mechanism maintains object association by anchoring each group glint to its parent object's location, ensuring that spatial organization does not sacrifice the information about which object the actionable items belong to.

Inventive Principle:
Principle #5Merging (Combining)

4Measurement precision

If individual glints are displayed for each actionable item, then each action is clearly identifiable, but the field-of-view becomes cluttered and difficult to navigate

Engineering Contradiction:
Improveaction identificationVSAvoidfield-of-view complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Individual glints for actionable items associated with the same object are merged into a single group glint, significantly reducing field-of-view complexity. The group glint preserves action identification capability by maintaining the association between the consolidated indicator and its parent object, allowing users to navigate the interface more easily without losing the ability to identify specific actions.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS20240411422A1Object-Based Glint Grouping
Publication Date: 2024.12.12 APPLE INC
  • US20240411422A1 patent drawing
  • US20240411422A1 patent drawing
  • US20240411422A1 patent drawing

AI summary

In one implementation, a method of displaying a plurality of glints method includes capturing an image of an environment including a plurality of objects. The method includes detecting, in the image of the environment, a plurality of actionable items respectively associated with a plurality of actions. The method includes relating the actionable items to respective ones of the plurality of objects. The method includes displaying a plurality of group user interface elements in respective association with the plurality of objects. The method includes detecting user input directed to a particular group user interface element of the plurality of group user interface elements associated with a particular object of the plurality of objects. The method includes displaying a plurality of user interface elements in respective association with those of the plurality of actionable items related to the particular object.