Dynamic 3D Interaction Zones for Precise AR Button Targeting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional AR systems face challenges in accurately detecting and interpreting user interactions with virtual interface elements in 3D space due to factors such as lack of physical feedback, sensor limitations, and complexity of tracking user movements, often leading to erroneous selections and unintended interactions, especially when virtual elements are in close proximity.

Innovation Solution

A system that dynamically adjusts interaction zones based on factors like finger velocity, alignment, and temporal aspects of user movement, using smoothing and clamping techniques to improve accuracy and reliability of user interactions in 3D space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional AR systems use simple position-based detection methods, then the system complexity is low, but the accuracy of user interaction detection deteriorates leading to erroneous selections

Engineering Contradiction:
Improveaccuracy of user interaction detectionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by tracking finger velocity vectors and predicting intended targets before actual button selection occurs. This allows the system to anticipate user intent and prepare for accurate detection, resolving the contradiction by enhancing measurement precision through proactive tracking rather than reactive detection.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms by continuously monitoring finger movement patterns, velocity vectors, and alignment with virtual elements. This real-time feedback loop enables the system to adjust detection parameters dynamically, improving accuracy while managing complexity through adaptive rather than static detection methods.

Inventive Principle:
Principle #23Feedback

2Area of stationary object

If virtual interface elements are placed in close proximity to maximize screen utilization, then the area efficiency is improved, but the reliability of selection deteriorates due to difficulty in distinguishing between elements

Engineering Contradiction:
Improvescreen utilization efficiencyVSAvoidselection accuracy
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The system applies local quality by creating dynamically adjusted interaction zones around each virtual element based on its spatial relationship with the finger and other elements. Elements that are closer together receive more differentiated interaction zones, while maintaining overall compact layout, thus preserving both screen utilization and selection reliability.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses dynamics by making interaction zones adaptive rather than static. The zones expand or contract based on finger velocity, alignment, and proximity to multiple elements. This dynamic adjustment allows close placement of elements while maintaining reliable selection through context-aware zone modification.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If the interaction zones are made larger to improve ease of selection, then the ease of operation is improved, but the manufacturing precision of interaction boundaries deteriorates leading to unintended interactions

Engineering Contradiction:
Improveease of selectionVSAvoidinteraction boundary precision
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The system resolves this contradiction by making interaction zones dynamic rather than static. Zones expand to improve ease of selection when the finger is moving slowly or is well-aligned with the target, but contract or adjust boundaries when precision is needed to prevent unintended interactions, thus adapting to contextual requirements.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes parameters by adjusting interaction zone size and boundary characteristics based on multiple factors including finger velocity, alignment angles, and proximity to multiple elements. This parameter adaptation allows the system to optimize both ease of operation and boundary precision depending on the specific interaction context.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12468381B1Dynamic interaction zone system for accurate 3D button selection in augmented reality environments
Publication Date: 2025.11.11 SNAP INC
  • US12468381B1 patent drawing
  • US12468381B1 patent drawing
  • US12468381B1 patent drawing

AI summary

A head-wearable apparatus improves user interactions with virtual interface elements in augmented reality (AR) environments. The apparatus tracks hand movements in 3D space, calculating velocity vectors and positions of fingers. For each virtual interface element, it determines a UI-to-finger vector and calculates alignment with the finger's velocity vector. Interaction zones are dynamically adjusted based on this alignment and velocity magnitude. The system evaluates consistency between finger movement and element locations to predict intended targets. Interactions are triggered when fingers enter adjusted zones of predicted targets. This approach reduces erroneous selections and improves interaction accuracy, even for closely-spaced elements. The invention applies to various AR scenarios, enhancing user experiences in applications like gaming and education.