3D Painting Controls for Complex Eyewear Menu Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Smart glasses with limited user input interfaces restrict navigation through complex menu structures, limiting interaction with virtual content.

Innovation Solution

A system that utilizes multiple types of user inputs, including touch and gesture controls, to navigate through a complex augmented reality painting menu on eyewear devices, allowing seamless selection and manipulation of painting options without releasing a finger from the touch interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a single touch input interface is used in smart glasses, then the device structure remains simple, but the user cannot navigate through complex menu structures efficiently

Engineering Contradiction:
Improvemenu navigation capabilityVSAvoiduser input interface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extends the touch interface from a two-dimensional screen to a three-dimensional spatial interface by allowing finger gestures in multiple directions (horizontal, vertical, and radial movements) on the touch sensor. This dimensional expansion enables complex menu navigation without adding physical buttons or controls, resolving the contradiction between operational capability and device complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system dynamically interprets different finger movement patterns (tap, slide, pinch, palm-up gestures) as different navigation commands. By making the interface adaptive and context-aware rather than static, the single touch interface can handle complex menu structures through varied interaction modes, improving ease of operation without increasing hardware complexity.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If multiple finger gestures are supported for menu navigation, then interaction with virtual content improves, but the difficulty of detecting and measuring user inputs increases

Engineering Contradiction:
Improvevirtual content interactionVSAvoidgesture input detection complexity
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces an intermediary gesture recognition system that translates complex finger movements into standardized navigation commands. By using the touch sensor as an intermediary device that can detect multiple gesture types through software processing, the system achieves improved interaction without requiring complex hardware sensors, thus managing the detection complexity challenge.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system provides visual feedback through the display showing the current menu level and selected options in real-time. This feedback mechanism helps users understand the state of navigation and reduces the cognitive load for interpreting gestures, making the interaction more intuitive while the touch sensor continues to handle gesture detection through processed signals.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If a comprehensive painting menu with multiple options is displayed, then the functionality and versatility of the system improves, but the number of pages and inputs needed to access options increases

Engineering Contradiction:
Improvepainting option varietyVSAvoidtime to access painting options
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The painting menu is segmented into hierarchical levels with frequently used options accessible at higher levels and less frequent options at lower levels. The palm-up gesture enables users to jump between these hierarchical levels, effectively segmenting the menu structure to reduce navigation time while maintaining comprehensive functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system displays the most relevant painting options (such as brush color and style) at the top level of the menu hierarchy by default, performing preliminary organization of information based on usage frequency. This preliminary action reduces the time needed to access commonly used painting features without limiting the overall versatility of the system.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12443335B23D painting on an eyewear device
Publication Date: 2025.10.14 SNAP INC
  • US12443335B2 patent drawing
  • US12443335B2 patent drawing
  • US12443335B2 patent drawing

AI summary

Systems and methods are provided for performing operations comprising: displaying a plurality of augmented reality painting options; detecting, by a touch input interface of the eyewear device, a first touch input comprising a single finger touching the touch input interface; selecting a first augmented reality painting option of the plurality of augmented reality painting options in response to the first touch input; while continuing to detect continuous touch between the single finger and the touch input interface following selection of the first augmented reality painting option, displaying a second augmented reality painting option related to the first augmented reality painting option; and performing a selection associated with the second augmented reality painting option in response to detecting, by the touch input interface, movement of the single finger along the touch input interface while continuing to detect the continuous touch.