Smart Glasses Dynamic Input System for Hand Availability States

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Smart glasses user interfaces struggle to dynamically adjust content and navigation rules based on the availability of a user's hands for gesture-based navigation, leading to reduced comfort and effectiveness during AR interactions.

Innovation Solution

A computer-implemented method that determines the initial availability state of a user's hands using image data, selects a UI configuration and control profile from stored options based on this state and context, and initiates UI navigation events accordingly, allowing for real-time adjustments to ensure comfortable and effective gesture-based navigation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the UI configuration is fixed and does not adapt to hand availability, then the system complexity is reduced, but the adaptability and user comfort during AR interactions deteriorates

Engineering Contradiction:
Improveadaptability to hand availabilityVSAvoidUI configuration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic UI configuration that automatically adjusts based on real-time detection of hand availability states. The system transitions from static to dynamic control profiles, reconfiguring UI elements, navigation options, and interaction modes according to whether hands are available or occupied, thereby achieving adaptability without requiring complex manual setup

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs self-service mechanisms by automatically detecting hand availability through image data processing and autonomously selecting appropriate UI configurations and control profiles. This eliminates the need for users to manually adjust settings, allowing the interface to adapt itself based on observed physical states, thus improving adaptability while keeping the user experience simple

Inventive Principle:
Principle #25Self-service

2Ease of operation

If gesture-based navigation is always available, then the ease of operation is improved, but the reliability of navigation accuracy deteriorates when hands are occupied

Engineering Contradiction:
Improvegesture-based navigation easeVSAvoidnavigation accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system continuously monitors hand availability through image data capture and processing, providing real-time feedback about the user's physical state. Based on this feedback, the system dynamically adjusts the availability of gesture-based navigation and switches between different control profiles, ensuring that navigation options remain reliable and accurate by only enabling gestures when hands are actually available

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The control profile dynamically changes based on detected hand availability states. When hands are detected as occupied or unavailable, the system transitions from gesture-based control to alternative navigation methods, maintaining navigation reliability while preserving ease of operation by always having appropriate controls available for the current physical state

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12183074B2Dynamic input system for smart glasses based on user availability states
Publication Date: 2024.12.31 KYNDRYL INC
  • US12183074B2 patent drawing
  • US12183074B2 patent drawing
  • US12183074B2 patent drawing

AI summary

A dynamic user interface (UI) input system and method for smart glasses based on availability states of a user is provided. In embodiments, a method includes determining, by a computing device of smart glasses, an initial availability state of a user's hands for a user interface (UI) navigation event based on incoming image data; selecting, by the computing device, a UI configuration and a control profile for the UI navigation event from stored UI configurations and control profiles of the user based on the initial availability state of the user's hands; and initiating, by the computing device, the UI navigation event based on the selected UI configuration and the control profile, wherein content is displayed in a virtual UI of the smart glasses according to the UI configuration, and UI navigation by the user is controlled based on the control profile.