Virtual Keyboard Gesture Mapping for Wearable Text Input

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Wearable devices, such as XR headsets and smart glasses, lack effective methods for users to provide text input without voice, physical keyboards, or secondary input devices.

Innovation Solution

Implementing a virtual keyboard that allows users to input text using pinching, tapping, or other gestures, detected by integrated cameras and sensors, which map gesture locations to keyboard positions using computer vision and predictive models.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a virtual keyboard is implemented on a wearable device, then text input capability is improved, but device complexity increases

Engineering Contradiction:

Improvetext input capabilityVSAvoiddevice complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces physical keyboard mechanisms with a virtual keyboard displayed on the wearable device's display. Users interact with the virtual keyboard through gesture recognition (pinching, tapping) detected by integrated cameras and sensors, eliminating the need for physical keys while maintaining text input functionality. This substitution reduces mechanical complexity while adding software-based interaction layers.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces gesture recognition technology as an intermediary between the user and the virtual keyboard. Cameras and sensors detect hand gestures, map them to keyboard positions, and translate them into text input. This intermediary layer enables physical-free interaction with the virtual interface, resolving the contradiction between enabling text input and maintaining device simplicity.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If gesture recognition is implemented without physical contact, then ease of operation is improved, but measurement precision deteriorates

Engineering Contradiction:

Improvegesture interactionVSAvoidgesture location accuracy

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The patent implements feedback mechanisms where the system detects gestures via cameras and sensors, maps them to virtual keyboard positions, and provides visual feedback through the displayed virtual keyboard. This feedback loop allows the system to continuously refine gesture location mapping, improving measurement precision while maintaining contactless operation. The mapping algorithm adjusts based on detected gesture patterns and their correspondence to keyboard layout.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent performs preliminary mapping of gesture locations to keyboard positions before final input registration. The system pre-establishes the relationship between gesture coordinates detected by sensors and virtual keyboard key locations, allowing for accurate translation of physical gestures into precise text input. This preliminary action ensures measurement precision is maintained despite the contactless nature of gesture recognition.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS20260010237A1Gesture entry on a device

Publication Date: 2026.01.08 GOOGLE LLC

AI summary

According to at least one implementation, a method includes identifying a first state for a gesture from a user of a device and determining a first location associated with the gesture. The method further includes determining a second location on an interface displayed by the device based on the first location and causing display of an identifier in the second location on the interface.