Gesture Keyboard and Pointer Input With Wrist and Finger Tracking

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing hand-held key-paddle input devices for computers, while suitable for mobile applications, encumber the hands and are limited by the need for a horizontal surface, and existing virtual interfaces lack effective kinesthetic and tactile feedback for user input.

Innovation Solution

A virtual key-paddle input device using body-worn sensors to track hand and finger movements, allowing users to associate specific gestures with computer inputs, reducing dependence on physical devices through proprioceptive sense and providing alternative sensing apparatuses like cameras and strain sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If hand-held key-paddle input devices are used, then kinesthetic and tactile feedback is provided for user input, but the hands are encumbered and the device requires a horizontal surface

Engineering Contradiction:

Improvekinesthetic and tactile feedbackVSAvoidmobility and surface requirement

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent replaces the mechanical hand-held key-paddle device with a virtual interface system that uses optical sensing (cameras) and electronic sensors to detect hand and finger movements. This substitution eliminates the physical device that encumbers the hands while maintaining the ability to detect gesture movements through proprioceptive feedback and visual feedback from the display

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary sensing system consisting of cameras and sensors that mediate between the user's natural hand movements and the computer input. This intermediary system captures movement data without requiring the user to hold or interact with a physical device, thereby resolving the contradiction between providing feedback and maintaining mobility

Inventive Principle:

Principle #24Intermediary (Mediator)

2Device complexity

If body-worn sensors are used to track hand movements, then physical devices are reduced, but alternative sensing apparatuses like cameras and strain sensors are required

Engineering Contradiction:

Improvephysical device reductionVSAvoidsensing apparatus implementation

Core Design Contradiction:

Device complexityVSEase of manufacture

Solution Approach 1:

The patent employs multi-functional sensing apparatuses that can detect multiple types of movements and gestures. The camera system and strain sensors are designed to capture various hand, wrist, and finger movements, allowing a single sensing system to replace multiple specialized physical devices. This multi-functionality approach makes the system manufacturable and implementable while reducing overall device complexity

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If virtual key-paddle input device is used, then hands are not encumbered, but kinesthetic and tactile feedback is reduced

Engineering Contradiction:

ImprovemobilityVSAvoidkinesthetic and tactile feedback

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent implements a feedback mechanism where the system provides visual feedback through the display to guide users in performing correct gestures. The sensing system detects hand movements and provides real-time feedback by highlighting corresponding keys or functions on the display, compensating for the lack of physical kinesthetic and tactile feedback from a hand-held device

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12572272B2Method for computer key and pointer input using gestures

Publication Date: 2026.03.10 MCDERMID WILLIAM JAMES

AI summary

A method and an apparatus are provided for user input to a computer. A sensing apparatus tracks the position of the wrist and the position of the digits on the hand. A paired display shows left and right arrays of icons representing available inputs and highlights the inputs currently accessible by the digits based on the position of the wrists.