Hovering Keyboard Gesture Control for Intuitive GUI Task Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional Information Handling Systems (IHSs) lack the ability to effectively manipulate Graphical User Interfaces (GUIs) using hand gestures over a hovering keyboard, which limits user interaction and efficiency in processing and communicating information.

Innovation Solution

The implementation of a processor-based system that utilizes proximity sensors on a hovering keyboard to detect hand gestures, such as hand inclination and finger splaying, to manipulate a task map displayed on a screen, allowing for dynamic rendering and selection of tasks based on gesture parameters, and adjusts detection parameters to account for user drift.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional keyboards with physical keys are used, then reliable input detection is achieved, but user interaction efficiency and intuitiveness are limited

Engineering Contradiction:
Improveuser interaction efficiencyVSAvoidintuitiveness of interaction
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent replaces the mechanical key-pressing system with an optical/proximity-based detection system. Proximity sensors detect hand gestures and finger movements in the air space above the keyboard without requiring physical contact, thereby improving interaction efficiency and intuitiveness while maintaining reliable input detection

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary layer of gesture recognition between the user and the task map. Hand gestures serve as a mediator that translates user intent into GUI manipulations, making the interaction more intuitive and efficient compared to direct physical key pressing

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If proximity sensors are added to detect hand gestures, then GUI manipulation capability is enhanced, but device complexity increases

Engineering Contradiction:
ImproveGUI manipulation capabilityVSAvoidsensor system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The proximity sensor system serves multiple functions: detecting hand presence, recognizing gesture types, determining gesture intensity, and enabling various GUI manipulations. This multi-functionality justifies the added complexity by providing versatile interaction capabilities across different scenarios

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically adjusts its detection parameters and response behaviors based on the detected gesture characteristics. The keyboard adapts its functionality in real-time based on hand position, movement speed, and gesture patterns, enabling flexible GUI manipulation without requiring a completely new device architecture

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If hand gesture detection is implemented, then interaction intuitiveness is improved, but measurement precision challenges arise

Engineering Contradiction:
Improveinteraction intuitivenessVSAvoidgesture detection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system employs feedback mechanisms where the detected hand gestures are translated into visual feedback on the display, showing users how their gestures are being interpreted. This allows users to refine their gestures for more precise control, and the system adjusts its detection thresholds based on learned user patterns, improving measurement precision over time

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent changes multiple detection parameters including proximity thresholds, gesture velocity thresholds, and finger configuration parameters to optimize gesture recognition accuracy. By dynamically adjusting these parameters based on context and user behavior, the system maintains high measurement precision while preserving interaction intuitiveness

Inventive Principle:
Principle #35Parameter changes

4Measurement precision

If multiple sensors are used for accurate gesture detection, then gesture recognition accuracy is improved, but energy consumption increases

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidsensor system energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The proximity sensors operate in a periodic sampling mode rather than continuous monitoring. The system activates sensors at intervals and only when hand presence is detected, reducing overall energy consumption while maintaining sufficient gesture recognition accuracy through strategic sampling moments

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system uses a partial sensor array approach, activating only the necessary subset of proximity sensors based on detected hand position and gesture type. Not all sensors operate at full capacity simultaneously, reducing total energy consumption while maintaining adequate measurement precision for the specific gesture being performed

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables intuitive GUI manipulation through hand gestures, enhancing user interaction and efficiency in task management by allowing for proportional rendering and selection of tasks based on hand movements, while maintaining accurate gesture detection over time.

Implementation Method 1

proximity sensors are configured to measure distances between the user's hand or fingers to the keyboard

Methodology Applied
Scientific EffectProximity sensing: Capacitance

Data Source

PatentUS11221683B2Graphical user interface (GUI) manipulation using hand gestures over a hovering keyboard
Publication Date: 2022.01.11 DELL PROD LP
  • US11221683B2 patent drawing
  • US11221683B2 patent drawing
  • US11221683B2 patent drawing

AI summary

Systems and methods for enabling a Graphical User Interface (GUI) manipulation using hand gestures over a hovering keyboard are described. In some embodiments, an Information Handling System (IHS) may include a processor and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution by the processor, cause the IHS to: detect a hand gesture using proximity sensors disposed on a hovering keyboard coupled to the IHS, and manipulate a task map rendered on a display coupled to the IHS in response to the detection.