Gesture-Based Character Input via Optical Hand Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing touch screen technologies face issues such as poor screen clarity, vulnerability to damage, high cost, and low durability, especially when used at heights or large sizes, leading to untouchable regions and the need for a system that can recognize hand gestures without direct touch or additional mechanical input.

Innovation Solution

An apparatus and method that utilize a camera to recognize hand gestures by measuring finger lengths and detecting click events based on set thresholds, allowing character input on a virtual character pad without direct hand contact or mechanical devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a touch screen is positioned on a high place or increased in size, then the display area is improved, but the usability deteriorates due to untouchable regions

Engineering Contradiction:
Improvedisplay areaVSAvoidusability
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent introduces a camera as an intermediary device to capture hand gestures and convert them into input signals. The camera system includes a light source, camera lens, and image processor that work together to detect finger positions and gestures in the air space in front of the display, enabling remote operation of large or elevated screens without direct physical contact.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical touch system with an optical recognition system. Instead of requiring physical contact with the screen surface, the system uses optical fields (light) to detect hand gestures and finger positions. The camera captures images of hand gestures, and the image processor converts these optical signals into digital input commands, eliminating the need for mechanical interaction.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If existing touch screen technologies are used, then character input functionality is provided, but reliability deteriorates due to vulnerability to damage and poor durability

Engineering Contradiction:
Improvecharacter input functionalityVSAvoiddurability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The camera system acts as a protective intermediary between the user and the screen. By capturing hand gestures in the air space and converting them into input signals, the system eliminates direct physical contact with the screen surface, thereby preventing mechanical damage, scratches, and wear that would otherwise compromise screen durability and reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If direct touch input is required, then precise input control is achieved, but adaptability deteriorates as it becomes impossible to input with materials that do not induce electrons

Engineering Contradiction:
Improveinput control precisionVSAvoidinput material compatibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent replaces the electrical field-based capacitive touch system with an optical detection system. The camera captures visual information about hand gestures and finger positions, processing these optical signals into input commands. This substitution allows any opaque or reflective material to be used for input, as the detection mechanism relies on light reflection and shadow casting rather than electrical conductivity, dramatically expanding material compatibility.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS9720513B2Apparatus and method for receiving a key input
Publication Date: 2017.08.01 KOREA ELECTRONICS TECH INST
  • US9720513B2 patent drawing
  • US9720513B2 patent drawing
  • US9720513B2 patent drawing

AI summary

Provided are an apparatus and method for inputting a character The apparatus includes a recognition unit configured to measure lengths from arbitrary points on a user's hands to respective fingertips and recognize a click gesture using the measured lengths, a control unit configured to control character input according to the recognized click gesture, and a display unit configured to display a character pad for the character input and display a character input according to the click gesture recognized on the character pad.