Camera-Based Hand Gesture Input for Wearable Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional input devices for portable devices, such as touchscreens and speech recognition systems, face challenges like space constraints, high costs, low recognition accuracy, and privacy concerns, especially in noisy environments, making them unsuitable for wearable computers.

Innovation Solution

A camera-based input apparatus and method that captures hand images, maps hand segments to keys using a key-hand mapping table, and detects key inputs through image changes, allowing for efficient character input without additional input means like keypads or touchscreens.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If speech recognition-based input means is used, then input operation can be performed without physical contact, but recognition accuracy deteriorates in noisy environments

Engineering Contradiction:
Improvecontactless input operationVSAvoidrecognition accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces an optical intermediary (camera-based hand gesture recognition system) between the user and the device. Instead of using acoustic signals (speech) that are vulnerable to noise, the system uses visual signals (hand gestures captured by camera) as an intermediary communication channel, thereby maintaining contactless operation while improving accuracy in noisy environments

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the acoustic field-based speech recognition system with an optical field-based hand gesture recognition system. This substitution eliminates vulnerability to acoustic noise while maintaining the benefit of contactless interaction, as the optical system captures hand movements rather than relying on voice commands

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If touchscreen or virtual keyboard is used, then input functionality is provided, but mounting area requirement increases

Engineering Contradiction:
Improveinput functionalityVSAvoidmounting area
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent extracts the input functionality from physical input devices (keyboards, touchscreens) and relocates it to the user's hand gestures. The camera captures hand movements in the air space, eliminating the need for mounted input surfaces while preserving full input capabilities

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transitions from two-dimensional touchscreen input to three-dimensional spatial gesture input. By utilizing the air space around the device as the input domain, the system provides full keyboard functionality without requiring any physical mounting area on the device itself

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If speech recognition system is used, then input can be performed, but privacy protection deteriorates due to eavesdropping risk

Engineering Contradiction:
Improvevoice-based inputVSAvoidprivacy protection
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent replaces acoustic communication (speech) with optical communication (visual hand gestures). This intermediary change from sound-based to light-based interaction eliminates eavesdropping risks while maintaining natural, hands-free operation capability

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9448620B2Input method and apparatus of portable device for mapping segments of a hand to a plurality of keys
Publication Date: 2016.09.20 SAMSUNG ELECTRONICS CO LTD
  • US9448620B2 patent drawing
  • US9448620B2 patent drawing
  • US9448620B2 patent drawing

AI summary

An input apparatus for use in a portable device is provided. The input apparatus includes a camera for capturing an image; a storage unit which stores a key-hand mapping table for mapping segments of a hand to a plurality of keys, respectively, according to predetermined criteria; a display unit displaying the captured image during an input mode; and a control unit which activates the camera in the input mode, controls the display unit to display the captured image, assign the plural keys to the segments of the hand based on mapping information of the key-hand mapping table, detect an image change in one of the segments displayed on the display unit, and input the key mapped to the segment at which the image change is detected on the display unit.