Multi-Touch Gesture Recognition for Intuitive Multi-Device Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing remote control devices for home entertainment systems lack the ability to combine gesture recognition with device control, limiting user interaction to keypad or touch screen inputs.

Innovation Solution

A multi-touch device that recognizes the presence of objects or gestures on its surface, identifies their characteristics, and executes associated functions on external electronic devices by matching these characteristics with a data structure, allowing for control of external audio, video, or combination devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional remote control devices use keypad or touch screen inputs, then device control functionality is achieved, but user interaction intuitiveness and ease of operation deteriorates

Engineering Contradiction:
Improveuser interaction intuitivenessVSAvoidcontrol mechanism complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical keypad inputs and touch screen interfaces with a multi-touch surface that detects gestures and objects through capacitive sensing. This substitution enables more intuitive interaction by allowing users to naturally gesture or place objects on the surface, eliminating the need to learn complex remote control button layouts while maintaining control functionality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary processing layer that detects gestures and objects on the multi-touch surface, identifies their characteristics, and translates them into device control commands. This intermediary system bridges the gap between simple physical gestures and complex device control functions, enabling intuitive operation without requiring users to understand the underlying control complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If remote controls are designed as universal remotes to control multiple devices, then device compatibility increases, but device complexity and ease of operation worsens

Engineering Contradiction:
Improvedevice compatibilityVSAvoidremote control complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a multi-touch surface that can detect and respond to multiple types of inputs simultaneously - both gestures and physical objects. This universal input mechanism allows a single device to control multiple electronic devices through different interaction modes, eliminating the need for separate remote controls for different device types while maintaining simplicity in the control interface.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If gesture recognition is added to remote control devices, then user interaction intuitiveness improves, but device complexity and measurement precision requirements worsen

Engineering Contradiction:
Improvegesture recognition capabilityVSAvoidgesture detection precision
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent merges gesture detection with object recognition capabilities in a single multi-touch surface system. By combining these functions, the system can distinguish between intentional gestures and placed objects using the same sensor array, reducing the precision requirements compared to detecting only subtle gesture movements while maintaining intuitive user interaction.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS8154428B2Gesture recognition control of electronic devices using a multi-touch device
Publication Date: 2012.04.10 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US8154428B2 patent drawing
  • US8154428B2 patent drawing
  • US8154428B2 patent drawing

AI summary

Controlling external electronic devices using presence recognition through a multi-touch device is provided. An indication of the presence of at least one of an object or a gesture on a surface of the multi-touch device is received. A plurality of characteristics associated with the object or gesture are identified. Using the plurality of physical characteristics, a data structure is searched to determine the existence of a single object or a single gesture with characteristics that matches the plurality of characteristics. Responsive to a match, a determination is made as to whether the single object or the single gesture has an associated function. Responsive to the existence of the associated function, the associated function is executed on one of a plurality of external electronic devices.