Vertical Gesture Recognition Interface with Stereo Cameras

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing touch-sensitive screens are limited in handling multiple touch events, prone to misinterpretation of unintended contacts, and are expensive for large display sizes, restricting their application in providing comprehensive computer interfaces.

Innovation Solution

A gesture recognition interface system with a vertical display surface using infrared light sources and stereo cameras to generate image sets of an input object, determining three-dimensional locations and interpreting gestures to provide device inputs, allowing for precise and multi-dimensional user interactions without the need for physical contact.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touch sensitive screens are used to provide computer interface, then user input capability is improved, but the system becomes limited in handling multiple touch events and prone to misinterpretation

Engineering Contradiction:
Improveuser input capabilityVSAvoidtouch event interpretation accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent transitions from two-dimensional touch screen interaction to three-dimensional gesture recognition in spatial air space. The gesture recognition environment extends vertically and horizontally, allowing users to perform gestures in multiple dimensions (x, y, z coordinates) rather than being constrained to a flat surface. This dimensional expansion enables more distinct and unambiguous gesture patterns that are less prone to misinterpretation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces an intermediary gesture recognition environment between the user and the computer system. Instead of direct touch contact, users interact through gestures in the air space, and the system uses cameras and light sources as intermediary detection devices. This intermediary layer filters out unintended contacts (such as palm or cuff touches) that would be mistakenly registered by direct touch screens.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If touch sensitive screens are used for large display sizes, then display area is increased, but cost becomes prohibitively expensive

Engineering Contradiction:
Improvedisplay areaVSAvoidmanufacturing cost
Core Design Contradiction:
Area of stationary objectVSEase of manufacture

Solution Approach 1:

The patent replaces the mechanical touch-sensitive screen structure with an optical-based gesture recognition system. Instead of using expensive touch-sensitive materials and structures for large displays, the system uses cameras, light sources, and image processing to detect gestures in the air space in front of a standard display. This substitution dramatically reduces manufacturing costs for large display applications while maintaining or enhancing input capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Area of stationary object

If touch sensitive screens are used to eliminate desk area requirements, then space efficiency is improved, but the interface becomes limited in application range

Engineering Contradiction:
Improvedesk area requirementVSAvoidapplication range
Core Design Contradiction:
Area of stationary objectVSAdaptability or versatility

Solution Approach 1:

The patent adds vertical and depth dimensions to the interaction space, allowing gestures to occur in three-dimensional air space in front of the display. This enables a wider variety of gesture types (circling motions, scaling gestures, rotational movements) that cannot be performed on a flat touch screen, thereby expanding application versatility while maintaining space efficiency.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The gesture recognition system captures dynamic motion patterns over time, analyzing the trajectory, speed, and acceleration of gestures. This dynamic analysis enables recognition of complex gesture sequences and patterns, providing versatile input capabilities for various applications (navigation, selection, manipulation, etc.) without requiring physical contact or additional desk space.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient and accurate recognition of complex gestures, overcoming limitations of touch-sensitive screens by allowing multiple simultaneous inputs and reducing misinterpretation, while being cost-effective for large displays.

Implementation Method 1

at least one light source positioned to provide illumination of the gesture recognition environment

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Implementation Method 2

cameras configured to generate a plurality of image sets based on the illumination being reflected from an input object

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS8180114B2Gesture recognition interface system with vertical display
Publication Date: 2012.05.15 NORTHROP GRUMMAN SYSTEMS CORP
  • US8180114B2 patent drawing
  • US8180114B2 patent drawing
  • US8180114B2 patent drawing

AI summary

One embodiment of the invention includes a gesture recognition interface system. The system may comprise a substantially vertical surface configured to define a gesture recognition environment based on physical space in a foreground of the substantially vertical surface. The system may also comprise at least one light source positioned to provide illumination of the gesture recognition environment. The system also comprises at least two cameras configured to generate a plurality of image sets based on the illumination being reflected from an input object in the gesture recognition environment. The system further comprises a controller configured to determine a given input gesture based on changes in relative locations of the input object in each of the plurality of image sets. The controller may further be configured to initiate a device input associated with the given input gesture.