Light-Diffusive Screen Gesture Recognition via Infrared Illumination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing touch-sensitive screens are limited in handling multiple touch events, prone to misinterpretation of unintended contacts, and are expensive for large display sizes, restricting their application and usability.

Innovation Solution

A gesture recognition interface system utilizing a light-diffusive screen with infrared illumination and cameras to capture silhouette images of an input object, determining three-dimensional locations and interpreting gestures to provide device inputs, allowing for more versatile and accurate user interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touch sensitive screens are used to provide interface inputs, then user interaction capability is improved, but the system becomes limited in handling multiple touch events and misinterprets unintended contacts

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidtouch event interpretation accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent replaces the mechanical touch-sensitive screen system with an optical-based gesture recognition system. Instead of detecting physical contact through pressure or capacitance changes, the system uses infrared illumination and cameras to detect and track gestures in three-dimensional space, thereby eliminating misinterpretation of unintended contacts while maintaining user interaction capability

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transitions from two-dimensional touch screen interaction to three-dimensional gesture recognition. By capturing images from multiple cameras and processing them to determine spatial coordinates and gesture trajectories in 3D space, the system enables more accurate distinction between intentional gestures and unintended contacts

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If touch sensitive screens are used for interface input, then user interaction is enabled, but the number of touch events that can be handled over a given amount of time is limited

Engineering Contradiction:
Improveuser interactionVSAvoidtouch event processing rate
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent implements continuous gesture recognition by capturing a sequence of images at high frame rates and processing them to determine gesture trajectories. This allows the system to continuously track and interpret multiple gestures over time without the discrete sampling limitations of touch screens, thereby increasing the number of events that can be handled within a given time period

Inventive Principle:
Principle #20Continuity of useful action

3Adaptability or versatility

If touch sensitive screens are used, then interface functionality is provided, but the cost becomes prohibitively expensive and impractical for very large display sizes

Engineering Contradiction:
Improveinterface functionalityVSAvoidcost and practicality for large displays
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent replaces expensive touch-sensitive screen technology with a more cost-effective optical system consisting of infrared light sources and cameras. This substitution eliminates the need for expensive touch-sensitive coatings and electronics on large displays while maintaining interface functionality through gesture recognition

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a universal interface system that can be applied to display sizes of any scale. The optical gesture recognition system is not constrained by the physical limitations of touch-sensitive materials, allowing the same technology to be used for both small portable devices and very large display installations

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate recognition of complex gestures and multiple touch events without the need for physical contact, improving usability and reducing costs for large displays by providing a more efficient and accurate interface system.

Implementation Method 1

at least one light source positioned to illuminate a first side of a light-diffusive screen

Methodology Applied
Scientific EffectLight diffusion: Scattering

Implementation Method 2

configured to receive a plurality of images based on a brightness contrast difference between the light-diffusive screen and an input object

Methodology Applied
Scientific EffectBrightness contrast: Absorption (EM radiation)

Data Source

PatentUS8345920B2Gesture recognition interface system with a light-diffusive screen
Publication Date: 2013.01.01 NORTHROP GRUMMAN SYSTEMS CORP
  • US8345920B2 patent drawing
  • US8345920B2 patent drawing
  • US8345920B2 patent drawing

AI summary

One embodiment of the invention includes a gesture recognition interface system. The interface system may comprise at least one light source positioned to illuminate a first side of a light-diffusive screen. The interface system may also comprise at least one camera positioned on a second side of the light-diffusive screen, the second side being opposite the first side, and configured to receive a plurality of images based on a brightness contrast difference between the light-diffusive screen and an input object. The interface system may further comprise a controller configured to determine a given input gesture based on changes in relative locations of the input object in the plurality of images. The controller may further be configured to initiate a device input associated with the given input gesture.