Acoustic Gesture Detection for Large Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current touch sensing technologies, such as capacitive and camera-based systems, face limitations in detecting multiple touches on large areas, are expensive, and struggle with gesture identification in complex backgrounds, especially under varying ambient light conditions, increasing manufacturing costs and complexity.

Innovation Solution

A display system utilizing a plurality of acoustic/ultrasonic transducers arranged around a display panel to transmit and receive signals, processing these signals to determine object location and gesture, allowing for effective command input and information control without the need for complex image processing or additional lighting.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If camera-based touch detection systems are used to detect touch positions and gestures, then gesture identification capability is improved, but the system complexity and manufacturing cost increase due to strict environmental requirements and need for additional lighting or infrared cameras

Engineering Contradiction:
Improvegesture identification capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces the optical camera-based detection system with an acoustic/ultrasonic wave-based detection system. Instead of using cameras that require complex image processing and environmental lighting control, the invention uses acoustic waves transmitted through the touch panel to detect touch positions and gestures, substituting a simpler mechanical/acoustic system for a complex optical system

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces acoustic/ultrasonic waves as an intermediary medium to detect touch interactions. The acoustic waves serve as a mediator between the user's touch and the detection system, allowing gesture identification without requiring direct optical imaging or complex environmental conditions

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If camera-based touch detection systems are used in complex background environments with varying ambient light, then gesture detection coverage is improved, but the reliability deteriorates due to strict requirements on background and ambient light strength

Engineering Contradiction:
Improvegesture detection coverageVSAvoiddetection reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent replaces the light-dependent camera system with an acoustic wave system that is independent of ambient lighting conditions. The acoustic/ultrasonic waves can penetrate and detect touches regardless of background complexity or light levels, providing reliable detection in all environmental conditions

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If capacitive touch sensing techniques are used to detect multiple touches, then multi-touch detection capability is improved, but the manufacturing cost increases and effectiveness is reduced on large touch areas

Engineering Contradiction:
Improvemulti-touch detection capabilityVSAvoidmanufacturing cost
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent divides the touch panel into multiple acoustic/ultrasonic transducer units distributed across the panel surface. Each transducer can independently detect acoustic waves from touches in its vicinity, allowing multi-touch detection across large areas by combining information from multiple segmented detection points

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent replaces the expensive capacitive sensing matrix with a more cost-effective acoustic wave detection system using simple microphones or acoustic sensors that can detect multiple simultaneous touches through sound wave analysis

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate detection of object location and gesture on large areas under various lighting conditions, reducing manufacturing costs and complexity while providing reliable command input functionality.

Implementation Method 1

each acoustic/ultrasonic transducer Xi comprises a transmitter for transmitting a first signal S1i with a frequency band fi and a receiver for receiving a second signal S2i that is reflected from the first signal S1i by at least one object

Methodology Applied
Scientific EffectAcoustic wave reflection: Reflection

Data Source

PatentUS8941619B2Apparatus and method for controlling information display
Publication Date: 2015.01.27 AU OPTRONICS CORP
  • US8941619B2 patent drawing
  • US8941619B2 patent drawing
  • US8941619B2 patent drawing

AI summary

A display for controlling information display. In one embodiment, the display has a display panel having a display area for displaying information and a peripheral portion surrounding the display area, a plurality of acoustic/ultrasonic transducers, {Xi}, arranged at a plurality of selected locations in the peripheral portion, each acoustic/ultrasonic transducer Xi being configured to transmit a first signal S1i with frequency band fi in a first duration, Δtdi, and to receive a second signal S2i in a second duration, ΔTdi, periodically at each period, where the second signal S2i is reflected from the first signal S1i by at least one object, and a processor in communication with the plurality of acoustic/ultrasonic transducers {Xi} for processing the received second signals {S2i} from the plurality of acoustic/ultrasonic transducers {Xi} to determine a location and a gesture of the at least one object relative to the display area.