Ultrasonic Haptic Feedback for 3D Gesture Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Aircraft control panels and displays with three-dimensional sensing inputs lack a physical, perceivable surface in the active sensing region, making it difficult for users to maintain hand positions relative to the sensing area.

Innovation Solution

A system incorporating a display, a haptic feedback system with ultrasonic transducers, and a gesture recognition system, where the processor outputs synchronized graphical and haptic feedback data to form an ultrasonic acoustic field, allowing users to feel tactile sensations and aiding in gesture recognition within a user-manipulable region.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a three-dimensional sensing input system is implemented without a physical surface, then gesture recognition capability is improved, but user ability to maintain hand position deteriorates

Engineering Contradiction:
Improvegesture recognition capabilityVSAvoidhand position maintenance
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces an ultrasonic acoustic field as an intermediary between the display and the user's hand. This acoustic field creates a tangible, perceivable surface in the three-dimensional sensing region without requiring a physical display surface. The acoustic field provides tactile feedback that helps users maintain hand positions while enabling gesture recognition capabilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the traditional mechanical physical surface with an ultrasonic acoustic field. Instead of using a tangible display surface that users can touch and feel, the system uses ultrasonic waves to create a virtual surface that provides similar tactile guidance and feedback, enabling gesture control without direct physical contact.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If ultrasonic transducers are added to provide haptic feedback, then tactile feedback capability is improved, but device complexity increases

Engineering Contradiction:
Improvetactile feedback capabilityVSAvoidsystem component count
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent integrates ultrasonic transducers into the existing display structure, allowing the display to serve multiple functions: visual information presentation and haptic feedback generation. This multi-functionality approach adds tactile feedback capability without requiring completely separate haptic devices, thereby limiting the increase in overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines the ultrasonic haptic feedback system with the visual display system into a single integrated unit. The ultrasonic transducers are positioned to work in conjunction with the display, merging two functional systems (visual and tactile) into one cohesive interface, which reduces the overall complexity compared to having separate independent systems.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances pilot situational awareness and control feedback by providing a multi-sensory interaction experience, guiding hand positioning and recognizing gestures for improved aircraft operation, even without direct visual attention.

Implementation Method 1

The haptic feedback system may include ultrasonic transducers. The ultrasonic transducers may be configured to, based at least on the stream of the haptic feedback data, form an ultrasonic acoustic field in front of the display.

Methodology Applied
Scientific EffectUltrasonic vibration: Ultrasonic Vibration

Data Source

PatentUS10168782B1Ultrasonic haptic feedback control system and method
Publication Date: 2019.01.01 ROCKWELL COLLINS INC
  • US10168782B1 patent drawing
  • US10168782B1 patent drawing
  • US10168782B1 patent drawing

AI summary

A system may include a display, a haptic feedback system including ultrasonic transducers, a gesture recognition system, and a processor. The processor may be configured to output a stream of graphical data to the display, output a stream of haptic feedback data to the haptic feedback system, and output user-manipulatable region data to the gesture recognition system. The display may be configured to present a stream of images. The ultrasonic transducers may be configured to form an ultrasonic acoustic field in front of the display. The gesture recognition system may be configured to recognize a user gesture in the user-manipulatable region as a user input and to output gesture recognition data to the processor. The processor may be further configured to update the stream of graphical data and the stream of haptic feedback data based at least on the gesture recognition data.