Acoustic Gesture Detection Using Existing Microphones for Hearable Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Hearable devices face challenges in controlling functions with limited sensor availability, necessitating a robust and efficient method for user input without relying on external devices like smartphones.
Innovation Solution
The method involves detecting user gestures, such as placing a hand near the ear, using acoustic change detectors to analyze microphone signals, and enhancing desired sound components by increasing their energy relative to ambient noise, allowing direct control of hearable devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If acoustic change detection is used to detect hand gestures, then gesture control capability is improved, but device complexity increases due to additional signal processing requirements
Solution Approach 1:
The hearable device uses its existing microphone and audio processing capabilities to detect hand gestures by analyzing acoustic changes caused by hand placement near the ear. The system serves itself by utilizing already-present hardware (microphone, audio processor) for the additional function of gesture detection, avoiding the need for separate sensors or dedicated gesture detection hardware.
Solution Approach 2:
The audio input signal and processing circuitry serve multiple functions: traditional audio processing for hearing enhancement and the additional function of gesture detection. By analyzing spectral changes in the audio signal, the system simultaneously performs audio enhancement and gesture recognition using the same hardware resources.
2Measurement precision
If multiple sensors are added for gesture detection, then gesture recognition accuracy is improved, but power consumption increases
Solution Approach 1:
The hearable device uses its existing microphone and audio processing capabilities to detect hand gestures by analyzing acoustic changes caused by hand placement near the ear. The system serves itself by utilizing already-present hardware (microphone, audio processor) for the additional function of gesture detection, avoiding the need for separate sensors or dedicated gesture detection hardware.
3Adaptability or versatility
If external devices like smartphones are used for control, then control functionality is improved, but ease of operation deteriorates due to dependency on external devices
Solution Approach 1:
The hearable device uses its existing microphone and audio processing capabilities to detect hand gestures by analyzing acoustic changes caused by hand placement near the ear. The system serves itself by utilizing already-present hardware (microphone, audio processor) for the additional function of gesture detection, avoiding the need for separate sensors or dedicated gesture detection hardware.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables easy and power-efficient control of hearable devices by enhancing desired sounds over ambient noise using user gestures, maintaining a natural control interface without requiring additional devices.
Implementation Method 1
an acoustic change detector CD100 arranged to indicate, based on information from a first audio input signal IS10, a presence of an object (e.g., a hand of the user in a predetermined hand gesture)
Data Source
Figure 1A~1B
Figure 2
Figure 3
AI summary
Methods, systems, computer-readable media, and apparatuses for gesture control are presented. One example includes indicating, based on information from a first audio input signal, a presence of an object in proximity to a microphone, and increasing a volume level in response to the indicating.