Ultrasonic Gesture Recognition Using Speakers and Microphones in Low Light
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Electronic devices struggle to accurately recognize non-touch gestures in low-light or dark environments, affecting user experience.
Innovation Solution
The method employs autocorrelated ultrasonic signals emitted by speakers and collected by microphones to recognize non-touch gestures, utilizing existing hardware and software designs to enable accurate gesture recognition without additional components.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If an electronic device recognizes a non-touch gesture based on a photographed image, then the user can control an application based on the non-touch gesture, but the electronic device cannot accurately recognize the non-touch gesture under a dim light source
Solution Approach 1:
The patent replaces the optical-based photographed image recognition system with an acoustic-based ultrasonic signal recognition system. The speaker emits ultrasonic signals that reflect off the user's hand, and the microphone collects these reflected signals for gesture recognition. This substitution eliminates dependency on visible light, enabling accurate gesture recognition in dark environments.
Solution Approach 2:
The patent changes the recognition parameter from optical image data to acoustic signal characteristics. By analyzing parameters such as signal intensity, phase difference, and time of flight of ultrasonic waves, the system can detect hand gestures without requiring any visible light, thus resolving the contradiction between recognition accuracy and lighting conditions.
2Measurement precision
If the electronic device uses additional components or expensive components to achieve accurate non-touch gesture recognition, then the gesture recognition accuracy improves, but the cost of controlling the target application to respond to the non-touch gesture increases
Solution Approach 1:
The patent makes the existing speaker and microphone serve the dual function of audio processing and gesture recognition. The speaker not only outputs sound but also emits ultrasonic signals for gesture detection. The microphone not only records audio but also collects reflected ultrasonic signals. This multi-functionality eliminates the need for additional dedicated gesture sensing components, reducing device complexity and cost while maintaining recognition accuracy.
Solution Approach 2:
The existing audio hardware components (speaker and microphone) perform gesture recognition functions in addition to their primary audio functions. The system utilizes the inherent capabilities of these components to detect gestures, making the device self-sufficient for gesture recognition without requiring external or additional specialized components, thereby reducing overall system cost and complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate non-touch gesture recognition in various lighting conditions, improving user experience without increasing costs or complexity.
Implementation Method 1
starting the at least one speaker to emit an autocorrelated ultrasonic signal; starting the at least one microphone to collect a reflected signal reflected after the ultrasonic signal encounters a non-touch gesture
Data Source
AI summary
An electronic device includes at least one speaker and at least one microphone. A method is applied to the device, where the method includes displaying a target application. The target application is an application that supports non-touch gesture recognition. The method further includes starting the at least one speaker to emit an autocorrelated ultrasonic signal. The method further includes starting the at least one microphone to collect a reflected signal reflected after the ultrasonic signal encounters a non-touch gesture. The method further includes controlling, based on the target application and the reflected signal, the target application in response to the non-touch gesture.