Air Conditioner Voice Pickup Using Camera-Based Sound Source Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing household appliance voice recognition systems, particularly air conditioners, suffer from low accuracy due to signal attenuation and misidentification of voice commands when users are far from the device or in environments with multiple speakers, leading to poor user experience.
Innovation Solution
A method and system that uses a camera to determine the sound source location by analyzing image information, enhancing the audio signal pickup with an array type dual microphone at the identified location, and performing control operations based on the recognized voice information, thereby improving voice recognition accuracy and user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If an array type dual microphone is used to pick up audio signals through directional enhancement, then the voice recognition effect is improved, but when users are far from the air conditioner or move during voice control, the positioning is not updated in time, resulting in low recognition rate
Solution Approach 1:
The patent implements dynamic positioning by continuously updating user location information through camera capture. The system captures images, detects user positions, and updates the sound source location in real-time, allowing the microphone array to track moving users and maintain accurate voice recognition throughout the interaction process
Solution Approach 2:
The system establishes a feedback loop where the camera continuously monitors user position, feeds this location information back to the control system, which then adjusts the microphone array's directional enhancement focus accordingly. This closed-loop feedback ensures the system adapts to user movement and maintains optimal voice recognition accuracy
2Ease of operation
If voice control is used for household appliances, then the operation convenience is improved, but when the user is far from the air conditioner, signal attenuation occurs, causing poor voice recognition effect
Solution Approach 1:
The patent applies local quality enhancement by directing the microphone array's pickup sensitivity toward the specific location where the user is detected by the camera. Instead of uniform omnidirectional pickup, the system concentrates audio sensitivity in the direction of the sound source, compensating for signal attenuation over distance and improving recognition reliability for users positioned away from the device
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances voice recognition accuracy and user interaction by accurately detecting the user's location and enhancing audio signals, leading to improved control operations and overall user experience for household appliances like air conditioners.
Implementation Method 1
determining a sound source location by means of a camera; acquiring image information in a household appliance scenario by means of the camera; analyzing the image information to recognize user information
Implementation Method 2
picking up voice information of a user according to the sound source location; enhancing at least one pickup audio signal of an array type dual microphone at the sound source location
Data Source
Figure 1~2
Figure 3~4
AI summary
A household appliance control method, device and system, and an intelligent air conditioner are provided. The method includes that: a sound source location is determined by means of a camera; voice information of a user is picked up according to the sound source location; and at least one control operation is performed on a household appliance according to the voice information. The voice information matches at least one corresponding control instruction. By means of the method, a location of at least one user can be detected according to the camera, thereby enhancing at least one pickup audio signal at the location of the at least one user.