Intelligent Rearview Mirror Voice Pickup via Dynamic Beamforming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing intelligent rearview mirrors face inaccuracies in voice signal pickup due to uniform microphone settings, leading to suboptimal voice interaction and potential safety issues during vehicle operation.
Innovation Solution
A voice pickup method and apparatus that acquire an image of the vehicle interior to determine the position of a person and adjust the beamforming direction of a microphone array accordingly, ensuring accurate voice signal capture while suppressing ambient noise.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If uniform microphone settings are used in the intelligent rearview mirror, then the device complexity is reduced and ease of operation is improved, but the voice pickup accuracy deteriorates and voice interaction quality worsens
Solution Approach 1:
The patent implements dynamic beamforming direction adjustment based on real-time detection of person positions in the vehicle. The microphone array's beamforming direction is no longer fixed but dynamically adapts to the detected positions of drivers and passengers, allowing the system to optimize voice pickup accuracy for different seating configurations and occupied positions.
Solution Approach 2:
The system changes the beamforming direction parameter of the microphone array based on detected person positions. By adjusting this key parameter dynamically, the system achieves adaptive voice pickup optimization without requiring complex manual configuration, resolving the contradiction between accuracy and complexity.
2Adaptability or versatility
If the microphone array uses fixed beamforming direction, then the device complexity is reduced, but the adaptability to different person positions deteriorates and voice pickup accuracy worsens
Solution Approach 1:
The system performs self-adjustment by automatically detecting person positions and autonomously adjusting the beamforming direction without requiring manual intervention. The intelligent rearview mirror itself provides the adaptation service, eliminating the need for complex external control systems while achieving high adaptability to different seating configurations.
Solution Approach 2:
The system establishes a feedback loop where the detected positions of persons in the vehicle continuously inform the beamforming direction adjustment. This closed-loop control enables the microphone array to adapt to changing positions of drivers and passengers, improving versatility while maintaining manageable system complexity through automated feedback-driven adjustment.
3Reliability
If uniform voice pickup settings are used regardless of vehicle conditions, then the ease of operation is improved, but the voice interaction quality deteriorates and driving safety is influenced
Solution Approach 1:
The system performs preliminary detection of person positions and pre-adjusts the beamforming direction before voice interaction occurs. By proactively configuring the optimal pickup direction based on detected positions, the system ensures high-quality voice recognition is ready when needed, improving reliability for safety-critical operations without requiring complex real-time adjustments during interaction.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Improves the accuracy of voice pickup by directing the microphone array's beam towards the speaker, enhancing voice interaction and driving safety by reducing noise interference.
Implementation Method 1
adjusting a beamforming direction of a microphone array according to the position of the person in the vehicle
Data Source
Figure 1
Figure 2
Figure 3
AI summary
It is disclosed a voice pickup method and apparatus for an intelligent rearview mirror, an electronic device and a computer readable storage medium which relates to the technical field of vehicle-mounted equipment, and may be used in the field of automatic driving technologies. A voice pickup implementation of the intelligent rearview mirror according to some embodiments includes: acquiring an image of the interior of the vehicle; determining the position of a person in the vehicle with the image of the interior of the vehicle; and adjusting a beamforming direction of a microphone array according to the position of the person in the vehicle. With the present application, the accuracy of voices picked up by the intelligent rearview mirror may be improved.