Virtual Microphone Orientation Using Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio devices that rely solely on audio energy to orient virtual microphones often incorrectly orient towards interfering sources, especially when their energy is stronger than the desired source, leading to suboptimal audio signal quality and noise estimation.
Innovation Solution
An electronic device with a microphone array and sensors, such as accelerometers, gyroscopes, and proximity sensors, determines its usage mode and adjusts the virtual microphone orientation accordingly, using data from multiple sensors to ensure accurate beam steering and noise suppression, even when the device is in motion or changing orientation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If the audio device orients the virtual microphone towards the highest energy source, then the device can automatically orient without manual control, but it may wrongly orient towards interfering jammer sources when their energy is stronger than the desired source
Solution Approach 1:
The patent introduces sensor data (accelerometer, gyroscope, proximity sensor) as an intermediary to mediate between the audio energy detection and the final orientation decision. The sensor information about device orientation and position serves as a mediator that helps distinguish between desired sources and interfering sources, preventing wrong orientation towards jammers while maintaining automatic operation
Solution Approach 2:
The system uses feedback from multiple sensors continuously monitoring device orientation, position, and motion to adjust the virtual microphone orientation. This feedback mechanism allows the system to correct orientation errors that would occur if relying solely on audio energy, maintaining accuracy while preserving automatic operation
2Measurement precision
If the device uses sensor data to determine usage mode and orient the virtual microphone, then the orientation accuracy improves, but the device complexity increases
Solution Approach 1:
The patent makes existing sensors (accelerometer, gyroscope, proximity sensor) perform multiple functions. These sensors originally designed for other purposes are now also used to determine usage mode and orient the virtual microphone, adding orientation capability without requiring dedicated new components, thus limiting the increase in device complexity
Solution Approach 2:
The patent merges the orientation determination function with the existing usage mode detection function. By combining sensor data processing for both purposes into a unified system, the patent achieves multi-functional operation while avoiding the complexity of separate independent systems
3Ease of operation
If the virtual microphone is reoriented using beam steering, then the directional gain can be adjusted without physical movement, but the device may produce observable artifacts during orientation changes
Solution Approach 1:
The patent dynamically adjusts beam steering parameters based on real-time sensor data and usage mode. By making the beam steering adaptive and dynamic rather than static, the system can smoothly transition between orientations and maintain audio quality consistency, reducing observable artifacts during reorientation
Solution Approach 2:
The patent changes beam steering parameters (weights, delays, phase shifts) dynamically based on usage mode and device orientation. By adjusting these parameters continuously rather than in discrete steps, the system maintains audio quality consistency during transitions and minimizes observable artifacts
Data Source
AI summary
A method for controlling the orientation of a virtual microphone, which is carried out on an electronic device, includes combining and processing signals from a microphone array to create a virtual microphone; receiving data from a sensor of the electronic device; determining, based on the received data, a mode in which the electronic device is being used; and based on the determined mode, directionally orienting the virtual microphone. Possible use modes include a) a stowed use mode, in which the criterion is the electronic device being substantially enclosed by surrounding material; b) a handset (alternately, private) use mode, in which the criterion is the electronic device being held proximate to a user; and c) a handheld (alternately, speakerphone) use mode, in which the criterion is the electronic device being held away from a user.