Camera-View Acoustic Fence for Videoconference Noise Isolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing videoconferencing systems face challenges in effectively isolating and managing external noise sources due to difficulties in determining the acoustic fence boundaries, especially when cameras zoom or pan, leading to noise intrusion from outside the camera's field-of-view.
Innovation Solution
The system determines the angle of sound relative to the microphone array's centerline and the camera's field-of-view, automatically muting or unmuting microphones based on whether the sound source is within the camera's view, and uses lip movement detection to further refine noise management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Object-affected harmful factors
If multiple microphones are arranged in a perimeter to detect background noise, then noise reduction is achieved, but it requires multiple microphones located in various places and it is difficult for the individual to determine if he is inside or outside of the perimeter
Solution Approach 1:
The patent combines the camera and microphone array into a single integrated unit, where the microphone array is positioned within the camera housing. This merging eliminates the need for multiple separate microphones distributed around the perimeter, while maintaining the acoustic fence functionality. The camera's field-of-view angle serves as the boundary definition, making it intuitive for users to understand the capture area.
Solution Approach 2:
The camera housing serves multiple functions: it houses both the camera sensor and the microphone array, providing a universal platform for both visual and audio capture. This multi-functionality reduces the overall system complexity by consolidating components that were previously separate.
2Ease of operation
If the acoustic fence is set within a given angle of the centerline manually, then sound source localization can be controlled, but it is difficult and tedious to do and does not work properly with cameras that can be rapidly zoomed and/or panned
Solution Approach 1:
The system continuously receives feedback from the camera about its current field-of-view angle and centerline orientation. Based on this real-time feedback, the acoustic fence boundaries are automatically adjusted to match the camera's current positioning. This closed-loop feedback mechanism eliminates manual adjustment and ensures the acoustic fence remains synchronized with rapid camera zooms and pans.
Solution Approach 2:
The acoustic fence boundaries are made dynamic rather than static. The system automatically adapts the fence angle and position in real-time as the camera zooms or pans, ensuring continuous alignment between the visual field-of-view and the acoustic capture area without requiring manual reconfiguration.
3Device complexity
If the microphone array is located in the camera body with matched centerlines, then the acoustic fence occurs for areas outside the given angle of the array centerline, but noise from outside the camera angle field-of-view still enters into the videoconference
Solution Approach 1:
The system dynamically changes the parameters of the acoustic fence (angle boundaries, centerline orientation) to match the camera's field-of-view parameters. By continuously adjusting these parameters based on the camera's current zoom and pan settings, the system ensures that the acoustic capture area precisely corresponds to the visual field-of-view, preventing noise intrusion from outside areas.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach ensures that only sound within the camera's field-of-view is captured, reducing external noise interference and providing a clearer videoconference experience, even during camera zooms and pans, by automatically adjusting microphone settings.
Implementation Method 1
the angle of sound relative to the centerline of the microphone array is determined
Data Source
AI summary
Determining the angle of sound relative to the centerline of a microphone array. The angle of the centerline of a camera field-of-view (FoV) and the angle of the camera FoV is determined. Knowing the angle from the centerline of the microphone array of the particular sound and then the angle of the centerline of the camera FoV and angles of the camera FoV allows a determination if the sound is inside the FoV of the camera. If so, the microphones are unmuted. If not, the microphones are muted. As the camera zooms or pans, the changes in camera FoV and centerline angle are computed and used with the sound angle, so that the muting and unmuting occurs automatically as the camera zoom and pan angle change.