IoT Audio Stream Selection via Camera Field of View
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In communication systems, recording audio and video from a distance in noisy environments often results in substantial ambient noise interference, as existing technologies struggle to effectively isolate and enhance the target audio signal.
Innovation Solution
A computing device determines and selects IoT devices with microphones capable of remote audio recording and streaming within its field of view, dynamically switching between them to optimize audio quality based on proximity and performance characteristics, and combines the audio streams to reduce noise.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Length of moving object
If a camera is used to record audio and video from a distance, then the recording capability is extended, but the audio quality deteriorates due to substantial ambient noise interference
Solution Approach 1:
The system segments the audio capture function by utilizing multiple independent audio sources (microphones) distributed in the environment. Instead of relying on a single microphone in the camera, the system identifies and utilizes audio from multiple IoT devices, each potentially positioned closer to the sound source, thereby reducing ambient noise interference while maintaining extended recording distance capability
Solution Approach 2:
The system introduces an intermediary processing layer that acts as a mediator between the remote camera and the audio sources. This intermediary system (comprising the processor, display, and communication interfaces) identifies suitable IoT devices with microphones, establishes communication links, and selectively routes audio streams based on quality metrics, effectively mediating the audio capture process to overcome the distance-related noise problem
2Object-affected harmful factors
If multiple audio sources are utilized to reduce noise, then the audio quality improves, but the system complexity increases
Solution Approach 1:
The system employs self-service mechanisms where the processor automatically identifies suitable audio sources, evaluates their quality, and selects the optimal microphone stream without requiring manual user configuration. The system autonomously manages the complexity of multiple audio sources by implementing automatic quality assessment and selective routing based on predefined criteria, thereby improving noise reduction while minimizing the perceived system complexity for the user
3Object-affected harmful factors
If IoT devices are selected based on proximity to the subject, then the audio quality improves, but the difficulty of detecting and measuring the optimal source increases
Solution Approach 1:
The system replaces manual or mechanical methods of determining optimal audio sources with automated electronic detection and measurement capabilities. The processor utilizes communication interfaces to query IoT devices for their spatial information and audio quality metrics, automatically calculating and selecting the optimal source based on programmed criteria, thereby substituting complex manual detection processes with efficient computational methods
Data Source
Figure 1
Figure 2
Figure 3
AI summary
This disclosure provides systems, methods, and apparatus, including computer programs encoded on computer storage media, for network communication when recording audio and video (A/V) of a subject. In one aspect, a device may determine one or more internet of things (IoT) devices that are displayed within a field of view (FoV) of a camera of the device, and that are capable of remote audio recording and audio streaming. The device may select a first IoT device having a first microphone. The device may receive an audio stream from the first IoT device after selecting the first IoT device, the audio stream including the audio of the subject remotely recorded by the first IoT device for the device. When the FoV of the camera changes, the device may dynamically switch from receiving the audio stream from a first IoT device to receiving the audio stream from a second IoT device.