Multi-Device Audio Processing for Latency-Compensated Reverberation Removal
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices face challenges in effectively removing reverberation from audio data, leading to data distortion and increased processing load, especially when communicating with external devices, due to complex calculations required for reverberation removal.
Innovation Solution
The electronic device employs a wireless communication circuit, audio input device, and processor to obtain and process audio data, compensating for latency and removing reverberation through beamforming, and outputs processed audio data to an external device, while also receiving and mixing audio data from the external device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If reverberation removal is performed using complex calculations, then reverberation elimination effectiveness is improved, but data processing time and device load increase
Solution Approach 1:
The patent segments the audio data processing task by separating local audio data processing from remote audio data processing. The electronic device processes only local audio data (first audio data) while requesting remote audio data (second audio data) from an external device, dividing the complex reverberation removal task across multiple devices rather than performing all calculations locally.
Solution Approach 2:
The patent introduces an external electronic device as an intermediary to share the processing burden. The first audio data from the local device is transmitted to the external device, which performs additional processing and returns processed audio data, effectively using the external device as a computational intermediary to reduce local processing load.
2Device complexity
If reverberation removal is performed without considering external device audio data, then local processing simplicity is maintained, but additional data distortion occurs
Solution Approach 1:
The patent implements a feedback mechanism where the electronic device requests second audio data from the external device after transmitting the first audio data. The external device processes this data and returns it, allowing the original device to compare and adjust its processing based on external feedback, thereby reducing data distortion through iterative refinement.
Solution Approach 2:
The patent merges the processing results from both the local electronic device (first audio data) and the external electronic device (second audio data) to produce the final processed audio output. This combination allows the system to leverage information from multiple sources, reducing overall data distortion that would occur if only one device processed the audio independently.
Data Source
AI summary
Provided is a an electronic device and method of operating same. The electronic device includes: a wireless communication circuit configured to perform wireless communication with an external electronic device; an audio input device; at least one memory storing one or more instructions; and at least one processor operatively connected to the at least one memory and configured to execute the one or more instructions to: obtain first audio data through the audio input device, wherein the first audio data is synthetic data of a first signal received from a first talker and a second signal received from a second talker, and the first talker is closer to the electronic device than the second talker at the time the first audio data is obtained, receive second audio data from the external electronic device through the wireless communication circuit, wherein the second audio data is synthetic data of a third signal and a fourth signal, obtain a latency based on the first audio data and the second audio data, obtain compensated first audio data by compensating for the latency with respect to the second audio data, and obtain processed first audio data by removing the second signal from the compensated first audio data based on the third signal.