Audio Feedback Buffer Adjustment for Mirroring Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional short-range mirroring systems face challenges in balancing audio quality and latency, with small jitter buffers leading to audio drops and large buffers causing noticeable delays, and existing adaptive solutions fail to adequately compensate for changes in streaming delays.
Innovation Solution
The system employs a microphone at the transmitter to capture feedback audio from the receiver, comparing it to the transmitted audio to adjust buffer capacity and presentation timestamps, allowing for dynamic adjustments to balance playback quality and latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the jitter buffer capacity is increased to reduce audio drops, then audio quality is improved, but latency increases causing noticeable delays
Solution Approach 1:
The patent implements dynamic buffer size adjustment where the jitter buffer capacity is not fixed but adapts in real-time based on network conditions and audio playback requirements. The system monitors audio drops and latency metrics, then dynamically modifies buffer size to optimize the trade-off between audio quality and latency, allowing the buffer to expand when audio drops occur and contract when latency becomes excessive.
Solution Approach 2:
The system changes the buffer size parameter dynamically based on observed audio playback conditions. By adjusting this critical parameter in response to measured performance metrics (audio drops, latency), the system optimizes the contradiction between maintaining audio quality through larger buffers and minimizing latency through smaller buffers.
2Reliability
If the jitter buffer capacity is increased to store more frames, then audio drops are reduced, but the time to fetch frames increases causing greater latency
Solution Approach 1:
The patent makes the buffer capacity dynamic rather than static, allowing it to adapt its size based on real-time audio playback conditions. When audio drops are detected, the buffer expands to store more frames and prevent future drops. When latency becomes problematic, the buffer contracts to reduce frame fetch time, thus dynamically resolving the contradiction between audio continuity and frame fetch time.
3Device complexity
If conventional mirror systems use fixed buffer sizes, then system complexity is reduced, but they fail to compensate for changes in streaming delays resulting in audio drops or excessive latency
Solution Approach 1:
The patent implements a feedback mechanism where the system monitors audio playback conditions (audio drops, latency metrics) and uses this feedback to dynamically adjust buffer size. This closed-loop control allows the system to automatically adapt to changing streaming conditions without requiring complex manual configuration, resolving the contradiction between simplicity and reliability through automated adaptive behavior.
Solution Approach 2:
The system performs self-adjustment of buffer parameters based on its own performance metrics. By monitoring its own audio playback conditions and automatically modifying its buffer capacity accordingly, the system serves itself rather than requiring external intervention, maintaining reliability while keeping the control mechanism relatively simple.
Data Source
AI summary
A system, article, and method of audio quality and latency adjustment for audio processing by using audio feedback.