Audio Deceleration Logic for Real-Time Stream Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Late arriving audio packets cause delays and disruptions in audio streams, particularly in applications like web conferencing and video gaming, where minimal lag is crucial, leading to cumulative delays and increased user perception of lag.

Innovation Solution

Implementing an audio system with monitoring logic to detect late packets and processing logic to accelerate or decelerate the presentation of audio streams, ensuring seamless playback by adjusting the presentation rate stepwise to minimize perceived disruptions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If the receive buffer size is minimized to reduce lag time, then the time delay between audio events and their presentation is reduced, but the probability of audio stream interruptions from delayed packets increases

Engineering Contradiction:
Improvelag timeVSAvoidaudio stream continuity
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The system dynamically adjusts the playback rate in real-time based on the arrival status of audio packets. When packets arrive late, the system accelerates subsequent playback to compensate for the delay, and when packets arrive on time, normal playback rate is maintained. This dynamic rate adjustment resolves the contradiction by allowing minimal buffering while actively compensating for delays to maintain stream continuity.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The invention changes the playback rate parameter dynamically to compensate for late packet arrival. By adjusting the playback speed (accelerating or decelerating) based on actual packet arrival times, the system can maintain audio stream continuity even with minimal buffering, thus resolving the contradiction between reduced lag time and maintained reliability.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If audio packets are presented in real-time without adjustment, then the presentation timing matches the original audio stream timing, but late packets cause gaps and disruptions in the audio stream

Engineering Contradiction:
Improveaudio stream continuityVSAvoidpresentation delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system implements a feedback mechanism where the actual arrival times of audio packets are monitored and used to adjust the playback rate. This closed-loop control allows the system to detect late packets and compensate by accelerating subsequent playback, thereby maintaining audio stream continuity while minimizing overall presentation delay.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary rate adjustment calculations based on expected packet arrival patterns and proactively adjusts the playback rate before gaps occur. By anticipating potential delays and pre-adjusting the playback schedule, the system maintains continuity while minimizing cumulative delay.

Inventive Principle:
Principle #10Preliminary action

3Loss of time

If the presentation rate is accelerated to compensate for late packets, then the cumulative delay is reduced, but abrupt changes in presentation rate are perceived by the user

Engineering Contradiction:
Improvecumulative delayVSAvoidperceived audio disruption
Core Design Contradiction:
Loss of timeVSObject-affected harmful factors

Solution Approach 1:

The system segments the rate adjustment into small incremental steps rather than applying a single large change. By dividing the total required acceleration into multiple smaller adjustments applied sequentially, the system reduces cumulative delay while keeping individual rate changes imperceptible to users, thus resolving the contradiction between delay reduction and perceived smoothness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The playback rate is adjusted dynamically in a stepwise manner, with the acceleration applied gradually over time rather than abruptly. This dynamic, progressive adjustment allows the system to compensate for cumulative delay while maintaining perceptual smoothness, as the ear cannot detect small incremental changes in playback rate.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9564135B2Audio deceleration
Publication Date: 2017.02.07 SONY INTERACTIVE ENTERTAINMENT LLC
  • US9564135B2 patent drawing
  • US9564135B2 patent drawing
  • US9564135B2 patent drawing

AI summary

An audio receiving system includes logic configured to reduce the accumulation of delays caused by the late arrival of audio packets. This logic is configured to accelerate or decelerate presentation of a resulting audio stream in response to the detection of late packets. The acceleration is discontinued once the effects of the late packets have been compensated for. The audio receiving system is typically applied to applications in which lag is undesirable. These can include web conferencing, telepresence, and online video games.