Audio Reproduction Speed Control via Packet Interval Monitoring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In cloud-type gaming systems, network delays and jitter cause unstable data output, leading to discontinuous images and intermittent sound, with existing solutions either varying reproduction speed in a way that feels strange to users or imposing excessive load on devices.

Innovation Solution

A communication device and data processing method that monitor packet reception intervals to adjust audio or image reproduction speed based on calculated target and actual stored data numbers, switching between low-speed and high-speed modes with hysteresis to maintain smooth reproduction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If reproduction speed is changed frequently in accordance with packet delay state, then data output stability is improved, but device load becomes excessive

Engineering Contradiction:
Improvedata output stabilityVSAvoiddevice load
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic reproduction speed control by adjusting the playback rate based on the difference between target and actual stored data numbers. The system dynamically switches between normal reproduction mode and fast-forward mode, allowing the reproduction speed to adapt to network conditions while avoiding excessive frequency changes through mode-based control rather than continuous adjustment.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent employs feedback control by continuously monitoring the difference between target stored data number (calculated based on packet reception intervals) and actual stored data number in memory. This feedback mechanism triggers reproduction speed adjustments only when the difference exceeds thresholds, providing stable control without excessive device load from constant adjustments.

Inventive Principle:
Principle #23Feedback

2Reliability

If reproduction speed is changed in accordance with packet delay, then continuous output is achieved, but user experience deteriorates due to strange speed variations

Engineering Contradiction:
Improvecontinuous outputVSAvoiduser experience
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system dynamically adjusts reproduction speed between two distinct modes (normal and fast-forward) based on buffer status, rather than making frequent small adjustments. This dynamic mode switching ensures continuous playback by preventing buffer underrun while limiting speed variations to discrete levels that are less perceptible and more acceptable to users.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the reproduction speed parameter based on the buffer status (difference between target and actual stored data numbers). By controlling speed adjustments based on buffer thresholds rather than directly responding to every packet delay variation, the system maintains continuous output while producing more natural and less strange speed variations for the user.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If packet reception monitoring is performed for each packet, then reproduction control precision is improved, but processing time increases

Engineering Contradiction:
Improvereproduction control precisionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs reproduction speed control based on partial monitoring - specifically, it monitors packet reception intervals to calculate target stored data number, but triggers actual reproduction speed changes only when the difference between target and actual buffer levels exceeds certain thresholds. This partial action approach maintains sufficient control precision while reducing processing overhead compared to evaluating every single packet.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system calculates the target stored data number in advance based on packet reception intervals before actual reproduction decisions are made. This preliminary calculation of buffer requirements allows the system to make informed reproduction control decisions without intensive real-time processing during playback, reducing processing time while maintaining precision.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3149912B1Communication device and data processing method
Publication Date: 2018.09.26 SONY GROUP CORP
  • EP3149912B1 patent drawingFigure 1
  • EP3149912B1 patent drawingFigure 2
  • EP3149912B1 patent drawingFigure 3

AI summary

A packet reception state monitoring unit calculates a target stored data number as a target number of audio packets stored in a memory based on the variation in the reception intervals of audio packets, and a reproduction control unit controls the audio reproduction speed in accordance with the difference between the target stored data number and a memory-stored data number. When the memory-stored data number is smaller than the target stored data number, reproduction control is performed in a low-speed reproduction mode at a lower speed than a regular reproduction speed. When the memory-stored data number is larger than the target stored data number, reproduction control is performed in a high-speed reproduction mode at a higher speed than the regular reproduction speed. A reproduction speed changing process is performed, with hysteresis being given to transitions of the difference between the memory-stored data number and the target stored data number.