Video Streaming Delay Calculation Using Server Buffer Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for streaming data transfer, such as those using HTTP/TCP, fail to accurately calculate delay time due to network congestion, particularly as they only consider the client buffer state and not the server state during video streaming.

Innovation Solution

An information processing apparatus that communicates with an image capturing apparatus to request and acquire segment lists, decide which segments to request, and calculate delay time based on the number of segments in the list, providing a notification of the delay level, thereby accounting for server state in delay time calculation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If delay time is calculated taking into account only the client buffer state, then the calculation is simple, but the accuracy of delay time calculation is insufficient because server state is not considered

Engineering Contradiction:
Improvedelay time calculation accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the server buffer state information with the client buffer state information to calculate the total delay time. The server transmits its buffer state (number of segments) to the client, and the client combines this with its own buffer state to provide a comprehensive delay calculation that accounts for both ends of the streaming system.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The server provides feedback about its buffer state to the client by transmitting segment list information that includes the number of segments. The client uses this feedback information to adjust its delay time calculation and provide accurate delay level notifications to the user.

Inventive Principle:
Principle #23Feedback

2Productivity

If segment transmission is controlled based on client buffer state only, then the control mechanism is simple, but the streaming performance cannot be optimized considering server state

Engineering Contradiction:
Improvestreaming performanceVSAvoidcontrol mechanism complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The client receives feedback from the server about the number of segments in the server buffer and uses this information to dynamically adjust segment transmission control. This feedback mechanism enables optimized streaming performance by coordinating client requests with server availability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The segment transmission control is made dynamic by continuously adjusting the delay time calculation based on real-time server buffer state information. The client can adapt its transmission strategy according to the current server state, optimizing performance under varying conditions.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9445142B2Information processing apparatus and control method thereof
Publication Date: 2016.09.13 CANON KK
  • US9445142B2 patent drawing
  • US9445142B2 patent drawing
  • US9445142B2 patent drawing

AI summary

An information processing apparatus which communicates with an image capturing apparatus and reproduces video data obtained by the image capturing apparatus, comprises a unit which requests a segment list in which information of segments of video data is written; a unit which acquires the requested segment list; a unit which decides which segment, from the segments in the acquired segment list to request; a unit which requests the decided segment from the image capturing apparatus; a unit which acquires the requested segment; and a unit which calculates a delay time for segment transmission based on a number of segments in the segment list.