Automated Video Streaming Capacity Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for determining the capacity of media streaming systems are manual, time-consuming, and require significant human oversight, making it difficult to efficiently scale and maintain acceptable video quality and response times as user demand changes.

Innovation Solution

An automated capacity testing system that uses load generators to simulate user traffic and monitor performance metrics, allowing for the determination of the maximum number of concurrent users an origin server can handle while maintaining acceptable streaming quality, and dynamically adjusts the load to identify the server's capacity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual methods are used to determine streaming capacity, then human oversight and control are maintained, but the process becomes time-consuming and inefficient

Engineering Contradiction:
Improvehuman oversightVSAvoidtime-consuming
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs capacity testing automatically without requiring human operators to manually initiate or monitor each test. The load generators self-manage the testing process, dynamically adjusting load and collecting results autonomously, thereby eliminating time loss while maintaining reliability through automated quality checks

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements continuous feedback loops where performance metrics are monitored in real-time during capacity testing. This feedback mechanism allows the system to automatically adjust load parameters and identify capacity limits without human intervention, resolving the contradiction by making the process both fast and reliable

Inventive Principle:
Principle #23Feedback

2Productivity

If automated load testing is implemented, then efficiency and speed are improved, but system complexity increases

Engineering Contradiction:
Improvetesting efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The load generators are designed as multi-functional components that can simulate various user behaviors, generate different types of load patterns, and perform multiple testing scenarios. This universality improves productivity by consolidating multiple testing capabilities into single components, while managing complexity through standardized interfaces and configurations

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system introduces intermediary components such as load generators and performance monitors that mediate between the testing objectives and the origin server. These intermediaries simplify the overall system architecture by providing standardized interfaces and abstraction layers, making the automated testing process efficient without proportionally increasing complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If dynamic load adjustment is used to identify server capacity, then measurement precision is improved, but control difficulty increases

Engineering Contradiction:
Improvecapacity determination accuracyVSAvoidcontrol difficulty
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The load testing system dynamically adjusts load parameters during execution based on real-time performance feedback. This dynamic approach improves measurement precision by adapting to the server's actual capacity characteristics, while the automation of this dynamic adjustment through predefined algorithms and thresholds maintains ease of operation by eliminating manual control complexity

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11089076B1Automated detection of capacity for video streaming origin server
Publication Date: 2021.08.10 AMAZON TECH INC
  • US11089076B1 patent drawing
  • US11089076B1 patent drawing
  • US11089076B1 patent drawing

AI summary

A system for testing the streaming capacity of a media streaming system, or of one or more origin servers thereof, includes a control system that controls the provisioning of computing resources, such as virtual machine instances, configured as load generators. The load generators establish a plurality of concurrent streams of content from the media streaming system, thus representing a plurality of connected user devices. The streams impart a load on the media streaming system; additional load generators can be added to a scalable group to increase the load. The load generators can produce monitoring data describing errors in network activity (e.g., dropped packets) and in the stream data itself (e.g., synchronization errors). A metric analysis system calculates performance metrics based on the monitoring data, and signals the control system to add or remove load generators until the load is as high as possible without degrading service, revealing the streaming capacity.