Inferring ABR Video Streaming Behavior from Encrypted Traffic

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The adoption of end-to-end encryption protocols in adaptive bit rate (ABR) video streaming, such as HTTPS and QUIC, limits the availability of information for network operators and service providers to analyze and optimize streaming behavior, making it difficult to understand client system behavior and deliver a satisfying quality of experience (QoE) under varying network conditions.

Innovation Solution

A method and system that infers adaptive bit rate video streaming behavior by parsing network traces to collect packet information, detecting request packets, determining traffic volumes, and identifying candidate segments based on size and index matching criteria, allowing for the inference of segment sequences and characteristics even in encrypted traffic.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If end-to-end encryption protocols (HTTPS, QUIC) are adopted for video streaming, then security and privacy are improved, but network traffic analysis capability deteriorates

Engineering Contradiction:
ImprovesecurityVSAvoidtraffic analysis information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent introduces an intermediary inference system that acts as a mediator between encrypted traffic and analysis requirements. Instead of directly analyzing encrypted traffic (which loses information), the system uses observable traffic characteristics (packet sizes, timing patterns, sequence numbers) as intermediaries to infer ABR streaming behavior, segment boundaries, and quality metrics without decrypting the content.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the traditional mechanical approach of direct traffic inspection (which requires unencrypted data) with an inference-based system that uses statistical patterns and machine learning. The system substitutes direct observation with indirect reasoning, using observable traffic patterns to deduce unobservable streaming parameters through probabilistic models.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If encryption protocols are used, then data protection is improved, but ability to understand client system behavior deteriorates

Engineering Contradiction:
Improvedata protectionVSAvoidclient behavior analysis
Core Design Contradiction:
ReliabilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent changes the parameters being measured from content-based metrics (which require decryption) to traffic-pattern-based metrics (observable in encrypted traffic). The system measures packet size distributions, inter-packet timing, sequence number increments, and flow patterns as alternative parameters that preserve client behavior information while maintaining encryption.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements feedback loops where inferred behavior patterns are continuously refined against new traffic observations. The system uses feedback from traffic pattern matching and segment sequence inference to improve its understanding of client behavior over time, even though the underlying traffic remains encrypted.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If traffic volume information is collected from encrypted streams, then QoE analysis capability is improved, but information availability from encrypted traffic deteriorates

Engineering Contradiction:
ImproveQoE analysis precisionVSAvoidencrypted traffic information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent transitions from analyzing the content dimension of traffic (which is encrypted and invisible) to analyzing the structural dimension of traffic (packet sizes, timing, sequences). By changing the dimension of analysis from what the traffic carries to how the traffic is structured, the system recovers QoE analysis capability without requiring access to encrypted content.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11323423B2Method and apparatus for inferring ABR video streaming behavior from encrypted traffic
Publication Date: 2022.05.03 AT&T INTELLECTUAL PROPERTY I L P
  • US11323423B2 patent drawing
  • US11323423B2 patent drawing
  • US11323423B2 patent drawing

AI summary

Aspects of the subject disclosure may include, for example, a method in which a processing system parses a network trace to collect packet information for an encrypted adaptive bite rate (ABR) video stream encoded into a plurality of tracks; detects request packets corresponding to a sequence of requests for video segments to be downloaded at a network client; and determines a traffic volume downloaded at the network client to obtain a sequence of traffic volumes. The processing system identifies, for each of the sequence of traffic volumes, a set of candidate segments each having a size meeting a size-matching criterion; selects a segment from the set of candidate segments to determine a segment sequence meeting an index-matching criterion; and infers characteristics of the sequence of traffic volumes based on the segment sequence. Other embodiments are disclosed.