Encrypted Video QoE Estimation via HTTP Transaction Reconstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Network operators face challenges in monitoring and estimating video Quality of Experience (QoE) metrics for video streams delivered over encrypted transport protocols, as they lack access to video streaming applications, user devices, and servers, making it difficult to obtain objective measures of QoE, especially when network traffic is encrypted.

Innovation Solution

A processing system reconstructs a Hypertext Transfer Protocol (HTTP) transaction from encrypted packets without decryption, using packet-level data such as traffic direction and sizes, to model video sessions and estimate QoE metrics like average bitrate, re-buffering ratio, and startup delay, compatible with encrypted protocols like HTTP-based adaptive streaming (HAS) and QUIC.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If network operators use encrypted transport protocols to deliver video streams, then security and privacy are improved, but the ability to monitor and measure QoE metrics deteriorates

Engineering Contradiction:
ImprovesecurityVSAvoidQoE measurement
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary analysis system that sits between the encrypted video delivery infrastructure and QoE measurement requirements. This intermediary reconstructs HTTP transactions from encrypted TCP packets by analyzing packet-level metadata (sizes, timing, direction) without decrypting the actual content, thereby enabling QoE measurement while preserving encryption security

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the traditional mechanical approach of decrypting packets for analysis with an alternative information processing approach. Instead of breaking encryption to access payload content, the system substitutes decryption operations with metadata analysis operations that extract QoE-relevant information from packet headers and transmission patterns

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If network operators reconstruct HTTP transactions from encrypted packets, then QoE measurement capability is improved, but system complexity increases

Engineering Contradiction:
ImproveQoE measurementVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the QoE measurement process into distinct functional modules: packet capture and preprocessing, HTTP transaction reconstruction, video session modeling, and QoE metric estimation. Each module handles a specific aspect of the analysis, making the overall complex system manageable and maintainable through clear separation of concerns

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by pre-processing captured packets to extract relevant metadata (sizes, timing, direction) before the reconstruction phase. This preliminary organization of data reduces the computational burden during transaction reconstruction and simplifies the overall processing pipeline

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If network operators obtain objective QoE measures, then user experience management is improved, but access to application and device data is required, which conflicts with privacy and security

Engineering Contradiction:
ImproveQoE measurementVSAvoiddata access
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent positions the QoE analysis system as an intermediary that obtains measurements without requiring direct access to application logic or device internals. By analyzing encrypted network traffic at the transport layer, the system mediates between the need for objective QoE data and the requirement to preserve application and device privacy

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent substitutes the mechanical approach of accessing application and device data with an alternative method of inferring QoE metrics from encrypted network traffic patterns. This substitution eliminates the need for deep packet inspection or application-level access while still achieving objective measurement goals

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10757220B2Estimating video quality of experience metrics from encrypted network traffic
Publication Date: 2020.08.25 GEORGIA TECH RES CORP
  • US10757220B2 patent drawing
  • US10757220B2 patent drawing
  • US10757220B2 patent drawing

AI summary

In one example, a processing system including at least one processor obtains a transport control protocol flow associated with a video session that streams a video from a server to a client. The transport control protocol flow comprises a plurality encrypted packets exchanged between the server and the client. The processing system then reconstructs a hypertext transfer protocol transaction that is part of the streaming video session. The reconstructing is performed without decrypting the plurality of encrypted packets.