Automated Media Playback Error Detection Using Embedded Test Patterns

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional testing procedures for endpoint devices in video streaming services provide limited test coverage, are inconsistent across different manufacturers, and rely heavily on human perception, leading to exposure of users to playback errors.

Innovation Solution

Automating the testing process by using a test module coupled to an endpoint device to generate and analyze data streams with embedded test patterns, allowing for comprehensive and consistent detection of playback errors across various hardware, software, and media title versions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If human test engineers manually observe and log playback errors, then error detection is possible, but test coverage is limited and results are inconsistent

Engineering Contradiction:
Improveerror detection accuracyVSAvoidtest coverage
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system uses automated computer vision to have the display itself reveal playback errors through embedded test patterns. The test module captures images of the display, and the system automatically detects and logs errors without human intervention, enabling comprehensive testing across all media title versions and configurations.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual human observation with an automated computer vision system. The test module captures display images, and image processing algorithms automatically detect playback errors such as frame drops and freeze frames, eliminating the limitations of human perception and ensuring consistent, comprehensive testing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If comprehensive testing of all media title versions is performed, then error detection improves, but testing time and complexity increase

Engineering Contradiction:
Improveerror detection accuracyVSAvoidtesting time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system embeds test patterns into media titles before playback. These test patterns are invisible during normal viewing but enable automated detection of playback errors. The test module captures images of the display during playback, and the system automatically analyzes these images to detect errors, allowing comprehensive testing without requiring manual observation of every frame.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If different OEMs use different testing procedures, then each can test their specific device, but results become inconsistent across manufacturers

Engineering Contradiction:
Improvedevice-specific testingVSAvoidtest result consistency
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent creates a universal testing framework that can be applied across different OEM devices. The test module captures display images using standardized procedures, and the system automatically detects playback errors consistent across all manufacturers. This universal approach maintains device-specific testing while ensuring consistent, comparable results across all OEMs.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10931975B2Techniques for detecting media playback errors
Publication Date: 2021.02.23 NETFLIX INC
  • US10931975B2 patent drawing
  • US10931975B2 patent drawing
  • US10931975B2 patent drawing

AI summary

An endpoint device outputs frames of test media during a testing procedure. Each frame of test media includes a test pattern. A test module coupled to the endpoint device samples the test pattern and transmits sample data to a media test engine. The media test engine decodes a binary number from the test pattern and then converts the binary number to an integer value that is associated with the corresponding frame. The media test engine then analyzes sequences of these integer values to identify playback errors associated with the endpoint device.