Techniques for detecting media playback errors

Abstract

An endpoint device outputs frames of test media during a testing procedure. Each frame of test media includes a test pattern. A test module coupled to the endpoint device samples the test pattern and transmits sample data to a media test engine. The media test engine decodes a binary number from the test pattern and then converts the binary number to an integer value that is associated with the corresponding frame. The media test engine then analyzes sequences of these integer values to identify playback errors associated with the endpoint device.

Description

BACKGROUND OF THE INVENTIONField of the Invention[0001]Embodiments of the present invention relate generally to media playback and, more specifically, to techniques for detecting media playback errors.Description of the Related Art[0002]Many original equipment manufacturers (OEMs) produce endpoint devices that are pre-configured to connect to a video streaming service via an application that executes on the endpoint device. For example, an OEM could produce a smart television set that is pre-loaded with an endpoint application that can be automatically executed by the smart television to connect to the video streaming service and stream media titles to the smart television. With this approach, end-users may view media titles without needing to install additional software on the endpoint devices they purchase.[0003]An endpoint application that is pre-loaded on a given endpoint device may stream and playback many different versions of a given media title. In so doing, the endpoint app...

AI Technical Summary

Benefits of technology

The invention automates testing of endpoint devices, which expands the coverage of tests that can be performed by the device's manufacturer.

Problems solved by technology

This particular error is known in the art as a “frame drop” error.

First, OEMs typically cannot test all possible versions of each available media title with every different model of endpoint device and all different versions of the endpoint application because the number of possible test combinations is oftentimes too large. To solve this problem, OEMs usually test only a handful of versions of a limited subset of media titles with only the most recent release of the endpoint application. However, such limiting test coverage can expose end-users to playback errors associated with untested use cases. Test coverage may further be limited due to encryption protection associated with certain endpoint devices.

Second, different OEMs may not implement the exact same testing procedures, leading to inconsistent test results across different OEMs. For example, different OEMs may implement different test procedures altogether or may implement the same test procedure differently. If the test results are inconsistent across different OEMs, then different OEMs are likely to correct different sets of playback errors. As a result, endpoint devices from different OEMs may provide user experiences of variable quality when streaming video from the video streaming service, which may reflect poorly on the video streaming service.

Third, human test engineers do not always perceive every playback error that arises during testing. Thus, to the extent an actual end-user viewing experience reflects a given test scenario, the user could be exposed to any playback errors missed by the human test engineer during that test scenario. Additionally, human perception is generally subjective, reducing consistency across human test engineers.

Images