User Interface Fingerprinting for OTT Device Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Over-the-top (OTT) media applications lack effective tracking mechanisms for user interfaces and devices, making it difficult to monitor media consumption and device usage patterns.

Innovation Solution

Systems and methods that capture and analyze fingerprints of user interfaces to identify the corresponding services or devices, utilizing a database of known fingerprints and a knowledge graph to determine matches or partial matches, and update the database with new information to improve tracking capabilities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional video consumption tracking methods are used, then tracking accuracy is maintained for set-top boxes and cable television, but tracking capability is lost for OTT media applications and devices

Engineering Contradiction:
Improvetracking capabilityVSAvoidtracking accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent creates visual fingerprints by capturing and analyzing graphical user interface elements, logos, and visual characteristics of OTT applications. This copying approach allows the system to identify and track OTT devices without requiring direct integration or authentication with each service provider, thereby maintaining tracking accuracy while adapting to diverse OTT platforms

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent develops a universal tracking system that can identify multiple types of devices (set-top boxes, cable television, OTT applications) through a single fingerprinting mechanism. The system analyzes visual elements across different platforms and services, creating a multi-functional tracking capability that works across traditional and emerging media consumption devices

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If visual fingerprinting of user interfaces is implemented, then device identification capability is improved for OTT applications, but system complexity increases due to image capture and analysis requirements

Engineering Contradiction:
Improvedevice identification capabilityVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts specific visual features from captured screenshots, such as logos, interface elements, and graphical characteristics. By isolating and analyzing only the relevant visual fingerprint elements rather than processing entire images, the system achieves accurate device identification while reducing computational complexity and resource requirements

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent divides the user interface into distinct visual components and analyzes specific segments (logos, buttons, graphical elements) to create device identifiers. This segmentation approach allows the system to focus on distinctive features that reliably identify devices without being overwhelmed by the complexity of analyzing entire interface screenshots

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If comprehensive database of fingerprint characteristics is maintained, then matching accuracy is improved for known services, but data storage requirements and processing time increase

Engineering Contradiction:
Improvematching accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent compares only the extracted visual fingerprint features (logos, key interface elements) against the database of known service characteristics, rather than performing exhaustive full-interface comparisons. This partial action approach maintains high matching accuracy by focusing on distinctive features while significantly reducing processing time and computational resources required

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9819996B2Systems and methods for fingerprinting to track device usage
Publication Date: 2017.11.14 ADEIA GUIDES INC
  • US9819996B2 patent drawing
  • US9819996B2 patent drawing
  • US9819996B2 patent drawing

AI summary

Systems and methods are provided herein for using fingerprinting techniques on user interfaces, such as source indicators, application indicators, and the like, to determine the source of any given user interface. For example, a source of a user interface may be determined to be a particular console, such as an XBOX console, or a particular application, such as Netflix, a video streaming application. The use of various user interfaces tracked over time may indicate a loss or gain of popularity of a given source corresponding to a given user interface.