Mobile Usage Monitoring via Screen Image Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods lack effective solutions for monitoring and analyzing mobile device usage patterns across a representative population to provide accurate insights for content providers, advertisers, and service providers, as they struggle to collect and analyze usage data while maintaining user privacy and ensuring representative sampling.

Innovation Solution

A system comprising consenting panelists with mobile devices that execute a monitoring application, capable of collecting and reporting usage data to a collection server, which aggregates and analyzes this data to infer broader population trends, using techniques such as screen capture and image analysis to detect application launches and usage duration, while ensuring user privacy and demographic representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If monitoring application collects detailed usage data from mobile devices, then measurement precision is improved, but user privacy is compromised

Engineering Contradiction:
Improveusage data accuracyVSAvoiduser privacy loss
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent extracts only the necessary usage data elements needed for measurement purposes while leaving sensitive personal information out of the collection process. The monitoring application captures application launch events, screen capture data, and usage duration information without collecting personally identifiable information, thereby achieving measurement precision while preserving user privacy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary monitoring application that acts as a buffer between the user's private data and the external measurement system. This intermediary captures usage patterns locally on the device and transmits only aggregated, anonymized metrics to remote servers, preventing direct access to sensitive user information while maintaining measurement accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If panelist population is expanded to ensure representative sampling, then measurement reliability is improved, but data collection complexity increases

Engineering Contradiction:
Improverepresentative samplingVSAvoiddata collection system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the panelist recruitment and data collection process into distinct components: demographic screening, device setup, monitoring application installation, and data transmission protocols. This segmentation allows for systematic expansion of the panelist population while managing complexity through modular, standardized procedures for each participant.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal monitoring application framework that functions across diverse mobile devices and operating systems. This multi-functional approach allows the same data collection methodology to be applied universally across an expanding panelist population, reducing the complexity increase that would normally accompany population expansion.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If screen capture frequency is increased to detect application launches accurately, then measurement precision is improved, but energy consumption increases

Engineering Contradiction:
Improveapplication launch detectionVSAvoidmobile device battery
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic screen capture at strategically determined intervals rather than continuous monitoring. The system captures screens at regular intervals and uses change detection algorithms to identify application launches, achieving accurate measurement while consuming significantly less energy than continuous high-frequency capture would require.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent replaces intensive mechanical screen capture operations with lighter computational methods. Instead of continuously capturing and storing full screen images, the system uses incremental change detection and hashing algorithms that require minimal processing power and battery consumption while maintaining accurate detection of application launch events.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10740118B1Monitoring mobile device usage
Publication Date: 2020.08.11 COMSCORE INC
  • US10740118B1 patent drawing
  • US10740118B1 patent drawing
  • US10740118B1 patent drawing

AI summary

A first image of a mobile device screen is recorded into memory of the mobile device. The first image includes at least one icon that represents an application installed on the mobile device. A second image of the mobile device screen is recorded into the memory of the mobile device. A graphical change in an area of the mobile device screen corresponding to a position of the icon is detected by comparing at least a portion of the second image to the first image. The graphical change results from a user selection of the icon to activate the application represented by the icon. In response to detecting the graphical change, determine an identifier of the application represented by the icon. Send a record of the user selection of the icon to a collection server. The record includes at least the identifier of the application.