Screen Capture Media Identification During Audio Silence

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing media monitoring systems struggle to identify media content and providers during moments of silence, such as when audio signals are muted or not present, particularly in the context of streaming media accessed via the Internet, leading to gaps in audience measurement data.

Innovation Solution

Implementing a screen capture mechanism in media monitoring meters to capture images during moments of silence, utilizing image recognition technology and machine learning models to identify media and providers, complementing audio-based identification methods.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If audio-based identification methods are used to monitor media presentations, then media identification accuracy is improved during audio playback, but media identification fails during moments of silence when audio signals are muted or not present

Engineering Contradiction:
Improvemedia identification accuracyVSAvoidcontinuous media identification
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent combines audio-based identification methods with visual screen capture methods into a unified media monitoring system. The system switches between audio analysis and visual analysis depending on the current media playback state, ensuring continuous and reliable media identification across all conditions including moments of silence.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces screen capture as an intermediary method to bridge the identification gap during audio silence periods. When audio signals are unavailable or muted, the system captures visual frames from the media presentation and uses image recognition to identify the media content, thereby maintaining continuous identification capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If screen capture mechanism is implemented to capture images during moments of silence, then continuous media identification is improved, but device complexity increases

Engineering Contradiction:
Improvecontinuous media identificationVSAvoidsystem structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a dynamic system that adaptively switches between audio-based and visual-based identification methods based on real-time detection of audio signal availability. The system activates screen capture functionality only when audio signals are muted or absent, rather than running continuously, thereby reducing overall system complexity while maintaining continuous identification reliability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system automatically detects when audio signals are unavailable and self-switches to visual screen capture mode without requiring external intervention. The meter autonomously determines when to activate the image capture device and when to revert to audio-based identification, simplifying the control architecture while ensuring continuous media identification.

Inventive Principle:
Principle #25Self-service

3Loss of information

If image capture device is activated continuously to ensure no moment is missed, then complete media coverage is improved, but energy consumption increases

Engineering Contradiction:
Improvemedia coverage completenessVSAvoidenergy consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The patent employs periodic screen capture at specific intervals during moments of silence rather than continuous capture. The system captures images at strategically selected time points when audio is unavailable, ensuring complete media coverage during silence periods while minimizing energy consumption by keeping the image capture device inactive during normal audio playback.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system performs preliminary detection of audio signal status and proactively activates screen capture only when silence is detected, rather than waiting for potential information loss to occur. This preliminary action ensures complete media coverage during critical silence moments while avoiding unnecessary energy consumption during periods when audio-based identification is sufficient.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12581155B2Methods, system and article of manufacture, and apparatus to identify media using screen capture
Publication Date: 2026.03.17 THE NIELSEN CO (US) LLC
  • US12581155B2 patent drawing
  • US12581155B2 patent drawing
  • US12581155B2 patent drawing

AI summary

Methods, apparatus, systems, and articles of manufacture are disclosed that utilize screen capture to identify media. Example meter devices disclosed herein are to, in response to determining a media device is powered on, monitor a media device to detect audio output by the media device. Disclosed example meter devices are also to, in response to audio not being detected for a period of time, instruct an image capture device to capture image data representative of a media presentation by the media device. Disclosed example meter devices are also to instruct the image capture device to stop capturing the image data in response to detection of audio output by the media device. Disclosed example meter devices are also to determine, based on whether the image data corresponds to a menu presentation by the media device, whether to transmit the image data to a central facility for media identification.