Audience Composition Detection with Audio-Thermal-Facial Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audience monitoring technologies face challenges in accurately determining audience composition due to reliance on active prompting, which relies on audience compliance and can be processor-intensive, and passive facial recognition, which is time-consuming.

Innovation Solution

A combination of passive audio detection, thermal imaging, and facial recognition systems is used to identify audience members, supplemented by an active people meter to verify and minimize prompting, with a model trained to learn household media environments for accurate audience composition determination.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If passive facial recognition is used to identify audience members, then audience composition can be determined without active prompting, but the process becomes time-consuming

Engineering Contradiction:
ImproveAudience identification without promptingVSAvoidTime required for facial recognition
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent combines multiple detection systems (audio detection, thermal imaging, and facial recognition) into a unified audience monitoring system. Each system processes different types of data simultaneously, and the results are integrated to determine audience composition, thereby reducing the time required compared to using facial recognition alone while maintaining non-intrusive operation.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system divides the audience identification process into multiple parallel detection channels: audio detection for voice patterns, thermal imaging for heat signatures, and facial recognition for visual identification. This segmentation allows simultaneous processing of different data types, reducing overall time consumption while improving reliability.

Inventive Principle:
Principle #1Segmentation

2Reliability

If active prompting is used to determine audience composition, then audience compliance is required, but the process becomes processor-intensive and less reliable

Engineering Contradiction:
ImproveAudience complianceVSAvoidProcessor intensity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system enables passive self-identification of audience members through multiple sensors that automatically detect and process characteristics such as voice patterns, thermal signatures, and facial features without requiring active participation or compliance from audience members. This eliminates the need for processor-intensive prompting while improving reliability.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces active mechanical prompting systems with passive sensor-based detection systems. Instead of requiring audience members to actively respond to prompts, the system uses audio sensors, thermal cameras, and facial recognition algorithms to automatically identify and track audience members, thereby reducing processor intensity and improving reliability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If multiple detection systems are combined to improve accuracy, then audience composition determination becomes more reliable, but system complexity increases

Engineering Contradiction:
ImproveAudience composition accuracyVSAvoidSystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements a multi-functional detection system where audio sensors, thermal imaging devices, and facial recognition systems all serve the common purpose of identifying and tracking audience members. The system uses a unified processing architecture that integrates data from all sensors, achieving high measurement precision while managing complexity through shared computational resources and coordinated operation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces reliance on audience compliance and processor intensity, providing accurate and efficient audience composition monitoring with reduced prompting, enhancing the reliability and efficiency of audience monitoring systems.

Implementation Method 1

a thermal imaging system to capture frames of thermal image data of the media presentation environment

Methodology Applied
Scientific EffectThermal radiation: Thermal Radiation

Data Source

PatentUS20250259472A1Methods and apparatus to determine an audience composition based on voice recognition, thermal imaging, and facial recognition
Publication Date: 2025.08.14 THE NIELSEN CO (US) LLC
  • US20250259472A1 patent drawing
  • US20250259472A1 patent drawing
  • US20250259472A1 patent drawing

AI summary

Methods, apparatus, systems and articles of manufacture are disclosed. An example apparatus includes an audio detector to determine a first audience count based on signatures of audio data captured in the media environment, a thermal image detector to determine a heat blob count based on a frame of thermal image data captured in the media environment, and an audience image detector to identify at least one audience member based on a comparison of a frame of audience image data with a library of reference audience images, the audience image detector to perform he comparison in response to the first audience count not matching the heat blob count.