Facial Expression Analysis for Marketing Campaign Evaluation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for evaluating marketing campaigns are limited by requiring physical user input or speech recognition, which are impractical in public settings and may yield inaccurate results due to background noise or environmental factors, and lack a reliable means to assess user facial responses objectively.

Innovation Solution

A computer-implemented system utilizing facial recognition and eye-tracking technologies to analyze user facial expressions, allowing for hands-free input and objective evaluation of marketing campaigns by recording and analyzing facial responses, such as smiles or frowns, to determine the appropriateness of media presentation progression.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If physical user input methods (mouse, keyboard, touchscreen) are used to interact with media presentations, then user interaction capability is provided, but usability deteriorates in public settings where hand freedom is required

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidadaptability to public settings
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent replaces mechanical input methods (hand operations on mice, keyboards, or touchscreens) with facial expression recognition technology. The system captures and analyzes facial expressions through image processing to determine user approval or disapproval of media presentations, eliminating the need for physical hand input while maintaining interaction capability. This substitution resolves the contradiction by enabling hands-free interaction that works effectively in public settings.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If speech recognition is used to determine emotional affect or mental state, then hands-free interaction is achieved, but measurement precision deteriorates due to background noises causing false positive readings

Engineering Contradiction:
Improvehands-free interactionVSAvoidemotional affect detection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent substitutes acoustic-based speech recognition with optical-based facial expression analysis. Instead of relying on voice signals that are susceptible to background noise interference, the system captures visual images of facial expressions and analyzes them through image processing algorithms. This substitution maintains hands-free interaction while dramatically improving measurement precision by eliminating acoustic interference from the detection process.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If speech recognition is used to understand the speaker, then interaction capability is provided, but reliability deteriorates when media presentation plays simultaneously on the same device

Engineering Contradiction:
Improveinteraction capabilityVSAvoidspeaker recognition accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent replaces acoustic speech recognition with optical facial expression analysis to resolve the conflict between interaction capability and reliability. By using image capture and analysis of facial expressions rather than acoustic signal processing, the system can reliably identify user reactions even when audio from the media presentation is simultaneously playing on the same device, eliminating the reliability issues inherent in speech recognition.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Ease of manufacture

If conventional evaluation methods are used to assess user responses, then existing infrastructure is utilized, but measurement precision deteriorates due to inability to objectively assess facial responses

Engineering Contradiction:
Improveevaluation system implementationVSAvoidfacial response assessment accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent replaces conventional subjective evaluation methods with objective optical measurement systems. Instead of relying on self-reported responses or subjective assessment, the system uses image capture devices and image processing algorithms to objectively measure facial expressions. This substitution maintains ease of implementation through standard imaging technology while dramatically improving measurement precision for facial response assessment.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10880602B2Method of objectively utilizing user facial expressions when viewing media presentations for evaluating a marketing campaign
Publication Date: 2020.12.29 JINGLZ INC
  • US10880602B2 patent drawing
  • US10880602B2 patent drawing
  • US10880602B2 patent drawing

AI summary

The present invention is directed to a computer-implemented method and system for analyzing a user's facial responses to determine a user's approval or disapproval of a marketing campaign. Such a system may comprise open-source or commonly-implemented facial recognition hardware and software on smartphones, tablets, or computers, and may interface with the media-playing hardware on such devices. The system and method causes display of one or more media presentations to a plurality of users for measuring their facial gestures, wherein these facial gestures are associated with an approval or disapproval of one or more portions of the one or more media presentations. These face gestures may be recorded in a central server for data related to the individual and users in the aggregate and/or may be sent back to the developer of the one or more media presentations for analysis and/or editing.