Real-Time Viewer Expression Detection for Media Content Association

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for capturing media content moments and associated viewer reactions require rerunning the media content, disrupting the viewing experience and potentially altering the spontaneity of viewer reactions.

Innovation Solution

A system and method that detect viewer expressions in real-time while media content is being displayed, allowing for simultaneous capture of media content and viewer reactions without interrupting the viewing experience, by using electronic devices with cameras and processors to identify and store corresponding media content portions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If viewer reactions are captured after media content is viewed, then complete viewer reaction data is obtained, but the viewing experience is interrupted and spontaneity of reactions is lost

Engineering Contradiction:
Improveviewer reaction capture accuracyVSAvoidviewing experience continuity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs preliminary actions by detecting and capturing viewer expressions in real-time during media playback, rather than waiting until after the media content is viewed. This allows the system to capture spontaneous reactions as they occur naturally during the viewing experience, eliminating the need to interrupt playback for data collection.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuity of the viewing experience by performing expression detection and media content identification simultaneously during playback. The useful actions of media playback and viewer reaction capture occur continuously and concurrently without interruption, preserving both the viewing experience and the spontaneity of reactions.

Inventive Principle:
Principle #20Continuity of useful action

2Loss of information

If media content is rerun to capture viewer reactions, then complete reaction data is obtained, but time is lost and spontaneity is altered

Engineering Contradiction:
Improveviewer reaction data completenessVSAvoidviewing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system performs preliminary capture of both media content and viewer expressions during the original playback. By identifying and storing the specific portion of media content corresponding to detected expressions in real-time, the system eliminates the need for rerunning media to associate reactions with their source content.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback by continuously monitoring viewer expressions during playback and automatically identifying the corresponding media content portions. This real-time feedback loop allows the system to capture complete reaction data with proper temporal association without requiring additional playback time.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If real-time expression detection is performed during media playback, then viewing experience is preserved, but simultaneous capture of media content and reactions becomes complex

Engineering Contradiction:
Improveviewing experience continuityVSAvoidsimultaneous capture system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system merges the function of expression detection with media content identification into a unified process. By combining these functions and performing them simultaneously during playback, the system reduces overall complexity compared to separate sequential operations, while preserving the continuous viewing experience.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10623813B2Systems and methods for associating media content with viewer expressions
Publication Date: 2020.04.14 GOOGLE LLC
  • US10623813B2 patent drawing
  • US10623813B2 patent drawing
  • US10623813B2 patent drawing

AI summary

Systems and methods for capturing media content in accordance with viewer expression are disclosed. In some implementations, a method is performed at a computer system having one or more processors and memory storing one or more programs for execution by the one or more processors. The method includes: (1) obtaining a momentary reaction of the user to a portion of media content; (2) comparing the captured user reaction with one or more previously captured reactions of the user; (3) identifying the user reaction as one of a plurality of reaction types based on the comparison; (4) identifying the portion of the media content corresponding to the momentary reaction of the user; and (5) generating an electronic message that includes information regarding the portion of the media content item and information regarding the identified user reaction.