Selective Interactive Event Tracking via Facial Expression Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Interactive event tracking generates large amounts of data, much of which is not analytically useful, necessitating conditional filtering techniques to reduce volume and increase efficiency.

Innovation Solution

A system that uses facial expression data from cameras or image sensors to selectively record and tag interactive events based on detected user interests, employing a detection module, expression classifier, and tagging module to assign definitions to new facial expressions and tag corresponding interactive events, with the ability to update training data for improved recognition accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If all interactive events are recorded, then complete user interaction data is obtained, but data volume becomes excessively large and processing efficiency decreases

Engineering Contradiction:
Improvecompleteness of interaction dataVSAvoiddata processing efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system extracts only the essential and useful interactive events based on user interest indicators (facial expressions, cursor behavior, interaction duration) rather than recording all events. This selective extraction removes unnecessary data while preserving analytically valuable interactions, thereby reducing data volume without sacrificing information completeness.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Different filtering criteria and recording thresholds are applied to different types of interactive events based on their potential analytical value. High-value events (e.g., events accompanied by positive facial expressions or prolonged interaction) are recorded with higher priority, while low-value events are filtered out, creating a quality-based differentiation in data collection.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If facial expression analysis is added to filter interactive events, then data filtering accuracy improves, but system complexity increases

Engineering Contradiction:
Improveuser interest detection accuracyVSAvoidsystem architecture complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system employs a multi-modal detection approach where a single integrated framework processes multiple types of user interest indicators (facial expressions, cursor movements, interaction patterns) through unified algorithms. This multi-functional design allows the same system components to handle various detection tasks, reducing overall system complexity while maintaining high filtering accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

An intermediary processing layer is introduced that aggregates and correlates data from multiple sources (image sensors for facial expressions, input devices for interaction events, tracking systems for cursor movements). This intermediary layer synthesizes information from different modalities and applies coordinated filtering logic, simplifying the architecture by centralizing the complex decision-making process rather than distributing it across multiple independent systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11163988B2Selective interactive event tracking based on user interest
Publication Date: 2021.11.02 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11163988B2 patent drawing
  • US11163988B2 patent drawing
  • US11163988B2 patent drawing

AI summary

A system, method, and computer program product for tracking interactive events. Facial expression data and interactive event data are received. A new facial expression is detected in the facial expression data, and the new facial expression and corresponding interactive event data are recorded. The new facial expression is recognized based on training data, and in response, a definition is assigned to the new facial expression. The corresponding interactive event data is tagged with the definition.