Media Playback Control Using Mental State Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing media playback systems cannot accurately rewind media content to the exact point when a user becomes distracted, as they rely on fixed time increments, leading to inaccuracy and user frustration.

Innovation Solution

A computer-implemented method determines a mental state metric based on sensor data to modify media content playback, allowing for precise rewinding or pausing when the user becomes distracted and resuming playback when attention is regained, using a media controller application that processes cognitive, emotional, and mind-wandering metrics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If fixed time increment rewinding is used, then the system is simple to operate, but the rewinding accuracy is poor

Engineering Contradiction:
Improverewinding accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system continuously monitors the user's mental state through sensor data (eye tracking, cognitive load metrics) and uses this feedback to dynamically adjust media playback. When distraction is detected, the system automatically rewinds to the precise moment before distraction began, creating a closed-loop control system that improves rewinding accuracy without requiring manual user input.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces manual mechanical interaction (user pressing rewind buttons at fixed intervals) with an automated system using psychophysiological sensing and algorithmic determination of optimal rewind points. This substitution of mechanical user action with automated sensing and processing achieves precise rewinding while maintaining ease of operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If manual rewinding by fixed time increments is used, then the operation is easy, but the user experience is poor due to missing content

Engineering Contradiction:
Improverewinding operation easeVSAvoidcontent consumption reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system performs self-service by automatically detecting when the user becomes distracted and autonomously rewinding the media to the correct position without requiring user intervention. The system monitors its own operational context (user attention state) and self-corrects playback position, eliminating the need for manual rewinding operations while ensuring content is not missed.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors user mental state in advance and proactively rewinds media playback before the user would have the opportunity to manually rewind. By detecting early signs of distraction through sensor data and acting preemptively, the system ensures the user never misses content, maintaining both ease of operation and content consumption reliability.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If psychophysiological sensing is implemented, then the rewinding accuracy improves, but the device complexity increases

Engineering Contradiction:
Improvemental state measurement precisionVSAvoidsensing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses multi-functional sensor arrays that serve multiple purposes: eye tracking for attention detection, cognitive load monitoring for distraction identification, and potentially other psychophysiological measurements. By making the sensing system universal and multi-purpose, the patent achieves high measurement precision while justifying the increased complexity through multiple benefits from a single integrated system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3925812B1Modifying media content playback based on user mental state
Publication Date: 2024.07.24 HARMAN INT IND INC
  • EP3925812B1 patent drawingFigure 1
  • EP3925812B1 patent drawingFigure 2
  • EP3925812B1 patent drawingFigure 3

AI summary

Embodiments of the present disclosure sets forth a computer-implemented method for playing back media content comprising determining, based on sensor data, a first mental state associated with a user accessing media content, and modifying playback of media content based on the first mental state.