IoT-Driven Media Streaming Personalization via Reinforcement Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing media streaming services face challenges in providing personalized playback experiences for users, as predetermined narratives often fail to align with individual user preferences, leading to playback delays and potential skipping of essential plot elements, which degrade the viewing experience.

Innovation Solution

A computer-implemented method that uses an IoT device to determine user interactions and performs reinforcement-learning operations to dynamically personalize media title playback, allowing for real-time adjustments to the narrative sequence without interrupting the playback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a predetermined narrative is used for media playback, then the majority of users are appealed, but individual user preferences are not satisfied

Engineering Contradiction:
Improvepersonalization capabilityVSAvoidplayback control complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically adjusts the media playback narrative based on detected user emotions and interactions, eliminating the need for manual user input or complex control interfaces. The playback system serves itself by autonomously selecting and adjusting narrative elements according to real-time user state analysis.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If manual override of playback is allowed, then user preferences can be accommodated, but playback delays occur

Engineering Contradiction:
Improveuser preference adaptationVSAvoidplayback delay
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system pre-loads and prepares alternative narrative segments and playback adjustments in advance based on predicted user preferences and emotions. By having multiple narrative paths and adjustments ready beforehand, the system can switch between them instantly without causing playback delays or interruptions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuous playback without interruptions by automatically adjusting narrative flow in real-time based on user emotions. The seamless adaptation ensures that the playback action continues uninterrupted, eliminating the pauses and delays associated with manual overrides while still accommodating user preferences.

Inventive Principle:
Principle #20Continuity of useful action

3Ease of operation

If manual navigation commands are used, then users can skip unwanted portions, but essential plot elements may be inadvertently skipped

Engineering Contradiction:
Improvenavigation controlVSAvoidmissed plot elements
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system continuously monitors user emotions and engagement levels during playback, using this feedback to dynamically adjust the narrative in real-time. By detecting when a user is disengaged or bored, the system can automatically emphasize or replay essential plot elements, ensuring they are not missed even when users navigate through the content at their own pace.

Inventive Principle:
Principle #23Feedback

4Adaptability or versatility

If reinforcement learning is used for personalization, then viewing experience quality is enhanced, but computational complexity increases

Engineering Contradiction:
Improvepersonalization accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system applies reinforcement learning selectively to the most critical aspects of narrative personalization rather than attempting to optimize all elements. By focusing computational resources on key decision points and emotional engagement factors, the system achieves effective personalization without requiring excessive computational complexity across the entire playback system.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11109099B1Techniques for streaming a media title based on user interactions with an internet of things device
Publication Date: 2021.08.31 DISNEY ENTERPRISES INC
  • US11109099B1 patent drawing
  • US11109099B1 patent drawing
  • US11109099B1 patent drawing

AI summary

In various embodiments, an interactive streaming application plays back a media title via a client device. In operation, the interactive streaming application causes the client device to playback a first chunk of the media title. While the client device plays back the first chunk, the interactive streaming application determines a movement of an internet of things (“IoT”) device that is controlled by the user. The interactive streaming application performs reinforcement-learning operation(s) based on the first chunk and the movement to determine a second chunk of the media title to playback. The interactive streaming application then causes the client device to playback the second chunk of the media title. Advantageously, the interactive streaming application can automatically personalize the playback of the media title for the user based, at least in part, on movements of the IoT device.