Real-Time Media Overlay for Interactive Viewer Engagement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing media presentations, such as movies and TV shows, do not allow for real-time user interaction, limiting audience engagement and participation, as they are static and do not enable dynamic interaction with the content.

Innovation Solution

A method and apparatus that enables real-time user interaction by adding game overlays to media presentations, allowing users to interact with the content through avatars and virtual objects that respond to user gestures, with preprocessing to extract metadata streams and composite interactive elements with the media content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a media presentation is kept static to maintain its original content integrity, then the media content remains unchanged and playable on any system, but user interaction capability is lost

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidmedia content integrity
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The system segments the media presentation into two independent layers: the original static media content and an interactive overlay layer. The media content remains unchanged and intact, while the overlay layer provides interactive elements such as hot spots, avatars, and game elements. This segmentation allows the media content to maintain its integrity while the overlay enables user interaction capabilities.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The invention adds a new dimensional layer (the interactive overlay) on top of the traditional two-dimensional media presentation. This overlay dimension contains interactive elements that respond to user input without altering the underlying media content, effectively adding interactivity as a new dimension while preserving the original content structure.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If game elements are added to enable user interaction, then audience engagement is improved, but the complexity of the system increases

Engineering Contradiction:
Improveaudience engagementVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system introduces an intermediary component (the overlay generator and compositor) that mediates between the simple media playback and complex user interaction requirements. This intermediary layer handles the complexity of interaction management, hot spot detection, and element compositing, while presenting a simplified interface to both the media content and the user.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The overlay system is designed as a universal platform that can be applied to various types of media presentations (movies, TV shows, videos) without requiring modifications to the original content. The same overlay infrastructure supports multiple interaction modes, game elements, and engagement features, reducing overall system complexity through reuse.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If interactive elements are overlaid on media content, then real-time user interaction is enabled, but the original media presentation quality may be compromised

Engineering Contradiction:
Improvereal-time interactionVSAvoidmedia presentation quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The overlay system applies interactive elements only to specific local regions (hot spots) of the media presentation rather than uniformly across the entire content. This localized approach ensures that interactive elements are placed strategically without obscuring or degrading the overall media quality, maintaining precision in both interaction and presentation.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The overlay elements are designed to be dynamic and adaptive, adjusting their position, visibility, and interaction properties in real-time based on the media content being displayed and user actions. This dynamic behavior allows the system to maintain optimal media quality while enabling flexible real-time interaction.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10412456B2Method and apparatus for real-time viewer interaction with a media presentation
Publication Date: 2019.09.10 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10412456B2 patent drawing
  • US10412456B2 patent drawing
  • US10412456B2 patent drawing

AI summary

Real-time participation within a media presentation is disclosed. A participant overlay may be generated by preprocessing a media presentation captured in real time with a camera to extract a time-variant metadata stream associated with one or more interactive regions depicted in the media presentation. The participant overlay includes simulated physics, which may include boundaries of the interactive regions defined in accordance with content in said media presentation. A participant's interaction with said media presentation through the interactive regions may be captured and combined with the media presentation for display on a display. The interaction may comprise a user action upon one or more elements in the media presentation, a user action expressed in the media presentation through an avatar, or a user action in said media presentation in connection with a game element.