Video Commentary Synchronization via Sensor Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video content commentary is often limited in perspective and restricted, as it is typically controlled by the content producer and cannot be consumed separately from the video content, limiting user-generated commentary opportunities and diversity.

Innovation Solution

A method and system that utilize sensor systems, such as image, acoustic, and depth sensors, to record viewer interactions while watching video content, generating and storing commentary data with identification and synchronization metadata, allowing users to upload and share commentary, which can be synchronized with the video content for later playback, and made available through a commentary service.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If commentary is recorded as an integral part of the content under producer control, then the commentary is synchronized with the video content, but the commentary is limited in perspective and cannot be consumed separately

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidcommentary diversity
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system separates commentary data from video content by storing them as independent entities in the database. Commentary is captured as separate audio/video streams with timestamp metadata, allowing independent retrieval and playback. This segmentation enables multiple commentary versions to coexist for the same content while maintaining synchronization through timestamp-based alignment during playback.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a commentary service as an intermediary layer between video content and viewers. This service receives commentary submissions, stores them with synchronization metadata, and delivers appropriate commentary based on user preferences. The intermediary manages the complexity of matching commentary with content while enabling diverse perspectives without requiring direct integration between commentary and video streams.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of manufacture

If commentary is produced centrally by content producers, then the commentary process is controlled and consistent, but user-generated commentary opportunities are limited

Engineering Contradiction:
Improvecommentary production controlVSAvoiduser-generated content capability
Core Design Contradiction:
Ease of manufactureVSExtent of automation

Solution Approach 1:

The system transitions from static, producer-controlled commentary to dynamic, user-generated commentary. Multiple users can submit commentary for the same video content, and the system dynamically selects and delivers appropriate commentary based on user profiles, preferences, and social network information. This dynamic approach enables both professional and amateur commentary while maintaining system-controlled delivery mechanisms.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The commentary service serves multiple functions: it accepts commentary from various sources (professional producers and regular users), stores diverse commentary types, filters based on user preferences, and delivers synchronized commentary. This multi-functional platform replaces the single-function producer-controlled model with a universal system that handles both centralized and decentralized commentary generation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If commentary is integrated into video content, then the commentary plays automatically with each rebroadcast, but the commentary cannot be selected or customized by viewers

Engineering Contradiction:
Improveautomatic playbackVSAvoidviewer selection capability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system changes the parameter of commentary delivery from fixed (single integrated track) to variable (multiple selectable options). Commentary is stored with metadata including timestamps, commentator identifiers, and content references, allowing the system to dynamically select which commentary to play based on user preferences, social connections, or random selection. This parameter change enables automatic playback while providing viewer customization options.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP2721833B1Providing video presentation commentary
Publication Date: 2019.05.15 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP2721833B1 patent drawingFigure 1
  • EP2721833B1 patent drawingFigure 2
  • EP2721833B1 patent drawingFigure 3

AI summary

Embodiments are disclosed that relate to providing commentary for video content. For example, one disclosed embodiment provides a method comprising receiving and storing an input of commentary data from each of a plurality of commentary input devices, and also, for each input of commentary data, receiving and storing identification metadata identifying a commentator, for each input of commentary data, synchronization metadata that synchronizes the commentary data with the associated media content item is received and stored. The method further comprises receiving a request from a requesting media presentation device for commentary relevant to a specified media content item and a specified user, identifying relevant commentary data based upon social network information for the specified user, and sending the relevant commentary data to the requesting client device.