Personalized AV Stream Creation with Social Media Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods fail to effectively integrate and synchronize audio/video (AV) stream captures with related social media data, such as comments and links, especially when viewers experience different lag times and comments arrive after the event, making it difficult to embed highlights into recorded programs.

Innovation Solution

A method and system that select and capture AV stream portions based on user preferences and timestamps from associated social media streams, generating a personalized AV stream by combining captured AV content with relevant social media data, using a hardware data recorder and monitoring system to identify and synchronize indicia across streams.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If users watch recorded AV programs later, then they can skip ads and watch at convenience, but they miss out on real-time social media discussions and highlights

Engineering Contradiction:
Improveconvenience of watching recorded contentVSAvoidmissed social media discussions and highlights
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system performs preliminary capture of social media comments and highlights during the live broadcast, storing them with timestamp associations. When the user watches the recorded program later, these pre-captured social media elements are automatically embedded at the appropriate moments, eliminating the need for real-time viewing while preserving the social viewing experience.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If users surf websites to watch highlights and discussions before or after the match, then they can access social media content, but it is time consuming and may spoil the viewing experience

Engineering Contradiction:
Improveaccess to social media contentVSAvoidtime spent surfing websites
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system merges the AV program stream with the social media data stream by capturing both simultaneously and embedding social media comments and highlights directly into the recorded program at their corresponding timestamp positions. This integration allows users to consume both the program and social media content in a single viewing session, eliminating the need to separately surf websites.

Inventive Principle:
Principle #5Merging (Combining)

3Loss of information

If users surf websites to watch highlights and discussions before or after the match, then they can access social media content, but it may accidentally reveal spoilers

Engineering Contradiction:
Improveaccess to social media contentVSAvoidaccidental exposure to spoilers
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system applies local quality control by selectively embedding only certain social media content at specific timestamp positions in the recorded program. Comments and highlights are embedded only at appropriate moments that do not reveal spoilers, allowing users to access social media content safely during viewing without accidental exposure to harmful information.

Inventive Principle:
Principle #3Local quality

4Loss of information

If the system captures social media comments in real-time, then it can embed them in the recorded program, but it must handle different lag times for different viewing platforms

Engineering Contradiction:
Improvecapture of social media commentsVSAvoidhandling of different platform lag times
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system introduces a reference timeline as an intermediary that serves as a common time reference for both the AV program stream and the social media data stream. By synchronizing both streams to this reference timeline and using timestamp associations, the system can accurately match social media comments with their corresponding program moments regardless of different platform lag times, simplifying the synchronization process.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9332313B2Personalized augmented A/V stream creation
Publication Date: 2016.05.03 TAIWAN SEMICONDUCTOR MANUFACTURING CO LTD
  • US9332313B2 patent drawing
  • US9332313B2 patent drawing
  • US9332313B2 patent drawing

AI summary

A personalized audio and/or video (AV) stream is created for a user. A first stream of AV data is selected by reference to predetermined user preferences. One or more further data streams having a predetermined relation to the first stream are selected. Portions of the first stream are identified and captured by reference to identifying predetermined indicia in a group of streams consisting of the first stream and the one or more further data streams, where the capturing comprises capturing one or more time stamps from the group of streams. The personalized AV stream, comprising a captured portion of the first stream and data selected by reference to the predetermined indicia from at least one of the further data streams is generated, where the data selected is based on each captured timestamp.