Video Stream Metadata Encoding for Interactive Content

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video content playback systems require multiple starts and stops to enable user interactivity and synchronization of primary and supplemental content, which is processing-intensive and limits interactive content accessibility on widely distributed playback devices.

Innovation Solution

Embedding supplemental content and encoded metadata directly into the video frames with default content, allowing for enhanced interactivity and low-processing requirements, using a bit-block technique for transfer and variable aspect ratios to resist piracy and maintain interactivity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If separate data streams are used for primary and supplemental content, then content synchronization can be achieved, but processing power requirements increase significantly

Engineering Contradiction:
Improvecontent synchronizationVSAvoidprocessing power
Core Design Contradiction:
ReliabilityVSPower

Solution Approach 1:

The patent combines primary content and supplemental content into a single integrated video stream, eliminating the need for separate data streams. This merging approach maintains content synchronization while dramatically reducing processing power requirements, as the supplemental content is embedded within the video frame structure rather than requiring concurrent processing of separate streams.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The video stream serves multiple functions simultaneously: it carries both primary content and supplemental content, and the embedded metadata provides synchronization information without requiring separate processing channels. This multi-functional approach allows a single stream to accomplish what previously required multiple coordinated streams.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If multiple playback starts and stops are required for user interactivity, then user control over content changes is enabled, but playback continuity is disrupted

Engineering Contradiction:
Improveuser controlVSAvoidplayback continuity
Core Design Contradiction:
Ease of operationVSDuration of action of stationary object

Solution Approach 1:

The patent embeds all possible supplemental content and interaction options within the video stream in advance, with metadata indicating available alternatives. This preliminary preparation allows users to interact with the content during playback without requiring stops, as the system can immediately switch between embedded content variants based on user input.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically switches between different supplemental content embedded within the same video stream based on real-time user interactions. This dynamic capability enables content modification during continuous playback, eliminating the need for static pre-selection or playback interruptions.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If advanced GPUs are used to process complex rendering data, then interactive content quality is improved, but device accessibility is reduced

Engineering Contradiction:
Improveinteractive content qualityVSAvoiddevice accessibility
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent employs lightweight bit-block transfer techniques instead of complex GPU rendering, using simpler, more widely available processing methods. This approach maintains adequate content quality while making the technology accessible to a broader range of devices, including those without advanced graphics processing capabilities.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The system changes the processing approach from high-complexity GPU rendering to simpler bit-block operations, fundamentally altering the computational parameters required. This parameter change enables the same interactive content functionality to run on devices with varying processing capabilities, greatly expanding device accessibility.

Inventive Principle:
Principle #35Parameter changes

4Power

If supplemental content is embedded in video frames, then processing requirements are reduced, but content piracy resistance must be maintained

Engineering Contradiction:
Improveprocessing requirementsVSAvoidcontent piracy
Core Design Contradiction:
PowerVSObject-affected harmful factors

Solution Approach 1:

The patent employs variable aspect ratios for embedded supplemental content within video frames, creating an asymmetric structure that complicates extraction and reproduction efforts. This asymmetry, combined with the integration of content and metadata, makes it more difficult for pirates to separate and redistribute content without proper authorization.

Inventive Principle:
Principle #4Asymmetry

Solution Approach 2:

The system nests supplemental content and metadata within the video frame structure, creating a nested organization where content is embedded within content. This nesting approach protects the supplemental content by integrating it into the main video stream, making unauthorized extraction and use more difficult while maintaining low processing requirements.

Inventive Principle:
Principle #7Nested doll (Nesting)

Data Source

PatentUS11695988B2Content stream having encoded metadata for video enhancement
Publication Date: 2023.07.04 DISNEY ENTERPRISES INC
  • US11695988B2 patent drawing
  • US11695988B2 patent drawing
  • US11695988B2 patent drawing

AI summary

A system for providing default content enhanced with supplemental content includes processing hardware and a memory storing a software code. The processing hardware executes the software code to receive a content stream including multiple video frames, a first video frame of the multiple video frames including first default content, first supplemental content, and first encoded metadata, and to decode the first encoded metadata of the first video frame to produce first decoded metadata. The processing hardware further executes the software code to select, using the first decoded metadata, at least a first portion of the first supplemental content for use in enhancing the first default content, transfer, using the first decoded metadata, the selected first portion of the first supplemental content to one or more predetermined locations in the first default content to produce an enhanced first video content, and output the enhanced first video content to a display device.