Overlay-Based Watermarking for Video Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for delivering video frames with synchronized metadata in live broadcast productions are inefficient, as they often require additional steps for synchronization and are vulnerable to manipulation during video processing, especially when using ancillary data regions or separate metadata streams.

Innovation Solution

The use of digital watermarking techniques to embed metadata within graphical overlays in broadcast video, leveraging overlay-templates for informed watermarking methods that ensure synchronization and robustness without additional processing steps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If metadata is stored in ancillary data regions or separate streams, then synchronization can be achieved, but the system becomes vulnerable to manipulation during video processing and requires additional processing steps

Engineering Contradiction:
Improvesynchronization reliabilityVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges metadata with the video content by embedding it within the graphical overlays that are already part of the video display. This integration eliminates the need for separate metadata streams or ancillary data regions, as the metadata becomes an intrinsic part of the video signal itself, thereby reducing processing complexity while maintaining synchronization reliability.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses digital watermarking to embed metadata within the visual content of graphical overlays. This copying approach embeds the metadata information directly into the pixel data of the overlay regions, making the metadata travel with the video content through all processing stages without requiring separate transmission channels or additional synchronization mechanisms.

Inventive Principle:
Principle #26Copying

2Reliability

If digital watermarking is used to embed metadata in graphical overlays, then synchronization and robustness are improved, but the payload capacity is limited by the overlay region size

Engineering Contradiction:
Improvesynchronization robustnessVSAvoidmetadata payload capacity
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent segments the metadata payload across multiple graphical overlays that appear throughout the video sequence. Each overlay carries a portion of the metadata, and collectively they convey the complete information set. This segmentation allows the system to achieve high payload capacity while maintaining the robustness of individual watermark embeddings in each overlay region.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs periodic insertion of graphical overlays containing watermarked metadata at regular intervals throughout the video stream. This periodic action ensures that the metadata is transmitted repeatedly, enhancing synchronization robustness while the accumulation of metadata across multiple periodic instances increases the effective payload capacity beyond what a single overlay could provide.

Inventive Principle:
Principle #19Periodic action

3Illumination intensity

If high-rate cameras and UHD/HDR content are used, then video quality is improved, but redundancy increases in static or low-detail regions where overlays are rendered

Engineering Contradiction:
Improvevideo qualityVSAvoidredundant data
Core Design Contradiction:
Illumination intensityVSLoss of substance

Solution Approach 1:

The patent converts the redundancy inherent in high-rate camera oversampling and UHD/HDR content into a benefit by using it as the carrier for metadata embedding. The excessive data in static or low-detail regions, which would otherwise be wasted space, becomes the medium for hiding metadata through digital watermarking, thereby transforming a loss of substance into a useful resource for information transmission.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS9299119B2Overlay-based watermarking for video synchronization with contextual data
Publication Date: 2016.03.29 DISNEY ENTERPRISES INC
  • US9299119B2 patent drawing
  • US9299119B2 patent drawing
  • US9299119B2 patent drawing

AI summary

Systems and methods for synchronizing a broadcast video with contextual data are disclosed, wherein the broadcast video is enhanced by graphical overlays. Synchronization is achieved by means of digital watermarking of the broadcast video in conjunction with the graphical-overlays. Exemplary embodiments embed a watermark bitstream into the broadcast video based on an overlay-template, characteristic of a corresponding overlay-graphic. The watermarked video is then transmitted over a communication link to a receiving-end including a detector. According to some embodiment, the embedder inserts the watermark bitstream into the overlay-graphics' regions of the video and the detector extracts the watermark bitstream based on information in the overlay-template and based on a restored version of the original overlay-graphics.