Metadata Framing Structure for Video Data Coherency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems face challenges in ensuring metadata coherency and high-bandwidth metadata transportation within digital video broadcasting, particularly due to limitations in existing metadata transporting interfaces like HDMI, DVI, and SDI, which result in time synchronization issues and inability to handle high-bandwidth metadata effectively.

Innovation Solution

A metadata framing structure is introduced, featuring a header, packet type, configuration, variable length payload, timestamp, and checksum, allowing metadata to be serialized and embedded within video frames, especially in the code word guard bit position of color channels, ensuring coherency and adaptability across various interfaces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If metadata is transmitted over existing video interfaces (HDMI, DVI, SDI), then the interfaces can handle metadata transportation, but the bandwidth capability is limited and time synchronization is lost

Engineering Contradiction:
Improvemetadata coherencyVSAvoidmetadata bandwidth
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The metadata is divided into multiple packets that are transmitted across multiple video frames. Each packet contains a portion of the metadata payload, allowing the complete metadata to be distributed over time while maintaining synchronization with the video stream through frame-based delimiting.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Timestamps are embedded in the metadata packets to indicate when each packet should be applied relative to the video stream. This preliminary time information allows the receiving system to reassemble the metadata in the correct temporal sequence, ensuring coherence even when metadata is transmitted across multiple frames.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If metadata is transmitted at existing video frame rates, then the metadata can be delivered with the video, but high bandwidth metadata cannot be transported

Engineering Contradiction:
Improvemetadata transmission speedVSAvoidmetadata bandwidth
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The metadata payload is segmented into multiple packets that can be distributed across multiple video frames. This segmentation allows large amounts of metadata to be transmitted at the existing video frame rate without overwhelming a single interface, while the cumulative bandwidth across multiple frames accommodates high-bandwidth metadata requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Metadata packets are transmitted periodically with each video frame, utilizing the existing video timing infrastructure. This periodic transmission pattern allows high-bandwidth metadata to be delivered systematically over time, leveraging the video stream's inherent periodicity to maintain synchronization and throughput.

Inventive Principle:
Principle #19Periodic action

3Quantity of substance

If metadata is spread across multiple frames, then high bandwidth metadata can be transported, but time synchronization is lost

Engineering Contradiction:
Improvemetadata bandwidthVSAvoidtime synchronization
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

Each metadata packet includes a timestamp field that specifies when the packet should be applied in the video stream timeline. This preliminary time information is embedded in the packet header, allowing the receiving system to correctly order and synchronize the packets even though they are transmitted across multiple frames, thereby preventing time desynchronization.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The metadata packets include delimiting information and timestamps that provide feedback about their temporal position and synchronization status. This feedback mechanism allows the receiving system to verify timing accuracy and adjust if necessary, ensuring that the metadata remains synchronized with the video stream throughout the transmission process.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9549197B2Visual dynamic range timestamp to enhance data coherency and potential of metadata using delay information
Publication Date: 2017.01.17 DOLBY LABORATORIES LICENSING CORP
  • US9549197B2 patent drawing
  • US9549197B2 patent drawing
  • US9549197B2 patent drawing

AI summary

A system and method for enhancing data coherency and potential of at least one metadata associated with a video data configured to operate in a visual dynamic range (VDR) format are detailed. One system embodiment employs a metadata framing structure which includes a header start of frame bit set, a packet type bit set, a configuration bit set, a variable depth configuration/metadata bit set, a header end of frame bit set, a timestamp bit set for specifying a frame delay count to apply the at least one metadata to the video data and a checksum check bit set. The at least one metadata is designed to embed within a code word guard bit position of at least one color channel of the video data and adaptable to embed within the VDR pipeline to enhance the quality of the video data.