High Frame Rate Video Transport via HD Architecture Metadata Packing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video architectures are inadequate for supporting the bandwidth and timing requirements of high frame rate image sensors, leading to inefficient data transport and loss of data, as they are not designed to handle the large number of pixels generated by these sensors, and replacing existing infrastructure is impractical and costly.

Innovation Solution

A method and apparatus that mosaic high frame rate data into lossless segments, using pixel packing and metadata to reconstruct the raw data, allowing transport over existing HD video architectures by encoding information in VANC/HANC metadata and using multiple parallel connections, enabling legacy hardware to handle high frame rate video data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If conventional HD video architectures are used to transport high frame rate video data, then existing infrastructure can be utilized, but bandwidth and timing requirements cannot be met

Engineering Contradiction:
Improveutilization of existing infrastructureVSAvoidbandwidth capacity
Core Design Contradiction:
Ease of manufactureVSQuantity of substance

Solution Approach 1:

The patent divides the high frame rate video data stream into multiple lower-rate substreams that can be transported over existing HD video infrastructure. By segmenting the data into manageable chunks that fit within standard video protocol bandwidth limits, the system enables transport of high frame rate data (e.g., 1000+ fps) over conventional architectures designed for lower frame rates.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces temporal dimension by using frame interleaving and packing techniques. Multiple frames from different time points are combined and transported in a single data stream, allowing the system to exceed the bandwidth capacity of individual video channels while maintaining compatibility with existing HD video infrastructure.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Quantity of substance

If video compression techniques are used to transport high frame rate data, then bandwidth requirements are reduced, but data loss occurs

Engineering Contradiction:
Improvebandwidth utilizationVSAvoiddata integrity
Core Design Contradiction:
Quantity of substanceVSLoss of information

Solution Approach 1:

The patent creates multiple copies of video data across parallel transport channels using techniques like frame packing and interleaving. By distributing redundant data representations across multiple standard video streams, the system ensures that even if some data is lost or corrupted during transmission, the original high frame rate data can be reconstructed at the receiving end.

Inventive Principle:
Principle #26Copying

3Quantity of substance

If new video architectures are developed to support high frame rate sensors, then bandwidth and timing requirements are met, but cost and complexity increase

Engineering Contradiction:
Improvebandwidth capacityVSAvoidarchitecture complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent makes existing HD video infrastructure multi-functional by implementing software-based processing that enables standard video architectures to handle high frame rate data. The system uses universal frame packing, interleaving, and unpacking algorithms that work across different video protocols and formats, allowing a single infrastructure to serve both traditional and high frame rate applications.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Speed

If high frame rate video data is transported in real-time, then timing requirements are met, but bandwidth limitations cause data loss

Engineering Contradiction:
Improvedata transport speedVSAvoidbandwidth capacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent segments high frame rate video data into multiple parallel lower-rate streams that can be transmitted simultaneously over existing video infrastructure. By dividing the data stream and using techniques like frame packing and interleaving, the system achieves real-time transport of high frame rate data without overwhelming the bandwidth capacity of individual video channels.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10701367B2Method for encoding raw high frame rate video via an existing HD video architecture
Publication Date: 2020.06.30 RAYTHEON CO
  • US10701367B2 patent drawing
  • US10701367B2 patent drawing
  • US10701367B2 patent drawing

AI summary

A system for transporting fast frame rate video data from a high frame rate image sensor mosaics and spreads the fast frame rate video data in 1920×1080p30 video frames for transporting via an existing standard video architecture. Packing information, spreading information, and unique ID/timestamps for each frame is encoded in metadata and inserted in ancillary metadata space of the 1080p30 video frames. A robust encoding scheme generates the metadata and ensures that the transported video can be reassembled into its original fast frame rate form after being spread over multiple channels.