Video Stream Delay Estimation Using Timestamp Mediation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in real-time estimation and synchronization of video data streams from cameras, particularly in vehicles, with other real-time signals for overlaying additional data, due to complexities in processing and timing synchronization.

Innovation Solution

An apparatus and method for real-time delay estimation and synchronization of video data streams, utilizing advanced image processing techniques and signal processing algorithms to align video data with other real-time signals, ensuring accurate overlay of additional data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If real-time processing of video data streams is implemented, then synchronization accuracy is improved, but processing complexity increases

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary timestamp assignment to video frames at the source camera before transmission. This preliminary action allows the receiving end to simply read and use these timestamps for synchronization without performing complex real-time processing, thus achieving high synchronization accuracy while keeping processing complexity low.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces timestamps as an intermediary element that carries timing information through the video data stream. These timestamps act as a mediator between the video capture time and the display time, enabling synchronization without requiring complex processing algorithms at the receiving end.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If delay estimation is performed to align video with real-time signals, then data overlay accuracy is improved, but processing time increases

Engineering Contradiction:
Improvedata overlay accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system calculates and stores delay values for different video resolutions and frame rates in advance. When processing video streams, the system simply retrieves the pre-calculated delay value matching the current video parameters, achieving high overlay accuracy without performing time-consuming calculations in real-time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies delay compensation selectively based on video parameters. Instead of always performing full delay estimation and compensation, the system uses pre-determined delay values for standard resolutions and frame rates, performing partial processing only when needed, thus reducing overall processing time while maintaining accuracy.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11849105B2Estimating real-time delay of a video data stream
Publication Date: 2023.12.19 EDGY BEES LTD
  • US11849105B2 patent drawing
  • US11849105B2 patent drawing
  • US11849105B2 patent drawing

AI summary

In an arrangement where a physical phenomenon affects a digital video camera and is measured or sensed by a sensor, a delay of a digital video stream from the digital video camera is estimated. The digital video stream is processed by a video processor for producing a signal that represents the changing over time of the effect of the physical phenomenon on the digital video camera. The signal is then compared with the sensor output signal, such as by using cross-correlation or cross-convolution, for estimating the time delay between the compared signals. The estimated time delay may be used for synchronizing when combining additional varied data to the digital video stream for low-error time alignment. The physical phenomenon may be based on mechanical position or motion, such as pitch, yaw, or roll. The time delay estimating may be performed once, upon user control, periodically, or continuously.