Video Stream Header Creation Using Preliminary Data Size Calculation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing method of generating a joined video stream requires lengthy processing to analyze and extract picture data from multiple video streams, leading to a significant delay in creating the header of a multiplexed stream, especially when dealing with large data amounts.

Innovation Solution

A data processing device and method that calculates the data size of a joined frame by combining frames from different video streams, allowing the creation of a header for the multiplexed stream before the actual joining process, thereby reducing the delay in starting the streaming process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If video stream analysis and picture data extraction are performed from head to end before joining, then accurate position information and code amount information are obtained, but very long processing time is required

Engineering Contradiction:
Improveposition information accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary analysis of video stream structures and calculates expected position information and code amount information before actual picture data extraction and joining. This allows the header to be created in advance based on calculated values rather than waiting for complete processing of all picture data, significantly reducing processing time while maintaining accuracy

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent divides the video stream processing into independent segments that can be analyzed separately. By segmenting the analysis process and using parallel processing for multiple video streams, the overall processing time is reduced while still obtaining accurate position and code amount information needed for header creation

Inventive Principle:
Principle #1Segmentation

2Reliability

If complete joined video stream is generated before creating header, then accurate code amount information is available, but significant delay occurs especially with large data amounts

Engineering Contradiction:
Improvecode amount information accuracyVSAvoiddelay time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent calculates code amount information in advance based on video stream metadata and encoding parameters before actual picture data processing. This preliminary calculation provides sufficiently accurate information for header creation, eliminating the need to wait for complete joined video stream generation and reducing delay significantly

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If video streams are analyzed completely before joining, then picture data positions are clear, but processing efficiency decreases

Engineering Contradiction:
Improvepicture data position informationVSAvoidprocessing efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent performs preliminary analysis to obtain picture data position information from video stream metadata and structure information before actual joining operations. This preliminary position information allows efficient picture data extraction and joining without requiring complete sequential analysis, thereby maintaining information accuracy while improving processing efficiency

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3032835B1Data processing device, data processing method, program, recording medium, and data processing system
Publication Date: 2019.12.04 UNIVERSITY OF ELECTRO-COMMUNICATIONS
  • EP3032835B1 patent drawingFigure 1
  • EP3032835B1 patent drawingFigure 2
  • EP3032835B1 patent drawingFigure 3

AI summary

The present invention comprises: a data size calculation unit that calculates the data size of a joined frame generated if an assumption is made that a first frame inside a first video stream and a second frame inside a second video stream are joined; a header creation unit that creates a header for a multiplexed stream including a joined video stream, using the data size information for the joined frame; a joined video stream generation unit that generates the joined video stream; and a multiplexed stream output unit that performs header output processing for the multiplexed stream or outputs the multiplexed stream including the joined video stream.