Multidimensional Media Stream Splitter and Merger with Segment Metadata

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The current Network-Based Media Processing (NBMP) standard does not support multidimensional segment metadata, limiting its ability to efficiently split and merge multidimensional media data for parallel processing.

Innovation Solution

The proposed solution extends the NBMP splitter and merger functions to support multidimensional media data by segmenting media streams into parallel sub-streams with segment metadata for ordering, allowing for parallel processing and subsequent merging into a single stream.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the current NBMP splitter and merger functions are used, then 1-dimensional media segments can be processed independently, but multidimensional media data cannot be properly segmented and merged

Engineering Contradiction:

Improvesupport for multidimensional media dataVSAvoidcomplexity of splitter and merger functions

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments multidimensional media data into multiple independent sub-streams by introducing segment metadata that includes ordering information. Each sub-stream can be processed independently while the metadata enables proper reassembly, thus extending the NBMP framework to handle multidimensional data without requiring complete redesign of the processing functions.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Segment metadata acts as an intermediary element between the splitter and merger functions. This metadata carries ordering information that enables the merger to correctly reassemble segments from multiple parallel sub-streams, resolving the contradiction by providing a simple intermediary mechanism rather than complex function redesign.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If parallel processing is implemented for multidimensional media data, then processing efficiency is improved, but the current NBMP framework lacks the capability to split and merge such data

Engineering Contradiction:

Improveparallel processing capabilityVSAvoidcorrectness of segment ordering

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

Segment metadata provides feedback information about segment ordering to the merger function. This feedback mechanism ensures that even though segments are processed in parallel across multiple sub-streams, the merger can correctly reassemble them in the proper sequence, thus enabling parallel processing while maintaining reliability through metadata-driven ordering information.

Inventive Principle:

Principle #23Feedback

3Ease of operation

If multidimensional media data is segmented without segment metadata, then processing can be simplified, but segments cannot be properly ordered during merging

Engineering Contradiction:

Improvesimplicity of processingVSAvoidloss of segment ordering information

Core Design Contradiction:

Ease of operationVSLoss of information

Solution Approach 1:

The patent extracts ordering information from the complex multidimensional segmentation problem and places it into a separate, manageable segment metadata structure. This extraction allows the main processing logic to remain simple while the metadata preserves the necessary ordering information, thus preventing information loss without complicating the core processing operations.

Inventive Principle:

Principle #2Taking out (Extraction)

Data Source

PatentUS12284232B2Splitter and merger functions for multidimensional segmented media data

Publication Date: 2025.04.22 TENCENT AMERICA LLC

AI summary

A method including segmenting a multidimensional media stream into a plurality of segments of multidimensional media in a multidimensional space; splitting the segmented multidimensional media stream into a plurality of sub-streams that are capable of being processed in parallel, wherein each of the plurality of sub-streams comprises a segment metadata that is used for ordering the segments within the each sub-stream; processing each of the plurality of sub-streams in parallel; and merging the plurality of sub-streams into a single stream using the segment metadata carried to an output segment, wherein the single stream comprises ordered segments.