Streaming Media Data Processing via Segmented Serialization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Traditional distributed data processing systems face challenges in efficiently processing multimedia content due to the complexity of understanding and indexing media files like photos and videos, and the significant computational resources required, as well as the large file sizes of multimedia data, which differ greatly from textual data.

Innovation Solution

The system partitions media data into multiple partitions and processes each partition on individual computing nodes in a streaming-based manner, using a platform module to encode and serialize media files, and a user module to perform specific media operations, allowing for flexibility and efficient processing without overwhelming memory requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional distributed data processing systems process multimedia content, then processing capability is provided, but memory consumption becomes excessive and processing efficiency deteriorates

Engineering Contradiction:

Improvemultimedia processing efficiencyVSAvoidmemory consumption

Core Design Contradiction:

ProductivityVSQuantity of substance

Solution Approach 1:

The patent divides multimedia data into multiple partitions and processes each partition independently on different computing nodes. This segmentation allows the system to handle large multimedia files without loading the entire file into memory at once, thus reducing memory consumption while maintaining processing capability across the distributed system.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs preliminary encoding and serialization of media files before distributing them for processing. This preliminary action prepares the data in a format that is more efficient for distributed processing and reduces the computational overhead during the actual processing stage, improving overall productivity.

Inventive Principle:

Principle #10Preliminary action

2Adaptability or versatility

If complex machine learning algorithms are used to understand and index media files, then indexing capability is improved, but computational resource requirements increase significantly

Engineering Contradiction:

Improvemedia understanding capabilityVSAvoidcomputational resource consumption

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent segments the complex machine learning processing task into smaller sub-tasks that can be executed independently on different computing nodes. Each node processes a specific partition of multimedia data using simplified versions of the algorithms, reducing the computational burden on any single node while maintaining overall indexing capability.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary layer that pre-processes and filters multimedia data before applying complex machine learning algorithms. This intermediary processing reduces the volume and complexity of data that requires intensive computational resources, thereby reducing energy consumption while preserving the ability to understand and index media content.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Quantity of substance

If multimedia file sizes are reduced through compression, then storage efficiency is improved, but processing complexity increases

Engineering Contradiction:

Improvestorage efficiencyVSAvoidprocessing complexity

Core Design Contradiction:

Quantity of substanceVSDevice complexity

Solution Approach 1:

The system performs preliminary encoding of multimedia files into standardized formats before compression and storage. This preliminary encoding ensures that the data is in an optimal format for both compression and subsequent processing, reducing the complexity of handling various file formats during processing while maintaining storage efficiency.

Inventive Principle:

Principle #10Preliminary action

4Productivity

If the system is designed to handle large multimedia files, then processing capability is improved, but system flexibility and adaptability decrease

Engineering Contradiction:

Improvelarge file processing capabilityVSAvoidsystem flexibility

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent implements a segmented architecture where multimedia data is divided into independent partitions that can be processed separately. This segmentation allows the system to scale horizontally by adding more computing nodes for larger files while maintaining the flexibility to handle different file sizes and types by simply adjusting the number and distribution of partitions.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS10362082B2Method for streaming-based distributed media data processing

Publication Date: 2019.07.23 BAIDU USA LLC

AI summary

In one embodiment, a cluster manager partitions media data into multiple media data partitions, each of which is to be processed by a computing node of a computing system. A platform module in a computing node receives a number of media files included in a media data partition. The platform module encodes each media file from an original format into a predefined format. The platform module then combines or serializes each encoded media file into a single stream of serialized data, and transmits it to a user module in the computing node. The user module separates from each other the received encoded media files. The user module then decodes each separated, encoded media file from the predefined format into the original format, and performs a specific media processing operation on each decoded file. Examples of the media processing operation include classification, image transformation, and feature extraction.