Media Processing Engine Framework Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing multimedia frameworks face challenges in synchronizing multiple media streams efficiently, particularly in mobile environments, due to high memory usage, complex synchronization procedures, and excessive processing overheads, which limit flexibility and performance.

Innovation Solution

A method that synchronizes different media types within a single task using a system timer module to generate configured timing signals, parsing data streams to obtain media types, creating media and session time counters, and processing samples in a synchronized manner, minimizing memory usage and processing overheads.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If hardware timers and independent tasks are used for each media type, then synchronization accuracy is improved, but device complexity and processing overhead increase

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges multiple media type processing into a single unified task, eliminating the need for separate independent tasks for each media type. This consolidation reduces system complexity while maintaining synchronization through a unified timing mechanism that handles audio, video, and other media streams together.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements a universal timer mechanism that serves all media types within a single task. This multi-functional approach allows one timing system to synchronize diverse media streams (audio, video, subtitles) without requiring dedicated hardware timers for each type, thereby reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If multiple independent tasks are used for different media types, then synchronization is achieved, but processing overhead increases

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent combines processing of multiple media types into a single task execution context. By handling audio, video, and other media streams within one task, the system eliminates task switching overhead and context switching costs, thereby improving processing efficiency while maintaining synchronization through unified timing control.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If hardware timers are provided for each source and sink components, then synchronization accuracy is improved, but memory usage increases

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidmemory consumption
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent employs a universal timer mechanism that serves all media types and components within a single task. This shared timing resource eliminates the need for multiple dedicated hardware timers, significantly reducing memory consumption while maintaining synchronization accuracy through unified time management across all media streams.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Measurement precision

If a single reference clock controls all modules, then synchronization is achieved, but processing overhead increases due to periodic queries

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent implements a self-service timing mechanism where the single reference clock automatically provides timing signals to all modules without requiring periodic queries. Each component within the single task receives timing information passively through the unified timing system, eliminating the processing overhead associated with active querying while maintaining synchronization accuracy.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS7539218B2Media processing engine framework
Publication Date: 2009.05.26 NVIDIA CORP
  • US7539218B2 patent drawing
  • US7539218B2 patent drawing
  • US7539218B2 patent drawing

AI summary

A method is described for synchronously processing and rendering digitized media data streams where each data stream is made up of a sequence of samples. The described method includes processing each data stream in a single task. The method includes the generating the timing signals for different data streams from a single operating system timer and further processing the media in the data stream synchronously in one task using this timing signal.