Media Processing Unit Compressed Domain Adaptation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing digital media processing systems face challenges in handling varying network conditions and display device capabilities, leading to inefficiencies and increased hardware complexity due to the need for decompression and handling of uncompressed video frames.

Innovation Solution

An integrated circuit with a media processing unit and network processing unit that converts compressed media streams based on network conditions, using a network conditions detector to adjust parameters such as latency and bandwidth, allowing for processing entirely in the compressed domain without decompression, and adapting to changes in network and display capabilities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If digital media streams are decompressed to handle network conditions and display capabilities, then processing flexibility and adaptability are improved, but hardware complexity and processing requirements increase exponentially

Engineering Contradiction:

Improveprocessing flexibilityVSAvoidhardware complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary processing layer that operates on compressed media streams without full decompression. This intermediary layer enables network condition analysis, format conversion, and display capability matching while keeping the data in compressed form, thus providing processing flexibility without the exponential hardware complexity increase that would result from full decompression

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent applies local quality by performing selective processing only on the portions of the media stream that need adaptation. Instead of decompressing the entire stream, the system processes specific segments or parameters (such as format conversion or network condition adjustments) while maintaining compression for the rest, thereby reducing overall hardware requirements while preserving necessary adaptability

Inventive Principle:

Principle #3Local quality

2Device complexity

If compressed media streams are processed without decompression, then hardware requirements and processing bandwidth are reduced, but the ability to adapt to varying network conditions and display capabilities is limited

Engineering Contradiction:

Improvehardware requirementsVSAvoidadaptability to network conditions

Core Design Contradiction:

Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamics by enabling the compressed media processing system to dynamically adjust its operation based on real-time network conditions and display capabilities. The system can change processing parameters, convert formats, and adapt bitrates while operating on compressed streams, thus maintaining adaptability without requiring full decompression and the associated hardware complexity

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent applies parameter changes by modifying compression parameters (such as bitrate, resolution, or format) directly on the compressed media stream based on network conditions and display capabilities. This allows the system to adapt to varying requirements by changing encoding parameters without decompressing the data, thereby reducing hardware requirements while preserving adaptability

Inventive Principle:

Principle #35Parameter changes

3Adaptability or versatility

If multiple digital formats are supported across different playback devices, then device versatility is improved, but hardware complexity increases due to the need for decompression and format conversion

Engineering Contradiction:

Improvedevice versatilityVSAvoidhardware complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements universality by creating a single processing platform that can handle multiple digital formats and playback device types without requiring separate decompression hardware for each format. The system performs format conversion and adaptation operations on compressed streams, enabling one device to serve multiple functions and support diverse playback requirements without exponential hardware complexity increases

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS7830800B1Architecture for combining media processing with networking

Publication Date: 2010.11.09 NXP USA INC

AI summary

Systems and methods for processing media streams for transport over a network based on network conditions. An integrated circuit comprises a media processing unit coupled to receive feedback from a network processing unit. The media processing unit converts a media stream from a compressed input stream to a compressed output stream such that the compressed output stream has characteristics that are best suited for the network conditions. Network conditions can include, for example, characteristics of the network (e.g., latency or bandwidth) or characteristics of the remote playback devices (e.g., playback resolution). Changes in the network conditions can result in a change in the conversion process.