Dynamic Media Stream Assignment Across Hardware And Software Codecs

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Media servers face overload issues due to the large number of media streams, leading to a reduction in media stream quality, such as dropped frames and reduced bitrate, despite having specialized hardware for encoding/decoding.

Innovation Solution

A dynamic switching layer that leverages both software and hardware encoding/decoding capabilities of a media server to optimize media stream processing, dynamically assigning streams based on performance state, resource utilization, and media stream parameters, ensuring transparent operation to applications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If specialized hardware encoding/decoding is used to process media streams, then processing speed and efficiency are improved, but hardware overload occurs when handling large numbers of streams leading to quality reduction

Engineering Contradiction:

Improvemedia stream processing capacityVSAvoidmedia stream quality

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system dynamically switches between hardware and software encoding/decoding based on the number of active media streams. When the stream count exceeds a threshold, the system transitions from hardware-based processing to software-based processing, allowing the processing capacity to adapt flexibly to varying workload conditions and prevent hardware overload while maintaining stream quality

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes the processing mode parameter from hardware encoding/decoding to software encoding/decoding based on the media stream count threshold. This parameter change allows the system to operate in different processing regimes appropriate to the current workload, resolving the contradiction between processing capacity and quality

Inventive Principle:

Principle #35Parameter changes

2Productivity

If hardware encoding/decoding is used, then processing efficiency is improved, but the system becomes less flexible in handling varying numbers of media streams

Engineering Contradiction:

Improveencoding/decoding efficiencyVSAvoidflexibility in handling stream volume variations

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The system implements dynamic processing mode selection that transitions between hardware and software encoding/decoding based on real-time media stream count. This dynamic approach provides both high efficiency (via hardware) and high adaptability (via software), allowing the system to optimize for speed when streams are few and for flexibility when streams are numerous

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system achieves multi-functionality by incorporating both hardware and software encoding/decoding capabilities. The hardware provides high-speed processing for common scenarios, while the software provides flexible handling for varying workload conditions, making the system universally applicable across different stream volume scenarios

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250301188A1Dynamic assignment of data stream processing in multi-codec systems

Publication Date: 2025.09.25 NVIDIA CORP

AI summary

Systems and methods for improved media stream processing. In at least one embodiment, a first media stream is assigned a hardware processing engine and a second media stream is assigned to a software processing engine based on a performance state of an application server, one or more parameters of the first media stream, and one or more parameters of the second media stream.