Bitrate Allocator for Video Data Multiplexing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data transmission methods, such as constant bitrate encoding and variable bitrate encoding, fail to optimize bandwidth usage effectively for video streams, leading to inefficient use of transmission channels, especially when dealing with varying image complexities.

Innovation Solution

A system and method for multiplexing data and video streams in a transmission channel with a fixed bitrate, utilizing a bitrate allocator and controller that adjusts data bitrate requests based on memory occupancy, delay, and video stream bitrates to ensure efficient use of bandwidth, allowing for deterministic and opportunistic data transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If constant bitrate encoding (CBR) is used, then the bitrate is stable and predictable, but the bandwidth usage is inefficient for images of low complexities

Engineering Contradiction:
Improvebitrate stabilityVSAvoidbandwidth utilization efficiency
Core Design Contradiction:
Stability of the object's compositionVSProductivity

Solution Approach 1:

The system dynamically adjusts the bitrate allocation between video streams and data based on real-time conditions. The statistical multiplexer monitors the complexity of video content and the arrival rate of data, then dynamically modifies the bitrate assigned to each stream, allowing the system to transition from static CBR to adaptive bitrate allocation that optimizes bandwidth utilization while maintaining stability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The invention changes the bitrate parameter dynamically based on video complexity and data arrival patterns. By monitoring metrics such as scene complexity, motion activity, and data queue depth, the system adjusts the bitrate parameter in real-time, allowing efficient bandwidth usage for low-complexity content while ensuring sufficient capacity for high-complexity scenes and data transmission requirements.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If variable bitrate encoding (VBR) is used, then the bandwidth usage is optimized, but the bitrate becomes unpredictable

Engineering Contradiction:
Improvebandwidth utilization efficiencyVSAvoidbitrate predictability
Core Design Contradiction:
ProductivityVSStability of the object's composition

Solution Approach 1:

The statistical multiplexer implements feedback mechanisms that continuously monitor video stream characteristics and data arrival rates. This feedback information is used to adjust bitrate allocation dynamically, creating a closed-loop control system that optimizes bandwidth utilization while maintaining predictable overall bitrate behavior through coordinated adjustment of multiple streams.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system merges multiple video streams and data streams into a single multiplexed output, combining their bitrate demands. By aggregating multiple VBR streams, the system achieves more predictable overall bitrate behavior while maintaining individual stream optimization, as the variations in one stream can be compensated by other streams.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If statistical multiplexing is applied to multiple video streams, then bandwidth allocation is optimized, but the system complexity increases

Engineering Contradiction:
Improvebandwidth allocation efficiencyVSAvoidmultiplexer complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The statistical multiplexer divides the bitrate allocation task into separate modules for each video stream and data stream. Each stream is processed independently with its own complexity assessment and bitrate demand calculation, allowing the system to manage multiple streams efficiently without requiring a monolithic complex processing architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Each video stream and data stream effectively serves itself by providing information about its complexity and bitrate demands to the multiplexer. The streams self-report their requirements, and the multiplexer automatically allocates bandwidth based on this information, reducing the need for complex external control mechanisms.

Inventive Principle:
Principle #25Self-service

4Productivity

If data is multiplexed with video streams, then the channel capacity is fully utilized, but data transmission delays may increase

Engineering Contradiction:
Improvechannel capacity utilizationVSAvoiddata transmission delay
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary assessment of data importance and video stream characteristics before multiplexing. By pre-classifying data packets according to their urgency and pre-evaluating video stream buffer states, the multiplexer can make rapid allocation decisions that prioritize time-sensitive data while maintaining efficient channel utilization.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The multiplexer applies different quality of service treatments to different data packets based on their local characteristics. High-priority data receives preferential treatment with lower delays, while less critical data can tolerate higher delays. This localized quality differentiation allows full channel utilization without uniformly increasing delays for all data.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9467719B2System and method for the transmission of data and streams containing video data D<sub>video </sub>in a channel with given bitrate
Publication Date: 2016.10.11 HARMONIC INC
  • US9467719B2 patent drawing
  • US9467719B2 patent drawing
  • US9467719B2 patent drawing

AI summary

System and method for multiplexing data Di and one or more streams containing video data Dvideo in a transmission channel with fixed bitrate comprising a multiplexer (11) and its controller (112), the multiplexer (11) comprising one to n inputs (11v) receiving the stream or streams Dvideo, a bitrate allocator (12), the multiplexer (11) comprises an input (11d) for the data Di to be multiplexed, and the said system comprises at least the following elements: a memory (20) receiving the data to be multiplexed with the stream or streams Dvideo, a bitrate estimator (21) which transmits a bitrate request Rd to the bitrate allocator (12), the bitrate request Rd is transmitted to the controller (112) of the multiplexer and delayed, the controller (112) is suitable for reading from the memory (20) the data Di to be multiplexed, up to compliance with the bitrate request Rd.