Layered Video Forwarding for Receiver-Specific Bandwidth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multi-person video call scenarios, existing technologies struggle to efficiently manage variable network conditions across multiple peer terminals, leading to issues like delaying, lagging, or halting, which deteriorate user experience due to the difficulty in forwarding video frames reasonably.
Innovation Solution
A method and apparatus that organize video frames into multiple layers based on inter-frame dependency relationships, determine layer bit rates, allocate downlink bandwidths, and perform frame extraction processing to ensure optimal delivery to receivers, utilizing a frame extraction bucket to dynamically manage network resources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video frames are transmitted without frame extraction processing in multi-person video calls, then video quality is maintained, but network bandwidth is excessively consumed causing delays and lagging
Solution Approach 1:
The patent segments video frames into different layers (first frame layer and second frame layer) based on inter-frame dependency relationships. This segmentation allows selective transmission of essential frames while discarding redundant ones, thereby reducing bandwidth consumption while maintaining video call stability.
Solution Approach 2:
The patent applies different transmission strategies to different frame layers. The first frame layer (containing essential frames) is transmitted to all receivers, while the second frame layer (containing dependent frames) is selectively transmitted based on receiver-specific network conditions. This local quality approach optimizes bandwidth usage while ensuring reliable video delivery.
2Loss of energy
If frame extraction processing is applied to all receivers uniformly, then bandwidth consumption is reduced, but video quality deteriorates for receivers with good network conditions
Solution Approach 1:
The patent implements receiver-specific frame extraction strategies based on individual network conditions. Each receiver receives the first frame layer universally, while the second frame layer is selectively provided based on that receiver's specific network status. This ensures optimal video quality for each receiver without uniformly degrading service for all.
Solution Approach 2:
The patent dynamically adjusts the frame extraction strategy based on real-time network conditions of each receiver. The determination of whether to provide the second frame layer to a specific receiver is made dynamically based on current network status, allowing the system to adapt to changing conditions and maintain optimal video quality.
3Reliability
If all video frames are forwarded to multiple receivers, then video quality is maintained for all receivers, but network bandwidth is excessively consumed
Solution Approach 1:
The patent divides video frames into two distinct layers based on inter-frame dependency. The first layer contains essential frames that maintain video call quality, while the second layer contains dependent frames that can be selectively discarded. This segmentation enables significant bandwidth reduction while preserving core video quality for all receivers.
Solution Approach 2:
The patent applies partial action by providing only the essential first frame layer to all receivers, and selectively providing the second frame layer only to receivers with sufficient network capacity. This partial transmission approach reduces overall bandwidth consumption while maintaining adequate video quality for all participants.
4Device complexity
If frame layers are not organized based on inter-frame dependency, then processing complexity is reduced, but bandwidth allocation efficiency deteriorates
Solution Approach 1:
The patent organizes video frames into structured layers based on inter-frame dependency relationships, creating a clear hierarchy between essential and dependent frames. This segmentation provides a systematic framework for bandwidth allocation, improving allocation efficiency while maintaining manageable processing complexity through the organized structure.
Data Source
AI summary
Disclosed in the embodiments of the present application are a video call processing method and apparatus, a device and a storage medium. The method comprises: determining a layer code rate corresponding to each frame layer in video data which is sent by a sending end; according to a total downlink sounding bandwidth and uplink code rates respectively corresponding to a plurality of receiving ends, determining allocated downlink bandwidths respectively corresponding to the plurality of receiving ends; according to the layer code rates and the allocated downlink bandwidths respectively corresponding to the plurality of receiving ends, determining target frame layers respectively corresponding to the plurality of receiving ends; and forwarding, to a corresponding receiving end, video data which is obtained after a target frame layer has been subjected to frame extraction processing.