Compressed Video Frame Distribution with IDR Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Joining a video conference as a new participant requires transmitting full frames of video to the new participant, incurring significant bandwidth costs and straining network resources, while existing participants rely on differential frames that the new participant lacks.
Innovation Solution
Generate an instantaneous decoder refresh (IDR) frame for the new participant based on prior frames acknowledged by existing participants, and transmit this frame along with a benchmark frame to synchronize all participants, allowing subsequent differential frames to be based on this common frame.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If full video frames are transmitted to new participants, then video quality and synchronization are maintained, but bandwidth usage increases significantly
Solution Approach 1:
The system transmits an IDR frame to the new participant before transmitting differential frames. This preliminary action provides a complete reference frame that the new participant needs to decode subsequent differential frames, enabling efficient bandwidth usage while maintaining video quality and synchronization.
Solution Approach 2:
The video transmission is segmented into two parts: an IDR frame containing complete video data, and subsequent differential frames containing only changes. This segmentation allows the new participant to receive a complete reference frame first, then efficiently receive only the differences, reducing overall bandwidth usage while maintaining reliability.
2Loss of energy
If differential frames are used for existing participants, then bandwidth usage is reduced, but new participants lack the necessary reference frames
Solution Approach 1:
The IDR frame acts as an intermediary that bridges the gap between differential frames. It provides the necessary reference information that new participants lack, enabling them to decode subsequent differential frames without having received previous video data, thus preventing information loss while maintaining efficient bandwidth usage.
Solution Approach 2:
The system provides the IDR frame as a preliminary action before transmitting differential frames to new participants. This ensures that new participants have the necessary reference information available before needing to decode differential frames, preventing information loss while maintaining bandwidth efficiency.
3Reliability
If a common reference frame is established for all participants, then synchronization is improved, but additional frame generation and transmission is required
Solution Approach 1:
The IDR frame serves multiple functions: it acts as a complete video frame for new participants, serves as a reference frame for generating differential frames, and establishes a common synchronization point for all participants. This multi-functionality improves synchronization without requiring separate complex processes for each participant type.
Solution Approach 2:
The system generates and transmits the IDR frame as a preliminary action to establish a common reference point for all participants before transmitting differential frames. This preliminary establishment of a common reference frame simplifies subsequent synchronization processes rather than complicating them.
Data Source
AI summary
One disclosed example method includes receiving, by a video conference provider, video frames from a plurality of existing participants in a video conference; receiving, by the video conference provider, a request from a new user to join the video conference, and in response: generating, by the video conference provider, an instantaneous decoder refresh (IDR) frame; determining, by the video conference provider, one or more prior video frames previously acknowledged by each existing participant of the plurality of existing participants; generating, by the video conference provider, a benchmark frame for each of the plurality of existing participants based on at least one of the determined one or more prior video frames and the IDR frame; transmitting, by the video conference provider, the IDR frame to the new user; and transmitting, by the video conference provider, a message comprising the benchmark frame to each of the plurality of existing participants.