Video Encoder Reference Frame Management for Weak RTC Networks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Encoders with high specifications struggle to maintain video smoothness in real-time communication (RTC) scenarios when network conditions deteriorate, particularly in ultra-high-definition video transmissions.
Innovation Solution
Implement flexible management of reference frames by allowing encoders and decoders to access an external reference list independent of the encoder/decoder, enabling cross-frame and cross-resolution references, and optimizing intra and inter coding processes to improve video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high specification encoders are used for ultra-high-definition video, then video quality is improved, but encoder capability deteriorates under weak network conditions
Solution Approach 1:
The patent implements dynamic reference frame management where the encoder can flexibly select reference frames from an external reference list based on network conditions. The system transitions from static, fixed reference frame selection to dynamic adaptation, allowing the encoder to switch between different reference frames (including cross-frame and cross-resolution references) to maintain video quality under varying network conditions.
Solution Approach 2:
The patent changes the parameter of reference frame selection flexibility by introducing an external reference list that is independent of the encoder. This allows the system to change reference frame parameters dynamically - selecting from multiple external references rather than being constrained by a fixed internal reference list, thereby improving adaptability to weak network conditions.
2Device complexity
If traditional encoder reference frame management is used, then encoder simplicity is maintained, but flexibility and adaptability are reduced
Solution Approach 1:
The patent introduces an external reference list as an intermediary component that mediates between the encoder and the reference frame management system. This external reference list acts as a mediator that provides flexible reference frame selection without complicating the encoder's core structure, allowing the encoder to access a broader set of references while maintaining relative simplicity.
Solution Approach 2:
The external reference list serves multiple functions: it provides reference frames for intra coding, enables inter coding with cross-frame references, and supports cross-resolution references. This multi-functionality increases adaptability without requiring separate specialized structures for each reference type, thereby improving versatility while controlling complexity.
Data Source
AI summary
Embodiments of this application provide an encoding method, a decoding method, and an electronic device. The method includes: obtaining a current frame; obtaining a reconstructed picture corresponding to a reference frame of the current frame from an external reference list of an encoder, where the reference frame of the current frame is a frame encoded by the encoder, and the external reference list is independent of the encoder; performing, by the encoder, intra coding on the reconstructed picture; and performing, by the encoder, inter coding on the current frame based on a result of the intra coding, to obtain a bitstream corresponding to the current frame. In this way, the encoder may flexibly select a reference frame from the external reference list for encoding, thereby implementing cross-frame reference or cross-resolution reference, and improving flexibility of reference frame management of the encoder.