Hardware Decoder Preloading for Faster Video First Frame
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video decoding methods result in a long time to first frame, typically 200 ms, leading to delayed or lagged first frames when switching videos, adversely affecting user experience.
Innovation Solution
Asynchronous initialization of hardware decoders by carrying encoding format information in playback address information, allowing for simultaneous acquisition of hardware decoders during video playback setup, reducing the time required for decoder creation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If hardware decoder is acquired sequentially after video data is obtained, then the decoding process can be properly initialized, but the time to first frame increases significantly (200ms)
Solution Approach 1:
The patent applies preliminary action by acquiring the hardware decoder in advance based on the encoding format information obtained from the playback address, before the video data is fully downloaded. This allows the decoder to be ready when the video data arrives, reducing the time to first frame while ensuring proper decoder initialization.
2Ease of operation
If video playback starts immediately without async decoder acquisition, then the startup process is simpler, but the first frame is delayed or lagged affecting user experience
Solution Approach 1:
The system performs preliminary action by extracting encoding format information from the playback address and acquiring the appropriate hardware decoder before video playback starts. This maintains operational simplicity for the user while eliminating first frame delays through advance decoder preparation.
3Productivity
If encoding format information is carried in playback address information, then async decoder acquisition is enabled, but the data structure becomes more complex
Solution Approach 1:
The playback address information structure is enhanced to serve multiple functions: it not only provides the video data location but also carries the encoding format information needed for decoder acquisition. This multi-functionality approach enables async decoder acquisition without requiring separate data structures or additional communication protocols.
Data Source
AI summary
Embodiments of the present disclosure provide a method, an apparatus, an electronic device, a computer-readable storage medium, a computer program product, and a computer program for video decoding. The method obtains playback address information of a video to be played, the playback address information carrying encoding format information of the video to be played; obtains the video to be played in accordance with the playback address information; and, in progress of obtaining the video to be played asynchronously, acquires a hardware decoder based on the encoding format information of the video to be played; and decodes the obtained video to be played with the hardware decoder. Embodiments of the present disclosure carry the encoding format information of the video to be played in the playback address information of the video, so that the asynchronous acquisition of the hardware decoder can be adopted in progress of the startup of video playback.