Seamless Video Resolution Switching via Decoder Handoff
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing network video technologies, particularly in DASH video playback, face challenges in seamless switching between video decoding resolutions, leading to stuck playback and poor user experience due to the time required for video decoder initialization and adaptation between H.264 and H.265 formats.
Innovation Solution
A method that initializes a software decoder first to perform decoding operations while simultaneously starting hardware decoding, switching to hardware decoding when the hardware decoder's decoding progress catches up with the software decoder's, ensuring seamless resolution switching without interruptions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by moving object
If hardware decoding is used for DASH video playback, then system resources are saved and computing performance is improved, but playback sticking occurs during resolution switching due to decoder initialization time
Solution Approach 1:
The patent applies preliminary action by initializing the software decoder in advance before resolution switching occurs. When a resolution switch is detected, the software decoder is already ready to immediately take over decoding tasks, preventing playback sticking. This is implemented by maintaining a software decoder instance that can be activated when hardware decoding needs to switch between resolutions, ensuring continuous decoding capability without waiting for initialization during critical playback moments.
Solution Approach 2:
The software decoder acts as an intermediary between the hardware decoder and the video playback system. During resolution switching transitions, the software decoder mediates the transition by temporarily taking over the decoding role from the hardware decoder, ensuring seamless playback. This intermediary mechanism allows the system to switch between hardware and software decoding modes without interruption, resolving the contradiction between resource efficiency and playback smoothness.
2Adaptability or versatility
If video decoder initialization is performed during resolution switching, then adaptation between H.264 and H.265 formats is achieved, but playback is interrupted and user experience deteriorates
Solution Approach 1:
The software decoder is initialized in advance before resolution switching is needed. When a format change or resolution switch occurs, the pre-initialized software decoder can immediately process the video stream without waiting for initialization, thus eliminating playback interruptions. This preliminary preparation allows the system to adapt between H.264 and H.265 formats seamlessly while avoiding the time loss associated with real-time initialization.
Solution Approach 2:
The patent employs copying by creating a software decoder that replicates the functionality of the hardware decoder. This software copy can be activated independently when format adaptation is needed, allowing the system to switch between hardware and software decoding without interrupting playback. The copied decoder instance maintains all necessary decoding capabilities while providing a failover mechanism that prevents time loss during initialization.
3Manufacturing precision
If hardware decoding is switched between different resolutions, then video quality is improved, but decoding progress mismatch causes playback sticking
Solution Approach 1:
The patent implements feedback by continuously monitoring the decoding progress of both hardware and software decoders. When the software decoder's decoding progress falls behind the hardware decoder, the system automatically adjusts the switching timing to ensure smooth transitions. This feedback mechanism prevents playback sticking by synchronizing the switching decision with the actual decoding state, maintaining both video quality and playback continuity during resolution changes.
Solution Approach 2:
The system applies dynamics by making the decoding mode flexible and adjustable based on real-time conditions. Instead of being locked into hardware decoding only, the system can dynamically switch between hardware and software decoding modes depending on the current resolution requirements and decoding progress. This dynamic adaptation ensures that video quality is maintained while preventing playback sticking through flexible mode switching.
Data Source
AI summary
The present invention provides a method, device and computer-readable medium of a seamless switch between resolutions based on software and hardware decoding and belongs to a field of the Internet technology. The method, device and computer-readable medium of the present invention comprise, during playing a DASH video, initializing a software decoder according to a video stream in a target encoded format received by an original decoder when it needs to switch to another resolution, at the same time the original decoder continuing to decode the video stream in an original encoded format existing in a buffer, decoding the video stream in the target encoded format using the software decoder after the video stream in the original encoded format is decoded, at the same time initializing a second hardware decoder corresponding to the target encoded format, switching to the second hardware decoder and stopping software decoding when a decoding progress of the second hardware decoder catches up with a decoding progress of the software decoder, so as to realize the seamless switch between the resolutions, avoid sticking in the process of playing the video, and improve user experience.