Adaptive Resolution Video Coding Switch Frame
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video codecs struggle to adaptively change the resolution of video frames in real time based on network conditions without incurring additional time and computational costs, as they require starting a new video sequence or using a new frame type, which is inefficient and costly.
Innovation Solution
An adaptive resolution video coding system that allows for real-time changes in frame size or resolution within a video sequence by signaling the maximal resolution in a sequence header and relative resolutions in frame headers, enabling encoding and decoding systems to resize frames as needed without starting a new sequence or using a new frame type.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional video codec is used to change video resolution adaptively, then video resolution can be adjusted according to network conditions, but extra time and computational effort are required due to intra-coded frame encoding
Solution Approach 1:
The patent enables dynamic resolution changes within a video sequence by introducing a switch frame type that allows inter-coded frames to have varying resolutions. The encoder can dynamically adjust the resolution of switch frames based on network conditions without requiring full intra-coded frames, thus maintaining adaptability while reducing encoding time and computational overhead.
Solution Approach 2:
The patent changes the resolution parameter of video frames dynamically by introducing a new frame type (switch frame) that supports resolution transitions. The switch frame uses a different coding approach that allows resolution changes without the overhead of complete intra-coded frames, enabling parameter changes with reduced computational cost.
2Adaptability or versatility
If conventional video codec is used to change video resolution adaptively, then video resolution can be adjusted according to network conditions, but extra network bandwidth is consumed due to intra-coded frame transmission
Solution Approach 1:
The patent enables dynamic resolution changes within a video sequence by introducing a switch frame type that allows inter-coded frames to have varying resolutions. The encoder can dynamically adjust the resolution of switch frames based on network conditions without requiring full intra-coded frames, thus maintaining adaptability while reducing encoding time and computational overhead.
Solution Approach 2:
The patent changes the resolution parameter of video frames dynamically by introducing a new frame type (switch frame) that supports resolution transitions. The switch frame uses a different coding approach that allows resolution changes without the overhead of complete intra-coded frames, enabling parameter changes with reduced computational cost.
3Loss of energy
If switch frame is used to change video resolution, then intra coding cost is avoided, but extra computational time and network bandwidth overhead still occur
Solution Approach 1:
The patent enables dynamic resolution changes within a video sequence by introducing a switch frame type that allows inter-coded frames to have varying resolutions. The encoder can dynamically adjust the resolution of switch frames based on network conditions without requiring full intra-coded frames, thus maintaining adaptability while reducing encoding time and computational overhead.
Solution Approach 2:
The patent changes the resolution parameter of video frames dynamically by introducing a new frame type (switch frame) that supports resolution transitions. The switch frame uses a different coding approach that allows resolution changes without the overhead of complete intra-coded frames, enabling parameter changes with reduced computational cost.
4Adaptability or versatility
If frame size is changed in conventional video codec, then new video sequence must be started, but this causes interruption and extra encoding overhead
Solution Approach 1:
The patent enables dynamic resolution changes within a video sequence by introducing a switch frame type that allows inter-coded frames to have varying resolutions. The encoder can dynamically adjust the resolution of switch frames based on network conditions without requiring full intra-coded frames, thus maintaining adaptability while reducing encoding time and computational overhead.
Solution Approach 2:
The patent changes the resolution parameter of video frames dynamically by introducing a new frame type (switch frame) that supports resolution transitions. The switch frame uses a different coding approach that allows resolution changes without the overhead of complete intra-coded frames, enabling parameter changes with reduced computational cost.
Data Source
AI summary
A client device may receive encoded data of a first video frame from a server over a network, and decode the encoded data to obtain the first frame based at least in part on one or more second frames of a second resolution that are stored in a reference frame buffer of the client device. In response to determining that the first resolution is lower than the second resolution, the client device may or may not resize the first frame from the first resolution to the second resolution and store the first frame of the first resolution and/or the resized first frame of the second resolution in the reference frame buffer, depending on which coding design that the client device employs. The client device may display the reconstructed frame to a user.