Video Encoding Refresh Scheme for Lower Decoding Delay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding techniques suffer from decoding delays due to long series of frames encoded exclusively in inter-mode, leading to delayed production of correctly decoded video.
Innovation Solution
Implement a refresh scheme that forcibly encodes a set of zones in a frame in intra-mode, irrespective of the initial evaluation, and provide a specification of these zones, eliminating the need for encoding mode flags, thereby allowing improved video quality within a given data budget.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If inter-mode encoding is applied to maximize data compression, then data bandwidth efficiency is improved, but decoding delay increases due to lack of reference frames
Solution Approach 1:
The patent applies periodic intra-mode encoding at regular intervals (e.g., every Nth frame) to create reference frames, while using inter-mode encoding for intermediate frames to maintain compression efficiency. This periodic refresh strategy ensures that reference frames are available at predictable intervals, reducing decoding delay while maintaining overall data bandwidth efficiency.
Solution Approach 2:
The video sequence is segmented into groups of frames, where each group contains a mix of intra-mode and inter-mode encoded frames. This segmentation allows the system to balance between compression efficiency (inter-mode) and reference frame availability (intra-mode) at different positions in the sequence, resolving the contradiction between data bandwidth efficiency and decoding delay.
2Loss of time
If intra-mode encoding is applied frequently to provide reference frames, then decoding delay is reduced, but data bandwidth efficiency deteriorates
Solution Approach 1:
Instead of applying intra-mode encoding to all frames (excessive action), the patent applies it partially - only to specific frames at regular intervals where reference frames are most needed. This partial application reduces the overall impact on data bandwidth efficiency while still achieving the goal of reducing decoding delay through periodic reference frame availability.
3Quantity of substance
If evaluation-based mode selection is used to optimize compression, then data bandwidth efficiency is improved, but decoding delay increases due to long inter-mode sequences
Solution Approach 1:
The patent introduces a preliminary rule that overrides the evaluation-based mode selection: at predetermined intervals, intra-mode encoding is forced regardless of the evaluation result. This preliminary action ensures that reference frames are created at regular intervals, preventing long sequences of inter-mode encoded frames and thus reducing decoding delay while maintaining evaluation-based optimization for other frames.
Data Source
AI summary
A sequence of frames is encoded in the following manner. An evaluation for respective zones in a frame is made whether a zone should be encoded in an intra-mode or in an inter-mode. A refresh scheme is applied that causes a set of zones in the frame to be forcibly encoded in the intra-mode, irrespective of the evaluation made. A specification of the refresh scheme is provided, which identifies the set of zones in the frame that are forcibly encoded in the intra-mode.