Virtual Intra-Frame Buffering for Video Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current digital network cameras face limitations in buffering compressed video content due to large distances between intra-refresh frames, leading to high memory requirements and limited ability to store meaningful portions of encoded data, especially with limited buffer capacities.
Innovation Solution
The method involves encoding video content using a video codec to generate intra-frames and inter-frames, with the option to create virtual intra-frames when buffer thresholds are exceeded, allowing for efficient storage and transmission of compressed video data, even with long group-of-picture lengths.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If long GOP-length encoding is used to reduce network resource consumption, then transmission efficiency is improved, but memory requirements increase and buffering capability deteriorates
Solution Approach 1:
The patent segments the video stream by inserting virtual intra-frames at strategic points within the GOP structure. This divides the long GOP into smaller manageable segments that can be buffered independently, reducing the total memory required while maintaining transmission efficiency. The virtual intra-frames act as segmentation points that allow the buffer to discard older data more aggressively.
Solution Approach 2:
The patent introduces virtual intra-frames as intermediary elements within the GOP structure. These virtual intra-frames serve as mediators that allow the system to maintain long GOP-length encoding for transmission efficiency while providing periodic refresh points that enable effective buffering with limited memory. The virtual intra-frames are computed from existing inter-frames and serve as intermediate reference points.
2Loss of energy
If large distances between intra-refresh frames are used to minimize network resources, then network resource consumption is reduced, but buffer capacity effectiveness deteriorates
Solution Approach 1:
The patent performs preliminary computation of virtual intra-frames from inter-frames before they are needed for buffering operations. By pre-computing these reference frames and storing them in the buffer, the system prepares advance reference data that enables effective buffering without requiring more memory than available. This preliminary action allows the buffer to operate effectively despite the original large distances between real intra-frames.
Solution Approach 2:
The patent changes the parameter of frame distance by introducing virtual intra-frames at computed intervals within the GOP structure. While the original intra-refresh frame distance remains large for network efficiency, the virtual intra-frames create effective reference points at smaller intervals for buffering purposes. This parameter change enables the buffer to manage memory effectively while maintaining the original encoding efficiency.
3Device complexity
If limited buffer memory is used to constrain device complexity, then device simplicity is improved, but ability to store meaningful video portions deteriorates
Solution Approach 1:
The patent creates copies of essential video data by computing virtual intra-frames from existing inter-frames. These virtual copies serve as sufficient reference points for buffering purposes, allowing the limited buffer memory to store meaningful video portions without requiring the full original data. The virtual intra-frames are computed copies that contain the essential reference information needed for effective buffering.
Solution Approach 2:
The patent employs virtual intra-frames as disposable reference objects that can be computed, used for buffering, and then discarded or overwritten. These virtual intra-frames are cheaper in terms of memory consumption compared to storing complete GOPs, and their temporary nature allows the limited buffer to continuously rotate through meaningful video portions without permanent storage requirements.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems and methods are provided for encoding raw image content encoded using one or more virtual intra-frames. In an exemplary method, a stream of video content may be encoded to generate compressed video data that includes an intra-frame and a plurality of corresponding inter-frames. The compressed video data may be stored within a buffer, and when the amount of data in the buffer exceeds a threshold value, a virtual intra-frame may be computed based on decoded inter-frame data. The virtual intra-frame may be output for storage in the buffer.