Live Video Inter-Frame Conversion for Selective Segment Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional livestreaming systems face inefficiencies in capturing specific segments of live media streams due to the need to receive and store the entire stream before recording, leading to increased processing overhead, processor load, and bandwidth requirements, especially when using inter-frame only GOP structures.
Innovation Solution
A recode engine converts inter-frames into intra-frames within the live media stream to enable selective recording of segments, minimizing processor load and reducing the need for transcoding the entire stream, by leveraging codecs like H.263, H.264, MPEG4, HEVC, and 3GP, and updating headers to reference the new intra-frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If inter-frame only GOP structure is used for livestreaming, then bandwidth requirements and processor load are reduced, but the ability to capture specific segments becomes limited requiring entire stream storage
Solution Approach 1:
The patent divides the video stream into manageable segments by inserting intra-frames at specific intervals and positions. This allows the stream to be captured at any point without requiring storage of the entire stream, as each segment becomes independently decodable from its associated intra-frame.
Solution Approach 2:
The patent performs preliminary encoding of intra-frames at predetermined intervals during the livestreaming process. This advance preparation ensures that when segment capture is needed, the necessary reference frames are already available, eliminating the need to store and process the entire stream.
2Adaptability or versatility
If entire live media stream is received and stored before capturing segments, then segment capture is enabled, but processing overhead and storage requirements increase
Solution Approach 1:
The patent extracts only the necessary intra-frames and segment data from the full stream for storage, rather than storing the entire stream. This selective extraction reduces storage requirements while maintaining the ability to capture and replay specific segments on demand.
Solution Approach 2:
The patent applies different storage priorities to different parts of the stream. Intra-frames and their associated segment data are stored with high priority, while other portions can be discarded or stored with lower priority, optimizing storage efficiency for segment capture functionality.
3Adaptability or versatility
If nearest intra-frame is used to start recording in inter-frame only GOP structure, then segment capture becomes possible, but significant portions of stream must still be stored
Solution Approach 1:
The patent performs preliminary insertion of intra-frames at strategic positions during stream encoding. This ensures that when segment capture is initiated, the required intra-frame is already present in the stream buffer, eliminating the need to store and process intervening frames from the beginning of the stream.
Solution Approach 2:
The patent uses intra-frames as intermediary reference points that enable segment capture without requiring access to the entire stream. These intra-frames act as self-contained starting points that allow independent decoding and capture of subsequent segments.
4Adaptability or versatility
If conventional transcoding is performed to enable segment capture, then segment recording is enabled, but processor load and time resources increase
Solution Approach 1:
The patent performs preliminary encoding of intra-frames during the original stream encoding process, rather than performing transcoding later. This advance preparation eliminates the need for computationally intensive transcoding operations when segment capture is needed, maintaining high processing efficiency.
Solution Approach 2:
The patent creates simplified copies of the stream structure with inserted intra-frames that can be directly used for segment capture without requiring full transcoding. These copied structures maintain compatibility with standard decoders while enabling efficient segment extraction.
Data Source
AI summary
In various examples, a media stream may be received by a re-encode system that may leverage a recode engine to convert (e.g., at an interval, based on a request, etc.) an inter-frame associated with the media stream to an intra-frame. The intra-frame may be converted from the inter-frame using parameters or other information associated with and received with the media stream. The converted intra-frame may be merged into an updated segment of the media stream in place of the original inter-frame to enable storage of the updated segment—or a portion thereof—for later use.