Overlapping Segments for Accurate I-Frame Placement in Distributed Video Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current distributed video encoding systems struggle with accurately placing I-frames in the output video and efficiently allocating bits per frame, leading to suboptimal video quality and encoding performance, especially when dealing with variable complexity segments and camera movements.

Innovation Solution

The system employs a complexity analyzer to allocate bits per frame based on segment complexity, splits the video into overlapping segments for precise key frame placement, and uses multiple encoders to encode video segments, ensuring accurate I-frame placement and uniform quality across segments, while also performing image stabilization using distributed processing nodes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If distributed video encoding is used to enable parallel processing and faster encoding, then encoding speed and productivity are improved, but accurate placement of I-frames and uniform bit allocation become difficult to achieve

Engineering Contradiction:
Improveencoding speedVSAvoidI-frame placement accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The video is divided into multiple segments that are processed in parallel by different encoding nodes. Each segment is independently encoded while maintaining coordination through a master node that manages I-frame placement across all segments, enabling both parallel processing and accurate key frame positioning.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A master node acts as an intermediary between multiple encoding nodes, coordinating the encoding process to ensure uniform I-frame placement and bit allocation across all parallel-encoded segments. The master node receives encoded segments and assembles them into the final output with consistent quality parameters.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of manufacture

If bits are allocated uniformly across all video frames, then encoding simplicity is maintained, but video quality suffers in high-complexity segments

Engineering Contradiction:
Improveencoding simplicityVSAvoidvideo quality
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

Bit allocation is adjusted locally based on segment complexity. The system analyzes each video segment's complexity characteristics and allocates bits proportionally, allowing high-complexity segments to receive more bits for better quality while maintaining simplicity in low-complexity areas, achieving overall optimized video quality.

Inventive Principle:
Principle #3Local quality

3Productivity

If video is split into non-overlapping segments for parallel encoding, then processing efficiency is maximized, but precise key frame placement becomes impossible

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidkey frame placement precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The video is pre-processed to identify optimal segment boundaries that align with I-frame locations. This preliminary analysis enables parallel encoding of segments while ensuring that key frames are positioned accurately at segment boundaries, maintaining both processing efficiency and placement precision.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Segments are created with overlapping regions that contain reference frames needed for accurate I-frame placement. The overlapping portions act as nested structures where one segment contains reference information for adjacent segments, enabling precise key frame positioning while maintaining parallel processing capability.

Inventive Principle:
Principle #7Nested doll (Nesting)

Data Source

PatentUS10499070B2Key frame placement for distributed video encoding
Publication Date: 2019.12.03 META PLATFORMS INC
  • US10499070B2 patent drawing
  • US10499070B2 patent drawing
  • US10499070B2 patent drawing

AI summary

A method and system for encoding a segment of an input video with accurate placement of key frames, e.g., I-Frames, using Group of Pictures (GOPs) length for output in a distributed video encoding system with two or more encoders is disclosed. The method includes creating overlapping segments in order to allow precise key frame placement. Further, the method includes using desired segment length and the desired key frame placement to create the overlapping segments. Further, the method includes skipping a certain number of frames at the beginning of the segment, and a certain number of frames at the end of the segment, thereby achieving accurate placement of key frames.