Multipass Video Encoding via Frame Subsampling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multipass video encoding for long sequences is inefficient as it requires encoding the entire video sequence multiple times, significantly increasing processing time and resource usage.

Innovation Solution

The system employs subsampling techniques where only select frames are encoded on each pass, with coding parameters adjusted based on the results of previous passes, allowing for extrapolation of information for non-encoded frames to meet specified requirements, thereby reducing the need to encode the entire sequence on each iteration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If multipass encoding is used to achieve highly efficient video compression, then compression efficiency is improved, but processing time increases significantly

Engineering Contradiction:
Improvecompression efficiencyVSAvoidprocessing time
Core Design Contradiction:
Loss of energyVSLoss of time

Solution Approach 1:

The patent segments the video sequence into multiple passes, where each pass processes only a subset of frames (subsampled frames) rather than the entire sequence. This segmentation allows the system to achieve multipass compression efficiency while reducing the processing burden of each individual pass, thereby resolving the contradiction between compression efficiency and processing time.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by encoding only a subset (subsample) of frames during intermediate passes rather than processing the complete video sequence. This partial processing approach maintains the iterative optimization benefits of multipass encoding while significantly reducing processing time, as the system processes fewer frames per pass and uses extrapolation to estimate parameters for non-encoded frames.

Inventive Principle:
Principle #16Partial or excessive action

2Manufacturing precision

If the entire video sequence is encoded multiple times for multipass encoding, then coding parameter optimization is improved, but device complexity increases

Engineering Contradiction:
Improvecoding parameter optimizationVSAvoidencoding system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the encoding task into multiple passes with each pass handling only subsampled frames. This segmentation reduces the complexity of each individual encoding operation while maintaining the overall optimization capability through iterative parameter adjustment based on subsampled frame results.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses extrapolation techniques that create estimated representations of coding parameters for non-encoded frames based on the analysis of subsampled frames. This copying approach allows the system to infer parameters for the entire sequence without explicitly processing every frame, thereby reducing device complexity while maintaining optimization quality.

Inventive Principle:
Principle #26Copying

3Productivity

If subsampling of frames is used to reduce processing time, then processing efficiency is improved, but measurement precision deteriorates

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidcoding parameter accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent implements feedback mechanisms where coding parameters are adjusted based on the results obtained from encoding subsampled frames. The system analyzes the coding characteristics of the subsampled frames and uses this feedback to refine parameters for subsequent passes, ensuring that measurement precision is maintained despite processing only a subset of frames.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces the mechanical approach of encoding every frame with a computational approach using extrapolation and parameter adjustment. Instead of physically processing all frames, the system substitutes this with mathematical estimation techniques that infer parameters for non-encoded frames based on subsampled frame data, maintaining accuracy while improving efficiency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS8031777B2Multipass video encoding and rate control using subsampling of frames
Publication Date: 2011.10.04 APPLE INC
  • US8031777B2 patent drawing
  • US8031777B2 patent drawing
  • US8031777B2 patent drawing

AI summary

An encoder includes an encoder engine, a storage device and a controller to implement an iterative coding process. The encoder engine compresses a selected portion of a data sequence. The storage device stores the compressed portion of the data sequence after each iteration. The controller selects the portion of the data sequence to compress for each iteration. The controller gathers statistics from the compressed portion of the data sequence. The gathered statistics include statistics generated by the selected frames and statistics extrapolated from the selected frames for the non-selected frames. The controller adjusts coding parameters of the encoder engine on each iteration until the gathered statistics meet a specified performance requirement.