Predictive Frame Selection for Video Encoding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding methods face challenges in selecting the optimal frame type (P-frame or B-frame) for coding, which affects coding efficiency and perceptual quality, often resulting in compromised efficiency and flickering artifacts, especially at low or medium coding bit rates.

Innovation Solution

A method and apparatus for predictive frame selection that chooses between single direction inter predictive and bi-directional inter predictive picture types based on coding efficiency and the determination of flickering artifacts, using a unified framework that integrates multiple heuristics and a more accurate frame motion intensity measure to select P-frames over B-frames when conditions such as high accumulated motion, unbalanced motion, or low motion are met.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If B-frame coding is used to improve coding efficiency, then compression performance is improved, but flickering artifacts increase

Engineering Contradiction:
Improvecoding efficiencyVSAvoidflickering artifacts
Core Design Contradiction:
ProductivityVSObject-generated harmful factors

Solution Approach 1:

The patent changes the decision parameters for frame type selection by introducing a comprehensive motion intensity measure that combines multiple motion metrics (bidirectional motion intensity, forward motion intensity, backward motion intensity) with thresholds. This parameter change enables the system to identify and avoid B-frame coding in situations that would produce flickering while maintaining B-frame coding elsewhere for efficiency gains.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent performs preliminary motion analysis and frame type decision-making before actual encoding. By calculating motion intensities and determining frame types in advance based on predefined thresholds and motion characteristics, the system可以避免suboptimal B-frame selections that would cause flickering, while ensuring efficient P-frame or I-frame placement to prevent artifact propagation.

Inventive Principle:
Principle #10Preliminary action

2Quantity of substance

If more B-frames are coded to improve compression, then bit rate efficiency is improved, but perceptual quality deteriorates

Engineering Contradiction:
Improvebit rate efficiencyVSAvoidperceptual quality
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent introduces comprehensive motion intensity parameters (bidirectional motion intensity, forward motion intensity, backward motion intensity) with specific thresholds to control frame type selection. These parameter changes enable the system to maintain high bit rate efficiency through strategic B-frame coding while preventing perceptual quality degradation by avoiding B-frames in low-motion or high-sensitivity regions.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements a feedback mechanism where motion analysis results from previously encoded frames inform subsequent frame type decisions. By continuously monitoring motion characteristics and adjusting frame type selections based on observed patterns, the system optimizes the balance between bit rate efficiency and perceptual quality, preventing the accumulation of flickering artifacts while maintaining compression effectiveness.

Inventive Principle:
Principle #23Feedback

3Object-generated harmful factors

If P-frame coding is used instead of B-frame coding, then flickering artifacts are reduced, but coding efficiency decreases

Engineering Contradiction:
Improveflickering artifactsVSAvoidcoding efficiency
Core Design Contradiction:
Object-generated harmful factorsVSProductivity

Solution Approach 1:

The patent applies local quality control by making frame type decisions on a per-frame basis rather than uniformly across the entire video sequence. By analyzing motion characteristics of individual frames and applying different frame types (I-frame, P-frame, or B-frame) locally where appropriate, the system reduces flickering artifacts in sensitive regions while maintaining high coding efficiency in regions where B-frames are beneficial.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamic frame type selection that adapts to changing motion characteristics throughout the video sequence. Rather than using a fixed frame type structure, the system dynamically adjusts frame type decisions based on real-time motion analysis, allowing it to switch between P-frame and B-frame coding strategies to optimize the balance between artifact reduction and coding efficiency for each specific frame.

Inventive Principle:
Principle #15Dynamics

4Manufacturing precision

If complex motion analysis is performed to improve frame type selection, then perceptual quality is improved, but computational complexity increases

Engineering Contradiction:
Improveperceptual qualityVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the motion analysis process into distinct, manageable components: bidirectional motion intensity calculation, forward motion intensity calculation, backward motion intensity calculation, and frame type decision logic. Each component processes specific motion aspects independently with defined thresholds, reducing the computational burden compared to holistic complex motion models while maintaining comprehensive motion characterization for accurate frame type selection.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10080034B2Method and apparatus for predictive frame selection supporting enhanced efficiency and subjective quality
Publication Date: 2018.09.18 INTERDIGITAL MADISON PATENT HLDG
  • US10080034B2 patent drawing
  • US10080034B2 patent drawing
  • US10080034B2 patent drawing

AI summary

A method and apparatus are provided for predictive frame selection supporting enhanced efficiency and subjective quality. The apparatus includes an encoder for encoding a picture using a selection scheme that selects between encoding the picture as a single direction inter predictive picture type and a bi-directional inter predictive picture type based on coding efficiency and a determination of a flickering artifact resulting from coding the picture as the bi-directional inter predictive picture type.