Cross-Color Prediction for Video Compression Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video coding methods, particularly in entropy coding, face inefficiencies in predicting pixel values due to limited utilization of spatial and cross-color correlations, leading to suboptimal compression results, especially in natural content with varying color correlations.

Innovation Solution

The implementation of cross-color prediction, which determines pixel predictions by combining spatially correlated intra-color predictors with predictor residuals, allowing adaptive selection between intra-color and cross-color predictions using a weighted sum, specifically for Bayer images, to enhance prediction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional intra-color prediction methods are used, then the device complexity is low, but the prediction accuracy and compression efficiency deteriorate

Engineering Contradiction:
Improveprediction accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges intra-color prediction with cross-color prediction by combining the intra-color predictor pixel with color residuals from a reference picture. This integration allows the system to leverage both spatial correlation (intra-color) and cross-color correlation simultaneously, improving prediction accuracy without requiring a completely separate prediction system.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces color residuals as an intermediary element that bridges the intra-color prediction and cross-color prediction. The color residuals capture the difference between the current picture's color components and the reference picture's color components, serving as a mediator that enhances the basic intra-color predictor with additional cross-color information.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If cross-color prediction is implemented, then the compression efficiency improves, but the computational complexity increases

Engineering Contradiction:
Improvecompression efficiencyVSAvoidcomputational complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the prediction process into distinct components: the intra-color predictor pixel generation, the color residual calculation, and the final prediction combination. By dividing the cross-color prediction into these manageable segments, the system can process each part separately and efficiently, reducing the overall computational burden while maintaining compression efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary action by pre-calculating and storing color residuals from the reference picture before the actual prediction process. This allows the decoder to quickly access and apply the residuals during decoding without performing complex calculations in real-time, thereby improving compression efficiency while managing computational complexity.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If adaptive selection between intra-color and cross-color prediction is used, then the prediction accuracy improves for varying color correlations, but the device complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements dynamics by making the prediction method adaptive rather than fixed. The system dynamically selects between intra-color prediction and cross-color prediction based on the actual color correlation characteristics of the current picture. This adaptability allows the system to optimize prediction accuracy for different content types while managing device complexity through conditional logic rather than always using the more complex cross-color method.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10609411B1Cross color prediction for image/video compression
Publication Date: 2020.03.31 SONY GROUP CORP
  • US10609411B1 patent drawing
  • US10609411B1 patent drawing
  • US10609411B1 patent drawing

AI summary

To improve intra coding prediction, cross-color prediction utilizes spatial correlation and cross-color correlation to generate a more accurate predictor. Cross-color prediction is also able to be used in a dynamic system which selects between cross-color prediction and intra-color prediction.