Video Coding Saliency Map Motion Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video compression standards, such as MPEG1, MPEG2, MPEG4, and H.264, face challenges in achieving higher compression rates while maintaining visual quality, particularly in emerging applications like high-quality video distribution over the internet and mobile devices.

Innovation Solution

A coding and decoding method that calculates a saliency map for key pictures, estimates motion vectors, motion compensates the saliency map, and codes picture portions based on their saliency levels, using either standard H.264 methods or more precise interpolation techniques, to optimize compression efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If standard video compression methods (MPEG1, MPEG2, MPEG4, H.264) are used, then compression efficiency is maintained at current levels, but compression rate cannot be increased further while preserving visual quality

Engineering Contradiction:
Improvevisual qualityVSAvoidcompression rate
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent applies different coding methods to different regions of the video picture based on their saliency levels. High-saliency regions (containing important visual information) are coded with higher quality methods, while low-saliency regions use more aggressive compression. This local differentiation allows increasing overall compression rate while preserving visual quality in critical areas.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes coding parameters dynamically based on saliency map analysis. By calculating a saliency map and using it to select coding methods, the system adapts compression parameters to the local importance of different picture regions, enabling higher compression rates without sacrificing perceived visual quality.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If compression rate is increased to enable new services (internet video distribution, mobile video), then data transmission efficiency improves, but visual quality of reconstructed pictures deteriorates

Engineering Contradiction:
Improvedata transmission efficiencyVSAvoidvisual quality
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

By identifying and protecting high-saliency regions through the saliency map, the patent ensures that visually important areas maintain quality even under high compression. Less important regions are compressed more aggressively, achieving better overall data transmission efficiency while preserving essential visual information.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent performs preliminary saliency map calculation and analysis before the actual coding process. This preliminary action identifies which regions require quality preservation, allowing the coding process to prioritize these areas and achieve better visual quality at higher compression rates.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If uniform high-quality coding is applied to all picture portions, then visual quality is maximized, but compression rate decreases

Engineering Contradiction:
Improvevisual qualityVSAvoidcompression rate
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent explicitly avoids uniform coding by using the saliency map to differentiate coding quality across picture regions. High-saliency portions receive high-quality coding while low-saliency portions use more efficient compression, achieving an optimal balance between visual quality and compression rate that uniform coding cannot attain.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Instead of applying high-quality coding uniformly to all regions (excessive action), the patent applies it only where necessary based on saliency analysis (partial action). This selective approach maintains visual quality where it matters most while achieving better compression rates.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS8755436B2Method of coding, decoding, coder and decoder
Publication Date: 2014.06.17 INTERDIGITAL MADISON PATENT HLDG
  • US8755436B2 patent drawing
  • US8755436B2 patent drawing
  • US8755436B2 patent drawing

AI summary

A method for coding a picture portion of a picure of a video sequence is disclosed, at least one picture of the video sequence being a key picture. The method comprises the following steps:a) calculate a saliency map of the key picture,b) estimate for the picture portion to be coded, at least one motion vector pointing towards a portion of the key picture,c) motion compensate at least one portion of the saliency map using an estimated motion vector to obtain, for said picture portion, at least one portion of the predicted saliency map, andd) code the picture portion according to the saliency level of the portion of the predicted saliency map.The invention also relates to a method for decoding a binary stream, a coder able to code pictures of a video sequence and a decoder of a binary stream.