Video Coding Saliency Map Motion Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video compression standards, such as MPEG1, MPEG2, MPEG4, and H.264, face challenges in achieving higher compression rates while maintaining visual quality, particularly in emerging applications like high-quality video distribution over the internet and mobile devices.
Innovation Solution
A coding and decoding method that calculates a saliency map for key pictures, estimates motion vectors, motion compensates the saliency map, and codes picture portions based on their saliency levels, using either standard H.264 methods or more precise interpolation techniques, to optimize compression efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If standard video compression methods (MPEG1, MPEG2, MPEG4, H.264) are used, then compression efficiency is maintained at current levels, but compression rate cannot be increased further while preserving visual quality
Solution Approach 1:
The patent applies different coding methods to different regions of the video picture based on their saliency levels. High-saliency regions (containing important visual information) are coded with higher quality methods, while low-saliency regions use more aggressive compression. This local differentiation allows increasing overall compression rate while preserving visual quality in critical areas.
Solution Approach 2:
The patent changes coding parameters dynamically based on saliency map analysis. By calculating a saliency map and using it to select coding methods, the system adapts compression parameters to the local importance of different picture regions, enabling higher compression rates without sacrificing perceived visual quality.
2Productivity
If compression rate is increased to enable new services (internet video distribution, mobile video), then data transmission efficiency improves, but visual quality of reconstructed pictures deteriorates
Solution Approach 1:
By identifying and protecting high-saliency regions through the saliency map, the patent ensures that visually important areas maintain quality even under high compression. Less important regions are compressed more aggressively, achieving better overall data transmission efficiency while preserving essential visual information.
Solution Approach 2:
The patent performs preliminary saliency map calculation and analysis before the actual coding process. This preliminary action identifies which regions require quality preservation, allowing the coding process to prioritize these areas and achieve better visual quality at higher compression rates.
3Loss of information
If uniform high-quality coding is applied to all picture portions, then visual quality is maximized, but compression rate decreases
Solution Approach 1:
The patent explicitly avoids uniform coding by using the saliency map to differentiate coding quality across picture regions. High-saliency portions receive high-quality coding while low-saliency portions use more efficient compression, achieving an optimal balance between visual quality and compression rate that uniform coding cannot attain.
Solution Approach 2:
Instead of applying high-quality coding uniformly to all regions (excessive action), the patent applies it only where necessary based on saliency analysis (partial action). This selective approach maintains visual quality where it matters most while achieving better compression rates.
Data Source
AI summary
A method for coding a picture portion of a picure of a video sequence is disclosed, at least one picture of the video sequence being a key picture. The method comprises the following steps:a) calculate a saliency map of the key picture,b) estimate for the picture portion to be coded, at least one motion vector pointing towards a portion of the key picture,c) motion compensate at least one portion of the saliency map using an estimated motion vector to obtain, for said picture portion, at least one portion of the predicted saliency map, andd) code the picture portion according to the saliency level of the portion of the predicted saliency map.The invention also relates to a method for decoding a binary stream, a coder able to code pictures of a video sequence and a decoder of a binary stream.


