Video Coding Using Display Modification Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards like H.264 and HEVC face challenges in efficiently compressing video data due to high computational load and power consumption, particularly in motion estimation and mode decision processes, which are exacerbated by the need to search large areas for motion vectors.
Innovation Solution
The method and system utilize content-based metadata to reduce the area searched for motion vectors by providing object motion data and dimensions, allowing for reduced computational load and power consumption by concentrating motion estimation searches within defined object areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If motion estimation searches a large area of the reference frame to find matching blocks, then motion vector accuracy is improved, but computational load and power consumption increase significantly
Solution Approach 1:
The patent applies preliminary action by using object motion data from display content information to pre-determine motion vectors for blocks associated with moving objects before performing full motion estimation. The encoder identifies objects in the current frame, retrieves their motion data (position, velocity, acceleration) from display content information, and uses this to calculate preliminary motion vectors. This preliminary determination avoids the need for exhaustive block matching searches, significantly reducing computational load and power consumption while maintaining accurate motion vectors for object-containing blocks.
2Manufacturing precision
If motion estimation is performed on all blocks in a frame, then compression quality is improved, but processing time and computational resources increase
Solution Approach 1:
The patent applies segmentation by dividing the frame into blocks and further categorizing blocks based on their association with moving objects identified from display content information. Instead of performing motion estimation uniformly on all blocks, the system segments the processing into: (1) blocks associated with moving objects, which use object motion data for rapid motion vector determination, and (2) other blocks, which use conventional motion estimation or alternative prediction methods. This selective segmentation maintains compression quality for object-containing regions while reducing processing time overall.
Solution Approach 2:
The patent applies partial action by performing simplified or alternative motion estimation only on blocks that do not contain moving objects, while using object motion data for blocks that do contain objects. The system performs full or enhanced motion estimation only where necessary (on object-containing blocks) and uses alternative approaches elsewhere, achieving adequate compression quality without the excessive computational cost of uniform full-search motion estimation across the entire frame.
3Adaptability or versatility
If conventional motion estimation techniques are used without object information, then encoding compatibility is maintained, but encoding efficiency decreases
Solution Approach 1:
The patent applies universality by designing an encoding system that can operate in multiple modes: (1) when display content information is available, it uses object motion data to determine motion vectors for object-containing blocks, improving encoding efficiency; (2) when display content information is unavailable or incompatible, it falls back to conventional motion estimation techniques. This multi-functional approach maintains encoding compatibility across different scenarios while maximizing encoding efficiency when object information is available. The system universally handles both cases without requiring changes to the decoding side.
Data Source
AI summary
Techniques described herein are related to video coding using display modification input.