Image Processing Device Temporal Prediction Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In image encoding and decoding processes, especially with large frames, temporal predictors often generate small processing units, leading to increased memory access frequency and bandwidth requirements, resulting in higher processing loads.
Innovation Solution
An image processing device that includes a temporal prediction control unit to manage motion vector prediction, allowing spatial or both spatial and temporal predictions, and sets thresholds based on region size or the number of temporally-predicted motion vectors to optimize prediction methods and reduce unnecessary memory access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If temporal prediction is performed using motion vectors of temporally adjacent regions, then encoding efficiency is improved, but memory access frequency and bandwidth requirements increase
Solution Approach 1:
The patent changes the parameter of prediction unit size from fixed to variable based on template matching results. By adapting the prediction unit size dynamically, the system optimizes the balance between encoding efficiency and memory access requirements, allowing larger prediction units when possible to reduce the number of predictions needed
2Productivity
If temporal prediction is performed using motion vectors of temporally adjacent regions, then encoding efficiency is improved, but processing load increases
Solution Approach 1:
The patent applies local quality by performing template matching and motion vector calculation only for regions where it is beneficial, rather than uniformly across the entire image. The system selectively applies temporal prediction based on local characteristics, reducing overall processing load while maintaining encoding efficiency where needed
3Measurement precision
If prediction unit size is reduced to improve motion vector accuracy, then encoding precision is improved, but the number of processing units increases
Solution Approach 1:
The patent makes the prediction unit size dynamic rather than fixed, allowing it to vary based on local image characteristics and template matching results. This dynamic adaptation enables the system to use smaller prediction units only where necessary for accuracy, while using larger units elsewhere to reduce the total number of processing units
Data Source
AI summary
The present technique relates to an image processing device and method for preventing increases in the processing load of image encoding and decoding. The image processing device includes: a temporal prediction control unit that controls, in a prediction of a motion vector, whether a temporal prediction is to be performed to predict the motion vector by using the motion vector of a neighbor region temporally adjacent to the current region being processed; and a motion vector encoding unit that predicts the motion vector of the current region by performing only a spatial prediction to predict the motion vector from the motion vector of a neighbor region spatially adjacent to the current region or performing both the spatial prediction and the temporal prediction under the control of the temporal prediction control unit, and encodes the motion vector of the current region by using the predicted value.