Variable Resolution Rendering via Motion Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Three-dimensional rendered animations often contain extraneous detail that viewers cannot perceive, and rendering each pixel of a high-resolution image is computationally intensive, leading to inefficiencies in processing systems.
Innovation Solution
Implementing a variable resolution rendering system that uses a motion estimator engine to generate a motion vector field, allowing the rendering processor to assign varying logical pixel dimensions based on the presence of objects and motion within image tiles, thereby reducing computational workload without affecting perceived image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If each pixel is rendered at high resolution, then image quality is improved, but computational intensity increases
Solution Approach 1:
The patent applies local quality by rendering different regions of the image at different resolutions. Regions with objects or high motion activity are rendered at higher resolution, while regions without objects or with low motion are rendered at lower resolution. This is achieved by dividing the image into tiles and assigning variable logical pixel dimensions to each tile based on motion estimation and object detection, thereby reducing overall computational intensity while maintaining high image quality where needed.
2Productivity
If variable resolution rendering is implemented, then computational workload is reduced, but rendering complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the image into multiple tiles and processing each tile independently with different resolution settings. The rendering system segments the image based on motion estimation results and object presence, allowing each segment to be rendered at appropriate resolution. This segmentation approach reduces computational workload while managing complexity through automated tile-based processing.
Solution Approach 2:
The patent applies dynamics by making the rendering resolution dynamic rather than static. The logical pixel dimensions are adjusted dynamically based on motion vectors and object detection results for each tile. Regions with higher motion or object presence receive higher resolution, while static or empty regions receive lower resolution. This dynamic adaptation optimizes computational efficiency without requiring complex manual configuration.
3Productivity
If motion estimation is performed, then rendering optimization is improved, but processing time increases
Solution Approach 1:
The patent applies preliminary action by performing motion estimation and object detection before the actual rendering process. The system analyzes motion vectors and identifies objects in advance to determine which regions should be rendered at higher resolution. This preliminary analysis allows the rendering system to optimize resource allocation before rendering begins, improving overall efficiency while the processing time for motion estimation is amortized across multiple rendering operations.
Data Source
AI summary
A rendering processor assigns varying logical pixel dimensions to regions of an image frame and rendering pixels of the image frame based on the logical pixel dimensions. The rendering processor renders in highest resolution (i.e., with smaller logical pixel dimensions) those areas of the image that are more important (on which the viewer is expected to focus (the “foveal region”), or regions with little-to-no motion), and renders in lower resolution (i.e., with larger logical pixel dimensions) those areas of the image outside the region of interest, or regions that are speedily moving, so that loss of detail in those regions will be less noticeable to the viewer. For regions with less detail or greater magnitude of motion, larger logical pixel dimensions reduce the computational workload without affecting the quality of the displayed graphics as perceived by a user.