Dual-Channel Game Frame Transfer With Depth-Aware Motion Vectors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D graphical rendering technologies face challenges in accurately converting frames between different framerates and resolutions, particularly due to imperfect methods of handling motion vectors and depth information, leading to computational inefficiencies and visual artifacts.
Innovation Solution
The use of block-level motion vectors with depth (MVDs) and separate channels for objects with and without motion vectors, along with dynamic sampling resolution, to enhance frame interpolation and reduce computational demands.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If motion vectors are used to generate interpolated frames, then framerate conversion efficiency is improved, but visual accuracy and depth information are lost
Solution Approach 1:
The patent adds depth information (z-dimension) to traditional 2D motion vectors, creating 3D motion vectors. This dimensional enhancement allows the system to maintain both computational efficiency for framerate conversion and visual accuracy by accounting for depth variations in the scene, resolving the contradiction between productivity and measurement precision.
Solution Approach 2:
The patent combines motion vector data with depth map information to create composite motion vector representations. This composite approach integrates multiple data types (motion information and depth information) to achieve both efficient framerate conversion and high visual accuracy, addressing the trade-off between productivity and measurement precision.
2Measurement precision
If all frames are rendered at high resolution, then visual quality is improved, but computational power requirements increase
Solution Approach 1:
The patent applies motion vector-based frame interpolation to generate intermediate frames, so that not all frames need to be fully rendered at high resolution. By partially rendering frames (using interpolation for some frames, full rendering for others), the system maintains visual quality while reducing overall computational power requirements.
Solution Approach 2:
The patent performs preliminary calculations of motion vectors and depth information before actual frame rendering. This preliminary action prepares data structures and motion information in advance, enabling more efficient subsequent rendering operations and reducing the peak computational power needed for high-quality visual output.
3Productivity
If traditional motion vector methods are used, then computational efficiency is improved, but depth information and visual artifacts are lost
Solution Approach 1:
The patent extends traditional 2D motion vectors to 3D motion vectors by incorporating depth information from depth maps. This dimensional enhancement allows the system to maintain computational efficiency while preserving depth information, as the additional z-component is integrated into the existing motion vector processing pipeline without requiring fundamentally new computational approaches.
Data Source
AI summary
Various methods are provided for generating motion vectors in the context of 3D computer-generated images. An example method includes generating, based on a current frame to be rendered, a block-level motion vector with depth (MVD) texture comprising a set of block-level motion vectors each having an associated depth value, outputting the block-level MVD texture for image processing on a first channel, and outputting at least a portion of the current frame on a second channel.