Virtual Scene Frame Reprojection Using Depth and Color Texture Maps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Many terminal devices struggle to support high frame rates for virtual scene rendering due to limited processing capabilities, leading to suboptimal display effects.
Innovation Solution
An image display method that involves acquiring a first scene depth and color texture maps, mapping spatial positions of triangle faces using camera parameters, and generating subsequent texture maps to display frames without full redrawn rendering, thereby reducing processing workload and improving frame rates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If high frame rate rendering is implemented, then display effect is improved, but terminal processing capability requirements increase
Solution Approach 1:
The patent pre-calculates and stores spatial position relationships of triangle faces in a clipping space during the first rendering. When generating the second image frame, it directly retrieves and maps these pre-stored positions using camera parameters, avoiding real-time complex calculations. This preliminary preparation enables high frame rates by reducing the computational burden during actual rendering.
Solution Approach 2:
The patent generates the second image frame by copying and mapping spatial position data from the first image frame's clipping space. Instead of recalculating all triangle face positions, it creates a transformed copy using camera parameter mappings, significantly reducing processing requirements while maintaining visual fidelity.
2Manufacturing precision
If full redrawn rendering is performed for each frame, then image quality is maintained, but processing workload increases
Solution Approach 1:
The patent extracts only the essential spatial position information of triangle faces from the first image frame and stores it in a clipping space. For the second frame, it only needs to map these extracted positions using camera parameters, rather than performing complete redrawn rendering. This selective extraction maintains image quality while dramatically reducing processing workload.
Solution Approach 2:
Instead of performing complete rendering for every frame, the patent applies partial rendering by only updating the portions of the image that require changes based on camera parameter differences. It maps existing triangle face positions rather than recalculating all positions, achieving sufficient image quality with reduced processing effort.
Data Source
AI summary
Image rendering techniques for use with virtual worlds and interactive media are described herein. Techniques may include: acquiring a first scene depth texture map and a first scene color texture map of a first image frame; acquiring, based on the first scene depth texture map, a first spatial position of a vertex of a target triangle face in a first clipping space; mapping, based on a first camera parameter and a second camera parameter, the first spatial position to a second spatial position in a second clipping space; generating a second scene depth texture map and a second scene color texture map based on the second spatial position and the first scene color texture map; and displaying a second image frame based on the second scene depth texture map and the second scene color texture map. Image display frame rates for a virtual scene may be improved, thereby improving visual effects.