Hybrid Image Rendering with Split Frame Buffers for Low-I/O Reflections
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The high power consumption in image rendering due to significant input/output overheads during the transmission of G-buffers in the combination of rasterization and ray tracing technologies for three-dimensional scene rendering.
Innovation Solution
The method involves separating rendering information into reflecting and reflected objects, performing ray tracing on the reflecting objects first to store reflections in a first frame buffer, and then performing rasterization on both types of objects in a second frame buffer, reducing the need for transmitting detailed reflections and minimizing unnecessary calculations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the GPU performs rasterization and stores the complete G-buffer in a first frame buffer, then the geometric information and object images are preserved for subsequent ray tracing operations, but significant I/O overheads are generated during transmission causing excessively high power consumption
Solution Approach 1:
The patent segments the rendering process into two distinct phases: a rasterization phase that generates a G-buffer with geometric information, and a ray tracing phase that uses only selected portions of this data. By dividing the complete G-buffer transmission into selective data extraction, the system preserves rendering accuracy while reducing the I/O overhead to only the necessary reflection-related information, thereby significantly lowering power consumption.
Solution Approach 2:
The patent extracts only the specific reflection-related information from the complete G-buffer that is necessary for ray tracing operations, rather than transmitting the entire G-buffer. This extraction principle reduces the data transmission volume and I/O overhead while maintaining the quality of reflection rendering, thus resolving the contradiction between rendering reliability and power consumption.
2Reliability
If the GPU transmits the complete G-buffer for ray tracing operations, then all object information is available for accurate reflection rendering, but the I/O overheads cause rendering efficiency to decrease
Solution Approach 1:
The patent segments the G-buffer data into essential reflection information and non-essential data, transmitting only the segmented reflection-related portions to the ray tracing unit. This segmentation maintains reflection rendering quality by preserving all necessary geometric and material data for accurate reflection calculation, while improving rendering efficiency by eliminating unnecessary data transmission overhead.
Solution Approach 2:
The patent extracts and transmits only the specific portions of the G-buffer that contain reflection-related information (such as normal vectors, material properties, and geometric data for reflecting surfaces) to the ray tracing unit. This extraction approach ensures that reflection rendering quality is maintained with all necessary data present, while rendering efficiency is improved by reducing I/O overhead to minimal necessary transmissions.
3Reliability
If the GPU performs ray tracing based on the complete G-buffer, then comprehensive reflection images are obtained, but the computing power consumption becomes excessively high
Solution Approach 1:
The patent applies local quality by performing ray tracing operations only on the specific reflecting objects and surfaces where reflections are actually visible in the final image, rather than processing all objects in the scene. By determining which portions of the G-buffer contain relevant reflection information and processing only those local regions, the system maintains complete reflection image quality while significantly reducing computing power consumption through selective processing.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
An image rendering method and a related device thereof are disclosed in this application, to avoid generation of significant I/O overheads during information transmission, thereby reducing power consumption of image rendering. The method in this application includes: performing ray tracing based on rendering information of a reflecting object, and storing an obtained image of a reflection in the reflecting object in a first frame buffer, where the first frame buffer is used for storing an image that does not need to be displayed temporarily; performing rasterization separately based on the rendering information of the reflecting object and rendering information of a reflected object, and storing an obtained image of the reflecting object and an obtained image of the reflected object in a second frame buffer, where the second frame buffer is used for storing an image to be displayed; and obtaining, from the first frame buffer, the image of the reflection in the reflecting object, and storing the image of the reflection in the reflecting object in the second frame buffer, so that the image of the reflecting object, the image of the reflected object, and the image of the reflection in the reflecting object are fused to obtain a target image.