Intercepting GPU Ray Tracing Structures for Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional tools are unable to process image data related to ray tracing effectively, as they are not designed to handle driver-specific acceleration structures used in ray tracing, limiting their ability to provide visualization features for ray-traced images.

Innovation Solution

A method is introduced to intercept proprietary ray tracing instructions from a graphics processing unit (GPU) or graphics driver, convert them into a visualization structure using assistance information, and generate a visualization of the image, allowing for the display of ray-traced images without requiring the visualization tool to understand the proprietary structure's format.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional visualization tools are used for ray tracing images, then the tools can process standard rasterized images, but they cannot process driver-specific acceleration structures and proprietary ray tracing instructions

Engineering Contradiction:
Improveability to process different image typesVSAvoidcompatibility with proprietary structures
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces a bridge application that acts as an intermediary between the ray tracing application and the visualization tool. This bridge intercepts proprietary ray tracing instructions from the GPU driver and converts them into a standardized format that visualization tools can understand, enabling conventional tools to process ray tracing images without requiring tool-specific modifications for each GPU vendor's proprietary structure

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a copy or representation of the proprietary acceleration structure in a standardized format. The bridge application captures the essential information from driver-specific acceleration structures and reconstructs it in a universal representation that can be processed by visualization tools, allowing the original proprietary structure to remain unchanged while enabling compatibility

Inventive Principle:
Principle #26Copying

2Productivity

If driver-specific acceleration structures are used for ray tracing, then GPU manufacturers can optimize rendering performance, but visualization tools cannot process these structures effectively

Engineering Contradiction:
Improverendering performanceVSAvoidvisualization capability
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The bridge application serves as a mediator that preserves the performance benefits of driver-specific acceleration structures while providing visualization capabilities. It intercepts the proprietary instructions after they are generated by the GPU driver, extracts the necessary information, and converts it to a visualization-friendly format, thus maintaining rendering optimization without sacrificing debuggability

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system separates the rendering function from the visualization function. The GPU driver and bridge application handle the proprietary acceleration structure for optimal rendering, while the visualization tool works with a simplified standardized representation. This segmentation allows each component to be optimized independently for its specific purpose

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11113869B2Techniques for generating visualizations of ray tracing images
Publication Date: 2021.09.07 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11113869B2 patent drawing
  • US11113869B2 patent drawing
  • US11113869B2 patent drawing

AI summary

Examples described herein generally relate to generating a visualization of an image. A proprietary structure that specifies ray tracing instructions for generating the image using ray tracing is intercepted from a graphics processing unit (GPU) or a graphics driver. The proprietary structure can be converted, based on assistance information, to a visualization structure for generating the visualization of the image. The visualization of the image can be generated from the visualization structure.