Stereoscopic Rendering via Raymarching and Virtual View Broadcaster

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating stereoscopic 360-degree panoramas are complex and often result in incorrect depth representation and stitching artifacts when viewed from directions other than perpendicular, due to the impractical need for numerous input images and inefficient rendering processes.

Innovation Solution

A cloud-based rendering system employing raymarching and depth information to convert monoscopic rendered images into stereoscopic pairs, using a virtual view broadcaster that generates 360-degree stereoscopic images by tracing rays from points on a projection circle, allowing for perfect or near-perfect circular projection without stitching artifacts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional methods are used to generate stereoscopic 360-degree panoramas, then depth representation and stitching quality improve, but the complexity of the rendering system and computational cost increase significantly

Engineering Contradiction:
Improvedepth representation accuracyVSAvoidrendering system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system pre-renders a single monoscopic 360-degree panorama with an associated depth map before viewing. This preliminary rendering captures all necessary geometric and depth information in advance, eliminating the need for complex real-time multi-view rendering systems while preserving depth accuracy through subsequent raymarching operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces a depth map as an intermediary data structure that bridges the monoscopic rendered image and the final stereoscopic output. This depth map serves as a mediator that enables accurate depth representation and stereoscopic conversion without requiring complex multi-camera systems or real-time multi-view rendering infrastructure.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If multiple input images are used to create stereoscopic panoramas, then viewing quality from various directions improves, but the number of required images and processing time increase

Engineering Contradiction:
Improveviewing qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs all necessary rendering and depth calculation operations in advance, creating a complete monoscopic panorama with full depth information before the user views it. This eliminates real-time processing requirements while maintaining high viewing quality across all directions through the pre-computed depth map and raymarching technique.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If raymarching with depth buffers is employed to convert monoscopic images to stereoscopic pairs, then rendering efficiency improves, but the complexity of the conversion process increases

Engineering Contradiction:
Improverendering efficiencyVSAvoidconversion process complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system leverages the depth buffer information that is already generated during the monoscopic rendering process. Instead of requiring separate depth sensing hardware or additional complex processing systems, the rendering pipeline itself produces the depth data as a byproduct, which is then reused by the raymarching algorithm for stereoscopic conversion.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the generation of high-quality stereoscopic panoramas with accurate depth representation and minimal artifacts, reducing rendering costs and improving the virtual reality experience by processing monoscopic images in real-time.

Implementation Method 1

converting the set of rendered images into a stereoscopic pair of images employing depth information from the monoscopic set of rendered images and raymarching

Methodology Applied
Scientific EffectRaymarching:

Data Source

PatentUS10839591B2Stereoscopic rendering using raymarching and a virtual view broadcaster for such rendering
Publication Date: 2020.11.17 NVIDIA CORP
  • US10839591B2 patent drawing
  • US10839591B2 patent drawing
  • US10839591B2 patent drawing

AI summary

The disclosure provides a virtual view broadcaster, a cloud-based renderer, and a method of providing stereoscopic images. In one embodiment, the method includes (1) generating a monoscopic set of rendered images and (2) converting the set of rendered images into a stereoscopic pair of images employing depth information from the monoscopic set of rendered images and raymarching.