Stereoscopic Panoramic Rendering via Cubemap Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies face challenges in rendering high-quality stereoscopic panoramic images, particularly in achieving full panoramic coverage without artifacts and ensuring real-time performance, as existing methods often result in distortions, swirl artifacts, and inefficient computational processes.

Innovation Solution

The approach involves using a cubemap to enable graphics pipeline interpolations on plane surfaces instead of a spherical surface, calculating normalized device coordinates for each vertex, and employing a panoramic shader to convert the cubemap to an equirectangular projection, while also tessellating polygons to minimize interpolation differences between the left and right eye views.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If spherical panorama rendering is used to achieve full 360° coverage, then panoramic coverage is improved, but image quality deteriorates due to swirl artifacts and distortions

Engineering Contradiction:
Improvepanoramic coverageVSAvoidimage quality
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The spherical panorama rendering is segmented into multiple planar cubemap faces (front, back, left, right, top, bottom). Each face is rendered separately on a flat plane rather than attempting to map directly to a sphere, which eliminates the swirl artifacts that occur when interpolating across curved spherical surfaces. The segmented planar renders are then assembled to form the complete panoramic view.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The invention transitions from rendering directly on a spherical surface to rendering on planar surfaces (cubemap faces). This dimensional change from curved to flat surfaces allows standard graphics pipeline interpolations to work correctly without introducing distortion, while still achieving full panoramic coverage through the cubemap projection method.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Area of stationary object

If traditional spherical rendering methods are used, then panoramic coverage is achieved, but computational efficiency deteriorates

Engineering Contradiction:
Improvepanoramic coverageVSAvoidrendering speed
Core Design Contradiction:
Area of stationary objectVSProductivity

Solution Approach 1:

By segmenting the spherical rendering into discrete planar cubemap faces, the graphics pipeline can process each face independently using efficient planar interpolation algorithms. This segmentation allows parallel processing and avoids the computationally expensive spherical coordinate transformations required by traditional methods, significantly improving rendering speed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The invention replaces the mechanical spherical coordinate system with a planar cubemap coordinate system. This substitution allows the use of standard graphics hardware acceleration and linear interpolation techniques instead of complex spherical mathematics, dramatically improving computational efficiency and real-time rendering performance.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If stereoscopic rendering is implemented for 3D effect, then depth perception is improved, but computational complexity increases

Engineering Contradiction:
Improvedepth perception qualityVSAvoidrendering system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The invention merges the cubemap rendering approach with stereoscopic rendering by generating separate cubemaps for the left and right eyes. Each cubemap is rendered independently using the efficient planar method, and then both are combined and displayed simultaneously in a stereoscopic format. This integration maintains depth perception quality while avoiding the complexity of traditional stereoscopic spherical rendering.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10628990B2Real-time system and method for rendering stereoscopic panoramic images
Publication Date: 2020.04.21 INTEL CORP
  • US10628990B2 patent drawing
  • US10628990B2 patent drawing
  • US10628990B2 patent drawing

AI summary

A system and method for rendering stereoscopic panoramas. For example in one embodiment, vertices of geometric primitives are generated for a panoramic image. Vertices of geometric primitives are stored in a 3-D coordinate system. A vertex processor determines a final location, equivalent to latitude and longitude coordinates, for each of the vertices in a panoramic image. A rendering engine renders the panoramic image in accordance with the final location of each of the vertices.