Virtual Camera View Capture for VR Content Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for capturing virtual reality content from rendered environments are computationally intensive and often produce subpar content due to the need for stitching video streams captured by virtual cameras, which can introduce artifacts and lower content quality.

Innovation Solution

Instructing a graphics engine to position virtual cameras within the rendered environment based on a specified configuration to capture views that can be projected on a cube map, allowing the engine to generate virtual reality content directly, and outputting depth information for enhanced 3D 360-degree content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If video streams are captured by virtual cameras and stitched together to create virtual reality content, then virtual reality content can be generated from rendered environments, but the process becomes computationally intensive and introduces artifacts that lower content quality

Engineering Contradiction:
Improveability to generate virtual reality content from rendered environmentsVSAvoidcontent quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent extracts the view capture process from the traditional video streaming approach and integrates it directly into the rendering pipeline. Instead of capturing video streams separately and stitching them later, the system extracts and outputs the necessary view information directly from the rendering engine, eliminating the stitching process and its associated artifacts.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent merges the view capture function with the rendering process itself. By combining these operations, the system eliminates the need for separate video capture and stitching steps, reducing computational overhead and improving content quality by generating virtual reality content directly from the rendered environment.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If video streams are captured by virtual cameras and stitched together to create virtual reality content, then virtual reality content can be generated from rendered environments, but the computational cost increases

Engineering Contradiction:
Improveability to generate virtual reality content from rendered environmentsVSAvoidcomputational cost
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The patent extracts the view capture process from the traditional video streaming approach and integrates it directly into the rendering pipeline. Instead of capturing video streams separately and stitching them later, the system extracts and outputs the necessary view information directly from the rendering engine, eliminating the stitching process and its associated artifacts.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent merges the view capture function with the rendering process itself. By combining these operations, the system eliminates the need for separate video capture and stitching steps, reducing computational overhead and improving content quality by generating virtual reality content directly from the rendered environment.

Inventive Principle:
Principle #5Merging (Combining)

3Ease of manufacture

If conventional video capture methods are used, then content can be captured from rendered environments, but artifacts are introduced and content quality deteriorates

Engineering Contradiction:
Improveability to capture contentVSAvoidcontent quality
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent extracts the view capture process from the traditional video streaming approach and integrates it directly into the rendering pipeline. Instead of capturing video streams separately and stitching them later, the system extracts and outputs the necessary view information directly from the rendering engine, eliminating the stitching process and its associated artifacts.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses the rendering engine's existing capability to generate views and directly copies this output for virtual reality content creation. This approach leverages the high-quality rendering already performed, avoiding the need for separate video capture and processing steps that would degrade quality.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11386607B1Systems and methods for capturing content
Publication Date: 2022.07.12 META PLATFORMS INC
  • US11386607B1 patent drawing
  • US11386607B1 patent drawing
  • US11386607B1 patent drawing

AI summary

Systems, methods, and non-transitory computer-readable media can obtain information describing a set of views corresponding to a rendered environment, the views being captured based on a specified virtual camera configuration; determine at least one representation in which information describing the set of views is formatted; and output virtual reality content based at least in part on the at least one representation.