VR Stitching Error Correction via Cloud Feedback Loop

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Virtual reality content generation faces challenges due to stitching errors when combining feeds from multiple cameras, leading to excessive data processing and suboptimal viewing experiences.

Innovation Solution

A cloud-based method that receives and corrects initial virtual reality video renders by identifying stitching errors, allowing users to edit and transmit corrections, which are then used to generate error-free virtual reality content for viewing devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a larger number of cameras are used to reduce stitching errors, then manufacturing precision is improved, but device complexity and data processing requirements increase

Engineering Contradiction:
Improvestitching error reductionVSAvoidcamera array complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary stitching to generate an initial virtual reality render, then identifies stitching errors in that render, and finally generates correction data to fix the errors. This preliminary action approach allows the system to work with fewer cameras while achieving high precision through iterative correction rather than relying solely on increased camera quantity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements a feedback loop where stitching errors are identified in the initial render, correction data is generated based on these identified errors, and the corrections are applied to produce the final virtual reality content. This feedback mechanism enables continuous improvement of stitching accuracy without requiring additional cameras.

Inventive Principle:
Principle #23Feedback

2Manufacturing precision

If a larger number of cameras are used to reduce stitching errors, then manufacturing precision is improved, but productivity decreases due to excessive data processing

Engineering Contradiction:
Improvestitching error reductionVSAvoiddata processing efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system extracts only the necessary correction data from the initial virtual reality render rather than processing all camera feeds simultaneously. By identifying specific stitching errors and generating corrections only for those areas, the system significantly reduces data processing requirements while maintaining high stitching precision.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The stitching correction process is segmented into distinct steps: initial stitching, error identification, correction data generation, and final rendering. This segmentation allows the system to process data in manageable portions rather than handling all camera feeds at once, improving productivity while achieving high precision results.

Inventive Principle:
Principle #1Segmentation

3Manufacturing precision

If manual correction tools are provided to users, then manufacturing precision is improved through error correction, but ease of operation decreases

Engineering Contradiction:
Improvestitching error correctionVSAvoiduser editing complexity
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system automatically performs stitching error identification and correction data generation without requiring manual user intervention. The automated error identification and correction processes maintain high manufacturing precision while preserving ease of operation, as users simply need to provide feedback on the automated corrections rather than manually edit complex stitching parameters.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Users provide feedback on the automated stitching corrections, and this feedback is used to refine the correction process. This feedback loop maintains high precision while keeping the system easy to operate, as users only need to review and provide simple feedback rather than perform complex manual corrections.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11348202B2Generating virtual reality content based on corrections to stitching errors
Publication Date: 2022.05.31 VERIZON PATENT & LICENSING INC
  • US11348202B2 patent drawing
  • US11348202B2 patent drawing
  • US11348202B2 patent drawing

AI summary

Illustrative methods and systems for generating virtual reality content based on corrections to stitching errors are described. An illustrative computer-implemented method includes receiving raw virtual reality video data representing images recorded by camera modules of a camera array, using a stitching algorithm to stitch the images together to generate an initial virtual reality render, determining that the initial virtual reality render has a stitching error, determining a correction for the stitching error, and modifying the stitching algorithm based on the correction for the stitching error. The modified stitching algorithm may be used to generate a corrected virtual reality render that corrects the stitching error.