360 Degree 3D Stitching for Virtual Reality Headsets

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional cameras capture only two-dimensional images, limiting their field of view and inability to provide a 360° simulated 3D view.

Innovation Solution

A single-dimensional camera captures images over a 360° array by stitching multiple images taken at different angles while rotating around a fixed center point, using a cellular phone with a processor and memory to compile three-dimensional information and display a simulated 360° image on a virtual-reality headset.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a conventional camera is used to capture images, then the device complexity is low, but the field of view is limited and cannot provide a 360° simulated 3D view

Engineering Contradiction:
Improvefield of viewVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the 360° viewing experience into multiple discrete image captures taken at different angular positions. Instead of using a complex single-camera system, the solution segments the capture process into multiple simpler shots that are later stitched together computationally to form the complete 360° panorama.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from traditional 2D flat image capture to 360° spherical panorama capture by adding angular dimensionality. Multiple 2D images taken at different orientations are combined to create a immersive 360° viewing experience that encompasses all directions around the camera position.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If multiple images are stitched together to expand field of view, then the field of view is improved, but the image processing complexity increases

Engineering Contradiction:
Improvefield of viewVSAvoidimage processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary actions by capturing all necessary images at different angular positions before the stitching process. The camera systematically rotates through predetermined angles and captures images in advance, which are then processed and combined offline to create the final 360° panorama, separating capture from processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces computational algorithms as an intermediary between image capture and final display. These algorithms automatically detect features, match corresponding points across multiple images, and seamlessly stitch them together, reducing manual intervention and simplifying the overall process despite the complexity of combining multiple perspectives.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If a single-dimensional camera captures images at different angles, then the 360° view is achieved, but the depth perception information is insufficient

Engineering Contradiction:
Improve360° view capabilityVSAvoiddepth perception information
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent applies local quality by providing different information to each eye from various angular perspectives. The left and right images are specifically optimized for their respective eyes, with each receiving slightly different angular views that correspond to the natural positioning of human eyes, thereby creating realistic depth perception through stereoscopic visualization.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11290644B2Image system with 360 and 3-d stitching
Publication Date: 2022.03.29 UBIQUITY HOLDINGS INC
  • US11290644B2 patent drawing

AI summary

A 360° view of an area is obtained by stitching together multiple images each of the images obtained at a different point of view. One of the points of view or each one of the points of view receives different angled views of different features in the image. Each feature in the image is therefore imaged from multiple different angles. The images are stitched together into a three-dimensional panorama which is optimized for display on a display where one image is intended for users left eye and another image is intended for the users right eye. The left eye sees features of the image from one field of view, and the right eye sees features of that same image from a different field of view, where each field in the image is shown to the different eyes at different points of view. Therefore, the different eyes perceive different parts of the depth of the image. And that last part into the specification and maybe into the claims.