Spherical Depth Camera Sub-Assemblies for 360-Degree VR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality systems face challenges in capturing high-quality 360-degree images and depth maps due to the configuration of cameras, which affects the realism and seamlessness of the reconstructed virtual environment.

Innovation Solution

A camera system comprising a plurality of depth camera sub-assemblies arranged in a spherical configuration around a center point, with projectors emitting structured light patterns and cameras capturing images to generate 360-degree depth maps, allowing for the creation of 3D 360-degree content for virtual reality applications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a conventional camera configuration is used, then the device complexity is low, but the measurement precision of depth maps and image quality are insufficient

Engineering Contradiction:
Improvedepth map qualityVSAvoidcamera system configuration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The camera system is divided into multiple depth camera sub-assemblies, each independently capturing depth information from specific directions. Each sub-assembly projects structured light patterns and captures images, with the controller integrating data from all sub-assemblies to construct a comprehensive 360-degree depth map, thereby improving measurement precision through distributed sensing

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from conventional 2D image capture to 360-degree three-dimensional depth mapping by arranging cameras and projectors in a spherical configuration. This spatial dimensionality change enables comprehensive environmental reconstruction with accurate depth information from all directions simultaneously

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple depth camera sub-assemblies are arranged in spherical configuration, then 360-degree depth map quality is improved, but the device complexity increases

Engineering Contradiction:
Improve360 degree depth map accuracyVSAvoidspherical camera arrangement
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Multiple depth camera sub-assemblies are merged into a unified spherical system where each sub-assembly projects structured light patterns and captures images. The controller integrates depth information from all sub-assemblies to construct a single comprehensive 360-degree depth map, combining individual contributions into a cohesive whole

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

Each depth camera sub-assembly serves multiple functions: projecting structured light patterns, capturing images, and contributing to both depth map construction and plain image capture. This multi-functionality reduces the need for separate specialized components while maintaining system capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enables the capture of high-quality 360-degree images and depth maps, enhancing the realism and immersion of virtual reality experiences by providing accurate depth information and seamless reconstruction of virtual environments.

Implementation Method 1

Each projector faces away from the center point and is configured to project a structured light pattern over a field of view of the local area

Methodology Applied
Scientific EffectStructured light projection: Light

Implementation Method 2

The one or more cameras of each depth camera sub-assembly are positioned facing away from the center point, and are configured to capture images of at least a portion of the structured light pattern projected by the projector of the depth camera sub-assembly

Methodology Applied
Scientific EffectOptical detection: Photography

Data Source

PatentUS10440349B23-D 360 degrees depth projector
Publication Date: 2019.10.08 META PLATFORMS TECHNOLOGIES LLC
  • US10440349B2 patent drawing
  • US10440349B2 patent drawing
  • US10440349B2 patent drawing

AI summary

A camera system configured to generate depth information for a local area. The camera system comprises a plurality of depth camera sub-assemblies arranged in a substantially spherical arrangement. Each sub-assembly comprises a projector that projects a structured light pattern onto a portion of the local area, such that the projected light patterns of the plurality of sub-assemblies form a tiled light pattern covering 360 degrees of the local area. Each sub-assembly further comprises at least one camera is configured to capture images of the local area. A controller of the camera system is configured to receive the captured images and to construct a 360 degree depth map of the scene, based upon the structured light patterns projected by the projectors of the plurality captured in the received images.