Inward-Facing 3D Camera Array for VR Depth Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing camera arrangements for capturing environments in virtual reality applications face challenges such as occlusion of features, limited image quality, and difficulty in deriving depth data, especially when trying to capture a complete environment from multiple viewpoints or poses, which can result in incomplete or low-quality 3D images.

Innovation Solution

A three-dimensional camera array is arranged on a frame with cameras facing inward to capture images of the surrounding environment, allowing for greater overlap between fields of view and enabling image processing to remove occlusions and fill in gaps, using a polyhedral structure like a dodecahedron to minimize internal obstructions and maximize captured data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If cameras are arranged to face outwards from a compressed volume, then images can be captured for a range of angles at a given position, but depth data derivation becomes difficult and the internal volume is not visible to any cameras

Engineering Contradiction:
Improveangular coverageVSAvoiddepth data derivation
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent inverts the conventional camera arrangement by having cameras face inwards toward the center of the volume rather than outwards. This inversion allows the internal volume to be visible to cameras while maintaining angular coverage, and enables better depth data derivation through the compressed camera arrangement.

Inventive Principle:
Principle #13The other way round (Inversion)

2Reliability

If multiple stationary cameras are used to capture the entire environment, then complete environmental capture is achieved, but device complexity and cost increase

Engineering Contradiction:
Improveenvironmental capture completenessVSAvoidcamera system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges multiple cameras into a single compressed volume arrangement where cameras face inwards toward the center. This consolidation achieves complete environmental capture while reducing device complexity compared to using multiple stationary cameras positioned throughout the environment.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If cameras are repositioned or reoriented to capture multiple images, then complete environment capture is achieved, but time consumption increases

Engineering Contradiction:
Improveenvironmental capture completenessVSAvoidimage capture time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent employs a pre-configured compressed camera arrangement where all cameras are positioned and oriented before capture begins. This preliminary arrangement enables simultaneous capture of multiple images from different angles in a single operation, eliminating the need for time-consuming repositioning or reorientation during the capture process.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3341682B1Image capture apparatus
Publication Date: 2021.12.29 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP3341682B1 patent drawingFigure 1
  • EP3341682B1 patent drawingFigure 2
  • EP3341682B1 patent drawingFigure 3

AI summary

An image capture apparatus suitable for capturing images for use in generating a virtual reality environment, the apparatus comprising a three-dimensional frame that defines an internal volume and a plurality of cameras arranged on the frame so as to form a three-dimensional array, wherein the cameras are arranged to face inwards towards a part of the internal volume and are arranged to capture images of a scene located outside the internal volume, the images also comprising at least a portion of the internal volume.