Multi-Camera Array With Folded Prism Apex

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing array cameras suffer from quality degradation due to parallax and tilt artifacts, which prevent seamless stitching of images captured by multiple cameras into a single image without artifacts, leading to issues like 'double image' ghosting and discontinuous features.

Innovation Solution

The use of a central mirror or prism with multiple facets to split incoming light into multiple portions, aligned such that each camera's optical axis intersects at a common apex, ensuring that each camera captures a portion of the image without parallax and tilt artifacts, allowing for seamless merging of views into a single image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple cameras are arranged in an array to capture images from different angles, then the field of view and resolution are improved, but parallax and tilt artifacts occur causing image quality degradation

Engineering Contradiction:
Improveimage resolutionVSAvoidparallax and tilt artifacts
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The image capture system is segmented into multiple independent camera units, each capturing a portion of the overall scene. The reflecting component is also segmented into multiple facets, with each facet directing light to a specific camera. This segmentation allows the system to achieve a wider field of view and higher resolution while managing parallax effects through proper geometric configuration.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs an asymmetric arrangement where camera positions and orientations are specifically designed relative to the reflecting component's apex. Each camera is positioned at a unique angle and distance, creating an asymmetric configuration that, when properly calculated, eliminates parallax and tilt artifacts while maintaining improved image resolution across the stitched panorama.

Inventive Principle:
Principle #4Asymmetry

2Area of stationary object

If images from multiple cameras are stitched together to create a panoramic view, then the field of view is expanded, but seamless stitching is prevented by parallax and tilt artifacts

Engineering Contradiction:
Improvefield of viewVSAvoidimage alignment consistency
Core Design Contradiction:
Area of stationary objectVSStability of the object's composition

Solution Approach 1:

The patent creates an equipotential configuration by positioning all camera optical axes to intersect at the reflecting component's apex. This geometric arrangement ensures that all cameras share a common reference point, making the image composition stable and consistent across different viewing angles. The apex serves as a virtual center of rotation, allowing seamless stitching without parallax or tilt artifacts.

Inventive Principle:
Principle #12Equipotentiality

Solution Approach 2:

The reflecting component with its apex serves as an intermediary element that mediates between the multiple cameras and the final stitched image. By directing light from the scene through the reflecting facets to each camera, it creates a geometric relationship where all views are referenced to the same apex point, enabling seamless stitching while expanding the field of view.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Length of stationary object

If the camera array is positioned closer to the scene to reduce device profile, then the device becomes more compact, but optical zoom capability and space for complex optics are reduced

Engineering Contradiction:
Improvedevice thicknessVSAvoidfocal length
Core Design Contradiction:
Length of stationary objectVSLength of moving object

Solution Approach 1:

The patent transitions from a traditional linear optical path to a three-dimensional folded optical path using reflecting components. Light travels from the scene to the reflecting facets, then bounces to the cameras positioned on a flat substrate. This dimensional change allows the optical path to fold back on itself, enabling long effective focal lengths while maintaining a compact device thickness.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The optical system is nested within a folded structure where the light path is contained within the device thickness. The reflecting components and camera array are arranged in a nested configuration that allows the optical path to effectively extend beyond the physical device boundaries, achieving long focal lengths in a thin profile.

Inventive Principle:
Principle #7Nested doll (Nesting)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration enables the creation of low-profile image capture devices with improved image quality, free from parallax and tilt artifacts, allowing for seamless stitching and enhanced resolution without ghosting or discontinuous features.

Implementation Method 1

a reflecting component including a plurality of primary light redirecting surfaces, the reflecting component comprising an apex at a location of an intersection of planes formed by each of the plurality of primary light redirecting surfaces

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP3158395B1Multi-camera system using folded optics free from parallax and tilt artifacts
Publication Date: 2020.06.17 QUALCOMM INC
  • EP3158395B1 patent drawingFigure 1A
  • EP3158395B1 patent drawingFigure 1B
  • EP3158395B1 patent drawingFigure 2

AI summary

Aspects relate to an array camera exhibiting little or no parallax artifacts in captured images. For example, the planes of the central mirror prism of the array camera can intersect at an apex defining the vertical axis of symmetry of the system. The apex can serve as a point of intersection for the optical axes of the sensors in the array. Each sensor in the array "sees" a portion of the image scene using a corresponding facet of the central mirror prism, and accordingly each individual sensor/mirror pair represents only a sub-aperture of the total array camera. The complete array camera has a synthetic aperture generated based on the sum of all individual aperture rays.