Light-Field Camera with Uneven Angular Sampling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing plenoptic cameras capture four-dimensional light-field images with relatively low output resolution due to decreased spatial resolution for increased angular resolution, which is inadequate for many applications requiring high-resolution image and depth data.

Innovation Solution

The system captures light-field images with uneven and/or incomplete angular sampling using novel exit pupil shapes and microlens array configurations, such as high aspect ratio exit pupils and non-standard packing patterns, to increase spatial and output resolution, enhance depth data quality, and extend the refocusable range.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If plenoptic microlens array and single photosensor are used to capture four-dimensional light-field image, then angular resolution is increased, but spatial resolution is decreased significantly

Engineering Contradiction:
Improveangular resolutionVSAvoidspatial resolution
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent divides the light-field capture into multiple separate camera units, each capturing a portion of the light-field data. This segmentation allows each camera to maintain high spatial resolution while the collective system achieves comprehensive angular sampling, resolving the contradiction between spatial and angular resolution requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a single-camera four-dimensional light-field capture to a multi-camera array where the spatial arrangement of multiple cameras provides the angular dimension. This dimensional transformation allows each camera to operate at full spatial resolution while the array configuration achieves the required angular sampling.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If complete and even sampling in two angular dimensions is performed, then light-field data quality is improved, but output resolution and depth data quality are reduced

Engineering Contradiction:
Improveangular sampling completenessVSAvoidoutput resolution
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent applies uneven and incomplete angular sampling strategies where different regions of the light-field data are sampled at different resolutions. This local quality approach allocates higher sampling density to regions critical for depth perception while using lower sampling in regions less critical for the specific application, thereby maintaining output resolution while achieving sufficient angular sampling quality.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If spatial resolution is decreased to increase angular resolution, then four-dimensional light-field capture is enabled, but virtual view resolution becomes too low for widespread adoption

Engineering Contradiction:
Improvelight-field capture capabilityVSAvoidvirtual view resolution
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent merges multiple high-resolution camera captures into a unified light-field representation. By combining the data from multiple cameras, the system achieves both four-dimensional light-field capture capability and high virtual view resolution, as each camera contributes high-resolution spatial data that collectively provides comprehensive angular information.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach increases the output resolution and quality of depth data while maintaining or improving the refocusable range, allowing for higher angular sampling and improved image processing without the need for excessive pixel count or complex processing techniques.

Implementation Method 1

a plenoptic microlens array and a single photosensor, containing a two-dimensional (2D) array of pixels, are used

Methodology Applied
Scientific EffectLight focusing: Lens

Data Source

PatentUS10897608B2Capturing light-field images with uneven and/or incomplete angular sampling
Publication Date: 2021.01.19 GOOGLE LLC
  • US10897608B2 patent drawing
  • US10897608B2 patent drawing
  • US10897608B2 patent drawing

AI summary

A light-field camera may generate four-dimensional light-field data indicative of incoming light. The light-field camera may have an aperture configured to receive the incoming light, an image sensor, and a microlens array configured to redirect the incoming light at the image sensor. The image sensor may receive the incoming light and, based on the incoming light, generate the four-dimensional light-field data, which may have first and second spatial dimensions and first and second angular dimensions. The first angular dimension may have a first resolution higher than a second resolution of the second angular dimension.