Light Field Camera Microlens Array Virtual Aperture Design

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies face challenges in generating high-quality three-dimensional (3D) images from light field data, as they often require complex processing and specialized equipment, and struggle to provide a seamless 3D viewing experience with varying perspectives and depth of field.

Innovation Solution

The development of a light field acquisition device and processing circuitry that captures light field data using a microlens array and photosensor array, allowing for the generation of 3D images by simulating multiple virtual apertures and perspectives, enabling 3D encoding and rendering techniques such as stereo disparity and extended depth of field.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If multiple cameras are used to capture different perspectives for 3D imaging, then the quality and realism of the 3D image is improved, but the device complexity and cost increase

Engineering Contradiction:
Improve3D image qualityVSAvoidnumber of cameras
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the light capture function by using a microlens array where each microlens captures light from a specific direction. This allows a single camera to function as multiple virtual cameras, each capturing a different perspective, thereby achieving high-quality 3D imaging without needing multiple physical cameras.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a directional dimension to light capture by arranging microlenses in specific patterns (e.g., hexagonal, rectangular) that correspond to different viewing angles. This dimensional approach to organizing light capture enables the system to simulate multiple perspectives from a single device, resolving the contradiction between image quality and device complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Manufacturing precision

If complex processing is applied to generate 3D images from light field data, then the depth of field and perspective control are improved, but the processing time and computational resources increase

Engineering Contradiction:
Improvedepth of field controlVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary action by capturing all necessary light field data in a single exposure through the microlens array. All directional information and perspective data are recorded simultaneously during image capture, rather than requiring complex post-processing to synthesize these elements, thereby reducing processing time while maintaining depth of field control.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex mechanical multi-camera systems with an optical solution using a microlens array. This substitution allows the system to capture multiple perspectives optically during a single exposure, eliminating the need for complex temporal and computational processing to achieve the same result.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If a single camera is used to capture light field data, then the device complexity is reduced, but the ability to capture multiple perspectives simultaneously is limited

Engineering Contradiction:
Improvenumber of camerasVSAvoidperspective capture capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent makes a single camera universal by equipping it with a microlens array that enables it to perform the function of multiple cameras. Each microlens in the array captures light from a different direction, allowing the single device to simultaneously capture multiple perspectives, thereby achieving multi-functionality without increasing the number of camera units.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the creation of high-quality 3D images with adjustable depth of field and perspective, providing a more immersive viewing experience while reducing the need for multiple cameras and complex processing, and allowing for real-time 3D video capture and rendering.

Implementation Method 1

a microlens array and photosensor array to capture light field data

Methodology Applied
Scientific EffectOptical focusing: Lens

Data Source

PatentUS8749620B13D light field cameras, images and files, and methods of using, operating, processing and viewing same
Publication Date: 2014.06.10 GOOGLE LLC
  • US8749620B1 patent drawing
  • US8749620B1 patent drawing
  • US8749620B1 patent drawing

AI summary

A 3D stereo image of a scene is generated by generating first image data of the scene using light field data representing light rays from a first direction, and second image data of the scene using light field data representing light rays from a second direction. The 3D stereo image of the scene is then generated using the first image data and the second image data. A microlens array may be used to direct light rays onto a photosensor array, wherein each microlens of the microlens array includes a physical aperture which correlates to a plurality of associated photosensors, a first virtual aperture which correlates to a first subset of the associated photosensors, and a second virtual aperture which correlates to a second subset of the associated photosensors. Each virtual aperture thus provides light rays from a different direction for use in generating the 3D stereo image.