Light-Field Camera 3D Image Synthesis via Micro-Lens Array

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for generating 3D images using multiple cameras require precise calibration and complex algorithms, leading to high costs and long calculation times due to differences in camera parameters and potential image focus issues.

Innovation Solution

A light-field camera system with a main lens, micro-lens array, and image processing module that forms micro-images corresponding to different viewing angles, allowing for the generation of 3D images by obtaining pixel values from specific image zones and combining them to create camera images, reducing the need for complex processing algorithms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple cameras are used to obtain parallax images for 3D image generation, then the 3D image can be synthesized, but the costs and calculation times increase due to parameter calibration and complex image processing algorithms

Engineering Contradiction:
Improve3D image synthesis capabilityVSAvoidcamera system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the light field into multiple micro-images through a micro-lens array, where each microlens captures light from a specific angular range. This segmentation allows the single camera to function equivalently to multiple cameras, obtaining parallax information without requiring actual multiple camera devices, thus reducing device complexity while maintaining 3D synthesis capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a micro-lens array as an intermediary component between the main lens and the light sensing component. This intermediary structure enables the single camera to capture multi-angular light field information by forming multiple micro-images, effectively acting as a mediator that provides parallax data without requiring multiple cameras, thereby simplifying the overall system

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If delicate cameras and complex image processing algorithms are used for calibration, then parameter precision is improved, but costs and calculation times increase

Engineering Contradiction:
Improveparameter calibration precisionVSAvoidcalculation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The light-field camera performs self-calibration through its inherent micro-lens array structure. Each microlens naturally captures light from a specific angular range, and the geometric relationship between microlenses and image zones is predetermined by the optical design. This self-service mechanism eliminates the need for external calibration equipment and complex calibration algorithms, reducing both costs and calculation time while maintaining precision

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent changes the approach from calibrating camera parameters to directly utilizing the fixed geometric parameters of the micro-lens array. By treating the micro-lens array's structural parameters (positions, focal lengths) as known constants built into the system design, the method avoids time-consuming calibration processes while maintaining measurement precision through the deterministic optical geometry

Inventive Principle:
Principle #35Parameter changes

3Reliability

If conventional multi-camera methods are used, then parallax images can be obtained, but image focus precision deteriorates due to parameter differences between cameras

Engineering Contradiction:
Improveparallax image acquisitionVSAvoidimage focus precision
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent merges multiple camera functions into a single light-field camera by combining the main lens with a micro-lens array. All micro-images are captured by the same light sensing component with identical optical parameters, ensuring consistent focus across all angular views. This merging eliminates the focus inconsistency problem inherent in multi-camera systems while maintaining the ability to obtain parallax images

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces costs and calculation time while providing efficient generation of 3D images by using a single light-field camera, enabling quick and focused 3D image synthesis without the need for complex algorithms, resulting in a cost-effective and efficient method for generating 3D images at various viewing angles.

Implementation Method 1

a main lens for collecting light field information from a scene

Methodology Applied
Scientific EffectLight refraction: Refraction

Implementation Method 2

a micro-lens array that includes a plurality of microlenses... forming, using the micro-lens array, a plurality of adjacent micro-images at different positions

Methodology Applied
Scientific EffectLight refraction and focusing: Refraction

Implementation Method 3

a light sensing component... obtaining an image pixel value from an ith image zone of each of the micro-images

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS9581787B2Method of using a light-field camera to generate a three-dimensional image, and light field camera implementing the method
Publication Date: 2017.02.28 LITE ON TECH CORP
  • US9581787B2 patent drawing
  • US9581787B2 patent drawing
  • US9581787B2 patent drawing

AI summary

A method is provided to generate a 3D image using a light-field camera that includes a main lens, a micro-lens array, a light sensing component, and an image processing module. The micro-lens array forms a plurality of adjacent micro-images at different positions of the light sensing component. Each micro-image includes multiple image zones corresponding to different viewing angles. For each micro-image, the image processing module obtains image pixel values from the image zones, so as to generate camera images corresponding to different viewing angles. The image processing module combines the camera images to generate the 3D image.