Focused Plenoptic Camera Microlens Design and Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional plenoptic cameras suffer from artifacts due to low angular resolution and inefficient rendering methods, resulting in final images with poor depth representation and resolution, as they patch together microimages from microlenses focused at infinity.

Innovation Solution

A focused plenoptic camera design where microlenses are focused on the photographed object rather than at infinity, combined with a rendering algorithm that adjusts magnification values for each microimage to match neighboring images, reducing artifacts and enhancing resolution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If microlenses are focused at infinity in a plenoptic camera, then angular resolution is improved, but manufacturing precision and alignment difficulty worsen

Engineering Contradiction:
Improveangular resolutionVSAvoidmicrolens alignment precision
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent changes the focal distance parameter of the microlenses from infinity to a finite distance (e.g., 1 meter or the specific object distance). This parameter change allows the microlenses to be focused on objects at specific distances rather than at infinity, which simplifies the optical design and reduces alignment complexity while maintaining adequate angular resolution for the application

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

Instead of focusing the microlenses at infinity (conventional approach) and accepting the resulting alignment difficulties, the patent inverts the approach by focusing them at a finite distance. This inversion resolves the manufacturing precision issue while still capturing sufficient angular information through the light field rendering process

Inventive Principle:
Principle #13The other way round (Inversion)

2Manufacturing precision

If microlenses are focused on the photographed object, then manufacturing precision is improved, but angular resolution worsens

Engineering Contradiction:
Improvemicrolens alignment precisionVSAvoidangular resolution
Core Design Contradiction:
Manufacturing precisionVSMeasurement precision

Solution Approach 1:

The patent introduces a computational rendering process as an intermediary between the optical capture and final image formation. This computational mediator reconstructs the scene by synthesizing views from multiple microlens perspectives, thereby compensating for the reduced angular resolution and recovering high-quality images with proper depth representation

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the focal distance parameter of the microlenses from infinity to a finite distance (e.g., 1 meter or the specific object distance). This parameter change allows the microlenses to be focused on objects at specific distances rather than at infinity, which simplifies the optical design and reduces alignment complexity while maintaining adequate angular resolution for the application

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If basic rendering methods are used with focused plenoptic cameras, then device complexity is reduced, but image quality worsens due to artifacts

Engineering Contradiction:
Improverendering algorithm complexityVSAvoidimage quality
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent applies parameter changes to the rendering process by adjusting magnification values for different regions of the image. Instead of using a uniform rendering approach, the system varies magnification parameters across different spatial locations to compensate for perspective distortions and artifacts, thereby improving image quality without significantly increasing device complexity

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent uses a multi-pass rendering approach where multiple copies of the microlens array data are processed with different magnification parameters. These multiple copies are then combined to produce the final artifact-reduced image, effectively using copying and composition to improve quality while keeping the base rendering algorithm relatively simple

Inventive Principle:
Principle #26Copying

4Device complexity

If uniform magnification is applied in rendering, then device complexity is reduced, but manufacturing precision of the final image worsens due to mismatched microimages

Engineering Contradiction:
Improverendering process complexityVSAvoidfinal image resolution
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent applies local quality by using different magnification values for different regions of the image rather than a uniform magnification factor. Each region is rendered with magnification parameters optimized for its specific spatial characteristics, which improves the overall precision and quality of the final image while managing complexity through localized adjustments

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution results in higher-resolution images with reduced artifacts, allowing for better depth representation and improved rendering quality, achieving resolutions comparable to modern photography standards.

Implementation Method 1

The main lens refracts light from an object located in front of the camera to form an image of the object at a focal plane of the main lens

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

Each microlens of the microlens array projects a separate portion of the image of the object formed at the focal plane on which the microlens is focused onto a separate location on the photosensor

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentUS9316840B2Methods and apparatus for reducing plenoptic camera artifacts
Publication Date: 2016.04.19 ADOBE INC
  • US9316840B2 patent drawing
  • US9316840B2 patent drawing
  • US9316840B2 patent drawing

AI summary

Methods and apparatus for reducing plenoptic camera artifacts. A first method is based on careful design of the optical system of the focused plenoptic camera to reduce artifacts that result in differences in depth in the microimages. A second method is computational; a focused plenoptic camera rendering algorithm is provided that corrects for artifacts resulting from differences in depth in the microimages. While both the artifact-reducing focused plenoptic camera design and the artifact-reducing rendering algorithm work by themselves to reduce artifacts, the two approaches may be combined.