Plenoptic Lens Depth Map for Vehicle Obstacle Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging systems with fixed focal lengths struggle to maintain image detail for objects at varying distances from the vehicle, leading to blurry images of objects closer to the vehicle, which hampers gesture recognition and obstacle detection.

Innovation Solution

A digital imaging system employing a plenoptic lens system with a main lens and an intermediate microlens array, capable of focusing light from multiple depths of field and projecting intermediary images onto an image sensor assembly, allowing for the creation of a three-dimensional depth map and detection of gestures and obstacles based on distance information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a main lens with fixed focal length is used for focusing on objects at a set distance, then the imaging system can capture objects at that specific distance, but objects closer to the vehicle remain out of focus or lose detail

Engineering Contradiction:
Improveimage detailVSAvoiddepth of field coverage
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The imaging system divides the field of view into multiple depth zones using a main lens array, where each main lens focuses on a specific depth range. This segmentation allows different portions of the scene at different distances to be captured with appropriate focus, resolving the contradiction between maintaining image detail and covering multiple depths of field.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A microlens array is introduced as an intermediary component between the main lens array and the image sensor. Each microlens corresponds to a main lens and captures light from multiple angles, enabling the system to reconstruct both high-resolution 2D images and 3D depth information. This intermediary structure allows the system to maintain image detail while adapting to multiple depths of field.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If a fixed focal length lens is used, then the imaging system structure remains simple, but it cannot provide accurate depth information for objects at varying distances

Engineering Contradiction:
Improvedistance measurement accuracyVSAvoidlens system structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system transitions from conventional 2D imaging to 4D light field imaging by adding angular information capture through the microlens array. This dimensional expansion enables accurate depth measurement for objects at varying distances while maintaining a relatively compact lens structure, as the additional information is obtained optically rather than through complex mechanical adjustments.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides enhanced image resolution and accurate detection of gestures and obstacles by focusing light from multiple depths of field, enabling improved vehicle safety features such as collision avoidance and gesture recognition.

Implementation Method 1

a main lens configured to focus light from a field of view for a plurality of depths of field and project a plurality of intermediary images

Methodology Applied
Scientific EffectLight focusing: Lens

Implementation Method 2

an intermediate microlens array disposed between the main lens and the image sensor assembly... for focusing the plurality of intermediary images from the main lens onto the image sensor assembly. Each of the plurality of intermediate micro lenses projects the plurality of intermediary images onto the image sensor assembly from a different perspective

Methodology Applied
Scientific EffectLight focusing: Lens

Data Source

PatentUS11418695B2Digital imaging system including plenoptic optical device and image data processing method for vehicle obstacle and gesture detection
Publication Date: 2022.08.16 MAGNA CLOSURES INC
  • US11418695B2 patent drawing
  • US11418695B2 patent drawing
  • US11418695B2 patent drawing

AI summary

A digital imaging system and method of image data processing are provided. The system includes a main lens configured to focus light from a field of view for a plurality of depths of field and project a plurality of intermediary images representing the depths of field. An image sensor assembly is in a spaced relationship with the main lens and includes a light sensors grouped into sensor sub-arrays. An intermediate microlens array is disposed between the main lens and the image sensor assembly and includes intermediate micro lenses adjacent to and abutting one another to focus the intermediary images onto one of the sensor sub-arrays from a different perspective than another adjacent micro lens. A control unit captures and stores image data associated with the intermediary images and creates a three-dimensional depth map. The control unit also calculates distance information of objects to detect a gesture or obstacle.