Dynamic Pixel Clustering for LIDAR Motion Blur Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional LIDAR systems face challenges in achieving high frame rates and reducing motion blur due to static photodetector arrays, which limit oversampling and averaging capabilities, especially with oscillating scanners and frequency-modulated continuous-wave light beams.

Innovation Solution

A dynamically reconfigurable photodetector array that forms pixels by clustering sub-pixels and sub-sub-pixels, allowing for adaptive activation and deactivation based on the scanning structure's position, enabling dynamic pixel formation and averaging during scanning operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a 2×1D Lissajous scanning approach is used, then coverage area is improved, but frame rate decreases to 10-25 Hz

Engineering Contradiction:
Improvecoverage areaVSAvoidframe rate
Core Design Contradiction:
Area of stationary objectVSProductivity

Solution Approach 1:

The photodetector array is divided into multiple independently controllable pixel clusters that can be selectively activated. This segmentation allows the system to process data from different spatial regions separately, enabling higher effective frame rates by processing multiple smaller regions in sequence rather than waiting to complete a full large-area scan cycle.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If averaging over several frames is performed, then signal-to-noise ratio is improved, but memory requirements increase

Engineering Contradiction:
Improvesignal-to-noise ratioVSAvoidmemory requirements
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The system performs preliminary averaging by accumulating photon counts within each pixel cluster during the scan cycle itself, rather than storing complete frames for post-processing averaging. This preliminary action reduces the memory burden by processing data incrementally as it arrives, maintaining high signal-to-noise ratios without requiring storage of multiple complete frames.

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If a static photodetector array is used, then device complexity is reduced, but adaptability to scanning motion decreases

Engineering Contradiction:
Improvephotodetector array structureVSAvoidadaptability to scanning motion
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The photodetector array implements dynamic pixel clustering where groups of photodetector elements can be selectively activated and deactivated based on the real-time position of the scanning laser. This dynamic configuration allows the sensor to adapt to the moving projection of the laser beam, maintaining measurement accuracy throughout the scan cycle without requiring a completely reconfigurable hardware architecture.

Inventive Principle:
Principle #15Dynamics

4Area of stationary object

If oscillating scanner is used, then scanning coverage is improved, but motion blur increases due to scanner movement during time-of-flight

Engineering Contradiction:
Improvescanning coverageVSAvoidmotion blur
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The system changes the temporal parameters of pixel activation to match the scanner's motion characteristics. By dynamically adjusting which pixel clusters are active at specific times during the scan cycle, the system compensates for scanner movement during the time-of-flight measurement period, effectively reducing motion blur while maintaining broad scanning coverage.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enhances LIDAR systems' ability to perform oversampling and averaging without motion blur, even with oscillating scanners, by dynamically adjusting pixel clustering to match the movement of the scanning structure, thereby improving data quality and reducing memory requirements.

Implementation Method 1

the time it takes for the reflections to arrive at various sensors in the photodetector array is determined. This is also referred to as measuring time-of-flight (ToF)

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 2

Single photodetectors or arrays of photodetectors receive reflections from objects illuminated by the light

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS12061290B2Beam steering aware pixel clustering of segmented sensor area and implementing averaging algorithms for pixel processing
Publication Date: 2024.08.13 INFINEON TECHNOLOGIES AG
  • US12061290B2 patent drawing
  • US12061290B2 patent drawing
  • US12061290B2 patent drawing

AI summary

A scanning system includes a scanning structure configured to rotate about at least one first scanning axis; a driver configured to drive the scanning structure about the at least one first scanning axis and detect a position of the scanning structure with respect to the at least one first scanning axis during movement of the scanning structure; a segmented pixel sensor including a plurality of sub-pixel elements arranged in a pixel area; and a controller configured to selectively activate and deactivate the plurality of sub-pixel elements into at least one active cluster and at least one deactivated cluster to form at least one active pixel from the at least one active cluster, receive first position information from the driver indicating the detected position of the scanning structure, and dynamically change a clustering of activated sub-pixel elements and a clustering of deactivated sub-pixel elements based on the first position information.