Event-Based Camera for Surveying in Low Light

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional surveying apparatuses face challenges with image quality impairment due to high dynamic range and motion blur in weakly illuminated environments, leading to inaccurate visual odometry and target identification, especially in tunnels and buildings, and struggle with rapidly moving targets and extraneous light sources.

Innovation Solution

The implementation of an event-based camera with a dynamic vision sensor that detects changes in light intensity as events, allowing for improved target identification and tracking by differentiating target radiation from ambient radiation and enabling precise distance and orientation determination, even in challenging lighting conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a standard camera is used for visual odometry and target identification, then the apparatus can operate in various lighting conditions, but image quality is greatly impaired by high dynamic range and motion blur in weakly illuminated environments

Engineering Contradiction:
Improvetarget identification accuracyVSAvoidlighting condition sensitivity
Core Design Contradiction:
ReliabilityVSIllumination intensity

Solution Approach 1:

The patent changes the fundamental operating parameter of the camera from continuous frame-based capture to event-based capture triggered by temporal changes in light intensity. This allows the system to operate independently of absolute illumination levels and respond only to changes, thereby resolving the contradiction between reliability in target identification and sensitivity to lighting conditions.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The event-based camera dynamically adjusts its capture behavior based on scene changes rather than operating at a fixed frame rate. This dynamic adaptation allows the system to maintain high temporal resolution during rapid changes while consuming less energy during stable conditions, improving both target identification reliability and robustness to varying illumination.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If a standard camera operates in weakly illuminated environments, then it can capture images, but motion blur and high dynamic range effects greatly impair image quality

Engineering Contradiction:
Improveposition determination accuracyVSAvoidmotion blur and high dynamic range
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The event-based camera employs periodic sampling triggered by temporal changes rather than continuous capture. Each pixel independently monitors for intensity changes and triggers capture events only when thresholds are exceeded, effectively eliminating motion blur while maintaining precision in position determination during dynamic scenes.

Inventive Principle:
Principle #19Periodic action

3Measurement precision

If an event-based camera is used to detect changes in light intensity, then target identification and tracking accuracy is improved, but the system must process event data from all pixels

Engineering Contradiction:
Improvetarget positioning accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the relevant information from the event stream by filtering for events that correspond to target characteristics. Instead of processing all pixel events uniformly, the system identifies and processes only those events that contribute to target identification and tracking, thereby reducing data processing complexity while maintaining high measurement precision.

Inventive Principle:
Principle #2Taking out (Extraction)

4Reliability

If conventional cameras are used for surveying, then they can record images, but they consume excessive power and generate large amounts of data

Engineering Contradiction:
Improvesurveying accuracyVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The event-based camera performs partial action by capturing only the necessary information - temporal changes in light intensity - rather than recording complete frames continuously. This selective capture maintains surveying accuracy by focusing on relevant changes while dramatically reducing power consumption and data generation compared to conventional continuous capture.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enhances the accuracy of target positioning and tracking, reduces data processing demands, and improves robustness against extraneous light influences, enabling reliable operation in difficult environments with high temporal resolution and reduced power consumption.

Implementation Method 1

a camera (2) comprising a position-sensitive pixel array sensor (5) for receiving and for detecting optical target radiation (4) retroreflected or emitted by the target (3), wherein a direction to the target is determinable on the basis of an ascertained position of the detected target radiation on the pixel array

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS12025439B2Surveying apparatus comprising event-based camera
Publication Date: 2024.07.02 LEICA GEOSYSTEMS AG
  • US12025439B2 patent drawing
  • US12025439B2 patent drawing
  • US12025439B2 patent drawing

AI summary

Surveying apparatus comprising an event-based camera comprising a dynamic vision sensor. The events detected by the camera are used, by means of target radiation, to determine a direction to a target to be surveyed or to determine camera poses of the camera in the context of visual odometry or determining the location of the surveying apparatus