Aerial Camera Registration via Reference Sensor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The registration of images captured from aerial vehicles with different light spectra is challenging due to variations in texture and illumination values, making it difficult to align and combine images effectively.

Innovation Solution

An aerial imaging system with a camera system mounted on an aerial vehicle, comprising a reference image sensor and multiple fixed wavelength sensors, capable of capturing images across various wavelength ranges, including visible and near-infrared spectra, which outputs multilayer and single-layer images for registration, allowing for precise alignment and combination of images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple image sensors capture images at different wavelength ranges, then spectral information coverage is improved, but image registration difficulty increases due to variations in texture and illumination values

Engineering Contradiction:
Improvespectral information coverageVSAvoidimage registration difficulty
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

A reference image captured at a first wavelength range serves as an intermediary mediator to facilitate the registration of images at different wavelength ranges. The reference image provides a common spatial framework that enables accurate alignment between images captured at different spectral bands, resolving the registration difficulty while preserving spectral information coverage

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If images at different wavelength ranges are captured, then plant health analysis capability is improved, but image alignment and combination complexity increases

Engineering Contradiction:
Improveplant health analysis capabilityVSAvoidimage alignment and combination complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary action by capturing a reference image at a first wavelength range before capturing images at other wavelength ranges. This reference image is used to pre-establish the spatial registration framework, simplifying subsequent image alignment and combination operations while enabling comprehensive plant health analysis across multiple spectral bands

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate registration of images from different light spectra, improving the analysis of agricultural fields by providing detailed information on plant health, chlorophyll concentration, and other parameters, while simplifying the image processing and alignment process.

Implementation Method 1

The plurality of image sensors are each configured to capture photographic images including light at different wavelength ranges

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11127165B1Registration of single channel image sensors
Publication Date: 2021.09.21 DEERE & CO
  • US11127165B1 patent drawing
  • US11127165B1 patent drawing
  • US11127165B1 patent drawing

AI summary

An aerial imaging system is disclosed. The aerial imaging system includes an aerial vehicle; a camera system mounted on the aerial vehicle; and an image storage medium. The camera system includes a lens and a plurality of image sensors. The plurality of image sensors includes a reference image sensor and a plurality of fixed wavelength sensors. The reference image sensor is configured to capture images including light at a plurality of wavelength ranges and to output a multilayer image. The plurality of fixed wavelength sensors are each configured to capture images including light at a selected wavelength range and to each output a single layer image. The image storage medium is configured to store the multilayer image and the plurality of single layer images.