Epipolar Image Processing for Satellite Depth Separation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing satellite imaging systems face challenges in distinguishing between ice, snow, and clouds due to similar reflectance and brightness temperatures, and adding infrared sensors or LiDAR devices increases cost and weight, necessitating a method to differentiate positions in depth without additional hardware.
Innovation Solution
An image processing system that acquires and aligns image data from multiple line sensors with different line-of-sight directions, generates epipolar plane images, and detects depth from streak patterns to differentiate between ground and airborne objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If infrared sensors or LiDAR devices are added to distinguish ice, snow, and clouds, then measurement precision is improved, but device complexity and weight increase
Solution Approach 1:
The patent applies multi-functionality by enabling existing imaging devices to perform depth detection in addition to their primary imaging function. By processing images from multiple existing line sensors with different line-of-sight directions, the system achieves depth discrimination without adding specialized sensors, making the existing devices serve multiple purposes.
Solution Approach 2:
The patent creates a virtual depth map by copying and processing information from multiple existing image sources. Instead of adding new physical sensors, the system generates depth information by synthesizing data from images already captured by the satellite's existing imaging devices, effectively copying useful information in a different form.
2Measurement precision
If infrared sensors or LiDAR devices are added to distinguish ice, snow, and clouds, then measurement precision is improved, but weight of the artificial satellite increases
Solution Approach 1:
The patent applies multi-functionality by enabling existing imaging devices to perform depth detection in addition to their primary imaging function. By processing images from multiple existing line sensors with different line-of-sight directions, the system achieves depth discrimination without adding specialized sensors, making the existing devices serve multiple purposes.
Solution Approach 2:
The patent creates a virtual depth map by copying and processing information from multiple existing image sources. Instead of adding new physical sensors, the system generates depth information by synthesizing data from images already captured by the satellite's existing imaging devices, effectively copying useful information in a different form.
3Adaptability or versatility
If multiple line sensors with different line-of-sight directions are used, then depth detection capability is improved, but device complexity increases
Solution Approach 1:
The patent extracts the essential depth information by selecting only the overlapping portions of images from multiple line sensors. Instead of processing all image data, the system extracts and processes only the relevant overlapping regions, simplifying the computational burden while maintaining depth detection capability.
Solution Approach 2:
The patent segments the image processing task by dividing it into distinct steps: acquiring images from multiple line sensors, identifying overlapping portions, generating epipolar plane images from overlaps, and detecting depth from streak patterns. This segmentation makes the complex processing more manageable and systematic.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables differentiation of positions in depth direction without additional imaging devices, reducing costs and weight, while effectively distinguishing between ice, snow, and clouds in satellite imagery.
Implementation Method 1
both ice and snow and clouds have a high reflectance of sunlight and are similar to each other, and thus, reflection intensities are similar to each other
Implementation Method 2
image data generated by imaging by an imaging means arranged to have different line-of-sight directions
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Provided is a method of acquiring image data generated by imaging by the imaging means arranged to have different line-of-sight directions, superimposing the image data while performing alignment in such a way as to eliminate absolute positional shift caused by the different line-of-sight directions in each piece of image data, selecting a transverse line that transverses an overlapping portion of the superimposed image data according to a direction in which ranges of each piece of image data in a superimposed state are shifted, generating epipolar plane image data by arranging each piece of image data of a portion where the selected transverse line and the overlapping portion overlap in an order determined by magnitudes of inclinations of the line-of-sight directions corresponding to each, and detecting a depth of a subject appearing in the image data from a streak pattern appearing in the generated epipolar plane image data.