Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Near-infrared and visible light remote sensing image registration method based on reinforcement learning

A remote sensing image and reinforcement learning technology, applied in the field of image processing, can solve unsatisfactory problems and achieve the effect of improving accuracy and enhancing feature extraction capabilities

Pending Publication Date: 2021-11-12
SHANGHAI INST OF TECH
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But it is not ideal in recent learning-based optical image registration and specific near-infrared and visible remote sensing image registration

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Near-infrared and visible light remote sensing image registration method based on reinforcement learning
  • Near-infrared and visible light remote sensing image registration method based on reinforcement learning
  • Near-infrared and visible light remote sensing image registration method based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The specific embodiments of the present invention will be further described below in conjunction with the accompanying drawings. It should be noted here that the descriptions of these embodiments are used to help understand the present invention, but are not intended to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below may be combined with each other as long as they do not constitute a conflict with each other.

[0025] Such as figure 1 As shown, a near-infrared and visible light remote sensing image registration method based on reinforcement learning includes the following steps:

[0026] S1, trim the infrared and visible light images to the same size and stack them;

[0027] In this embodiment, the visible light reference image and the near-infrared image to be registered are prepared, and the two images are reduced to the same size, and then stacked. The stacked images inclu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a near-infrared and visible light remote sensing image registration method based on reinforcement learning, and the method comprises the following steps: S1, trimming infrared and visible light images to the same size, and carrying out the stacking processing; S2, inputting the stacked images into a residual error improved dense neural network for processing, and outputting a Q value required by registration; S3, reasoning according to the Q value to predict probability distribution of each action in the strategy action space; S4, selecting an action with the maximum probability in the strategy action space according to the probability distribution of each action, and executing the action by the image to be registered; S5, after the to-be-registered image and the reference image reach a set similarity threshold value, carrying out greedy algorithm reasoning sampling on current image registration; and S6, carrying out moving resampling on the current image to be registered, and outputting a final registration result. According to the image registration method, all parts of the registered image are connected naturally and smoothly, multi-modal image registration is more stable, and the effect is better.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a registration method for near-infrared and visible light remote sensing images based on reinforcement learning. Background technique [0002] Visible and infrared sensors are two types of sensors that are commonly used and often used together in different tasks, such as face detection, object tracking, land cover classification, and self-driving cars. For remote sensing images, the captured panchromatic or RGB images are closest to human vision, but will be severely affected by lighting and atmospheric conditions; near-infrared images will be more robust to weather conditions and less susceptible to them . But because they are acquired by different imaging mechanisms in different wavelength bands, there are large geometric differences and different radiation intensities between visible and infrared images. This discrepancy may invalidate conventional registration meth...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/33G06N3/04
CPCG06T7/337G06N3/045
Inventor 陈颖陈磊张祺王嘉浩王伟李先静张文成
Owner SHANGHAI INST OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products