Multi-source remote sensing image automatic registration system based on forest and grass comprehensive monitoring

Abstract

The invention relates to a multi-source remote sensing image automatic registration system based on forest and grass comprehensive monitoring. The multi-source remote sensing image automatic registration system comprises a storage library, a reading module, a removing module, an ortho-rectification module, a monitoring module and a verification module. Before automatic registration of the multi-source remote sensing image data is carried out, the multi-source remote sensing image data is classified and stored, so that different types of satellite data are stored in corresponding storage blocks, and the satellite data comprise high-resolution first data, high-resolution second data, high-resolution sixth data, middle-bar data and resource satellite light data. And each storage block stores one kind of data acquired by the satellite, so that different satellite data can be correspondingly read.

Description

Technical Field

[0001] The present invention relates to the technical field of multi-source remote sensing image processing, in particular to a multi-source remote sensing image automatic registration technology, and in particular to a multi-source remote sensing image automatic registration system based on forest and grassland comprehensive monitoring. Background Art

[0002] When processing traditional multi-source remote sensing image data, it is necessary to process the data in advance so that the multispectral file path of each image is unique. If the same multispectral file path exists, the duplicate data needs to be deleted. Only after deletion can the data be projected. Since each image obtained has a certain error, the adjacent images cannot be fused during projection. Summary of the invention

[0003] In order to solve the problems of the prior art, the present invention provides a multi-source remote sensing image automatic registration system based on comprehensive forest and grassland monitoring.

[0004] Its main technical solutions are as follows:

[0005] The present invention provides a multi-source remote sensing image automatic registration system based on forest and grassland comprehensive monitoring, comprising:

[0006] The repository is used to store satellite data and build different storage blocks according to different satellite data;

[0007] The reading module is used to read the satellite data according to different storage blocks and decompress the satellite data; after decompression, the decompressed data is identified using the identification matrix set in the reading module to obtain each image contained in the satellite data and the multispectral file path of each image;

[0008] A removal module, connected to the reading module, is used to cache each image repeatedly contained in the satellite data and the multispectral file path of each image to form a stand-by data resource;

[0009] The orthorectification module outputs a geographic coordinate system; each image retained in the reading module is sequentially loaded by the loading module according to the multispectral file path of each image, each image is projected in the geographic coordinate system, and the projection error and image point displacement caused by terrain undulation are corrected by using the acquired digital elevation model data within the range of each image, so as to obtain the image data output after automatic registration, and the image data output after automatic registration is set to a revocable state;

[0010] A monitoring module, connected to the elimination module and the orthorectification module, used to establish a monitoring unit for the unused data resources and the corresponding each scene image retained in the reading module, wherein the monitoring unit is used to track the data calling process of each scene image retained in the reading module and record the calling path;

[0011] The verification module is connected to the orthorectification module, the monitoring module and the rejection module, and is used to detect the projection status and image point displacement of the image data in the geographic coordinate system to check whether the set projection and image point displacement requirements are met. If not, the first control unit set in the verification module is driven to control the orthorectification module to cancel the image data output after automatic alignment and restore to the loading step. After restoring to the loading step, the second control unit set in the verification module is driven to control the loading module to load the standby data resources to the orthorectification module according to the calling path, and then the orthorectification module completes the automatic alignment with the standby data resources and outputs the image data corresponding to the standby data resources, sets the image data corresponding to the standby data resources to a revocable state, and then uses the verification module again to detect the projection status and image point displacement of the image data corresponding to the standby data resources in the geographic coordinate system until the set projection and image point displacement requirements are met.

[0012] Furthermore, the reading module has:

[0013] A plurality of configured read paths, wherein the read paths are configured to form a one-to-one correspondence with the storage blocks through uniquely configured codes, and are used to read the satellite data in the storage blocks through the read paths;

[0014] A decompression unit, wherein the decompression unit is configured to: uniquely correspond to each reading path, receive the satellite data read by the reading path, and decompress the satellite data. The parent folder after the satellite data is decompressed, the file list will display the full path of the multispectral file of each image;

[0015] An identification matrix, the identification matrix having:

[0016] Logic control unit;

[0017] A plurality of identification units, each of which parses the read path in the corresponding decompression unit under the control of the logic control unit to identify the category of satellite data by reading the code in the path; and identifies the parent folder after decompression; to obtain each image contained in the satellite data and the multispectral file path of each image;

[0018] A plurality of duplicate checking units are provided, each of which corresponds to an identification unit, and the duplicate checking unit is used to compare the multispectral file path of each image to check whether there is duplication of image data.

[0019] Furthermore, the elimination module is used to obtain a comparison result of the multispectral file path of each image according to the duplicate checking unit set in the identification matrix, and perform elimination processing according to whether there is duplication of image data in the comparison result, wherein, when there is duplication of image data, each image repeatedly included in the satellite data and the multispectral file path of each image are cached to form stand-by data resources.

[0020] Furthermore, the orthorectification module has:

[0021] A first configuration unit is used to configure the reference parameters when outputting the geographic coordinate system;

[0022] A projection unit connected to the first configuration unit, and projects each image in the geographic coordinate system using the reference parameters of the output geographic coordinate system set by the first configuration unit;

[0023] A second configuration unit is used to perform basic configuration on the digital elevation model to form a correction unit for correction using the digital elevation model, and the correction unit corrects the projection error and image point displacement caused by terrain undulation within the range of each acquired image to obtain image data output after automatic registration;

[0024] A state setting unit is configured to control the operation process of the projection unit and the correction unit. Whenever the correction unit completes the data correction of each image, the state setting unit sets the image data that has been corrected and output after automatic registration to a revocable state.

[0025] Furthermore, the revocable state means that the operation flow of the projection unit and the correction unit is retracted and controlled under the control of the state setting unit to return to the initial flow of the orthorectification.

[0026] Furthermore, the monitoring module is provided with a plurality of monitoring units; each monitoring unit is configured to track the data calling process of each scene image retained in the reading module and record the calling path;

[0027] The data calling process for monitoring each image includes:

[0028] By monitoring the comparison result of the multispectral file path of each scene image, it is obtained whether each scene image read from the reading module has a standby data resource cached due to duplication I;

[0029] Monitor the moving path of each image read from the reading module during the projection operation and the correction operation, track the data calling process of each image according to the moving path, and form a calling path II.

[0030] Furthermore, when monitoring the data calling process of each image, time is used as a reference in the tracking process to monitor the moving path of each image read from the reading module during the projection operation and the correction operation.

[0031] Furthermore, the projection of the image data and the displacement of the image points are detected through the orthorectification parameters and the multispectral-panchromatic registration parameters to check whether the set projection and image point displacement requirements are met;

[0032] The degree of fusion is determined by comparing two adjacent image data to see whether they can achieve corresponding matching fusion during fusion.

[0033] Before the automatic registration of multi-source remote sensing image data, the application classifies and stores the multi-source remote sensing image data to store different types of satellite data in corresponding storage blocks, wherein the satellite data includes GF-1, GF-2, GF-6, CMB, and resource satellite data. Each storage block stores data collected by a satellite, so that different satellite data can be read accordingly.

[0034] In the present application, when orthorectification is performed, duplicate data is not completely removed, but the elimination module is used to compare the multispectral file path of each scene image according to the duplicate checking unit set in the identification matrix to obtain the comparison result, and the elimination process is performed according to whether there is duplication of image data in the comparison result, wherein, when there is duplication of image data, each scene image and the multispectral file path of each scene image that are repeatedly included in the satellite data are cached to form a standby data resource. In the refraction correction process, the digital elevation model is first configured on a basic basis to form a correction unit that uses the digital elevation model for correction, and the correction unit obtains the image data output after automatic registration for the projection error and image point displacement caused by the terrain undulation within the range of each scene image obtained by the correction unit; then the state setting unit controls the operation process of the projection unit and the correction unit, and each time the correction unit completes the data correction of each scene image, the state setting unit sets the image data that has been corrected and output after automatic registration to a state that can be revoked. Then, the detection module is used to detect the projection status and image point displacement of the image data in the geographic coordinate system to check whether the set projection and image point displacement requirements are met. If not, the first control unit arranged in the verification module is driven to control the orthorectification module to cancel the image data output after automatic alignment and restore to the loading step. After restoring to the loading step, the second control unit arranged in the verification module is driven to control the loading module to load the stand-by data resources to the orthorectification module according to the calling path, and then the orthorectification module completes the automatic alignment with the stand-by data resources and outputs the image data corresponding to the stand-by data resources, and sets the image data corresponding to the stand-by data resources to a revocable state. Then, the verification module is used again to detect the projection status and image point displacement of the image data corresponding to the stand-by data resources in the geographic coordinate system until the set projection and image point displacement requirements are met. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0036] Figure 1 It is a theoretical diagram of magnetic field line overflow of ground fissures provided by the present invention; DETAILED DESCRIPTION

[0041] In order to make the objectives, technical solutions and advantages of the present invention more clear, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

[0042] The basic principles of this application are as follows;

[0043] The multi-source remote sensing image automatic registration system based on forest and grassland comprehensive monitoring provided by this application includes functions such as orthorectification, panchromatic-multispectral automatic registration, panchromatic-multispectral fusion, image stretching, etc. Input data and output data can be selected independently, and the parameters required for processing can be reflected through the display interface, which is very convenient.

[0044] This application automatically identifies the GF-1, GF-2, GF-6, CMB, and ZR satellite data in the input folder, and displays the multispectral file path of each image on the interface, so that users can check whether all data have been read correctly. It has image removal and caching functions, which can remove duplicate data and cache them, enhancing the flexibility of system data calls.

[0045] The system can use two orthorectification methods with DEM reference and average elevation reference, and can specify the output resolution of the image. Multispectral images and panchromatic images can be automatically registered, and unstable factors such as water areas can be eliminated to ensure the quality of the later fused images. In order to achieve good visual effects of the image and facilitate the interpretation of the later objects, the system supports the image stretching function, which realizes linear stretching according to percentage and improves the readability of the image. In addition, the resampling, output format, output band setting and other information in the image processing process are reflected in the interface, and users can modify them manually as needed, which greatly improves the flexibility of the system.

[0046] The present invention provides a multi-source remote sensing image automatic registration system based on forest and grassland comprehensive monitoring, comprising:

[0047] The repository is used to store satellite data and build different storage blocks according to different satellite data;

[0048] The reading module is used to read the satellite data according to different storage blocks and decompress the satellite data; after decompression, the decompressed data is identified using the identification matrix set in the reading module to obtain each image contained in the satellite data and the multispectral file path of each image;

[0049] A removal module, connected to the reading module, is used to cache each image repeatedly contained in the satellite data and the multispectral file path of each image to form a stand-by data resource;

[0050] The orthorectification module outputs a geographic coordinate system; each image retained in the reading module is sequentially loaded by the loading module according to the multispectral file path of each image, each image is projected in the geographic coordinate system, and the projection error and image point displacement caused by terrain undulation are corrected by using the acquired digital elevation model data within the range of each image, so as to obtain the image data output after automatic registration, and the image data output after automatic registration is set to a revocable state;

[0051] A monitoring module, connected to the elimination module and the orthorectification module, used to establish a monitoring unit for the unused data resources and the corresponding each scene image retained in the reading module, wherein the monitoring unit is used to track the data calling process of each scene image retained in the reading module and record the calling path;

[0052] The verification module is connected to the orthorectification module, the monitoring module and the rejection module, and is used to detect the projection status and image point displacement of the image data in the geographic coordinate system to check whether the set projection and image point displacement requirements are met. If not, the first control unit set in the verification module is driven to control the orthorectification module to cancel the image data output after automatic alignment and restore to the loading step. After restoring to the loading step, the second control unit set in the verification module is driven to control the loading module to load the standby data resources to the orthorectification module according to the calling path, and then the orthorectification module completes the automatic alignment with the standby data resources and outputs the image data corresponding to the standby data resources, sets the image data corresponding to the standby data resources to a revocable state, and then uses the verification module again to detect the projection status and image point displacement of the image data corresponding to the standby data resources in the geographic coordinate system until the set projection and image point displacement requirements are met.

[0053] Furthermore, the reading module has:

[0054] A plurality of configured read paths, wherein the read paths are configured to form a one-to-one correspondence with the storage blocks through uniquely configured codes, and are used to read the satellite data in the storage blocks through the read paths;

[0055] A decompression unit, wherein the decompression unit is configured to: uniquely correspond to each reading path, receive the satellite data read by the reading path, and decompress the satellite data. The parent folder after the satellite data is decompressed, the file list will display the full path of the multispectral file of each image;

[0056] An identification matrix, the identification matrix having:

[0057] Logic control unit;

[0058] A plurality of identification units, each of which parses the read path in the corresponding decompression unit under the control of the logic control unit to identify the category of satellite data by reading the code in the path; and identifies the parent folder after decompression; to obtain each image contained in the satellite data and the multispectral file path of each image;

[0059] A plurality of duplicate checking units are provided, each of which corresponds to an identification unit, and the duplicate checking unit is used to compare the multispectral file path of each image to check whether there is duplication of image data.

[0060] Furthermore, the elimination module is used to obtain a comparison result of the multispectral file path of each image according to the duplicate checking unit set in the identification matrix, and perform elimination processing according to whether there is duplication of image data in the comparison result, wherein, when there is duplication of image data, each image repeatedly included in the satellite data and the multispectral file path of each image are cached to form stand-by data resources.

[0061] Furthermore, the orthorectification module has:

[0062] A first configuration unit is used to configure the reference parameters when outputting the geographic coordinate system;

[0063] A projection unit connected to the first configuration unit, and projects each image in the geographic coordinate system using the reference parameters of the output geographic coordinate system set by the first configuration unit;

[0064] A second configuration unit is used to perform basic configuration on the digital elevation model to form a correction unit for correction using the digital elevation model, and the correction unit corrects the projection error and image point displacement caused by terrain undulation within the range of each acquired image to obtain image data output after automatic registration;

[0065] A state setting unit is configured to control the operation process of the projection unit and the correction unit. Whenever the correction unit completes the data correction of each image, the state setting unit sets the image data that has been corrected and output after automatic registration to a revocable state.

[0066] Furthermore, the revocable state means that the operation flow of the projection unit and the correction unit is retracted and controlled under the control of the state setting unit to return to the initial flow of the orthorectification.

[0067] Furthermore, the monitoring module is provided with a plurality of monitoring units; each monitoring unit is configured to track the data calling process of each scene image retained in the reading module and record the calling path;

[0068] The data calling process for monitoring each image includes:

[0069] By monitoring the comparison result of the multispectral file path of each scene image, it is obtained whether each scene image read from the reading module has a standby data resource cached due to duplication I;

[0070] Monitor the moving path of each image read from the reading module during the projection operation and the correction operation, track the data calling process of each image according to the moving path, and form a calling path II.

[0071] Furthermore, when monitoring the data calling process of each image, time is used as a reference in the tracking process to monitor the moving path of each image read from the reading module during the projection operation and the correction operation.

[0072] Furthermore, the projection of the image data and the displacement of the image points are detected through the orthorectification parameters and the multispectral-panchromatic registration parameters to check whether the set projection and image point displacement requirements are met;

[0073] The degree of fusion is determined by comparing two adjacent image data to see whether they can achieve corresponding matching fusion during fusion.

[0074] Before the automatic registration of multi-source remote sensing image data, the application classifies and stores the multi-source remote sensing image data to store different types of satellite data in corresponding storage blocks, wherein the satellite data includes GF-1, GF-2, GF-6, CMB, and resource satellite data. Each storage block stores data collected by a satellite, so that different satellite data can be read accordingly.

[0075] In the present application, when orthorectification is performed, duplicate data is not completely removed, but the elimination module is used to compare the multispectral file path of each scene image according to the duplicate checking unit set in the identification matrix to obtain the comparison result, and the elimination process is performed according to whether there is duplication of image data in the comparison result, wherein, when there is duplication of image data, each scene image and the multispectral file path of each scene image that are repeatedly included in the satellite data are cached to form a standby data resource. In the refraction correction process, the digital elevation model is first configured on a basic basis to form a correction unit that uses the digital elevation model for correction, and the correction unit obtains the image data output after automatic registration for the projection error and image point displacement caused by the terrain undulation within the range of each scene image obtained by the correction unit; then the state setting unit controls the operation process of the projection unit and the correction unit, and each time the correction unit completes the data correction of each scene image, the state setting unit sets the image data that has been corrected and output after automatic registration to a state that can be revoked. Then, the detection module is used to detect the projection status and image point displacement of the image data in the geographic coordinate system to check whether the set projection and image point displacement requirements are met. If not, the first control unit arranged in the verification module is driven to control the orthorectification module to cancel the image data output after automatic alignment and restore to the loading step. After restoring to the loading step, the second control unit arranged in the verification module is driven to control the loading module to load the stand-by data resources to the orthorectification module according to the calling path, and then the orthorectification module completes the automatic alignment with the stand-by data resources and outputs the image data corresponding to the stand-by data resources, and sets the image data corresponding to the stand-by data resources to a revocable state. Then, the verification module is used again to detect the projection status and image point displacement of the image data corresponding to the stand-by data resources in the geographic coordinate system until the set projection and image point displacement requirements are met.

[0076] When using this application, enter the parent folder button and select the parent folder containing the unzipped data of GF-1, GF-2, GF-6, CMB and ZR satellites. The file list will display the complete path of the multispectral file for each image. After the selection is completed, you can delete a certain file or delete all files.

[0077] Orthorectification uses the DEM reference method by default. The output coordinate system is the geographic coordinate system, the output resolution is 0.000018°, and the panchromatic image is used as the benchmark to correct the multispectral image. The registration parameters include the size of the search window, the grid size, the threshold of the control point, the order of the fitting polynomial, and other parameters. It supports three fusion methods: RCS, Brovey, and PCA. It supports image stretching according to the percentage of the maximum and minimum values ​​to enhance the brightness and contrast of the image and improve the image readability. It can output envi, tiff, and jp2 data formats. The number of threads can be selected. Multispectral images, panchromatic images, and fused images are stored in different output folders for easy management by users. Click Execute to run.

[0078] There are many parameters on the system interface. To facilitate user use, the parameters of each step are grouped into orthorectification parameters, multispectral-panchromatic registration parameters, fusion parameters, and output folders. The system uses a set of default parameters when it starts. Users can modify the size of the adjustment parameters according to different usage requirements to meet the needs of actual production.

[0079] For ease of implementation, the core code of the reading module includes:

[0080]

[0081]

[0082] This application can input and configure parameters through the auxiliary display interface. The core code corresponding to the device is as follows:

[0083]

[0084]

[0085]

[0086] In this application, the basic code for orthorectification includes the following:

[0087]

[0088]

[0089]

[0090] The basic code of the detection module is as follows:

[0091]

[0092]

[0093]

[0094] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. The multi-source remote sensing image automatic registration system based on comprehensive forest and grassland monitoring is characterized by: include: The repository is used to store satellite data and build different storage blocks according to different satellite data; A reading module, used for reading satellite data according to different storage blocks and decompressing the satellite data; After decompression, the decompressed data is identified using the identification matrix set in the reading module to obtain each image contained in the satellite data and the multispectral file path of each image; A removal module, connected to the reading module, is used to cache each image repeatedly contained in the satellite data and the multispectral file path of each image to form a stand-by data resource; The orthorectification module outputs a geographic coordinate system; each image retained in the reading module is sequentially loaded according to the multispectral file path of each image, each image is projected in the geographic coordinate system, and the projection error and image point displacement caused by terrain undulation are corrected by using the acquired digital elevation model data within the range of each image, so as to obtain the image data output after automatic registration, and the image data output after automatic registration is set to a revocable state; A monitoring module, connected to the elimination module and the orthorectification module, used to establish a monitoring unit for the unused data resources and the corresponding each scene image retained in the reading module, wherein the monitoring unit is used to track the data calling process of each scene image retained in the reading module and record the calling path; The verification module is connected to the orthorectification module, the monitoring module and the rejection module, and is used to detect the projection status and image point displacement of the image data in the geographic coordinate system to check whether the set projection and image point displacement requirements are met. If not, the first control unit set in the verification module is driven to control the orthorectification module to cancel the image data output after automatic alignment and restore to the loading step. After restoring to the loading step, the second control unit set in the verification module is driven to control the loading module to load the standby data resources to the orthorectification module according to the calling path, and then the orthorectification module completes the automatic alignment with the standby data resources and outputs the image data corresponding to the standby data resources, sets the image data corresponding to the standby data resources to a revocable state, and then uses the verification module again to detect the projection status and image point displacement of the image data corresponding to the standby data resources in the geographic coordinate system until the set projection and image point displacement requirements are met.

2. The multi-source remote sensing image automatic registration system based on forest and grassland comprehensive monitoring according to claim 1 is characterized in that: The reading module has: A plurality of configured read paths, wherein the read paths are configured to form a one-to-one correspondence with the storage blocks through uniquely configured codes, and are used to read the satellite data in the storage blocks through the read paths; A decompression unit, wherein the decompression unit is configured to: uniquely correspond to each reading path, receive the satellite data read by the reading path, and decompress the satellite data. The parent folder after the satellite data is decompressed, the file list will display the full path of the multispectral file of each image; An identification matrix, the identification matrix having: Logic control unit; A plurality of identification units, each of which parses the reading path in the corresponding decompression unit under the control of the logic control unit to identify the category of the satellite data by the code in the reading path; and identify the parent folder after decompression; to obtain each image contained in the satellite data and the multispectral file path of each image; A plurality of duplicate checking units are provided, each of which corresponds to an identification unit, and the duplicate checking unit is used to compare the multispectral file path of each image to check whether there is duplication of image data.

3. The multi-source remote sensing image automatic registration system based on forest and grassland comprehensive monitoring according to claim 1 is characterized in that: The elimination module is used to obtain the comparison result of the multispectral file path of each image according to the duplicate checking unit set in the identification matrix, and perform elimination processing according to whether there is duplication of image data in the comparison result. When there is duplication of image data, each image repeatedly included in the satellite data and the multispectral file path of each image are cached to form stand-by data resources.

4. The multi-source remote sensing image automatic registration system based on forest and grassland comprehensive monitoring according to claim 1 is characterized in that: The orthorectification module has: A first configuration unit is used to configure the reference parameters when outputting the geographic coordinate system; A projection unit connected to the first configuration unit, and projects each image in the geographic coordinate system using the reference parameters of the output geographic coordinate system set by the first configuration unit; A second configuration unit is used to perform basic configuration on the digital elevation model to form a correction unit for correction using the digital elevation model, and the correction unit corrects the projection error and image point displacement caused by terrain undulation within the range of each acquired image to obtain image data output after automatic registration; A state setting unit is configured to control the operation process of the projection unit and the correction unit. Whenever the correction unit completes the data correction of each image, the state setting unit sets the image data that has been corrected and output after automatic registration to a revocable state.

5. The multi-source remote sensing image automatic registration system based on forest and grassland comprehensive monitoring according to claim 4 is characterized in that: The revocable state means that the operation flow of the projection unit and the correction unit is retracted under the control of the state setting unit to return to the initial flow of the orthorectification.

6. The multi-source remote sensing image automatic registration system based on forest and grassland comprehensive monitoring according to claim 1 is characterized in that: The monitoring module is provided with a plurality of monitoring units; each monitoring unit is configured to track the data calling process of each scene image retained in the reading module and record the calling path; The data calling process for monitoring each image includes: By monitoring the comparison result of the multispectral file path of each scene image, it is obtained whether each scene image read from the reading module has a standby data resource cached due to duplication I; Monitor the moving path of each image read from the reading module during the projection operation and the correction operation, track the data calling process of each image according to the moving path, and form a calling path II.

7. The multi-source remote sensing image automatic registration system based on forest and grassland comprehensive monitoring according to claim 6 is characterized in that: When monitoring the data calling process of each scene image, time is used as a reference in the tracking process to monitor the moving path of each scene image read from the reading module during the projection operation and the correction operation.

8. The multi-source remote sensing image automatic registration system based on forest and grassland comprehensive monitoring according to claim 1 is characterized in that: Through the orthorectification parameters and multispectral-panchromatic registration parameters, the image data projection and image point displacement are tested to see whether the set projection and image point displacement requirements are met; The degree of fusion is determined by comparing two adjacent image data to see whether they can achieve corresponding matching fusion during fusion.

Images