Optical remote sensing satellite secondary product data edge receiving and matching processing method

Abstract

An optical remote sensing satellite secondary product data edge receiving and matching processing method comprises the steps that an optical remote sensing satellite observes a designated area to generate an original image, the original image is downloaded to a satellite data transmission station through a data transmission link, and the satellite data transmission station transmits the original image to a resource satellite application center to be processed to generate a secondary standard image product and matched auxiliary data; the resource satellite application center packages the data and then transmits the data to the emergency disposal center; the emergency disposal center transmits the data to the emergency rescue cloud, and the emergency rescue cloud transmits the data to the ground maneuvering processing system; the ground maneuvering processing system obtains three types of files including a tracking receiving plan, a second-level product production completion notice and a second-level product file compression package and stores the three types of files in an internal disk array; and the ground maneuvering processing system confirms that the tracking receiving plan completes receiving and analysis, confirms that the second-level product production completion notification and the second-level product file compression package complete receiving, analysis, unloading and matching, carries out disaster situation generation or mining analysis, and responds to disaster situation emergency task requirements.

Description

Technical Field

[0001] This invention relates to a method for edge reception and matching processing of secondary product data from optical remote sensing satellites, belonging to the field of ground processing of remote sensing satellite data. Background Technology

[0002] For high-precision remote sensing data processing needs in disaster risk monitoring and emergency response, the ground reception, processing, and cross-network transmission of optical remote sensing satellite data are crucial information sources for disaster assessment and emergency response decision-making. Due to bandwidth limitations of ground transmission networks and the timeliness requirements of disaster response, it is difficult to directly transmit large volumes of raw satellite data or standard imagery data such as secondary products to emergency response centers or disaster-stricken areas at the data edge for in-depth analysis. Raw optical remote sensing satellite data, received by ground data transmission stations, is typically transmitted directly to the Resource Satellite Application Center. The Resource Satellite Application Center then quickly generates rough disaster information based on the raw data, or corrects the raw data to obtain standard products such as secondary products, and then generates more precise disaster information based on these secondary products before distributing it to the emergency response center. The current processing method is insufficient in the transmission of raw data or standard imagery products such as secondary products, resulting in insufficient mining of remote sensing data at the disaster-stricken front lines and a lack of flexibility in disaster response. With the construction of emergency management collaborative networks, and in response to the strong demand for distributed disaster situation sharing, receiving and processing satellite standard imagery data at various data edge processing nodes at the disaster front line can effectively enhance the resilience of remote sensing data support. This provides more accurate target location information and situational information to the disaster front line, supporting decision-makers in assessing, formulating, and selecting optimal response plans, and enhancing their autonomous and rapid information analysis and autonomous observation task awareness capabilities. Currently, satellite data has different time bases at various ground transmission and processing nodes, and real-time synchronization of remote sensing products is difficult. This hinders collaboration between emergency response centers and the disaster front line, especially since ground mobile processing systems and other data edge processing nodes cannot promptly grasp satellite observation imagery data, making it difficult to quickly respond to changes in task requirements or malfunctions, and insufficient to meet the real-time and flexibility requirements of emergency response. Therefore, the current cross-network ground processing system still suffers from weak collaboration, resulting in inefficient updates and low collaboration efficiency between emergency response centers and ground mobile processing systems and other data edge processing nodes. Therefore, there is an urgent need for a method for receiving and matching data edge processing of optical remote sensing satellite secondary product data. Summary of the Invention

[0003] The technical problem solved by this invention is to overcome the shortcomings of the prior art and provide a method for edge reception and matching processing of optical remote sensing satellite secondary product data. This method can effectively solve the problems in emergency rescue scenarios, such as the mismatch between the order of standard image products, including satellite secondary product data, being placed on the ground mobile processing system and the actual satellite observation time, and the mismatch between standard image products and their corresponding auxiliary data files, which leads to misalignment between target observation information and target real information, and deterioration of the timeliness of target information.

[0004] The technical solution of this invention is: a method for edge reception and matching processing of secondary product data from optical remote sensing satellites, comprising: After the optical remote sensing satellite observes a designated area and generates raw images, the images are transmitted to the satellite data transmission station via a data transmission link. The satellite data transmission station then transmits the raw images to the Resource Satellite Application Center for processing to generate secondary standard image products and supporting auxiliary data. The Resource Satellite Application Center then packages the secondary standard image products and supporting auxiliary data and transmits them to the emergency response center. The emergency response center transmits Level 2 standard image products and supporting auxiliary data to the emergency rescue cloud, which in turn transmits the Level 2 standard image products and supporting auxiliary data to the ground mobile processing system. The ground mobile processing system receives secondary standard image products and supporting auxiliary data, and obtains three types of files: tracking and receiving plan, secondary product production completion notification, and secondary product file compressed package, which are stored in the internal disk array; The ground mobile processing system scans the internal disk array, confirms that the tracking and receiving plan has been received and parsed, and confirms that the secondary product production completion notification and the secondary product file compressed package have been received, parsed, transferred and matched, and generates the internal secondary product completion notification of the ground mobile processing system; After the completion notification of the secondary product within the ground mobility processing system is generated, the secondary product is read from the designated path of the ground mobility processing system and target detection processing begins. After the detection is completed, slice products are generated. Based on the sliced ​​products, disaster situation generation or mining analysis can be performed to respond to the needs of disaster emergency tasks.

[0005] Preferably, a transmission network needs to be built between the emergency response center and the emergency rescue cloud, and between the emergency rescue cloud and the ground system processing system, for real-time emergency transmission of optical remote sensing satellite level 2 product data to the disaster site or near-field.

[0006] Preferably, the tracking and receiving plan is an XML file; used to provide a list of tracking and receiving instructions to the ground mobile processing system; The notification of completion of production of the second-level product is in XML format; The secondary product files are packaged in a compressed file, containing TIFF, JPG, and XML format products.

[0007] Preferably, when the ground-based mobile processing system analyzes the received secondary standard image products and supporting auxiliary data, it performs a disk array scan at a fixed frequency.

[0008] Preferably, the ground-based mobile processing system scans the internal disk array to confirm that the tracking and reception plan has been completed, and performs reception and parsing. Specifically: If it is determined that the tracking and receiving plan file has not been updated for a longer period than the set update time threshold, the received tracking and receiving plan file is parsed and converted into a tracking and receiving plan file that conforms to the internal format of the ground mobile processing system. The parsing of the tracking and receiving plan file is completed, and the internal processing flow of the ground mobile processing system is initiated.

[0009] Preferably, the ground mobile processing system scans the internal disk array and confirms that the secondary product production completion notification and the secondary product file compressed package have been received, parsed, transferred, and matched. Specifically: For the compressed package of Level 2 product files that have been successfully downloaded to the disk, decompress the package and transfer the Level 2 product data within the package to a designated path within the ground mobile processing system. For the notification of completion of production of Level 2 products, read and parse the notification content, and determine whether the corresponding Level 2 product data has been decompressed in the specified path: if the decompression is complete, update the file path and convert the received notification of completion of production of Level 2 products into a transfer notification of completion of production of Level 2 products that conforms to the internal format of the ground mobile processing system, and the ground mobile processing system starts disaster handling.

[0010] Preferably, the compressed file of the secondary product document that has been downloaded to disk and the secondary product production completion notification can be parsed in parallel; The parsing begins when it is determined that the current file has not been updated for a longer period than the set update time threshold.

[0011] Preferably, the tracking and receiving plan, secondary product production completion notification, and secondary product file compressed package should be removed from the disk path after parsing to reduce the disk array scanning processing burden.

[0012] Compared with the prior art, the present invention has the following advantages: (1) The method of the present invention enables the rapid and effective transmission of standard image products such as optical remote sensing satellite secondary product data to the disaster site or near-field for effective processing in emergency disaster relief scenarios, ensuring that the front line of disaster relief can fully explore remote sensing data and effectively improve the flexibility and timeliness of disaster relief.

[0013] (2) The method of the present invention realizes that the order of satellite secondary product data and other standard image products in emergency rescue and disaster relief scenarios is matched with the actual satellite observation time in the ground mobile processing system, and the standard image products and corresponding auxiliary data files are paired, thus completing the pairing of standard observation information and target real information and improving the timeliness of target information.

[0014] (3) The present invention can also modify the auxiliary information files that accompany the standard image products in the ground mobile processing system to adapt to the processing flow inside various ground mobile processing systems located at the edge of information processing. Attached Figure Description

[0015] Figure 1 This is a diagram of the optical remote sensing satellite data transmission to edge receiving link according to the present invention; Figure 2 This is a flowchart of the edge reception and matching processing of optical remote sensing satellite secondary product data according to the present invention. Detailed Implementation

[0016] This invention addresses the challenges of disaster relief efforts. To improve the flexibility of disaster response and facilitate the full utilization of remote sensing data, current data transmission of raw data and standard image products (such as secondary products) is insufficient, hindering effective data processing at the disaster relief front. Limited by network bandwidth and time base variations, the transmission of large volumes of satellite standard image products results in timing discrepancies and file transfer delays. This leads to a mismatch between the image product's loading order on the ground-based mobile processing system (located at the edge of data processing) and the actual satellite observation time. Furthermore, the standard image products and their corresponding auxiliary data files are mismatched, resulting in a misalignment between target observation information and actual target information, and a deterioration in the timeliness of target information. Additionally, the auxiliary information files accompanying the image products require modification on the ground-based mobile processing system to adapt to its internal processing flow, complicating the process. Therefore, this invention proposes a method for edge reception and matching processing of optical remote sensing satellite secondary product data.

[0017] The specific steps are as follows: Step 1: After the optical remote sensing satellite observes the designated area and generates raw images, the images are transmitted down to the satellite data transmission station via a data transmission link. The data transmission station then transmits the raw images to the Resource Satellite Application Center for processing, which generates secondary standard image products and supporting auxiliary data. The Resource Satellite Application Center then packages the secondary standard image products and supporting auxiliary data and transmits them to the emergency response center.

[0018] Step 2: The emergency response center transmits data across networks to the emergency rescue cloud to achieve data uploading to the cloud. The emergency rescue cloud then transmits the data to the ground mobile processing system via the emergency dedicated network. (This step may not be inherent in the existing processing flow or may not be transmitted in a timely manner. The transmission network between the emergency response center, the rescue cloud, and the ground system processing system may be temporarily constructed. Therefore, due to limitations in communication conditions and data security requirements, secondary products generally experience problems such as out-of-order transmission and delayed transmission, requiring the adoption of subsequent matching processing methods.)

[0019] Step 3: The ground mobile processing system receives the product files and stores them on disks. It receives three types of data and stores them in the internal disk array: 1. Tracking receiving plan, 2. Secondary product production completion notification, 3. Secondary product file compressed package (containing secondary product data in various formats and supporting files).

[0020] Step 4: After the Ground Mobility Processing System scans its internal disk array and confirms that the compressed file has been downloaded to the disk, it decompresses the compressed file. The decompressed file is then paired with the secondary product completion notification downloaded to the disk. The secondary product path in the secondary product completion notification is corrected according to the internal format of the Ground Mobility Processing System, a new secondary product completion notification is generated, and it is forwarded to the disaster handling module within the Ground Mobility Processing System.

[0021] Step 5: The internal disaster handling module receives the secondary product reception completion notification, reads the secondary product from the specified path and starts target detection processing. After the detection is completed, a slice product completion notification is generated.

[0022] Step Six: The internal disaster processing module performs situational awareness generation or data mining analysis on the sliced ​​products to complete the processing, meeting the needs of edge disaster protection and rapidly responding to changes in mission requirements. The optical remote sensing satellite data transmission to edge receiving link diagram applicable to the technical solution of this invention is shown below. Figure 1 As shown: After optical remote sensing satellites observe a designated area and generate raw images, these images are transmitted via a data transmission link to a data transmission station. The data transmission station then uses a dedicated fiber optic network to transmit the raw images to the Resource Satellite Application Center for processing, generating secondary standard images. These images are then transmitted via the same dedicated fiber optic network to the Emergency Response Center. The Emergency Response Center further transmits the data across networks to the Emergency Rescue Cloud. The Emergency Rescue Cloud transmits the data in a pre-defined format to the ground-based mobile processing system via the emergency network. After format parsing, the files are saved to disk by the ground-based mobile processing system. The system then performs data decompression, parsing, and detection, analyzes the detection results for data mining and analysis, and completes the processing.

[0023] The Resource Satellite Application Center is responsible for processing, archiving, and distributing Earth observation satellite data, and processing the received raw satellite images into secondary products. The emergency response center is an institution or key hub that coordinates responses to public emergencies. The emergency rescue cloud integrates and stores various types of data, such as disaster information and rescue resources, and provides data processing and sharing services. The ground mobile processing system is an integrated system that can be flexibly deployed at or near the disaster site to complete data reception, analysis and rescue support processing. Emergency dedicated networks are dedicated communication networks customized for the emergency response field.

[0024] like Figure 2 The specific steps of this invention are as follows: Step 1: After the optical remote sensing satellite observes the designated area and generates raw images, the images are transmitted down to the satellite data transmission system via a data transmission link. The data transmission station then uses a dedicated fiber optic network to transmit the raw images to the Resource Satellite Application Center for processing, generating secondary standard image products and supporting auxiliary data. The Resource Satellite Application Center then packages the secondary standard image products and supporting auxiliary data and transmits them to the emergency response center via a dedicated fiber optic network.

[0025] Step 2: The emergency response center transmits the data across networks to the emergency rescue cloud, which then transmits the data to the ground mobile processing system in an agreed format via the emergency dedicated network.

[0026] Step 3: The ground mobile processing system receives the product files and stores them on disks. It receives three types of data and stores them in the internal disk array: 1. Tracking receiving plan ("xx".TRTASK format, XML file), 2. Secondary product production completion notification ("xx".SPOREADY format, XML file), 3. Secondary product file compressed package ("xx".zip, containing TIFF, JPG and XML files).

[0027] Step 4: The ground-based mobile processing system periodically scans the internal disk array to determine file types and files that have been transferred and are awaiting processing. It then employs parallel parsing threads to begin processing different file types. (1) For tracking and receiving plan files, convert them into tracking and receiving plan files that conform to the internal format of the ground mobile processing system, start the internal processing flow, and remove the processed tracking and receiving plan files in the original path to reduce the processing burden.

[0028] (2) For the compressed file that has been downloaded to disk, decompress the compressed file, transfer the secondary product data in the compressed file to the specified path inside the ground mobile processing system, and remove the processed compressed file from the original path to reduce the processing burden.

[0029] (3) For the notification of completion of production of secondary products, read and parse the notification content, and determine whether the corresponding secondary product data has been decompressed in the specified path: if the decompression is completed, update the file path to convert the notification of completion of production of secondary products into a notification of completion of production of secondary products that conforms to the internal format of the ground mobile processing system, send it to the disaster processing module inside the ground mobile processing system to start disaster processing, and remove the processed tracking and receiving plan file in the original path to reduce the processing burden.

[0030] Step 5: The internal disaster handling module receives the secondary product reception completion notification, reads the secondary product from the specified path and starts target detection processing. After the detection is completed, it generates slice products and slice product completion notification.

[0031] Step Six: The internal disaster processing module performs situation generation or mining analysis on the slice products to complete the processing, meet the needs of edge disaster protection at the front line of disaster in the local area, and quickly respond to changes in mission requirements. For example, the ground mobile processing system can generate disaster points that need further detailed observation based on the slice products, and guide unmanned observation equipment at the disaster site or near the field to conduct close-range detection.

[0032] Example: The following description, in conjunction with the accompanying drawings and a specific example of satellite data edge processing, illustrates the specific application of this patent in order to further understand the principles, steps, characteristics, and advantages of this method.

[0033] The following is an analysis of the edge reception and matching processing time of data from a certain optical remote sensing satellite's secondary product: In a certain mission, a ground-based mobile processing system needed to perform emergency processing of remote sensing images from a certain optical remote sensing satellite and analyze disaster information. By fully utilizing the existing transmission network and temporarily constructing a dedicated network, an emergency response center received satellite secondary product data transmitted in real time from a resource satellite application center via a dedicated fiber optic network, and transmitted it across networks to an emergency rescue cloud. The data was then transmitted to the ground-based mobile processing system in long message format via the emergency dedicated network. The ground-based mobile processing system received and transmitted the compressed file, and the file was successfully saved to disk. During the mission, the ground-based mobile processing system received over one hundred secondary product images and associated secondary product notifications in real time. The transmission time of the first secondary product image compressed package to the ground-based mobile processing system was in the minute range. The total edge reception time of all secondary product image compressed packages by the ground-based mobile processing system lasted approximately 1 hour and 10 minutes, and the total edge reception time of associated secondary product notifications lasted approximately 50 minutes. During the transmission of Level 2 product data and supporting files to the ground-based mobile processing system, limited by factors such as the emergency dedicated network bandwidth (approximately 20MB), approximately 4-6 Level 2 product compressed packages (each approximately 200MB) were written to disk per minute, resulting in a gradual increase in file transmission delay. Furthermore, frequent out-of-order file occurrences occurred during transmission, with the order in which the Level 2 product compressed packages were written to disk not matching the satellite observation time sequence.

[0034] The edge reception and matching processing of satellite secondary product data in this ground-based mobile processing system is designed and optimized based on this method. This includes increasing the disk array scanning frequency (approximately 30 seconds / s), reducing the disk completion judgment time threshold (approximately 5 seconds), multi-threaded parallel parsing of different file types (.TRTASK tracking reception plan, .SPOREADY secondary product production completion notification, .zip secondary product file compressed package), real-time transfer of processed files in the disk array to reduce the disk array scanning burden, and direct reading of the secondary product data decompression path. These measures enable edge reception and matching processing of optical remote sensing satellite secondary products and reduce processing time. Under network transmission conditions for this mission, the total time from satellite imaging to the first completion of edge reception and matching processing is in the minute range, effectively ensuring the timeliness of emergency disaster response. Furthermore, the ground-based mobile processing system generates disaster locations requiring further detailed observation based on sliced ​​products, guiding unmanned observation equipment at or near the disaster site for close-range detection. This effectively enhances autonomous and rapid information analysis and autonomous observation task recognition capabilities, improves emergency response flexibility, and enables rapid response to disaster emergency mission needs.

[0035] This invention addresses the problem that existing disaster analysis and processing procedures often fail to promptly transmit impact product data to the front lines for direct analysis and processing, instead relying on emergency response centers for inflexible handling and insufficient data acquisition at the front lines. It provides a method for edge reception and matching processing of secondary product data from optical remote sensing satellites, ensuring that frontline disaster responders can fully utilize remote sensing data and effectively improving the flexibility and timeliness of disaster response.

[0036] The contents not described in detail in this specification are existing technologies known to those skilled in the art.

Claims

1. A method for edge reception and matching processing of secondary product data from optical remote sensing satellites, characterized in that... include: After the optical remote sensing satellite observes the designated area and generates the raw image, it is transmitted to the satellite data transmission station via the data transmission link. The satellite data transmission station then transmits the raw image to the Resource Satellite Application Center for processing to generate secondary standard image products and supporting auxiliary data. The Resource Satellite Application Center will package the Level 2 standard image products and supporting auxiliary data and transmit them to the Emergency Response Center; The emergency response center transmits Level 2 standard image products and supporting auxiliary data to the emergency rescue cloud, which in turn transmits the Level 2 standard image products and supporting auxiliary data to the ground mobile processing system. The ground mobile processing system receives secondary standard image products and supporting auxiliary data, and obtains three types of files: tracking and receiving plan, secondary product production completion notification, and secondary product file compressed package, which are stored in the internal disk array; The ground mobile processing system scans the internal disk array, confirms that the tracking and receiving plan has been received and parsed, and confirms that the secondary product production completion notification and the secondary product file compressed package have been received, parsed, transferred and matched, and generates the internal secondary product completion notification of the ground mobile processing system; After the completion notification of the secondary product within the ground mobility processing system is generated, the secondary product is read from the designated path of the ground mobility processing system and target detection processing begins. After the detection is completed, slice products are generated. Based on the sliced ​​products, disaster situation generation or mining analysis can be performed to respond to the needs of disaster emergency tasks.

2. The method for edge reception and matching processing of optical remote sensing satellite secondary product data according to claim 1, characterized in that: A transmission network needs to be built between the emergency response center and the emergency rescue cloud, and between the emergency rescue cloud and the ground system processing system, to transmit optical remote sensing satellite level 2 product data to the disaster site or near-field in real time.

3. The method for edge reception and matching processing of optical remote sensing satellite secondary product data according to claim 1, characterized in that: The tracking and receiving plan is an XML file; it is used to provide a list of tracking and receiving instructions to the ground mobile processing system. The notification of completion of production of the second-level product is in XML format; The secondary product files are packaged in a compressed file, containing TIFF, JPG, and XML format products.

4. The method for edge reception and matching processing of optical remote sensing satellite secondary product data according to claim 1, characterized in that: When the ground-based mobile processing system analyzes the received secondary standard image products and supporting auxiliary data, it performs a disk array scan at a fixed frequency.

5. The method for edge reception and matching processing of secondary product data from optical remote sensing satellites according to claim 1, characterized in that: The ground-based mobile processing system scans the internal disk array, confirms the completion of the tracking and reception plan, and performs reception and parsing. Specifically: If it is determined that the tracking and receiving plan file has not been updated for a longer period than the set update time threshold, the received tracking and receiving plan file is parsed and converted into a tracking and receiving plan file that conforms to the internal format of the ground mobile processing system. The parsing of the tracking and receiving plan file is completed, and the internal processing flow of the ground mobile processing system is initiated.

6. The method for edge reception and matching processing of optical remote sensing satellite secondary product data according to claim 1, characterized in that: The ground-based mobile processing system scans the internal disk array and confirms that the Level 2 product production completion notification and the Level 2 product file compressed package have been received, parsed, transferred, and matched. Specifically: For the compressed package of Level 2 product files that have been successfully downloaded to the disk, decompress the package and transfer the Level 2 product data within the package to a designated path within the ground mobile processing system. For the notification of completion of production of Level 2 products, read and parse the notification content, and determine whether the corresponding Level 2 product data has been decompressed in the specified path: if the decompression is complete, update the file path and convert the received notification of completion of production of Level 2 products into a transfer notification of completion of production of Level 2 products that conforms to the internal format of the ground mobile processing system, and the ground mobile processing system starts disaster handling.

7. The method for edge reception and matching processing of secondary product data from optical remote sensing satellites according to claim 5, characterized in that: Both the compressed file of the completed secondary product documents and the notification of completion of secondary product production can be parsed in parallel. The parsing begins when it is determined that the current file has not been updated for a period of time longer than the set update time threshold.

8. The method for edge reception and matching processing of secondary product data from optical remote sensing satellites according to claim 1, characterized in that: After parsing, the tracking and receiving plan, the secondary product production completion notification, and the secondary product file compressed package should be removed from the disk path to reduce the disk array scanning processing burden.

Images