Remote sensing satellite data automatic distribution method and system

Abstract

The invention relates to a remote sensing satellite data automatic distribution method and system, and the method comprises the following steps: S1, receiving and analyzing a data transmission plan issued by a superior, completing the legality detection, and extracting and storing the task parameters of a legal plan; s2, matching corresponding satellite parameter information from pre-stored satellite attribute parameters according to task requirements; s3, state information, including a task execution state, a load state, a hardware operation state and a network flow state, of the distribution equipment is collected, and available equipment resources are dynamically distributed based on the multi-dimensional state data; and S4, a scheduling task is completed by using a satellite ground transmission model, and one-to-one or one-to-multiple target center distribution task automation is realized based on data driving. According to the invention, automatic resource scheduling can be realized according to task information, in-station equipment resources and satellite information to complete a one-to-many data distribution task, and reliable and efficient 10-gigabit network transmission is realized.

Description

Technical Field

[0001] The present invention relates to the technical field of satellite payload data transmission, and particularly to a method and system for automatically distributing remote sensing satellite data. Background Art

[0002] In recent years, with the rapid development of information technology, the application of remote sensing satellite technology in the fields of meteorological monitoring, agricultural planning, environmental assessment, disaster warning, etc. has been continuously deepened, and the demand for high-timeliness and high-resolution remote sensing data has shown an explosive growth. According to industry statistics, the number of remote sensing satellites in orbit globally has exceeded one thousand, and the amount of data generated daily is as high as dozens of PB, and the frequency and complexity of data distribution have increased significantly accordingly. At the same time, as the core node for ground data processing and distribution, the task mode of remote sensing stations is gradually transforming from single reception to multi-task parallel and dynamic scheduling. However, traditional data distribution systems are mostly designed based on fixed processes and static resource configurations, and it is difficult to meet the current demand for efficient distribution of massive data, and there is an urgent need for technological innovation to break through the bottleneck.

[0003] Traditional remote sensing data distribution systems usually rely on manual intervention or semi-automated scheduling, mainly focusing on the basic 10 Gigabit network transmission function. Its core processes include task reception, device allocation, data transmission, etc., but significant defects have emerged in practical applications.

[0004] Therefore, the requirements for the distribution system are no longer limited to being able to schedule devices to complete the basic function of conventional 10 Gigabit network transmission according to the established process. How to improve the automated scheduling of the system, flexibly and conveniently schedule device resources, and efficiently utilize the link bandwidth to complete one-to-one and one-to-many distribution tasks is a more concerned issue at present. Summary of the Invention

[0005] In order to solve the above technical problems existing in the prior art, the purpose of the present invention is to provide a method and system for automatically distributing remote sensing satellite data, which can automatically schedule resources according to task information, in-station device resources, and satellite information to complete the one-to-many data distribution task and achieve reliable and efficient 10 Gigabit network transmission.

[0006] To achieve the above object of the invention, the present invention provides a method for automatically distributing remote sensing satellite data, including the following steps:

[0007] Step S1: Receive and parse the data transmission plan issued by the superior, complete the legality detection, extract the task parameters of the legal plan and store them;

[0008] Step S2: Match the corresponding satellite parameters from the pre-stored satellite attribute parameters according to the task requirements;

[0009] Step S3: Collect the status information of the distribution device, including the task execution status, load status, hardware operation status, and network traffic status, and dynamically allocate available device resources based on the multi-dimensional status data;

[0010] Step S4: Use the satellite ground transmission model to complete the scheduling task, and realize the automation of the distribution task for one-to-one or one-to-many target centers based on data driving.

[0011] According to a technical solution of the present invention, the satellite ground transmission model defines the task distribution rules by integrating channels, rates, virtual channels, priorities, home centers, and transmission protocols.

[0012] According to a technical solution of the present invention, in step S1, the legality detection at least includes:

[0013] Perform legality detection on the file name, file format, and task parameter fields.

[0014] According to a technical solution of the present invention, it further includes:

[0015] Real-time monitor the status of the devices in the resource pool. When a device anomaly is detected, automatically switch to a standby device to ensure the continuity of the task.

[0016] According to a technical solution of the present invention, in step S4, it includes:

[0017] Send a data transmission application to the application center, and decide whether to start the task according to the feedback from the application center;

[0018] When starting the task, calculate the transmission rate according to the link bandwidth and task priority, and send a task control instruction to the distribution device;

[0019] Real-time monitor the task execution status, and send a transmission completion report to the application center after the task ends.

[0020] According to an aspect of the present invention, a remote sensing satellite data automatic distribution system is provided, including:

[0021] A task plan management module, configured to receive and parse the data transmission plan issued by the superior, complete the legality detection, extract the task parameters of the legal plan, and store them;

[0022] An information management module, configured to match the corresponding satellite parameters from the pre-stored satellite attribute parameters according to the task requirements;

[0023] A resource monitoring module, configured to collect the status information of the distribution device, including the task execution status, load status, hardware operation status, and network traffic status, and dynamically allocate available device resources based on the multi-dimensional status data;

[0024] The planned process scheduling module uses a satellite ground transmission model to complete scheduling tasks and realizes the automation of one-to-one or one-to-many target center distribution tasks based on data drive.

[0025] According to a technical solution of the present invention, the information management module is further used to store satellite attribute parameters, and the attribute parameters include the channel configuration, virtual channel identifier, priority level, home center and transmission protocol of the satellite.

[0026] The satellite ground transmission model defines task distribution rules by integrating channels, rates, virtual channels, priorities, home centers and transmission protocols.

[0027] According to a technical solution of the present invention, the legality detection at least includes:

[0028] Perform legality detection on the file name, file format and task parameter fields.

[0029] According to a technical solution of the present invention, it further includes:

[0030] The device switching module is used to monitor the status of the devices in the resource pool in real time. When a device anomaly is detected, it automatically switches to a standby device to ensure the continuity of tasks.

[0031] According to a technical solution of the present invention, the planned process scheduling module is further used to:

[0032] Send a data transmission application to the application center and decide whether to start a task according to the feedback from the application center;

[0033] When starting a task, calculate the transmission rate according to the link bandwidth and task priority, and send a task control instruction to the distribution device;

[0034] Monitor the task execution status in real time and send a transmission completion report to the application center after the task ends.

[0035] Compared with the prior art, the present invention has the following beneficial effects:

[0036] A method and system for automatically distributing remote sensing satellite data according to the present invention realizes the automatic scheduling of resources to complete the one-to-many data distribution task according to task information, in-station device resources, and satellite information, and realizes reliable and efficient 10 Gigabit network transmission.

[0037] In the present invention, through the design of a satellite ground transmission model and a unified management method, users can configure satellite task information according to their needs, and the system automatically completes the matching according to the configuration, simplifying manual operations.

[0038] By monitoring the task execution situation and the real-time monitoring and automatic anomaly switching of device resources, the reliability of the system is improved, and the complete execution of the distribution task is ensured.

[0039] Compared with the common data distribution processing, the present invention greatly reduces manual operations and interventions, significantly improving the transmission efficiency of satellite distribution tasks, thereby exerting greater efficacy.

[0040] Compared with the common data distribution mode, the present invention greatly reduces manual operations and interventions, enables real-time one-to-many data transmission, improves bandwidth utilization, and enhances transmission efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0042] Figure 1 Schematically showing a flowchart of a method for automatically distributing remote sensing satellite data according to an embodiment of the present invention;

[0043] Figure 2 Schematically showing a flowchart for starting an automatic data distribution task according to an embodiment of the present invention;

[0044] Figure 3 Schematically showing a flowchart for ending an automatic data distribution task according to an embodiment of the present invention;

[0045] Figure 4 Schematically showing a satellite information management diagram according to an embodiment of the present invention;

[0046] Figure 5 Schematically showing a display diagram of a distribution task according to an embodiment of the present invention;

[0047] Figure 6 Schematically showing a monitoring block diagram of a monitoring and management software according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0048] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.

[0049] As Figures 1 to 6As shown in the figure, an automatic distribution method and system for remote sensing satellite data of the present invention automatically schedules system resources to achieve data distribution; designs a satellite ground transmission model for channels, rates, virtual channels, priorities, home centers, and transmission protocols, uniformly manages satellite tasks according to the model, and realizes data-driven automatic distribution according to the model; performs balanced selection and rate calculation of task link devices based on real-time monitoring of task types, priorities, and device resources; and monitors the status of devices in the resource pool in real time according to the task execution situation, and switches devices in case of anomalies.

[0050] An automatic distribution system for remote sensing satellite data of the present invention includes: a task plan management module, an information management module, a resource monitoring module, a plan process scheduling module, and a device switching module.

[0051] The task plan management module is used to receive and parse the data transmission plan issued by the superior, complete the legality detection, receive the legal plan, extract the task parameters of the legal plan and store them, and reject the illegal plan;

[0052] The information management module is mainly responsible for the unified management of satellite parameter information, and is used to match the corresponding satellite parameters from the pre-stored satellite attribute parameters according to the task requirements;

[0053] The resource monitoring module is mainly responsible for monitoring the software and hardware device resources in the station, automatically allocating the distribution device resources that can execute tasks, and is used to collect the status information of the distribution devices, including task execution status, load status, hardware operation status, and network traffic status, and dynamically allocate available device resources based on multi-dimensional status data; it is also used to complete device parameter configuration according to the task information;

[0054] The plan process scheduling module is mainly responsible for completing task scheduling. In a plan-driven manner, according to the principle of time compliance, it starts the task execution process and schedules relevant devices to complete the distribution task plan. It uses the satellite ground transmission model to complete the scheduling task and realizes the automation of the distribution task for one-to-one or one-to-many target centers based on data driving.

[0055] In some embodiments of the present invention, the information management module is also used to store satellite attribute parameters, and the attribute parameters include channel configuration, virtual channel identifier, priority level, home center, and transmission protocol of the satellite,

[0056] The establishment process of the satellite ground transmission model is based on multi-parameter coupling design: First, according to the service configuration, satellite channel information is determined, and the number and characteristics of the physical channels for data transmission are determined; different types of data are transmitted to different centers according to the virtual channel identifier and the home center; secondly, based on the priority, the data transmission is sorted and scheduled, and high-priority tasks are transmitted first. Finally, a specific transmission method is selected according to the transmission protocol to distribute the data to the specified center.

[0057] The satellite ground transmission model defines task distribution rules by integrating channels, rates, virtual channels, priorities, home centers, and transmission protocols.

[0058] In some embodiments of the present invention, the legality detection at least includes:

[0059] Performing legality detection on file names, file formats, and task parameter fields.

[0060] According to a technical solution of the present invention, it further includes:

[0061] A device switching module, configured to monitor the status of devices in the resource pool in real time. When a device anomaly is detected, it automatically switches to a standby device to ensure task continuity.

[0062] The device switching module is configured with monitoring and management software to monitor the status of the aggregation and distribution devices in real time, establish a resource pool to uniformly schedule the devices, parse the plan file, extract valid task information, perform rate calculation according to the task type and priority, and send the task information to the balanced aggregation and distribution devices.

[0063] In an embodiment of the present invention, a method for automatically distributing remote sensing satellite data of the present invention includes the following steps:

[0064] Step S1: Receive and parse the data transmission plan issued by the superior, complete the legality detection, extract the task parameters of the legal plan, and store them. The legality detection at least includes: performing legality detection on file names, file formats, and task parameter fields;

[0065] Step S2: Match the corresponding satellite parameters from the pre-stored satellite attribute parameters according to the task requirements;

[0066] Step S3: Collect the status information of the distribution devices, including task execution status, load status, hardware operation status, and network traffic status, and dynamically allocate available device resources based on the multi-dimensional status data;

[0067] Step S4: Use the satellite ground transmission model to complete the scheduling task, and realize the automation of the distribution task for one-to-one or one-to-many target centers based on data driving. The satellite ground transmission model defines task distribution rules by integrating channels, rates, virtual channels, priorities, home centers, and transmission protocols.

[0068] In some embodiments of the present invention, it further includes:

[0069] Monitoring the status of devices in the resource pool in real time. When a device anomaly is detected, it automatically switches to a standby device to ensure task continuity.

[0070] In some embodiments of the present invention, a satellite ground transmission model is utilized to complete the scheduling task, including the following steps:

[0071] 1) After receiving the data transmission plan issued by the superior, parse it, and at the same time perform legality detection on the file name, file format, and task parameter fields included in the file. Receive the legal plan, reject the illegal plan, and at the same time store the task parameter information of the legal plan in the database for preservation;

[0072] 2) According to the transmission plan parameters, call the information management module to obtain the transmission protocol and center of the corresponding satellite. If it is a multi-center, establish a one-to-many task;

[0073] 3) According to the transmission plan parameters, call the resource monitoring module to collect the task execution status, load status, hardware status, and network traffic status information of each data aggregation and distribution device. Based on the above four states, select the device that satisfies the task the most according to the above states of each device to execute the plan.

[0074] 4) According to the transmission plan parameters, send a data transmission application to the application center at the preset time (settable) before the task execution. After receiving the application, the application center returns a transmission application receipt to confirm the data transmission information.

[0075] 5) After obtaining the transmission receipt from the application center, when the transmission application receipt is TRUE, calculate the transmission rate according to the current link bandwidth usage and task priority, and send a control packet to the data aggregation and distribution software as follows:

[0076] a. Send a distribution task control order to the data aggregation and distribution software;

[0077] b. The data aggregation and distribution software reports the control result and reports the task status during the processing.

[0078] When the transmission application receipt is FALSE, terminate the process, the task fails, and the process ends.

[0079] 6) During the task execution, the data aggregation and distribution software reports the task status in real time.

[0080] 7) After the task execution is completed, the data aggregation and distribution software reports the job completion information. The system simultaneously sends a transmission completion report to the application center. After receiving the report, the application center returns a transmission report receipt, and the process ends.

[0081] In some embodiments of the present invention, as Figure 2 shown, the workflow of the data automatic distribution task includes the following steps:

[0082] 1. Process start: Take "receiving a data transmission link establishment application" as the starting point of the process.

[0083] 2. Legality Check:

[0084] Check the length of the tracking and receiving plan number, whether the task code exists, etc., and verify the integrity of the information.

[0085] If the information is incomplete (such as incorrect length, missing key content), directly "reply to the transmission link establishment application receipt" (mark the reason for failure), and the process ends.

[0086] If the information is complete, proceed to the next step.

[0087] 3. Equipment Resource Discrimination and Instruction Issuance:

[0088] Discriminate the "data transmission server that can execute this task" in the equipment resources and issue a "data reception control" instruction to it.

[0089] 4. Response Check and Loop Judgment:

[0090] If the response to the "data reception control" from the server is not received, enter the loop judgment.

[0091] If the number of loops is greater than 3 times, record the log and alarm, and then "reply to the transmission link establishment application receipt" (mark the reason for failure), and the process ends.

[0092] If the loop does not exceed 3 times, continue with the subsequent processing.

[0093] 5. Classification and Handling of Failure Reasons:

[0094] If the reason for failure is "lack of satellite parameters / central parameters / equipment parameters", further judge whether there is corresponding parameter information:

[0095] If there is corresponding parameter, issue the corresponding parameter information;

[0096] If there is no corresponding parameter, record the log and alarm.

[0097] If it fails for other reasons, directly record the log and alarm.

[0098] 6. Multi-Server Response Handling:

[0099] If the response address or service quantity of the "data reception control" is greater than 1, record that "all data transmission server responses are normal" and update the plan status;

[0100] If the conditions are not met (such as the response quantity does not meet the standard), record the log and alarm, and reply to the "data transmission application receipt" (mark the reason for failure).

[0101] 7. Distribution Center Acquisition and Application Sending:

[0102] Obtain the distribution center according to parameters such as the plan information and satellite attributes.

[0103] Send a "data transmission link establishment application" to the distribution center.

[0104] 8. Central response processing:

[0105] If the "application receipt" from the center is not received within 10 seconds, enter a loop judgment:

[0106] If the loop is greater than 3 times, record a log alarm and reply with a "data transmission application receipt" (indicating the failure reason);

[0107] If the loop is not more than 3 times, continue to wait for the response.

[0108] After receiving a FALSE "application receipt", if the receipt content is abnormal, record a log alarm and reply with the receipt; if the receipt is normal, proceed to the next step.

[0109] 9. Server list filtering:

[0110] Filter the transmission server list and only retain the servers with normal status:

[0111] If the number of servers in the filtered list is greater than 0, send a "data transmission completion group, FALSE";

[0112] If the list count is 0, record a log alarm.

[0113] 10. Secondary instruction issuance and loop judgment:

[0114] Send a "data sending control" to the data transmission server.

[0115] If no response is received, enter a loop judgment:

[0116] If the loop is greater than 3 times, record a log alarm and reply with a "data transmission application receipt" (indicating the failure reason);

[0117] If the loop is not more than 3 times, continue the process.

[0118] 11. Processing of repeated failure reasons:

[0119] Execute again the failure reason classification and processing logic in step 5 (lack of parameters or other reasons), record the server task execution situation, update the plan status, and reply with a receipt.

[0120] 12. Real-time status update and process end:

[0121] Receive the real-time collection and distribution status information, update the plan execution status, and finally end the process.

[0122] In some embodiments of the present invention, such as Figure 3As shown in the figure, the workflow of the data automatic distribution task includes the following steps:

[0123] 1. Process startup: Start the process with "receiving the data transmission completion report".

[0124] 2. Plan information verification:

[0125] Verify whether there is a matching plan in the plan with the device code, spacecraft identification, and tracking and receiving plan number matching.

[0126] If no plan is matched, directly "reply the transmission completion report receipt, FALSE", and the process ends.

[0127] If a plan is matched, judge the "transmission success / failure" status.

[0128] 3. Transmission status judgment:

[0129] If the transmission status is "failure", reply "transmission completion report receipt, FALSE", and the process ends.

[0130] If the transmission status is "success", further judge the "receiving status".

[0131] 4. Receiving status processing:

[0132] If the receiving status is "to be executed":

[0133] Send "data receiving end notification" (content is "FALSE") to all data transmission servers that execute the receiving task, and enter the judgment of "whether a response is received".

[0134] If the receiving status is "executing / waiting for the transmission completion report":

[0135] Send "data receiving end notification" (content is the same as the report) to all data transmission servers that execute the receiving task, and enter the judgment of "whether a response is received".

[0136] 5. Response situation processing:

[0137] If no response is received, judge whether the number of loops is greater than 3 times:

[0138] If the loop > 3 times, log an alarm, reply "transmission completion report receipt, FALSE, reason 'no data received'", and the process ends.

[0139] If the loop does not exceed 3 times, return and continue to wait for the response.

[0140] If a response is received, judge "whether the completion report is successful".

[0141] 6. Completion report result processing:

[0142] If the completion report is "Failed":

[0143] Send a report receipt "FALSE" to all data transfer servers;

[0144] If a center application receipt is received, send "Transfer Completion Report, FALSE" to the user;

[0145] Send a control order (channel, stop), mark the status as failed, and send "Transfer Completion Report, FALSE" (reason same as the device) to the user, and the process ends.

[0146] If the completion report is "Success":

[0147] Loop to check "All data transfer servers have consistently received and processed successfully":

[0148] If not all completed, continue to loop;

[0149] After all are completed, inform the server that it is done and reply with a report receipt "TRUE".

[0150] 7. Wait for the result of the data transfer software:

[0151] Wait for the success / failure result of process 3 sent by the data transfer software, and loop to judge "Whether the data transfer servers for all execution tasks have sent process 3 successfully":

[0152] If not all are successful, send "Transfer Completion Report, FALSE" to the user, and the process ends.

[0153] If all are successful, send "Transfer Completion Report, TRUE" to the user, and the plan status changes to "Waiting for Quality Analysis Report".

[0154] 8. Quality analysis report processing:

[0155] Judge "Whether the corresponding quality report is received":

[0156] If not received, check if the detection time > 1 second:

[0157] If > 1 second, log an alarm and execute "Quality analysis report stored in the database, data reception successful, error data rate 0, error", and the plan status changes to "Completed", and the process ends.

[0158] If not exceeding 1 second, return and continue to wait.

[0159] If the quality report is received, store the report in the database, send the quality analysis report, and the plan status changes to "Completed", and the process ends.

[0160] It should be noted that although the embodiments described above of the present invention are illustrative, they are not a limitation of the present invention. Therefore, the present invention is not limited to the above specific embodiments. Without departing from the principle of the present invention, any other embodiments obtained by those skilled in the art under the inspiration of the present invention are deemed to be within the protection scope of the present invention.

Claims

1. An automatic distribution method for remote sensing satellite data, characterized in that, It includes the following steps: Step S1: Receive and parse the data transmission plan issued by the superior, complete the legality detection, extract the task parameters of the legal plan, and store them; Step S2: Match the corresponding satellite parameter information from the pre-stored satellite attribute parameters according to the task requirements; Step S3: Collect the status information of the distribution device, including the task execution status, load status, hardware operation status, and network traffic status, and dynamically allocate available device resources based on the multi-dimensional status data; Step S4: Use the satellite ground transmission model to complete the scheduling task, and realize the automation of the one-to-one or one-to-many target center distribution task based on data driving.

2. The automatic distribution method of remote sensing satellite data according to claim 1, wherein The satellite ground transmission model defines the task distribution rules by integrating channels, rates, virtual channels, priorities, home centers, and transmission protocols.

3. The automatic distribution method of remote sensing satellite data according to claim 1, wherein In step S1, the legality detection at least includes: Perform legality detection on the file name, file format, and task parameter fields.

4. The automatic distribution method of remote sensing satellite data according to claim 1, characterized in that It also includes: Real-time monitor the status of the devices in the resource pool. When a device anomaly is detected, automatically switch to a standby device to ensure the continuity of the task.

5. The automatic distribution method of remote sensing satellite data according to claim 1, wherein In step S4, it includes: Send a data transmission application to the application center and decide whether to start the task according to the feedback from the application center; When starting the task, calculate the transmission rate according to the link bandwidth and task priority, and send a task control instruction to the distribution device; Real-time monitor the task execution status and send a transmission completion report to the application center after the task ends.

6. An automatic distribution system for remote sensing satellite data, characterized in that, It includes: A task plan management module, which is used to receive and parse the data transmission plan issued by the superior, complete the legality detection, extract the task parameters of the legal plan, and store them; An information management module, which is used to match the corresponding satellite parameters from the pre-stored satellite attribute parameters according to the task requirements; A resource monitoring module, which is used to collect the status information of the distribution device, including the task execution status, load status, hardware operation status, and network traffic status, and dynamically allocate available device resources based on the multi-dimensional status data; A plan process scheduling module, which uses the satellite ground transmission model to complete the scheduling task, and realizes the automation of the one-to-one or one-to-many target center distribution task based on data driving.

7. The automatic distribution system for remote sensing satellite data according to claim 6, characterized in that, The information management module is also used to store the satellite attribute parameters, and the attribute parameters include the channel configuration, virtual channel identifier, priority level, home center, and transmission protocol of the satellite. The satellite ground transmission model defines the task distribution rules by integrating channels, rates, virtual channels, priorities, home centers, and transmission protocols.

8. The automatic distribution system for remote sensing satellite data according to claim 6, wherein The legality detection at least includes: Perform legality detection on the file name, file format, and task parameter fields.

9. The automatic distribution system for remote sensing satellite data according to claim 6, wherein It also includes: A device switching module, which is used to real-time monitor the status of the devices in the resource pool. When a device anomaly is detected, automatically switch to a standby device to ensure the continuity of the task.

10. The automatic distribution system for remote sensing satellite data according to claim 6, wherein The plan process scheduling module is also used for: Send a data transmission application to the application center and decide whether to start the task according to the feedback from the application center; When starting the task, calculate the transmission rate according to the link bandwidth and task priority, and send a task control instruction to the distribution device; Real-time monitor the task execution status and send a transmission completion report to the application center after the task ends.

Images