Workflow management method for collaborative remote sensing product production of multi-satellite data center

Abstract

The invention discloses a workflow management method for collaborative remote sensing product production of a multi-satellite data center, the method comprising the following steps: constructing a remote sensing product production processing flow base, constructing a multi-source remote sensing data processing flow knowledge base, and constructing a multi-level task order base; according to Keplerdynamic workflow system and PBS job scheduling system, automatically constructing the specific task workflow with different granularity for remote sensing product production; formulating a heuristicworkflow dynamic scheduling strategy method; formulating a multi-level task status monitoring strategy related to remote sensing product production, and a fault tolerant strategy based on retry, checkpoint recovery and timeout; constructing a dynamic process library and algorithm library to realize the dynamic and scalable management of multi-satellite remote sensing workflow in a multi-satellitedata center.

Description

technical field [0001] The present invention relates to the technical field of satellite data centers, in particular to a workflow management method for multi-satellite data center cooperative production of remote sensing products. Background technique [0002] At present, many countries and regions have established different remote sensing satellite platforms and satellite data centers, which have multi-spectral, multi-angle, multi-temporal, and multi-spatial resolution space observation and data processing capabilities. These different types of satellite platforms have produced and will continue to produce massive amounts of remote sensing data to meet specialized information extraction and application requirements. Since a single satellite data source is difficult to meet the comprehensive application needs of large-scale applications in the field of remote sensing, the current multiple satellite data center organizations are united to provide multi-source, massive satell...

AI Technical Summary

Problems solved by technology

[0003] However, there are technical problems in building a distributed remote sensing data collaborative processing system by combining multiple satellite data centers

First of all, multi-source remote sensing data are distributed in different satellite data centers, and large-scale data migration in the production process affects the overall efficiency of multi-data center collaborative processing; second, remote sensing data processing itself requires complex processes such as pre-processing and post-processing, and multi-source There are huge differences in the processing flow of remote sensing data, which increases the complexity of production workflow management; in addition, comprehensive remote sensing applications often require the processing system to be able to automatically complete batch data processing tasks, and realize complex process automation in distributed scenarios Management is also one of the key issues affecting the construction of multi-data center collaborative processing systems

For the production needs of massive remote sensing products and the important issues of multi-data center collaborative complex processing process automation management, the current solution is difficult to systematically formulate appropriate process management, work task automation organization, and scheduling based on the complex system architecture of multi-satellite data centers , extended management strategy

Images