Satellite ground data processing system construction method and satellite ground data processing method

Abstract

The invention relates to the technical field of satellite data processing, and discloses a satellite ground data processing system construction method and a satellite ground data processing method, and the method comprises the steps: obtaining satellite observation data; extracting a satellite model from the satellite observation data, mapping the satellite model to a preset satellite data processing flow, and determining a satellite data processing flow corresponding to the satellite model; service semantics are obtained, and a first mapping relation between the service link and the satellite data processing flow is established based on the service semantics; obtaining a service parameter value, and establishing a second mapping relationship between the service parameter and the satellite data processing flow based on the service parameter value and in combination with the first mapping relationship; establishing a third mapping relation between the business scheduling task and the satellite data processing flow based on business semantics in combination with the second mapping relation; and combining the first mapping relation, the second mapping relation and the third mapping relation to construct a satellite ground data processing system. According to the method, the business customization development workload is greatly reduced.

Description

Technical Field

[0001] The present invention relates to the field of satellite data processing technology, and in particular to a satellite ground data processing system construction method and a satellite ground data processing method. Background Art

[0002] Resource satellites are satellites used to survey and study the earth's natural resources. The observation payloads of resource satellites are becoming increasingly complex. In addition to optical payloads, they usually contain multiple observation payloads. After the satellite observation data is received and landed by the ground station, it is usually processed by the satellite ground data processing system for multi-satellite large-scale data processing and data product production, and standard products of various types of satellite observation data are produced. Since satellite ground data processing involves many business links, complex professional division of labor, and non-uniform professional operation software technology architecture, an independent data processing process scheduling system is usually required to achieve ground processing system interconnection, operation management, safety protection, and system simulation and verification, so as to meet the parallel scheduling and processing requirements of multi-satellite large-scale processing tasks of the satellite ground processing system, and provide powerful system support services for data processing, archiving and other subsystems.

[0003] In related technologies, ground data processing process scheduling systems usually need to be deeply customized and developed based on business scenarios. The configuration-based, low-code rapid development capabilities are generally insufficient, making it difficult to meet the multi-satellite large-scale processing task requirements of satellite ground processing systems. Summary of the invention

[0004] In view of this, the present invention provides a satellite ground data processing system construction method and a satellite ground data processing method to solve the problem that it is difficult to meet the multi-satellite large-scale processing task requirements of the satellite ground processing system.

[0005] In a first aspect, the present invention provides a method for constructing a satellite ground data processing system, the method comprising:

[0006] Obtain satellite observation data;

[0007] Extracting satellite models from satellite observation data, mapping the satellite models to preset satellite data processing procedures, and determining the satellite data processing procedures corresponding to the satellite models;

[0008] Acquire business semantics, and establish a first mapping relationship between business links and satellite data processing procedures based on the business semantics;

[0009] Acquire a service parameter value, and establish a second mapping relationship between the service parameter and the satellite data processing flow based on the service parameter value and in combination with the first mapping relationship;

[0010] Based on the business semantics and in combination with the second mapping relationship, a third mapping relationship between the business scheduling task and the satellite data processing flow is established;

[0011] The first mapping relationship, the second mapping relationship and the third mapping relationship are combined to construct a satellite ground data processing system.

[0012] In the present invention, by standardizing professional business terms in the data processing flow, unified standardized Chinese and English names and English IDs are formed to constrain and guide process modeling and customized development. By semantic analysis of professional business data in the ground data processing business process, the business process diagram used by business personnel can be quickly mapped to the Wfmc or BPMN standard graphics supported by the workflow system, and the data processing process can be quickly and accurately modeled. By extracting information related to business parameters and process scheduling, control items for process flow and multi-instance concurrent scheduling can be automatically formed, forming a dynamic scheduling method for ground data processing flow, improving configuration capabilities, and reducing the code workload of customized development. Based on the dynamic scheduling method, the productization and configuration of the satellite ground data processing process scheduling system can be realized, and the workload of business customization development can be greatly reduced.

[0013] In an optional implementation, based on business semantics, a first mapping relationship between a business link and a satellite data processing flow is established, including:

[0014] Establish the business steps of the business link as activity nodes;

[0015] Map the business links into sub-processes in the preset process template, extract and solidify the sub-processes in the satellite data processing process, and obtain the 0-level sub-processes;

[0016] Perform nested scheduling on the level 0 sub-process to obtain the standard sub-process;

[0017] The activity nodes are linked to the standard sub-processes, and the business links are named in a standardized manner to establish the first mapping relationship between the business links and the satellite data processing process.

[0018] In this approach, business subprocesses and nested business subprocesses based on business contexts can realize the automatic transfer of business contexts and process contexts, which can improve the reusability and configurability of business links. Standardization of professional terms based on business semantics can form a common language that can be referenced and reused in business information construction, avoiding inconsistencies in business and technical implementation.

[0019] In an optional implementation, based on the service parameter value and in combination with the first mapping relationship, a second mapping relationship between the service parameter and the satellite data processing flow is established, including:

[0020] Based on the service parameter value, determining whether the processing mode is a single-channel format or a dual-channel format;

[0021] Based on the processing method, the satellite payload is analyzed and the standard sub-process corresponding to the payload in the first mapping relationship is started;

[0022] Based on the number of data scenes extracted in the standard sub-process, the standard sub-process is started, and the business parameters are named in a standardized manner to establish a second mapping relationship between the business parameters and the satellite data processing process.

[0023] In this way, the multi-instance dynamic scheduling technology of activities / sub-processes based on business parameters can realize dynamic and efficient scheduling of process instances during runtime.

[0024] In an optional implementation, based on business semantics, a third mapping relationship between the business scheduling task and the satellite data processing flow is established, including:

[0025] Based on business semantics, execute business scheduling tasks of different interaction technologies;

[0026] Based on the standardized named business links, different interaction technologies are configured for the business links, and computing jobs are mapped to the active nodes to establish a third mapping relationship between the business scheduling tasks and the satellite data processing flow.

[0027] In this way, based on business semantics flowchart meta-mapping technology, software technicians can quickly convert professionals' business processing flows into standardized process models.

[0028] In a second aspect, the present invention provides a satellite ground data processing method, the method comprising:

[0029] Obtain satellite observation data to be processed;

[0030] Extract the satellite observation data to be processed and obtain the satellite model;

[0031] The satellite model is input into the satellite ground data processing system, and the satellite data processing process associated with the satellite model is started to obtain processed target ground data, wherein the satellite ground data processing system is constructed using the satellite ground data processing system construction method of any one of the first aspects.

[0032] In the present invention, satellite signals are extracted from the satellite observation data to be processed, and the satellite model is input into the constructed satellite ground data processing system. The computing job scheduling and business service collaboration are realized through data processing process scheduling. Different satellite models are matched with corresponding data processing processes. The automatic mapping of satellite models and data processing processes can realize the personalized configuration, intelligent matching and automatic scheduling of the data processing process of satellite model observation data.

[0033] In a third aspect, the present invention provides a device for constructing a satellite ground data processing system, the device comprising:

[0034] A first data acquisition module, used to acquire satellite observation data;

[0035] A satellite model configuration module is used to extract satellite models from satellite observation data, map the satellite models to a preset satellite data processing flow, and determine the satellite data processing flow corresponding to the satellite model;

[0036] A first mapping module, used to obtain business semantics and establish a first mapping relationship between business links and satellite data processing procedures based on the business semantics;

[0037] A second mapping module is used to obtain a service parameter value, and establish a second mapping relationship between the service parameter and the satellite data processing flow based on the service parameter value and in combination with the first mapping relationship;

[0038] A third mapping module is used to establish a third mapping relationship between the business scheduling task and the satellite data processing flow based on the business semantics and in combination with the second mapping relationship;

[0039] The system building module is used to build a satellite ground data processing system by combining the first mapping relationship, the second mapping relationship and the third mapping relationship.

[0040] In a fourth aspect, the present invention provides a satellite ground data processing device, the device comprising:

[0041] A second data acquisition module is used to acquire the satellite observation data to be processed;

[0042] A satellite model extraction module is used to extract the satellite observation data to be processed and obtain the satellite model;

[0043] The data processing module is used to input the satellite model into the satellite ground data processing system, start the satellite data processing process associated with the satellite model, and obtain the processed target ground data, wherein the satellite ground data processing system is constructed using the satellite ground data processing system construction device of the third aspect.

[0044] In a fifth aspect, the present invention provides a computer device, comprising: a memory and a processor, the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the satellite ground data processing system construction method of the first aspect or any corresponding embodiment thereof, or executes the satellite ground data processing method of the second aspect by executing the computer instructions.

[0045] In a sixth aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the satellite ground data processing system construction method of the first aspect or any corresponding embodiment thereof, or to execute the satellite ground data processing method of the second aspect.

[0046] In a seventh aspect, the present invention provides a computer program product comprising computer instructions, wherein the computer instructions are used to enable a computer to execute the satellite ground data processing system construction method of the first aspect or any corresponding embodiment thereof, or to execute the satellite ground data processing method of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0048] Figure 1 It is a flowchart of a method for constructing a satellite ground data processing system according to an embodiment of the present invention.

[0049] Figure 2 It is a schematic diagram of a satellite model dynamically starting a data processing scheduling main process according to an embodiment of the present invention.

[0050] Figure 3 It is a flowchart of another satellite ground data processing system construction method according to an embodiment of the present invention.

[0051] Figure 4 It is a flow chart of sub-process extraction and solidification in a satellite model scheduling main process according to an embodiment of the present invention.

[0052] Figure 5 It is a flow chart of nested scheduling of standard production sub-processes in a satellite model level 0 production sub-process according to an embodiment of the present invention.

[0053] Figure 6 The present invention is a flowchart of a process with sub-process linking and dynamic scheduling of active nodes at runtime according to an embodiment of the present invention.

[0054] Figure 7 The present invention is a flowchart of a process for dynamic multi-instance scheduling of activities / sub-processes based on business data control parameters according to an embodiment of the present invention.

[0055] Figure 8The figure is a flowchart of a satellite ground data processing method according to an embodiment of the present invention.

[0056] Fig. 9 It is a flow chart of comprehensive dispatching and monitoring of a ground data processing process according to an embodiment of the present invention.

[0057] Fig.10 4 is a structural block diagram of a satellite ground data processing system construction device according to an embodiment of the present invention.

[0058] Fig.11 4 is a structural block diagram of a satellite ground data processing device according to an embodiment of the present invention.

[0059] Fig.12 It is a schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0060] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0061] In the related technologies, the satellite ground data processing system has many subsystems, and the process scheduling system is one of them. The ground data processing process scheduling system usually needs to be deeply customized and developed according to the business scenario. The configuration-based, low-code rapid development capabilities are generally insufficient, and it is difficult to meet the multi-satellite large-scale processing task requirements of the satellite ground processing system.

[0062] In order to solve the above problems, a method for constructing a satellite ground data processing system is provided in an embodiment of the present invention, which is used in a computer device. It should be noted that its execution subject can be a satellite ground data processing system construction device, which can be implemented as part or all of the computer device through software, hardware, or a combination of software and hardware. The computer device can be a terminal, a client, or a server. The server can be a single server or a server cluster composed of multiple servers. The terminal in the embodiment of the present application can be a smart phone, a personal computer, a tablet computer, or other intelligent hardware devices. In the following method embodiments, the execution subject is a computer device as an example for explanation.

[0063] The computer device in this embodiment is suitable for the use scenario of customized development of resource satellite ground data processing process scheduling system. The present invention provides a method for constructing a satellite ground data processing system, and through the standardization of professional business terms in the data processing process, a unified standardized Chinese and English name and English ID are formed to constrain and guide process modeling and customized development. Through the semantic analysis of professional business data in the ground data processing business process, the business process diagram used by business personnel can be quickly mapped to the Wfmc or BPMN standard graphic element supported by the workflow system, and the data processing process can be quickly and accurately modeled. By extracting information related to business parameters and process scheduling, control items for process flow and multi-instance concurrent scheduling can be automatically formed, forming a dynamic scheduling method for ground data processing processes, improving configuration capabilities, and reducing the workload of customized development code. Based on the dynamic scheduling method, the productization and configuration of the satellite ground data processing process scheduling system can be realized, and the workload of business customization development can be greatly reduced.

[0064] According to an embodiment of the present invention, an embodiment of a method for constructing a satellite ground data processing system is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0065] In this embodiment, a method for constructing a satellite ground data processing system is provided, which can be used in the above-mentioned mobile terminals, such as mobile phones, tablet computers, etc. Figure 1 is a flow chart of a method for constructing a satellite ground data processing system according to an embodiment of the present invention. Figure 1 As shown, the process includes the following steps:

[0066] Step S101, obtaining satellite observation data.

[0067] In one example, satellite observation data is received by a ground station.

[0068] Step S102: extracting a satellite model from the satellite observation data, mapping the satellite model to a preset satellite data processing flow, and determining the satellite data processing flow corresponding to the satellite model.

[0069] In one example, after conventional satellite observation data is received on the ground, ground data processing is usually started in the form of satellite observation raw data files. Computing job scheduling and business service collaboration are achieved through data processing process scheduling. Different satellite models are matched with corresponding data processing processes. The automatic mapping of satellite models and data processing processes can realize personalized configuration, intelligent matching and automatic scheduling of the data processing process of satellite model observation data.

[0070] Specifically, the automatic mapping of satellite models and data processing procedures includes: 1) Satellite model and data processing procedure template configuration: Satellite model and data processing procedure template configuration implements the binding of the data processing procedure required to call the satellite model data. Usually, the observation data produced by the same satellite model have the same technical specifications and are scheduled and processed using the same data processing procedure. The satellite model data is extracted from the received raw observation data. Due to the long satellite development process and the large number of codes, it is necessary to match the same satellite model through satellite model, satellite code, satellite ID, etc. Figure 2 FIG. 1 is a schematic diagram of a satellite model dynamically starting a data processing scheduling main process according to an embodiment of the present invention. Figure 2 As shown, by associating the satellite model with the data processing main process template, the satellite model data extracted from the original observation data starts the corresponding satellite model data processing process instance.

[0071] 2) Satellite model and data processing process template version configuration: Satellite model and data processing process template version configuration implements the matching rules between satellite model and data processing process template version, including automatic version rules and specified specific versions. When the specific version of the process template is not specified, the automatic version rule directly matches the latest officially released version of the process template. The running process instance still maintains the process template version number configured when the process is started.

[0072] Step S103: acquiring business semantics, and establishing a first mapping relationship between business links and satellite data processing procedures based on the business semantics.

[0073] In one example, the first mapping relationship is the automatic mapping of satellite data processing business links and process activities / sub-processes. The satellite data processing process involves many business links. The automatic mapping of satellite business links and process activities / sub-processes mainly realizes the correspondence between business links / business steps and process modeling activities / sub-processes. The Chinese and English names of business links / business steps are standardized and consistent with the names / IDs of the corresponding process activities / sub-processes.

[0074] Step S104: acquiring a service parameter value, and establishing a second mapping relationship between the service parameter and the satellite data processing flow based on the service parameter value and in combination with the first mapping relationship.

[0075] In one example, the second mapping relationship is a mapping between business parameters and dynamic multi-instance concurrent processing of tasks. The coarse-grained mapping between business parameters and dynamic multi-instance concurrent processing of tasks mainly realizes the mapping relationship between business parameters and the number of task instances. The main business parameters that trigger multi-instance concurrent tasks include the number of channels, the number of level 0 data files, the number of scenes and other parameters. In the task scheduling process, multi-instance concurrent scheduling is performed based on the dynamically obtained parameter values. The Chinese and English names of business parameters are standardized, and the English names of business parameters that trigger multi-instance concurrent scheduling of tasks are solidified as built-in process / activity variables in process modeling.

[0076] Step S105 , based on the business semantics and in combination with the second mapping relationship, a third mapping relationship between the business scheduling task and the satellite data processing flow is established.

[0077] In one example, the third mapping relationship is the automatic mapping of the activity node and the technical mode of the business scheduling task, which is modeled as the business link / business step of the process activity node. According to different business semantics, the business scheduling tasks of different interactive technical modes such as job submission / message interaction / service call are executed. On the basis of the standardized naming of the business link / business step, different interactive technical modes are configured through the business link / business step to realize the automatic mapping of the activity node and the computing job / service collaborative processing. After the mapping is completed, the activity node automatically matches the model configuration corresponding to the interactive technical mode in the activity modeling. (For example, the activity node is mapped to SSH computing job submission in business semantics, and the configuration interface of SSH computing job submission is automatically displayed in the activity configuration interface in the process modeling).

[0078] Step S106, combining the first mapping relationship, the second mapping relationship and the third mapping relationship to construct a satellite ground data processing system.

[0079] The satellite ground data processing system construction method provided in this embodiment forms a unified standardized Chinese and English name and English ID through the standardization of professional business terms in the data processing process, constraining and guiding process modeling and customized development. Through the semantic analysis of professional business data in the ground data processing business process, the business process diagram used by business personnel can be quickly mapped to the Wfmc and BPMN standard graphics supported by the workflow system, and the data processing process can be quickly and accurately modeled. By extracting information related to business parameters and process scheduling, control items for process flow and multi-instance concurrent scheduling can be automatically formed, forming a dynamic scheduling method for ground data processing processes, improving configuration capabilities, and reducing the workload of customized development code. Based on the dynamic scheduling method, the satellite ground data processing process scheduling system can be productized and configured, greatly reducing the workload of business customization development.

[0080] In this embodiment, a method for constructing a satellite ground data processing system is provided, which can be used in the above-mentioned mobile terminals, such as mobile phones, tablet computers, etc. Figure 3 FIG. 4 is a flowchart of another method for constructing a satellite ground data processing system according to an embodiment of the present invention. Figure 3 As shown, the process includes the following steps:

[0081] Step S301, obtain satellite observation data. For details, see Figure 1 Step S101 of the illustrated embodiment will not be described in detail here.

[0082] Step S302: extract the satellite model from the satellite observation data, map the satellite model to a preset satellite data processing flow, and determine the satellite data processing flow corresponding to the satellite model. Figure 1 Step S102 of the illustrated embodiment will not be described in detail here.

[0083] Step S303: Acquire business semantics, and establish a first mapping relationship between business links and satellite data processing procedures based on the business semantics.

[0084] Specifically, the above step S303 includes:

[0085] Step S3031, establishing the business steps of the business link as activity nodes.

[0086] Step S3032, mapping the business links into sub-processes in the preset process template, extracting and solidifying the sub-processes in the satellite data processing process, and obtaining a level 0 sub-process.

[0087] Step S3033, nesting scheduling is performed on the level 0 sub-process to obtain a standard sub-process.

[0088] Step S3034, linking the activity node with the standard sub-process, standardizing the naming of the business link, and establishing a first mapping relationship between the business link and the satellite data processing process.

[0089] In one example, the satellite data processing process involves many business links. The automatic mapping of satellite business links and process activities / sub-processes mainly realizes the correspondence between business links / business steps and process modeling activities / sub-processes. The Chinese and English names of business links / business steps are standardized and consistent with the names / IDs of the corresponding process activities / sub-processes.

[0090] Specifically, the main steps of automatic mapping of satellite data processing business links and process activities / sub-processes include: 1) Automatic mapping of process activities: The business steps of business links are usually modeled as standard activity nodes.

[0091] 2) Automatic mapping of sub-processes / nested sub-processes: Business links that contain more than 3 business steps are mapped as sub-processes in the process template. If the sub-process does not have an independent calling scenario, it can be modeled as an internal sub-process. If there is an independent calling scenario (such as regular production and order production share standard production sub-processes), the standard production mapping can be modeled as a standard production process. In the main data processing process, the sub-process can be called through the sub-process type activity. The sub-process can form a process nested sub-process, such as the main process contains a 0-level production sub-process, and the 0 and production sub-processes are nested in the standard production sub-process. Among them, the sub-process extraction and solidification in the main process are as follows: Figure 4 As shown, Figure 4 FIG. 1 is a schematic diagram of a process for extracting and solidifying a sub-process in a satellite model scheduling main process according to an embodiment of the present invention. Figure 5 As shown, Figure 5 It is a flow chart of nested scheduling of standard production sub-processes in a satellite model level 0 production sub-process according to an embodiment of the present invention.

[0092] 3) Automatic mapping of activity nodes with sub-process connections: Business steps with specific business meanings, such as concurrent scheduling of independent sub-processes under certain business conditions before a certain step is completed. This business step can be processed as a specific activity node with sub-process connections. Among them, the scheduling of activity nodes with sub-process connections is as follows: Figure 6 As shown, Figure 6 The present invention is a flowchart of a process with sub-process linking and dynamic scheduling of active nodes at runtime according to an embodiment of the present invention.

[0093] In this approach, business subprocesses and nested business subprocesses based on business contexts can realize the automatic transfer of business contexts and process contexts, which can improve the reusability and configurability of business links. Standardization of professional terms based on business semantics can form a common language that can be referenced and reused in business information construction, avoiding inconsistencies in business and technical implementation.

[0094] Step S304: acquiring a service parameter value, and establishing a second mapping relationship between the service parameter and the satellite data processing flow based on the service parameter value and in combination with the first mapping relationship.

[0095] Specifically, the above step S304 includes:

[0096] Step S3041: Based on the service parameter value, determine whether the processing mode is a single-channel format or a dual-channel format.

[0097] Step S3042: Based on the processing method, the satellite payload is analyzed and the standard sub-process corresponding to the payload in the first mapping relationship is started.

[0098] Step S3043, based on the number of data scenes extracted in the standard sub-process, start the standard sub-process, standardize the naming of the business parameters, and establish a second mapping relationship between the business parameters and the satellite data processing process.

[0099] In one example, the coarse-grained mapping of business parameters and dynamic multi-instance concurrent tasks mainly realizes the mapping relationship between business parameters and the number of task instances. The main business parameters that trigger multi-instance concurrent tasks include parameters such as the number of channels, the number of level 0 data files, and the number of scenes. In the task scheduling process, multi-instance concurrent scheduling is performed based on the dynamically acquired parameter values. The Chinese and English names of business parameters are standardized, and the English names of business parameters that trigger multi-instance concurrent scheduling of tasks are solidified as built-in process / activity variables in process modeling. Among them, the data scene is the business organization form of satellite observation data, which can be an image or a track of data. For optical payloads, it represents a scene of image data, and for full-track payloads, it represents a full-track observation data set. The observation payload of a remote sensing satellite, such as an optical camera, takes a picture every time, which is a scene of data. The number of photos extracted from the original data packet is the number of data scenes; some parameter measurement values ​​may be accumulated data around the earth to constitute a scene of data.

[0100] There are three main types of concurrent tasks: the first is multi-channel processing in the data format processing flow, which dynamically decides to start single-channel format processing or dual-channel concurrent format processing based on the parameter information of the satellite model and the channel information actually extracted from the original observation data; the second is the level 0 data production initiated by different satellite payloads. The data files parsed from each payload need to start concurrent level 0 data production sub-process instances for processing; the third is scene processing. After the level 0 data processing is completed, the standard production sub-process needs to be started concurrently based on the number of data scenes. The channel mode, the number of level 0 payload files, and the number of scenes are all used as control parameters. After extraction and verification in the actual business processing process, they are mapped to process variables for dynamic multi-instance processing of activities / process instances. Among them, the dynamic scheduling of multiple instances of activities / sub-processes based on business data control parameters is as follows: Figure 7 As shown, Figure 7 The present invention is a flowchart of a process for dynamic multi-instance scheduling of activities / sub-processes based on business data control parameters according to an embodiment of the present invention.

[0101] In this way, the multi-instance dynamic scheduling technology of activities / sub-processes based on business parameters can realize dynamic and efficient scheduling of process instances during runtime.

[0102] Step S305: Based on the business semantics and in combination with the second mapping relationship, a third mapping relationship between the business scheduling task and the satellite data processing flow is established.

[0103] Specifically, the above step S305 includes:

[0104] Step S3051: Execute business scheduling tasks of different interaction technologies based on business semantics.

[0105] Step S3052, based on the standardized named business links, different interaction technologies are configured for the business links, and computing operations are mapped to the active nodes to establish a third mapping relationship between the business scheduling tasks and the satellite data processing flow.

[0106] In one example, the business links / business steps modeled as process activity nodes perform business scheduling tasks with different interactive technical methods such as job submission / message interaction / service call based on different business semantics. Based on the standardized naming of business links / business steps, different interactive technical methods are configured through business links / business steps to achieve automatic mapping of activity nodes and computing jobs / service collaborative processing. After the mapping is completed, the activity nodes automatically match the model configuration corresponding to the interactive technical method in the activity modeling. (For example, the activity node is mapped to SSH computing job submission in business semantics, and the configuration interface of SSH computing job submission is automatically displayed in the activity configuration interface in the process modeling).

[0107] Business nodes that interact with business subsystems are usually divided into three categories according to the interaction technology method: Web service call, Kafka message interaction, and SSH computing job submission. By mapping business information and processing methods, automatic technical matching of business activity scheduling and computing job interaction can be achieved.

[0108] In this way, based on business semantics flowchart meta-mapping technology, software technicians can quickly convert professionals' business processing flows into standardized process models.

[0109] Step S306: Combine the first mapping relationship, the second mapping relationship and the third mapping relationship to construct a satellite ground data processing system. Figure 1 Step S106 of the illustrated embodiment will not be described in detail here.

[0110] The satellite ground data processing system construction method provided in this embodiment realizes the automatic flow of business context and process context based on business sub-processes, nested business sub-processes and other technologies of business context, which can improve the reusability and configurability of business links. Based on the standardization of professional terms in business semantics, a common language that can be referenced and reused in business information construction can be formed to avoid inconsistencies in business and technical implementation. The multi-instance dynamic scheduling technology of activities / sub-processes based on business parameters can realize dynamic and efficient scheduling of process instances at runtime. Based on the flowchart meta-mapping technology of business semantics, software technicians can quickly convert the business processing flow of professionals into a standardized process model.

[0111] In this embodiment, a satellite ground data processing method is provided, which can be used in the above-mentioned mobile terminals, such as mobile phones, tablet computers, etc. Figure 8 is a flow chart of a satellite ground data processing method according to an embodiment of the present invention. Figure 8 As shown, the process includes the following steps:

[0112] Step S801, obtaining satellite observation data to be processed.

[0113] Step S802: extract the satellite observation data to be processed to obtain the satellite model.

[0114] Step S803, input the satellite model into the satellite ground data processing system, start the satellite data processing flow associated with the satellite model, and obtain the processed target ground data.

[0115] In the embodiment of the present invention, the satellite ground data processing system is constructed by using the above-mentioned satellite ground data processing system construction method.

[0116] In one example, a satellite ground data processing process dynamic scheduling system driven by business data semantics mainly includes:

[0117] 1. Parameter management: Parameter management is used to configure and manage various types of parameters required for the operation of the satellite ground data processing process dynamic scheduling system.

[0118] The main steps include: Satellite model information parameter configuration: implement standardized satellite model information configuration, including standardized satellite model name, English ID, satellite code and other information, which is used to automatically match the satellite model information extracted from the original observation data. Specifically include: 1) Process template version rule parameter configuration: configure the version matching rule of the process template, and the parameter value can select two types of data dictionary options: automatic version rule and specify specific version.

[0119] 2) Business link / business step parameter configuration: Through business semantics, the Chinese names / English codes of the business links / business steps in the data flow are standardized. In the process modeling stage, the Chinese names / English codes are directly mapped to the names / IDs of the process modeling elements (processes / sub-processes / activities).

[0120] 3) Business parameter configuration: Standardize the text names / English codes of business parameters that trigger multiple concurrent instances of tasks.

[0121] 4) Interaction technology parameter configuration: Configure the parameters of different interaction technology modes of the system, and bind differentiated configuration interfaces for different technology modes.

[0122] 2. Raw data transmission: Raw data transmission mainly involves receiving and processing satellite observation data, including file data transmission based on FTP and real-time data transmission based on data frames. In addition, it is necessary to match and verify the satellite model extracted from the raw data with the satellite model parameters in parameter management. Based on the satellite model information after comparison and verification, the main process of ground data processing associated with the satellite model is started.

[0123] The main steps include: 1) Satellite model data extraction and parameter matching: Match and verify the satellite model extracted from the original data with the satellite model parameters in parameter management.

[0124] 2) Automatic mapping of satellite models and data processing procedures: Based on the compared and verified satellite model information, the satellite data processing main scheduling process is started according to the aforementioned automatic mapping method of satellite models and data processing procedures.

[0125] 3. Process and task management: Process-level task management provides process modeling, process model management, business logic activities, activity routing, event listeners, process / sub-process startup, and task submission functions. In addition to conventional process modeling functions, process and task management also includes the dynamic scheduling function of the method of the present invention. The main dynamic scheduling configuration steps include: 1) Process modeling based on business semantics: Based on the business link / business step parameter configuration, process activities and sub-processes are modeled based on business semantics. The Chinese names and English IDs of standardized business links / business steps are directly mapped to the names and IDs of activity / sub-process model elements through configuration, ensuring the consistency of business semantics and technical semantics.

[0126] 2) Multi-instance concurrent configuration in process modeling: Based on the business parameter configuration, multi-instance concurrent configuration of activities / sub-processes is achieved by directly mapping the business parameters that trigger multi-instance concurrent tasks to process / activity variables.

[0127] 3) Dynamic configuration of activity interaction technology: Based on the configuration of interaction technology parameters, differentiated activity configuration interfaces are displayed in the activity configuration of the process modeling link.

[0128] 4. Business information management: Business information management is responsible for the unified management and maintenance of various business data information. The businesses involved in the data processing process include data processing business and data service business.

[0129] The business information management steps based on the method of the present invention include: 1) Satellite model and data processing flow template configuration information: After the data processing flow template modeling is completed, the satellite model and the data processing flow template are configured. Usually, a single satellite model needs to configure the main scheduling process, format processing process, level 0 production process, and standard production process to form the configuration relationship information between the satellite model and the data processing flow template, so as to realize the automatic mapping of the satellite model and the data processing flow.

[0130] 2) Business links / business steps and process activities / sub-process configuration information: In the process modeling based on business semantics, the mapping information of business links / business steps and process activities / sub-processes is automatically saved, and the dynamic scheduling of independently running sub-processes is realized based on the mapping information. The scheduling of nested sub-processes is automatically scheduled by the process engine.

[0131] 5. Comprehensive dispatch monitoring: Comprehensive dispatch monitoring includes visual comprehensive monitoring display and statistical analysis functions of real-time operation information of data processing flow. Fig. 9 As shown, Fig. 9 It is a flow chart of comprehensive dispatching and monitoring of a ground data processing process according to an embodiment of the present invention.

[0132] The main steps of comprehensive scheduling monitoring include: 1) Operation information monitoring: Based on the dynamic scheduling method, it provides the acquisition, visualization and monitoring alarm of comprehensive operation information of instances including main processes, sub-processes, nested sub-processes, activities, etc.

[0133] 2) Operation statistics analysis: After the operation information is obtained, real-time and historical operation information statistics analysis and report forms are provided based on the dynamic scheduling method.

[0134] The satellite ground data processing method provided in this embodiment extracts satellite signals from the satellite observation data to be processed, inputs the satellite model into the constructed satellite ground data processing system, and realizes computing job scheduling and business service collaboration through data processing process scheduling. Different satellite models are matched with corresponding data processing processes. The automatic mapping of satellite models and data processing processes can realize personalized configuration, intelligent matching and automatic scheduling of the data processing process of satellite model observation data.

[0135] In the present embodiment, a satellite ground data processing system construction device is also provided, and the device is used to implement the above-mentioned embodiment and preferred implementation mode, and the description that has been made will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware is also possible and conceived.

[0136] This embodiment provides a satellite ground data processing system construction device, such as Fig.10 As shown, including:

[0137] The first data acquisition module 1001 is used to acquire satellite observation data. Figure 1 Step S101 of the illustrated embodiment will not be described in detail here.

[0138] The satellite model configuration module 1002 is used to extract the satellite model from the satellite observation data, map the satellite model to the preset satellite data processing flow, and determine the satellite data processing flow corresponding to the satellite model. Figure 1 Step S102 of the illustrated embodiment will not be described in detail here.

[0139] The first mapping module 1003 is used to obtain business semantics and establish a first mapping relationship between business links and satellite data processing procedures based on the business semantics. Figure 1 Step S103 of the illustrated embodiment will not be described in detail here.

[0140] The second mapping module 1004 is used to obtain the service parameter value, and establish a second mapping relationship between the service parameter and the satellite data processing flow based on the service parameter value and the first mapping relationship. Figure 1 Step S104 of the illustrated embodiment will not be described in detail here.

[0141] The third mapping module 1005 is used to establish a third mapping relationship between the business scheduling task and the satellite data processing flow based on the business semantics and in combination with the second mapping relationship. Figure 1 Step S105 of the illustrated embodiment will not be described in detail here.

[0142] The system construction module 1006 is used to construct a satellite ground data processing system by combining the first mapping relationship, the second mapping relationship and the third mapping relationship. Figure 1 Step S106 of the illustrated embodiment will not be described in detail here.

[0143] In some optional implementations, the first mapping module 1003 includes:

[0144] The activity node establishment unit is used to establish the business steps of the business link as activity nodes.

[0145] The sub-process extraction and solidification unit is used to map the business links into sub-processes in the preset process template, extract and solidify the sub-processes in the satellite data processing process, and obtain the level 0 sub-process.

[0146] The sub-process nesting scheduling unit is used to perform nested scheduling on the level 0 sub-process to obtain a standard sub-process.

[0147] The node process linking unit is used to link the activity node with the standard sub-process, standardize the naming of the business links, and establish the first mapping relationship between the business links and the satellite data processing process.

[0148] In some optional implementations, the second mapping module 1004 includes:

[0149] The processing mode determining unit is used to determine whether the processing mode is a single-channel format or a dual-channel format based on the service parameter value.

[0150] The payload analysis unit is used to analyze the payload of the satellite based on the processing mode and start the standard sub-process corresponding to the payload in the first mapping relationship.

[0151] The business parameter standardized naming unit is used to start the standard sub-process based on the number of data scenes extracted in the standard sub-process, standardize the naming of the business parameters, and establish a second mapping relationship between the business parameters and the satellite data processing process.

[0152] In some optional implementations, the third mapping module 1005 includes:

[0153] The business scheduling task execution unit is used to execute business scheduling tasks of different interaction technologies based on business semantics.

[0154] The interaction configuration unit is used to configure different interaction technologies for business links based on standardized named business links, and to map computing operations to active nodes to establish a third mapping relationship between business scheduling tasks and satellite data processing flows.

[0155] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0156] The satellite ground data processing system construction device in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0157] In the present embodiment, a satellite ground data processing device is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware is also possible and conceived.

[0158] This embodiment provides a satellite ground data processing device, such as Fig.11 As shown, including:

[0159] The second data acquisition module 1101 is used to acquire the satellite observation data to be processed. Figure 8 Step S801 of the illustrated embodiment will not be described in detail here.

[0160] The satellite model extraction module 1102 is used to extract the satellite observation data to be processed and obtain the satellite model. Figure 8 Step S802 of the illustrated embodiment will not be described in detail here.

[0161] The data processing module 1103 is used to input the satellite model into the satellite ground data processing system, start the satellite data processing process associated with the satellite model, and obtain the processed target ground data, wherein the satellite ground data processing system is constructed using the satellite ground data processing system construction device of the third aspect. For details, please refer to Figure 8 Step S803 of the illustrated embodiment will not be described in detail here.

[0162] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0163] The satellite ground data processing device in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0164] The embodiment of the present invention also provides a computer device having the above Fig.10 The satellite ground data processing system construction device shown Fig.11 Satellite ground data processing equipment shown.

[0165] See also Fig.12 , Fig.12 is a schematic diagram of the structure of a computer device provided by an optional embodiment of the present invention, such as Fig.12As shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instructions executed in the computer device, including instructions stored in or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Fig.12 A processor 10 is taken as an example.

[0166] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0167] The memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.

[0168] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0169] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0170] The computer device also includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30 and the output device 40 may be connected via a bus or other means. Fig.12 The example of connecting through bus is taken in the following.

[0171] The input device 30 can receive input digital or character information, and generate key signal input related to the user settings and function control of the computer device, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator bar, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The above-mentioned display device includes but is not limited to a liquid crystal display, a light emitting diode, a display and a plasma display. In some optional embodiments, the display device can be a touch screen.

[0172] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0173] A part of the present invention may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present invention through the operation of the computer. Those skilled in the art should understand that the existence of the computer program instruction in a computer-readable medium includes, but is not limited to, a source file, an executable file, an installation package file, etc., and accordingly, the way in which the computer program instruction is executed by the computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium may be any available computer-readable storage medium or communication medium accessible to the computer.

[0174] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A method for constructing a satellite ground data processing system, characterized in that: The method comprises: Obtain satellite observation data; Extracting a satellite model from the satellite observation data, mapping the satellite model to a preset satellite data processing flow, and determining the satellite data processing flow corresponding to the satellite model; Acquire business semantics, and establish a first mapping relationship between a business link and the satellite data processing flow based on the business semantics; Acquire a service parameter value, and establish a second mapping relationship between the service parameter and the satellite data processing flow based on the service parameter value and in combination with the first mapping relationship; Based on the business semantics and in combination with the second mapping relationship, a third mapping relationship between the business scheduling task and the satellite data processing flow is established; The first mapping relationship, the second mapping relationship and the third mapping relationship are combined to construct a satellite ground data processing system.

2. The method according to claim 1, characterized in that The establishing of a first mapping relationship between a business link and the satellite data processing flow based on business semantics includes: Establishing the business steps of the business link as activity nodes; Mapping the business links into sub-processes in a preset process template, extracting and solidifying sub-processes in the satellite data processing process, and obtaining level 0 sub-processes; Perform nested scheduling on the level 0 sub-process to obtain a standard sub-process; The activity node is linked to the standard sub-process, and the business link is named in a standardized manner to establish a first mapping relationship between the business link and the satellite data processing process.

3. The method according to claim 2, characterized in that The establishing, based on the service parameter value and in combination with the first mapping relationship, a second mapping relationship between the service parameter and the satellite data processing flow comprises: Based on the service parameter value, determining whether the processing mode is a single-channel format or a dual-channel format; Based on the processing method, the satellite payload is analyzed, and a standard sub-process corresponding to the payload in the first mapping relationship is started; Based on the number of data scenes extracted in the standard sub-process, the standard sub-process is started, and the service parameters are named in a standardized manner to establish a second mapping relationship between the service parameters and the satellite data processing process.

4. The method according to claim 3, characterized in that The establishing, based on the business semantics, a third mapping relationship between the business scheduling task and the satellite data processing flow comprises: Based on the business semantics, executing the business scheduling tasks of different interaction technologies; Based on the standardized named business links, different interaction technologies are configured for the business links, and computing operations are mapped to the active nodes to establish a third mapping relationship between the business scheduling tasks and the satellite data processing flow.

5. A satellite ground data processing method, characterized in that: The method comprises: Obtain satellite observation data to be processed; Extracting the satellite observation data to be processed to obtain a satellite model; The satellite model is input into a satellite ground data processing system, a satellite data processing process associated with the satellite model is started, and processed target ground data is obtained, wherein the satellite ground data processing system is constructed using the satellite ground data processing system construction method described in any one of claims 1 to 4.

6. A satellite ground data processing system construction device, characterized in that: The device comprises: A first data acquisition module, used to acquire satellite observation data; A satellite model configuration module, used to extract a satellite model from the satellite observation data, map the satellite model to a preset satellite data processing flow, and determine the satellite data processing flow corresponding to the satellite model; A first mapping module, used for acquiring business semantics, and establishing a first mapping relationship between a business link and the satellite data processing flow based on the business semantics; A second mapping module is used to obtain a service parameter value, and establish a second mapping relationship between the service parameter and the satellite data processing flow based on the service parameter value and in combination with the first mapping relationship; A third mapping module, configured to establish a third mapping relationship between the service scheduling task and the satellite data processing flow based on the service semantics and in combination with the second mapping relationship; The system construction module is used to construct a satellite ground data processing system by combining the first mapping relationship, the second mapping relationship and the third mapping relationship.

7. A satellite ground data processing device, characterized in that: The device comprises: A second data acquisition module is used to acquire the satellite observation data to be processed; A satellite model extraction module is used to extract the satellite observation data to be processed to obtain a satellite model; A data processing module is used to input the satellite model into a satellite ground data processing system, start a satellite data processing process associated with the satellite model, and obtain processed target ground data, wherein the satellite ground data processing system is constructed using the satellite ground data processing system construction device described in claim 6.

8. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the computer instructions to construct the satellite ground data processing system described in any one of claims 1 to 4 or execute the satellite ground data processing method described in claim 5.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the satellite ground data processing system construction described in any one of claims 1 to 4 or execute the satellite ground data processing method described in claim 5.

10. A computer program product, characterized in that The invention comprises computer instructions, wherein the computer instructions are used to enable a computer to execute the satellite ground data processing system construction described in any one of claims 1 to 4 or to execute the satellite ground data processing method described in claim 5.

Images