Multi-source heterogeneous space-based data acquisition method and system based on message-driven mode

Abstract

The present invention relates to a multi-source heterogeneous space-based data acquisition method and system based on a message-driven mode, the method comprising: using a data acquisition message processing module to plan a collection plan according to the demand for space-based data, and issuing a data demand plan; using a data monitoring and sending module to receive the data demand plan, obtaining the corresponding data source according to the acquisition type, executing the data acquisition task, and monitoring the newly added space-based data in a multi-threaded manner according to the discovery-and-access monitoring mechanism, and sending the monitored space-based data message to a data scheduling processing module in a message-driven mode; using the data scheduling processing module to perform unified scheduling processing on various types of space-based data collected, and feeding back the processed standardized multi-source data response to the data acquisition message processing module. The present invention can realize the automatic access of space-based data of various network segments of various types of satellites and various types of payloads with different data types, formats, precisions, and delays.

Description

Technical Field

[0001] The present invention relates to the technical field of space-based data acquisition, and in particular to a multi-source heterogeneous space-based data acquisition method and system based on a message-driven mode. Background Art

[0002] As an important part of the integrated space-ground information network, space-based data has the characteristics of fast update speed and large data volume. The sources of this type of data are complex and diverse, and the network systems are different, which brings great difficulties to the collection and aggregation of data. Different sources of space-based data are complex and diverse, and the timeliness and stability are different. It is impossible to flexibly collect according to the characteristics of each type of data.

[0003] Data-driven collection methods often use shared storage, which is greatly affected by network fluctuations and will experience slow storage mount response after running for a certain period of time, resulting in the inability to collect and access data in a timely manner, or the instantaneous concurrent access of backlog data, causing a huge impact on the backend data processing platform.

[0004] In engineering practice, there are several prominent problems in the construction of space-based data collection capabilities:

[0005] (1) The existing technology does not provide high physical isolation for data collection between different network systems, which can easily lead to data mixing and penetration, posing a threat to the security of the data source;

[0006] (2) The data monitoring drive mechanism has poor stability and responds slowly to the large amount of data collected instantly, which may even cause response congestion and paralysis, resulting in data loss;

[0007] (3) The robustness of information exchange during data collection is low, and information exchange cannot be presented in a closed-loop manner;

[0008] (4) Lack of scalability and compatibility. As the types of space-based information that can be accessed increase, the data collection system’s elastic upgrade capabilities are relatively weak. Summary of the invention

[0009] In order to solve the above technical problems, the present invention provides a multi-source heterogeneous space-based data acquisition method and system based on a message-driven mode to improve the acquisition capability of space-based data with complex and diverse sources and different types in the same network segment or different network segments.

[0010] In order to achieve the above-mentioned object of the invention, the technical solution of the present invention is:

[0011] In a first aspect, the present invention provides a multi-source heterogeneous space-based data acquisition method based on a message-driven mode, comprising:

[0012] Use the data collection information processing module to plan the collection plan according to the demand for space-based data and issue data demand plans;

[0013] The data demand planning is received by using the data monitoring and sending module, the corresponding data source is obtained according to the collection type, the data collection task is executed, and the newly added space-based data is monitored in a multi-threaded manner according to the discovery-and-access monitoring mechanism, and the monitored space-based data message is sent to the data scheduling processing module in a message-driven mode;

[0014] The data scheduling and processing module is used to perform unified scheduling and processing on various types of space-based data collected, and the processed standardized multi-source data response is fed back to the data collection message processing module.

[0015] According to one aspect of the present invention, the data requirements include: data sources and data requirements in the same network segment and data sources and data requirements in different network segments.

[0016] According to one aspect of the present invention, in the process of using the data collection message processing module to plan a data collection plan according to the demand for space-based data and issuing a data demand plan, the process includes:

[0017] Calling the first network switching device to transmit the data sources and data requirements of different network segments sent by the data acquisition message processing module to the data monitoring and sending module;

[0018] The data acquisition message processing module is utilized to directly transmit the data source and data requirements of the same network segment to the data monitoring and sending module.

[0019] According to one aspect of the present invention, in the process of receiving the data demand planning by using a data monitoring and sending module, obtaining a corresponding data source according to a collection type, executing a data collection task, and monitoring the newly added space-based data in a multi-threaded manner according to a discovery-and-access monitoring mechanism, and sending the monitored space-based data message to a data scheduling processing module in a message-driven mode, the process includes:

[0020] Analyze the message protocol and file name of the monitored space-based data;

[0021] Using the historical collection data of the system cache and the database, the monitored file information is compared with the file information that has been monitored. If the file information is the same, the monitored file is not collected to the data scheduling processing module. Otherwise, the file is monitored and the monitored file is collected to the data scheduling processing module.

[0022] According to the plan, data service requirements are differentiated and whether cross-segment transmission is required is automatically identified.

[0023] According to one aspect of the present invention, the data scheduling and processing module is used to perform unified scheduling and processing on various types of collected space-based data, including:

[0024] According to the business needs of space-based data collection, the data collection strategy is set using the mode selection module;

[0025] Use the data configuration module to receive data-driven messages and conduct hierarchical monitoring according to different levels of multi-source space-based data;

[0026] Use the breakpoint resume module to pause or continue receiving the space-based data at any time during the transmission of the space-based data;

[0027] Use the data deduplication module to identify and deduplicate redundant data generated during data collection;

[0028] Use the scheduled cleanup module to set cleanup strategies according to different collection business requirements and regularly clean up redundant data;

[0029] Use the quality inspection module to check the quality and standardization of the collected data and eliminate invalid data;

[0030] Use the time-space screening module to screen valid data in time and space, and selectively access data that meets the preset time-space conditions;

[0031] Use the type filter module to set and select the type of access data;

[0032] Use the format conversion module to automatically match data types and convert the data formats and specifications uniformly;

[0033] The converted standard data is archived and stored by matching the corresponding template according to the data type using the archiving storage module, and the stored data information is recorded. The redundant data is cleaned up regularly or the historical redundant data is cleaned up once to obtain the standardized multi-source space-based data.

[0034] According to one aspect of the present invention, in the process of using the data scheduling processing module to perform unified scheduling processing on various types of collected space-based data, and feeding back the processed normalized multi-source data response to the data acquisition message processing module, it includes:

[0035] After receiving the data demand plan, the data monitoring and sending module calls the second network switching device and feeds back the standardized multi-source data responses of different network segments processed by the data scheduling processing module to the data acquisition message processing module through the channel of the second network switching device;

[0036] After receiving the data demand plan, the data monitoring and sending module directly feeds back the standardized multi-source data response of the same network segment to the data acquisition message processing module through the data scheduling processing module.

[0037] According to one aspect of the present invention, the standardized multi-source data response includes: standardized multi-source space-based data and a scheduling processing process message.

[0038] In a second aspect, the present invention further provides a multi-source heterogeneous space-based data acquisition system for executing the multi-source heterogeneous space-based data acquisition method based on the message-driven mode, comprising:

[0039] The data collection information processing module is used to plan the collection plan according to the demand for space-based data and issue data demand plans;

[0040] A data monitoring and sending module is used to receive the data demand planning, obtain the corresponding data source according to the collection type, execute the data collection task, and monitor the newly added space-based data in a multi-threaded manner according to the discovery-and-access monitoring mechanism, and send the monitored space-based data message to the data scheduling processing module in a message-driven mode; and

[0041] The data scheduling and processing module is used to perform unified scheduling and processing on various types of space-based data collected, and to feed back the processed standardized multi-source data response to the data collection message processing module.

[0042] According to another aspect of the present invention, the data scheduling processing module includes:

[0043] The mode selection module is used to set the data collection strategy according to the business requirements of space-based data collection;

[0044] The data configuration module is used to receive data-driven messages and perform hierarchical monitoring according to different levels of multi-source space-based data;

[0045] A breakpoint resume module is used to pause, terminate or continue receiving the space-based data at any time during the transmission of the space-based data;

[0046] Data deduplication module, used to identify and remove redundant data generated during data collection;

[0047] The scheduled cleanup module is used to set cleanup strategies according to different collection business requirements and regularly clean up redundant data;

[0048] The quality inspection module is used to check the quality and standardization of the collected data and eliminate invalid data;

[0049] The spatiotemporal screening module is used to screen valid data in time and space, and selectively access data that meets the preset spatiotemporal conditions;

[0050] Type screening module, used to set and select the type of access data;

[0051] A format conversion module, which is used to automatically match data types and convert the formats and specifications of data uniformly; and

[0052] The archiving and storage module is used to archive and store the converted standard data according to the data type and the corresponding template, record the stored data information, clean up the redundant data regularly or clean up the historical redundant data once, and obtain the standardized multi-source space-based data.

[0053] According to another aspect of the present invention, it further comprises: a first network switching device, used to transmit the data sources and data requirements of different network segments sent by the data acquisition message processing module to the data monitoring and sending module; and

[0054] The second network switching device is used to feed back the standardized multi-source data responses of different network segments processed by the data scheduling processing module to the data acquisition message processing module through the channel of the second network switching device after the data monitoring and sending module receives the data demand planning.

[0055] Compared with the prior art, the present invention has the following beneficial effects:

[0056] According to the solution of the present invention, a multi-source heterogeneous space-based data acquisition method and system under a message-driven mode are proposed. Through the message-driven and closed-loop processing methods, stable acquisition of space-based data of different types and complex and diverse sources is carried out, and automatic access to space-based data of various types of satellites and various types of payloads with different data types, formats, accuracies, and delays is achieved.

[0057] According to a solution of the present invention, space-based data of each network segment can be automatically accessed across networks, and data reception, processing, storage and display can be achieved in a message-driven manner, thus solving the impact of network fluctuations on the stability of shared storage.

[0058] According to one solution of the present invention, multi-threaded monitoring, data synchronous transmission and processing are performed on space-based data according to data sources and categories, including data format recognition, screening, conversion and deduplication, so as to improve the operating efficiency of the system and realize continuous and uninterrupted stable operation of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0060] Figure 1 A flowchart schematically shows a multi-source heterogeneous space-based data acquisition method based on a message-driven mode provided by an embodiment of the present invention;

[0061] Figure 2 A network architecture diagram schematically shows a multi-source heterogeneous space-based data acquisition system based on a message-driven mode provided by an embodiment of the present invention;

[0062] Figure 3 The processing flow chart of the data scheduling processing module provided in the embodiment of the present invention is schematically shown. DETAILED DESCRIPTION

[0063] The description of the embodiments of this specification should be combined with the corresponding drawings, which should be considered as part of the complete specification. In the drawings, the shape or thickness of the embodiments may be enlarged and indicated for simplification or convenience. Furthermore, the parts of each structure in the drawings will be described separately. It is worth noting that the elements not shown in the drawings or not described in words are in a form known to ordinary technicians in the relevant technical field.

[0064] The description of the embodiments herein and any reference to directions and orientations are only for the convenience of description and are not to be construed as any limitation on the scope of protection of the present invention. The following description of the preferred embodiments may involve combinations of features, which may exist independently or in combination, and the present invention is not particularly limited to the preferred embodiments. The scope of the present invention is defined by the claims.

[0065] like Figure 1 As shown, a multi-source heterogeneous space-based data acquisition method based on a message-driven mode disclosed in an embodiment of the present invention includes the following steps:

[0066] Step 100: Use the data collection information processing module to plan a collection plan according to the demand for space-based data and issue a data demand plan.

[0067] Furthermore, this embodiment divides the data source into data sources of the same network segment and data sources of different network segments based on the location of the data source. Therefore, the data requirements include: data sources of the same network segment and their data requirements and data sources of different network segments and their data requirements. For multi-source space-based data in different network segments, since such data sources and data application business systems are not in the same network segment, and the data types are diverse, the timeliness requirements are high. Compared with the data source network, the data application business system network has different access rights requirements. By adding a unidirectional network switching device, the data is automatically transferred, and the singleness of the data flow and the perfection of the message interaction are maintained. For multi-source space-based data in the same network segment, there are many types of data collected and monitored for access, the naming rules and data formats are inconsistent, and the real-time and security requirements for data collection are high. Then for different data source file paths under the same network segment, the embodiment of the present invention adopts a multi-threaded task mode to ensure peak processing capacity, point-to-point access for data discovery, and response and feedback of collection status through message-driven collection. The embodiment of the present invention adopts a configurable design, supports the addition and change of data types, does not rely on surface information such as file names and file suffixes to automatically identify data types, regularly cleans up historical redundant data, and prevents excessive long-term running data.

[0068] Then, in the step 100, the data acquisition message processing module is used to plan the data acquisition plan according to the demand for space-based data, and in the specific implementation process of issuing the data demand planning, for the data sources of different network segments, the first network switching device is called to pass the data source and its data demand issued by the data acquisition message processing module to the data monitoring and sending module. For the data source of the same network segment, the data acquisition message processing module is used to directly pass the data source and its data demand of the same network segment to the data monitoring and sending module.

[0069] Step 200, use the data monitoring and sending module to receive the data demand planning, obtain the corresponding data source according to the collection type, execute the data collection task, and monitor the newly added space-based data in multi-threaded manner according to the discovery and access monitoring mechanism, and send the monitored space-based data message to the data scheduling processing module in a message-driven mode.

[0070] In this embodiment, a data monitoring and sending module is used to receive the data demand planning, respond to events that change the original state of data or messages, such as the addition of new files, changes in file content or size, etc., and monitor the newly added space-based data in multiple threads according to the discovery-and-access monitoring mechanism. The monitored space-based data messages are sent to the data scheduling and processing module in a message-driven mode, which can solve emergencies such as network fluctuations and data surges.

[0071] In some embodiments, in step 200, the data demand planning is received by using a data monitoring and sending module, the corresponding data source is obtained according to the collection type, the data collection task is executed, and the newly added space-based data is monitored in a multi-threaded manner according to the monitoring mechanism of discovery and access, and the monitored space-based data message is sent to the data scheduling processing module in a message-driven mode. In the specific implementation process, the message protocol and file name of the monitored space-based data are first parsed, and the corresponding data source is sent according to the parsed collection type and information to execute the data collection task. Then, the system cache and the historical collection data of the database are used to compare the monitored file information with the file information that has been monitored. If the file information is the same, the monitored file is not collected to the data scheduling processing module, otherwise the file is monitored and the monitored file is collected to the data scheduling processing module. It is also possible to distinguish data service needs according to the planning, and automatically identify whether cross-segment transmission is required.

[0072] Step 300, using the data scheduling processing module to perform unified scheduling processing on various types of collected space-based data, and feeding back the processed standardized multi-source data response to the data acquisition message processing module.

[0073] In some embodiments, such as Figure 3 As shown, the specific implementation process of using the data scheduling processing module in step 300 to perform unified scheduling processing on various types of collected space-based data includes:

[0074] The logic of the scheduling process here is mainly planned according to the data demand, and receives various types of space-based data in each network segment sent by the data monitoring and sending module. First, according to the space-based data collection business needs, the mode selection module is used to set the data collection strategy; the data configuration module is used to receive data-driven messages, and hierarchical monitoring is performed according to different levels of multi-source space-based data; during the transmission of space-based data, the breakpoint resumption module is used to pause or continue receiving the space-based data at any time; in order to save network and storage resources, when duplicate data is generated during the collection process, the duplicate data and historical data are collectively referred to as redundant data, and the data deduplication module is used to identify and deduplicate the redundant data according to a certain strategy; and the timing cleaning module is used according to different collection business needs. Set a clearing strategy to regularly clean up redundant data; then use the quality inspection module to check the quality and standardization of the collected data and eliminate invalid data; use the time and space screening module to perform time and space screening on valid data, and selectively access data that meets the preset time and space conditions; use the type screening module to set and select the type of accessed data; use the format conversion module to automatically match data types, and uniformly convert the format and specifications of the data; then, use the archiving storage module to archive and store the converted standard data according to the data type and the corresponding template, and record the stored data information, regularly clean up redundant data or clean up historical redundant data at one time to obtain standardized multi-source space-based data.

[0075] In this embodiment, in the specific implementation process of using the data scheduling processing module in step 300 to uniformly schedule and process various types of space-based data collected, and feeding back the processed normalized multi-source data response to the data acquisition message processing module, for the data sources of different network segments, after receiving the data demand planning, the data monitoring and sending module calls the second network switching device and feeds back the normalized multi-source data response processed by the data scheduling processing module to the data acquisition message processing module through the channel of the second network switching device. For the data sources of the same network segment, after receiving the data demand planning, the data monitoring and sending module directly feeds back the normalized multi-source data response to the data acquisition message processing module through the data scheduling processing module.

[0076] Furthermore, the standardized multi-source data response includes: standardized multi-source space-based data and scheduling processing process messages. After cleaning the collected space-based data according to the above scheduling processing logic, this embodiment sends the standardized multi-source space-based data and scheduling processing process messages to the data collection message processing module for closed-loop processing.

[0077] The design process of the multi-source heterogeneous space-based data collection method of this embodiment implements the ideas of generalization, systematization, and modularization, builds a general platform, ensures interface consistency and standardization, and maximizes the collection capability of multi-source space-based data. Based on the principle of high automation, through the task message driving mode of centralized monitoring, the various collection modules are uniformly scheduled to work together, and even between different networks with physical isolation, closed-loop processing of message interaction can be achieved, thereby achieving the effect of stable and efficient collection of multi-source space-based data.

[0078] The embodiment of the present invention also discloses a multi-source heterogeneous space-based data acquisition system for executing the multi-source heterogeneous space-based data acquisition method based on the message-driven mode, focusing on the acquisition process from "data demand planning and issuance" to "standardized multi-source data response", such as Figure 2 As shown, the system adopts the method of source control and distributed collection and deployment, and includes three modules: data collection message processing module, data monitoring and sending module, and data scheduling processing module.

[0079] Among them, the data acquisition message processing module is used to plan the acquisition plan according to the demand for space-based data and issue the data demand plan; the data monitoring and sending module is used to receive the data demand plan, obtain the corresponding data source according to the acquisition type, execute the data acquisition task, and monitor the newly added space-based data in a multi-threaded manner according to the discovery and access monitoring mechanism, and send the monitored space-based data message to the data scheduling processing module in a message-driven mode; and the data scheduling processing module is used to perform unified scheduling processing on various types of space-based data collected, and feedback the processed standardized multi-source data response to the data acquisition message processing module. At the same time, the data monitoring and sending module is also used for task management, real-time monitoring and tracking of task execution status, and closed-loop processing, as well as collecting and monitoring the status of system hardware and software equipment and data source status.

[0080] and Figure 3 The data scheduling and processing module represented corresponds to the specific process of scheduling and processing the collected multi-source space-based data of each network segment and each type. The data scheduling and processing module includes the following 10 functional modules: mode selection module, data configuration module, breakpoint resume module, data deduplication module, timing cleaning module, quality inspection module, type screening module, format conversion module and archiving storage module. Among them,

[0081] The mode selection module is used to set data collection strategies according to different space-based data collection business needs; it can solve the coordination problems of factors such as multi-source data, timeliness, source control, and collaborative scheduling.

[0082] The data configuration module is used to receive data-driven messages and monitor multi-source space-based data at different levels; specifically, it can monitor in different folders according to different space-based data types. According to the added types of space-based information, the data collection capability can be flexibly expanded.

[0083] The breakpoint resume module is used to pause, terminate or continue receiving the space-based data at any time during the transmission process of the space-based data; the process of data transmission and archiving can be flexibly controlled.

[0084] The data deduplication module is used to identify and deduplicate redundant data generated during the data collection process; specifically, the module determines deduplication based on the file name, file size, file MD5 value, etc., automatically identifies the monitored duplicate data, and determines it as redundant data. After parsing the file name and content, it is compared with the system cache and historical database table, and selective access is performed on the monitored files and files that have been monitored.

[0085] The scheduled cleanup module is used to set cleanup strategies according to different collection business requirements and regularly clean up redundant data; the elements of the cleanup strategy include time, data category, process type, mode type, etc.

[0086] The quality inspection module is used to check the quality and standardization of the collected data and eliminate invalid data. Specifically, the module verifies the naming rules and formats of standardized space-based data, checks the integrity of space-based data, recursively decompresses compressed format files, and distinguishes the compression type by reading the byte header if the actual format of some compressed data is inconsistent with the suffix name, and archives them by category.

[0087] The spatiotemporal screening module is used to perform temporal and spatial screening on valid data, and selectively access data that meets preset spatiotemporal conditions; specifically, by setting a time window and defining an area range, data that meets preset spatiotemporal conditions is selectively accessed.

[0088] The type screening module is used to set and select the type of access data; further, other types of data that are not within the set range will not be accessed temporarily, so as to maintain a robust link resource. Access will be made after the type setting is cancelled.

[0089] The format conversion module is used to automatically match data types and uniformly convert the formats and specifications of data. Specifically, in order to facilitate the organization and management of data by subsequent application systems, this module automatically matches data types and uniformly converts the naming formats, data header files, index files, etc. of multi-source space-based data to improve the operating efficiency of the data application system.

[0090] The archiving and storage module is used to archive and store the converted standard data according to the data type and the corresponding template, record the stored data information, clean up the redundant data regularly or clean up the historical redundant data once, and obtain the standardized multi-source space-based data. Specifically, this module matches the corresponding template according to the different type IDs of the multi-source data for archiving.

[0091] During the process of the data scheduling processing module executing tasks, the task information of each node is recorded in its own log file, and timely alarms can be issued for abnormal situations.

[0092] like Figure 2 As shown, the network architecture of the multi-source heterogeneous space-based data acquisition system based on the message-driven mode disclosed in this embodiment also includes: a first network device and a second network device. Among them, the first network switching device is used to transmit the data sources and data requirements of different network segments issued by the data acquisition message processing module to the data monitoring and sending module; the second network switching device is used to feed back the standardized multi-source data response of different network segments processed by the data scheduling processing module to the data acquisition message processing module through the channel of the second network switching device after the data monitoring and sending module receives the data requirement plan.

[0093] In this embodiment, the system can collect data from multi-source space-based data information platforms to realize the collection of various space-based data information such as image data, signal data, measurement and feature data, etc. According to the data category, it can be divided into electronic data and imaging data, among which electronic data has many types and quantities of reception, small single files, and wide sources; imaging data has different reception formats, large single data volume, and different real-time requirements. Through message-driven and closed-loop processing methods, space-based data of different types and sources are stably collected to realize automatic access to space-based data of various satellites and various payloads with different data types, formats, precisions, and delays. At the same time, according to the data source and category, multi-threaded monitoring, data synchronous transmission and processing are carried out to realize continuous and uninterrupted stable operation of the system.

[0094] The serial numbers of the above-mentioned steps involved in the method of the present invention do not mean the order of execution of the method. The execution order of each step should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the implementation mode of the present invention.

[0095] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A multi-source heterogeneous space-based data acquisition method based on a message-driven mode, comprising: Use the data collection information processing module to plan the collection plan according to the demand for space-based data and issue data demand plans; The data demand planning is received by using the data monitoring and sending module, the corresponding data source is obtained according to the collection type, the data collection task is executed, and the newly added space-based data is monitored in a multi-threaded manner according to the discovery-and-access monitoring mechanism, and the monitored space-based data message is sent to the data scheduling processing module in a message-driven mode; The data scheduling and processing module is used to perform unified scheduling and processing on various types of space-based data collected, and the processed standardized multi-source data response is fed back to the data collection message processing module; In the process of receiving the data demand planning by using the data monitoring and sending module, obtaining the corresponding data source according to the collection type, executing the data collection task, and monitoring the newly added space-based data in a multi-threaded manner according to the discovery-and-access monitoring mechanism, and sending the monitored space-based data message to the data scheduling processing module in a message-driven mode, it includes: Analyze the message protocol and file name of the monitored space-based data; Using the historical collection data of the system cache and the database, the monitored file information is compared with the file information that has been monitored. If the file information is the same, the monitored file is not collected to the data scheduling processing module. Otherwise, the file is monitored and the monitored file is collected to the data scheduling processing module. According to the data demand plan, differentiate the data service demand, and automatically identify whether cross-segment transmission is required.

2. The method according to claim 1, characterized in that The data requirements include: data sources and data requirements in the same network segment and data sources and data requirements in different network segments.

3. The method according to claim 2, characterized in that In the process of using the data collection message processing module to plan the data collection plan according to the demand for space-based data and issue the data demand plan, it includes: Calling the first network switching device to transmit the data sources and data requirements of different network segments sent by the data acquisition message processing module to the data monitoring and sending module; The data acquisition message processing module is utilized to directly transmit the data source and data requirements of the same network segment to the data monitoring and sending module.

4. The method according to claim 2, characterized in that: The data scheduling and processing module is used to perform unified scheduling and processing on various types of space-based data collected, including: According to the business needs of space-based data collection, the data collection strategy is set using the mode selection module; Use the data configuration module to receive data-driven messages and conduct hierarchical monitoring according to different levels of multi-source space-based data; Use the breakpoint resume module to pause or continue receiving the space-based data at any time during the transmission of the space-based data; Use the data deduplication module to identify and deduplicate redundant data generated during data collection; Use the scheduled cleanup module to set cleanup strategies according to different collection business requirements and regularly clean up redundant data; Use the quality inspection module to check the quality and standardization of the collected data and eliminate invalid data; Use the time-space screening module to screen valid data in time and space, and selectively access data that meets the preset time-space conditions; Use the type filter module to set and select the type of access data; Use the format conversion module to automatically match data types and convert the data formats and specifications uniformly; The converted standard data is archived and stored by matching the corresponding template according to the data type using the archiving storage module, and the stored data information is recorded. The redundant data is cleaned up regularly or the historical redundant data is cleaned up once to obtain the standardized multi-source space-based data.

5. The method according to claim 2, characterized in that: In the process of using the data scheduling processing module to uniformly schedule and process various types of space-based data collected, and feeding back the processed standardized multi-source data response to the data collection message processing module, it includes: After receiving the data demand plan, the data monitoring and sending module calls the second network switching device and feeds back the standardized multi-source data responses of different network segments processed by the data scheduling processing module to the data acquisition message processing module through the channel of the second network switching device; After receiving the data demand plan, the data monitoring and sending module directly feeds back the standardized multi-source data response of the same network segment to the data acquisition message processing module through the data scheduling processing module.

6. The method according to any one of claims 1 to 5, characterized in that The standardized multi-source data response includes: standardized multi-source space-based data and scheduling processing process messages.

7. A multi-source heterogeneous space-based data acquisition system that executes the multi-source heterogeneous space-based data acquisition method based on a message-driven mode as described in any one of claims 1 to 6, characterized in that: include: The data collection information processing module is used to plan the collection plan according to the demand for space-based data and issue data demand plans; A data monitoring and sending module is used to receive the data demand planning, obtain the corresponding data source according to the collection type, execute the data collection task, and monitor the newly added space-based data in a multi-threaded manner according to the discovery-and-access monitoring mechanism, and send the monitored space-based data message to the data scheduling processing module in a message-driven mode; and The data scheduling and processing module is used to perform unified scheduling and processing on various types of space-based data collected, and to feed back the processed standardized multi-source data response to the data collection message processing module.

8. The system according to claim 7, characterized in that The data scheduling processing module includes: The mode selection module is used to set the data collection strategy according to the business requirements of space-based data collection; The data configuration module is used to receive data-driven messages and perform hierarchical monitoring according to different levels of multi-source space-based data; A breakpoint resume module is used to pause, terminate or continue receiving the space-based data at any time during the transmission of the space-based data; Data deduplication module, used to identify and remove redundant data generated during data collection; The scheduled cleanup module is used to set cleanup strategies according to different collection business requirements and regularly clean up redundant data; The quality inspection module is used to check the quality and standardization of the collected data and eliminate invalid data; The spatiotemporal screening module is used to screen valid data in time and space, and selectively access data that meets the preset spatiotemporal conditions; Type screening module, used to set and select the type of access data; A format conversion module, which is used to automatically match data types and convert the formats and specifications of data uniformly; and The archiving and storage module is used to archive and store the converted standard data according to the data type and the corresponding template, record the stored data information, clean up the redundant data regularly or clean up the historical redundant data once, and obtain the standardized multi-source space-based data.

9. The system according to claim 7, characterized in that Also includes: A first network switching device, used for transmitting the data sources and data requirements of different network segments sent by the data acquisition message processing module to the data monitoring and sending module; as well as The second network switching device is used to feed back the standardized multi-source data responses of different network segments processed by the data scheduling processing module to the data acquisition message processing module through the channel of the second network switching device after the data monitoring and sending module receives the data demand planning.

Images