Universal data stream analysis method and system

Abstract

The invention discloses a universal data flow analysis method and system, and the method comprises the steps: configuring a data flow analysis rule to form an analysis table, the analysis table comprises a plurality of configuration objects, and each configuration object comprises a configuration name, an identification code and a parameter configuration table; receiving a to-be-analyzed data stream; searching a parameter configuration table corresponding to the to-be-analyzed data stream in the analysis table; and analyzing each field in the to-be-analyzed data stream according to an analysis rule in the parameter configuration table to obtain an analysis result. According to the universal data flow analysis method, data is subjected to one-time batch configuration, the original configuration workload is greatly simplified, analysis processing of various types of data flows in the field of measurement, operation and control can be met, and by means of the analysis and parameter configuration method, different function requirements are referred to. The analysis processing problem of all data streams can be expanded, the data processing work amount is greatly shortened, and the data analysis efficiency is improved.

Description

technical field [0001] The invention belongs to the field of aerospace data processing, and in particular relates to a universal data flow analysis method and system. Background technique [0002] The general data analysis and configuration method in the current aerospace measurement, operation and control business requires the separate deployment of data formats and large parameter tables. For different data streams, some parameters can reach tens of thousands or more, and the configuration workload is huge. Therefore, how to improve the data stream Analytical efficiency is an urgent problem to be solved at present. There are currently the following methods in the prior art. [0003] 1. The patent document (patent number: CN202011611366.4) proposes a satellite telemetry data processing method, system and constellation status monitoring platform. Each sub-computing node performs calculations, but this method is mainly based on distributed computing to minimize the calculat...

AI Technical Summary

Problems solved by technology

[0003] 1. The patent document (patent number: CN202011611366.4) proposes a satellite telemetry data processing method, system and constellation status monitoring platform. Each sub-computing node performs calculations, but this method is mainly based on distributed computing to minimize the calculation time, and completes the improvement of the telemetry data processing rate of a large number of multi-satellite constellations, but does not design and implement the telemetry data processing algorithm. Update, also unable to complete the general parsing requirements of the data stream

[0004] 2. The patent document (patent number: CN202010862330.7) proposes a telemetry data processing method using a neural network, which uses the neural function mapping function and generalized learning ability to simplify the aircraft telemetry processing process and realizes that the aircraft telemetry data processing program does not change. It is specially written due to the different sensor parameters to improve the adaptability of the sensor. This method mainly solves the problem of digital conversion from the collected value of the flying chess sensor to the telemetry data, but does not solve the processing algorithm after the ground station telemetry data is received. Research, configuration and its universality and universal extension

[0005] 3. In April 2017, Wang Ruicheng, a graduate of Lanzhou University, published a paper titled "Research on Telemetry Data Method and Processing Realization", and proposed a data processing method based on the database, but this method is mainly for specific applications in aerospace shooting ranges. The dynamic adaptability and data management of telemetry data processing requirements have failed to form a wider range of telemetry data processing application scenarios, and are more inclined to the development and breakthrough of specific technologies for customized data processing application systems, lacking certain versatility and scalability

[0006] 4. In May 2017, Wang Bo, a graduate of the University of Chinese Academy of Sciences, published a paper titled "CCSDS-compliant Telemetry Acquisition and Remote Decoding Unit". The article was guided by a series of standards and based on the FPGA platform to achieve efficient, Universal and flexible telemetry acquisition and editing and remote decoding system. The research direction of this paper is mainly oriented to data acquisition, encoding and data preprocessing. More research has not been done on the telemetry data processing and general configuration of aerospace satellite data.

[0008] To sum up, none of the existing technical solutions can resolve large-scale general data flow analysis, and can only be manually configured each time it is analyzed, so it is time-consuming and laborious, not only inefficient, but also a waste of human resources

Images