Multi-source heterogeneous data processing method, device and system

Abstract

The present invention discloses a multi-source heterogeneous data processing method, device and system, wherein the method comprises: receiving heterogeneous data from different data sources, wherein the heterogeneous data comprises: data of different source devices and different data types; parsing the heterogeneous data according to a predetermined parsing rule; performing standardized conversion processing on the parsed data based on a predetermined standardized rule, wherein the standardized conversion processing comprises: data encoding conversion processing and telesignaling and telemetry value conversion processing; and sending the standardized processed data to a data platform for subsequent use. The present invention can improve the efficiency of data application.

Description

Technical Field

[0001] The present invention relates to the field of data processing, and in particular to a multi-source heterogeneous data processing method, device and system. Background Art

[0002] In recent years, big data technology has developed rapidly, and the application of new technologies in the field of new energy has gradually become a hot topic in industry research. How to apply big data technology to help the transformation of new energy has become the focus of research. However, the current characteristics of new energy data, such as multi-source heterogeneity, uneven data quality, inconsistent standards, and data islands, have posed challenges to the application of new energy big data. The purpose of data application is mainly to uniformly extract, clean, store, mine, analyze, and produce low-density and low-value data from both inside and outside to form high-density and high-value knowledge, and provide services for internal and external systems. The premise for achieving this goal is the reliability, security, real-time, stability, and standardization of data collection and transmission.

[0003] There are many types and quantities of power generation equipment in large-scale new energy sites, and the corresponding supporting power transmission and transformation equipment and control equipment are also numerous. At the same time, there are a large number of unstructured data such as pictures and text records. The large number of new energy sites, many manufacturers, different models, and different data standards have posed great challenges to the application of new energy big data.

[0004] At present, most power plants have achieved all-round, full-process, and high-precision monitoring of various power generation equipment, and have accumulated a large amount of multi-source heterogeneous data. These data are scattered in various monitoring systems, which brings great difficulties to subsequent data processing and conversion, and reduces the efficiency of data application. Summary of the invention

[0005] In view of this, the present invention provides a multi-source heterogeneous data processing method, device and system to solve at least one of the above-mentioned problems.

[0006] According to a first aspect of the present invention, a method for processing multi-source heterogeneous data is provided, the method comprising:

[0007] Receiving heterogeneous data from different data sources, wherein the heterogeneous data includes: data from different source devices and different data types;

[0008] Parsing the heterogeneous data according to predetermined parsing rules;

[0009] Performing standardized conversion processing on the parsed data based on predetermined standardized rules, wherein the standardized conversion processing includes: data coding conversion processing and telesignaling and telemetry value conversion processing;

[0010] Send the standardized data to the data platform for subsequent use.

[0011] According to a second aspect of the present invention, there is provided a multi-source heterogeneous data processing device, the device comprising:

[0012] A data receiving unit, used for receiving heterogeneous data from different data sources, wherein the heterogeneous data includes: data of different source devices and different data types;

[0013] A parsing unit, used for parsing the heterogeneous data according to a predetermined parsing rule;

[0014] A standardization conversion unit, used for performing standardization conversion processing on the parsed data based on a predetermined standardization rule, wherein the standardization conversion processing includes: data coding conversion processing and telesignaling and telemetry value conversion processing;

[0015] The data sending unit is used to send the standardized data to the data platform for subsequent use.

[0016] According to a third aspect of the present invention, a multi-source heterogeneous data processing system is provided, the system comprising: the above-mentioned multi-source heterogeneous data processing device, and a data platform, the data platform receiving and saving standardized processed data from the multi-source heterogeneous data processing device for subsequent use.

[0017] According to a fourth aspect of the present invention, there is provided an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above method when executing the program.

[0018] According to a fifth aspect of the present invention, there is provided a computer-readable storage medium having a computer program stored thereon, which implements the steps of the above method when executed by a processor.

[0019] It can be seen from the above technical solution that by parsing the received heterogeneous data according to predetermined parsing rules, then performing standardized conversion processing on the parsed data based on predetermined standardization rules, and sending the standardized data to the data platform for subsequent use, the collection of multi-source heterogeneous data and the conversion and access of standardized data can be realized, which can improve the efficiency of data application. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0021] Figure 1is a structural block diagram of a multi-source heterogeneous data processing system according to an embodiment of the present invention;

[0022] Figure 2 is a structural block diagram of a multi-source heterogeneous data processing device 1 according to an embodiment of the present invention;

[0023] Figure 3 is an exemplary diagram of a multi-source heterogeneous data processing system according to an embodiment of the present invention;

[0024] Figure 4 is an example structural block diagram of a standardized data interface according to an embodiment of the present invention;

[0025] Figure 5 is a diagram showing an example of data encoding according to an embodiment of the present invention;

[0026] Figure 6 is an example diagram of fault coding of a fault type measuring point of an electric control system according to an embodiment of the present invention;

[0027] Figure 7 is a flowchart of a multi-source heterogeneous data processing method according to an embodiment of the present invention;

[0028] Figure 8 It is a schematic block diagram of the system structure of the electronic device 600 according to an embodiment of the present invention. DETAILED DESCRIPTION

[0029] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0030] Since there is a large amount of scattered multi-source heterogeneous data in power plants, the efficiency of data application is reduced. Based on this, an embodiment of the present invention provides a multi-source heterogeneous data processing solution, which can realize the collection of multi-source heterogeneous data and the conversion and access of standardized data, thereby improving the efficiency of data application. The following is a detailed description of the embodiment of the present invention in conjunction with the accompanying drawings.

[0031] Figure 1 is a structural block diagram of a multi-source heterogeneous data processing system according to an embodiment of the present invention. Figure 1As shown, the system includes: a multi-source heterogeneous data processing device 1 and a data platform 2. The multi-source heterogeneous data processing device 1 is used to standardize the received multi-source heterogeneous data, and the data platform is used to receive and save the standardized data from the multi-source heterogeneous data processing device for subsequent use. The multi-source heterogeneous data processing device 1 is described in detail below.

[0032] Figure 2 is a structural block diagram of a multi-source heterogeneous data processing device 1, such as Figure 2 As shown, the device includes: a data receiving unit 11, a parsing unit 12, a standardization conversion unit 13 and a data sending unit 14, wherein:

[0033] The data receiving unit 11 is used to receive heterogeneous data from different data sources, wherein the heterogeneous data includes data from different source devices and different data types.

[0034] In actual operation, the data receiving unit can receive heterogeneous data from different data sources based on a unidirectional or bidirectional switching mode.

[0035] The parsing unit 12 is used to parse the heterogeneous data according to a predetermined parsing rule. Through the parsing process, the corresponding conversion rule of the data can be determined.

[0036] The standardization conversion unit 13 is used to perform standardization conversion processing on the parsed data based on a predetermined standardization rule, wherein the standardization conversion processing includes: data coding conversion processing and telesignaling and telemetry value conversion processing.

[0037] Specifically, the standardization conversion unit includes: a data encoding conversion module and a remote signaling and telemetry value conversion module, wherein:

[0038] A data encoding conversion module is used to perform data encoding conversion processing on the parsed data based on the preset encoding rules and the data source device and data type;

[0039] The remote signaling and telemetry value conversion module is used to convert the parsed data into remote signaling and telemetry values ​​according to the received remote signaling and telemetry value data format.

[0040] In one embodiment, the heterogeneous data includes: data of different fault type measuring points. The telesignaling and telemetry value conversion module can perform telesignaling and telemetry value conversion processing on the parsed data according to the telesignaling and telemetry value data formats from different fault type measuring points based on preset fault coding rules.

[0041] The data sending unit 14 is used to send the standardized data to the data platform for subsequent use.

[0042] The parsing unit 12 parses the heterogeneous data received by the data receiving unit 11 according to predetermined parsing rules, and then the standardization conversion unit 13 performs standardization conversion on the parsed data based on predetermined standardization rules. The data sending unit 14 sends the standardized data to the data platform for subsequent use. In this way, the collection of multi-source heterogeneous data and the conversion and access of standardized data can be realized, which can improve the efficiency of data application.

[0043] In order to better understand the present invention, the following Figure 3 The exemplary system shown is used to describe the embodiments of the present invention in detail.

[0044] In this example, different data sources come from new energy sites. Through this example system, data fusion applications can be realized. This system is the basis for building a new energy big data platform.

[0045] See also Figure 3 , showing the data interaction between the data center and the new energy station (i.e., station 1 and station n in the figure). In this structure, a highly reliable data acquisition device is used to collect all the production and operation data of the new energy station to the standardized data interface of the data center (with the function of the above-mentioned multi-source heterogeneous data processing device). At the same time, the system can realize two-way interaction of information between the data center and the station, making it easier for the station to receive business guidance information processed by the data center, and realize equipment status monitoring, production safety management, production and operation control and optimization of the station.

[0046] The above-mentioned standardized data interface collects data from all parties and then sends it to the data platform. The normal operation of the standardized data interface is the basis and prerequisite for the normal operation of the data platform. It is related to the security of the system, the accuracy and real-time nature of the data, and the stable operation of the entire system.

[0047] Figure 4 This is an example structure diagram of a standardized data interface, such as Figure 4 As shown, the standardized data interface includes: a data communication module, a data writing module, a data parsing module, a data conversion module, a data cache module, a data reading module, a controller, a timing module and a storage module, wherein:

[0048] The data communication module can have both wired and wireless communication functions, support 4G / 5G network communication, and can be set separately according to the needs of accessing the data source, so as to enhance the adaptability of the data interface. This module can adopt a multi-process mode or an independent service program mode, and simultaneously collect multiple data sources. The sending and receiving of each link in the process of remote data upload are independent, which can reduce the coupling and dependence between communication programs, improve execution efficiency and reduce security risks. According to the specific requirements of data collection, it can be set to switch between one-way transmission and two-way interaction modes to realize two-way interaction of data center and station information.

[0049] The data writing module is used to receive data. The data writing module and the data parsing module integrate the current mainstream communication protocol parsing rules. When the data is connected, the data parsing module can parse the data according to the data format, automatically determine the communication protocol used, and parse it using the integrated parsing rules to determine the data conversion standard. For special and personalized communication protocols, it provides programmable functions, and implements the parsing of data rules through programming. For source systems that use personalized communication protocols, it realizes compatibility with multiple communication protocols, multiple data collection types, unlimited number of tag points, high-speed data collection frequency, fault handling, log recording and other functions. For some data that cannot be collected automatically, such as production logs, operation analysis reports, photo materials, etc., the data writing module provides manual input functions.

[0050] In order to ensure the security and continuity of data collection and data conversion, a storage module is configured at the same time as the data cache module. Once a network interruption occurs and the data transmission connection is interrupted, the collected data can be stored for a certain period of time and data cached. The interface program data will form a cache file of a certain size and number. When the connection is restored, the cache file will continue to be sent out through the connection to ensure that the data is not lost. The full file cache mode can effectively improve the security of the data.

[0051] After data analysis, the data conversion module is used to achieve standardized conversion of the data. The data conversion module can perform intelligent coding functions on the data collection points and intelligent conversion functions of telemetering and telesignaling values. The following describes the data intelligent coding function and the intelligent conversion function of telemetering and telesignaling values ​​respectively.

[0052] (1) Intelligent data coding function: data is encoded according to the data source device type, data site source, and data type. This function can also edit the coding rules.

[0053] The data intelligent coding here refers to the coding of data measurement points, which consists of two parts, with a total of 20 bits, using Arabic numerals and English letters for coding. Figure 5As shown, the encoded data includes: region, substation, station information, and also includes relevant information of the unit. The encoding of the relevant information of the unit is described in detail below.

[0054] 1) Data source encoding requirements

[0055] The data source number of the data is 1-digit code. Select the corresponding code value from Table 1 below according to the data access source system. Table 1 shows an example of the data source number value.

[0056] Encoded value describe 1 Power generation equipment monitoring system (SCADA) 2 AVC System 3 AGC System 4 Power prediction 5 SVG 6 PMU 7 Single machine information 8 On-site monitoring 9 Equipment body

[0057] Table 1

[0058] 2) Equipment type coding requirements

[0059] The device type of the data is 1-bit. Select the corresponding code value from Table 2 below according to the access data device.

[0060] value describe 1 Wind turbines 2 Photovoltaic power generation equipment

[0061] Table 2

[0062] 3) Equipment number

[0063] The equipment code of the data occupies 3 digits and starts with Arabic numerals 001. The maximum Arabic numeral code is 999. After that, it is encoded in the form of a combination of letters and Arabic numerals. It is expressed in uppercase letters from the lowest digit. When the lowest uppercase letters are used up, the higher digit is increased by 1, and the cycle repeats. If the high digit is increased to a letter, the low digit is used in a cycle from 0 1 2··9A B··YZ. For example, ·······999, 00A, 00B…00Z, 01A…, the equipment code should be consistent with the number of the equipment ledger provided.

[0064] 4) Signal type

[0065] The signal type of the data occupies 1 bit of code. Select the corresponding code value from Table 3 below according to the access data signal type.

[0066]

[0067]

[0068] Table 3

[0069] 5) Part Number

[0070] The data component number occupies 1 digit. Select the corresponding code value from Table 4 and Table 5 below according to the component connected to the data measurement point. The wind turbine component (see Table 4) and photovoltaic power generation equipment component (see Table 5) are coded separately. If the data access component is not in the table below, expand and configure the code value based on experience.

[0071]

[0072] Table 4

[0073] value describe 0 Non-component information (status information, etc.) 1 Inverter 2 Combiner Box 3 Photovoltaic strings 4 Weather Station

[0074] Table 5

[0075] 6) Measurement point type

[0076] The data measurement point type number occupies 1 bit of code. Select the corresponding code value from Table 6 below according to the type of access data measurement point.

[0077] value describe 1 Fault type 2 Data Class 3 Status Class

[0078] Table 6

[0079] 7) Measurement point coding

[0080] The data point code occupies 4 bits, starting from Arabic numerals 0001, and the maximum Arabic numeral code is 9999. After that, it is coded in the form of a combination of letters and Arabic numerals, starting from the lowest bit and represented in uppercase letters. When the lowest uppercase letters are used up, the higher bit is increased by 1, and the cycle repeats. If the high bit is increased to a letter, the low bit is used in a cycle from 0 12··9A B··YZ. The measuring points with different equipment numbers should be coded separately.

[0081] (2) The intelligent conversion function of telesignal and telemetering values ​​can realize the standardized conversion of telesignal quantities and fault information, and can be edited according to the format of the access data.

[0082] The following description takes the compilation rules of fault type measurement point values ​​as an example.

[0083] 1) Fault measurement points should be classified and numbered according to the components. The fault measurement points of each type of component should be coded starting from 0001. The number of fault measurement points for each component is unlimited. The "Unit Fault Coding Table" can be formulated accordingly.

[0084] 2) The coding rules can include all faults of this unit and should distinguish between shutdown faults and alarms;

[0085] 3) The value of each fault measurement point is a maximum of 32 bits of binary number, representing the corresponding 32 fault status information, 1 indicates a fault occurs, and 0 indicates no fault occurs.

[0086] The calculation rule of the fault measurement point value is:

[0087] a. According to the sequence of the Unit Fault Coding Table, every 32 pieces of fault information of each type of component constitute a measuring point value. If it is less than 32 bits, the remaining number will constitute the final measuring point value of the component.

[0088] b. Binary numbers are represented from low to high, starting from component 0001 according to the Unit Fault Coding Table.

[0089] c. Each fault word starts with the fault code of 0001 for each component according to the "Unit Fault Coding Table", and the fault status of every 32 fault codes from low to high composes this 32-bit binary number.

[0090] d. When uploading the measuring point values, the above binary numbers should be converted into decimal numbers.

[0091] Figure 6 This is an example diagram of the fault coding of the fault measurement point of the electronic control system, such as Figure 6 As shown, the electronic control system fault word 1 indicates that the component is the first 32 bits of fault information of the electronic control system, and the electronic control system fault word 2 (not shown in the figure) indicates that the component is the 33rd to 64th bits of fault information of the electronic control system.

[0092] As described above, the embodiments of the present invention provide a data standardization data interface and encoding method for new energy, which solves the problems of non-standard data format and low application efficiency during the construction of new energy data centers. By standardizing the collection of data, standardization of data access is achieved, thereby improving the efficiency of data application.

[0093] Based on similar inventive concepts, an embodiment of the present invention further provides a multi-source heterogeneous data processing method, which is preferably used to implement the functions of the multi-source heterogeneous data processing device described above.

[0094] Figure 7 is a flowchart of the multi-source heterogeneous data processing method, such as Figure 7 As shown, the method includes:

[0095] Step 701, receiving heterogeneous data from different data sources, wherein the heterogeneous data includes data from different source devices and different data types.

[0096] In actual operation, heterogeneous data from different data sources can be received based on unidirectional or bidirectional switching modes.

[0097] Step 702: parse the heterogeneous data according to a predetermined parsing rule.

[0098] Step 703, performing standardization conversion processing on the parsed data based on predetermined standardization rules, wherein the standardization conversion processing includes: data coding conversion processing and telesignaling and telemetry value conversion processing.

[0099] Specifically, based on preset encoding rules, the parsed data can be subjected to data encoding conversion processing according to the data source device and data type; and the parsed data can be subjected to telesignaling and telemetry value conversion processing according to the accessed telesignaling and telemetry value data format.

[0100] In one embodiment, the heterogeneous data includes: data of different fault type measuring points. Based on the preset fault coding rules, the telesignaling and telemetry value conversion processing can be performed on the parsed data according to the telesignaling and telemetry value data formats from the different fault type measuring points.

[0101] Step 704, sending the standardized data to the data platform for subsequent use.

[0102] By parsing the received heterogeneous data according to predetermined parsing rules, then performing standardized conversion processing on the parsed data based on predetermined standardization rules, and sending the standardized data to the data platform for subsequent use, the collection of multi-source heterogeneous data and the conversion and access of standardized data can be achieved, which can improve the efficiency of data application.

[0103] The specific execution process of the above steps can be found in the description of the above system embodiment, which will not be repeated here.

[0104] This embodiment also provides an electronic device, which may be a desktop computer, a tablet computer, a mobile terminal, etc., but this embodiment is not limited thereto. In this embodiment, the electronic device may be implemented with reference to the above method embodiment and the embodiment of the multi-source heterogeneous data processing device / system, the contents of which are incorporated herein, and the repeated parts are not repeated.

[0105] Figure 8 FIG. 6 is a schematic block diagram of a system structure of an electronic device 600 according to an embodiment of the present invention. Figure 8 As shown, the electronic device 600 may include a central processor 100 and a memory 140; the memory 140 is coupled to the central processor 100. It should be noted that this figure is exemplary; other types of structures may also be used to supplement or replace this structure to implement telecommunication functions or other functions.

[0106] In one embodiment, the multi-source heterogeneous data processing function may be integrated into the central processing unit 100. The central processing unit 100 may be configured to perform the following control:

[0107] Receiving heterogeneous data from different data sources, wherein the heterogeneous data includes: data from different source devices and different data types;

[0108] Parsing the heterogeneous data according to predetermined parsing rules;

[0109] Performing standardized conversion processing on the parsed data based on predetermined standardized rules, wherein the standardized conversion processing includes: data coding conversion processing and telesignaling and telemetry value conversion processing;

[0110] Send the standardized data to the data platform for subsequent use.

[0111] From the above description, it can be seen that the electronic device provided in the embodiment of the present application parses the received heterogeneous data according to predetermined parsing rules, then performs standardized conversion processing on the parsed data based on predetermined standardization rules, and sends the standardized data to the data platform for subsequent use. In this way, the collection of multi-source heterogeneous data and the conversion and access of standardized data can be realized, which can improve the efficiency of data application.

[0112] In another embodiment, the multi-source heterogeneous data processing device / system can be configured separately from the central processing unit 100. For example, the multi-source heterogeneous data processing device / system can be configured as a chip connected to the central processing unit 100, and the multi-source heterogeneous data processing function can be realized through the control of the central processing unit.

[0113] like Figure 8 As shown, the electronic device 600 may further include: a communication module 110, an input unit 120, an audio processing unit 130, a display 160, and a power supply 170. It is worth noting that the electronic device 600 does not necessarily have to include Figure 8 In addition, the electronic device 600 may also include Figure 8 For components not shown, reference may be made to the prior art.

[0114] like Figure 8 As shown, the central processor 100 is sometimes also referred to as a controller or an operation control, and may include a microprocessor or other processor devices and / or logic devices. The central processor 100 receives inputs and controls the operations of various components of the electronic device 600.

[0115] The memory 140 may be, for example, one or more of a cache, a flash memory, a hard drive, a removable medium, a volatile memory, a non-volatile memory or other suitable devices. The above-mentioned information related to the failure may be stored, and a program for executing the relevant information may also be stored. The CPU 100 may execute the program stored in the memory 140 to implement information storage or processing.

[0116] The input unit 120 provides input to the CPU 100. The input unit 120 is, for example, a key or a touch input device. The power supply 170 is used to provide power to the electronic device 600. The display 160 is used to display display objects such as images and text. The display may be, for example, an LCD display, but is not limited thereto.

[0117] The memory 140 may be a solid-state memory, such as a read-only memory (ROM), a random access memory (RAM), a SIM card, etc. It may also be a memory that saves information even when the power is off, can be selectively erased, and is provided with more data, examples of which are sometimes referred to as EPROMs, etc. The memory 140 may also be some other type of device. The memory 140 includes a buffer memory 141 (sometimes referred to as a buffer). The memory 140 may include an application / function storage unit 142, which is used to store application programs and function programs or processes for executing the operation of the electronic device 600 through the central processor 100.

[0118] The memory 140 may also include a data storage unit 143 for storing data, such as contacts, digital data, pictures, sounds, and / or any other data used by the electronic device. The driver storage unit 144 of the memory 140 may include various drivers for communication functions of the electronic device and / or for executing other functions of the electronic device (such as messaging applications, address book applications, etc.).

[0119] The communication module 110 is a transmitter / receiver 110 that transmits and receives signals via an antenna 111. The communication module (transmitter / receiver) 110 is coupled to the central processor 100 to provide input signals and receive output signals, which may be the same as the case of a conventional mobile communication terminal.

[0120] Based on different communication technologies, multiple communication modules 110 may be provided in the same electronic device, such as a cellular network module, a Bluetooth module and / or a wireless LAN module. The communication module (transmitter / receiver) 110 is also coupled to a speaker 131 and a microphone 132 via an audio processor 130 to provide an audio output via the speaker 131 and receive an audio input from the microphone 132, thereby realizing a common telecommunication function. The audio processor 130 may include any suitable buffer, decoder, amplifier, etc. In addition, the audio processor 130 is also coupled to the central processor 100, so that the sound can be recorded on the local machine through the microphone 132, and the sound stored on the local machine can be played through the speaker 131.

[0121] An embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the multi-source heterogeneous data processing method are implemented.

[0122] To sum up, for the collection of multi-source heterogeneous data in new energy scenarios, the embodiments of the present invention provide a standardized collection interface device and a data standardization method. Through a standardized data interface, standardized access to data from different manufacturers, different sites, different equipment, and different sources is achieved, thereby improving the efficiency of data application.

[0123] The preferred embodiments of the present invention are described above with reference to the accompanying drawings. Many features and advantages of these embodiments are clear from this detailed description, and therefore the claims are intended to cover all such features and advantages of these embodiments that fall within their true spirit and scope. In addition, since many modifications and changes are easily conceivable to those skilled in the art, it is not intended to limit the embodiments of the present invention to the precise structure and operation illustrated and described, but all suitable modifications and equivalents falling within its scope may be covered.

[0124] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0125] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0126] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0127] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0128] The present invention uses specific embodiments to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for processing multi-source heterogeneous data, characterized in that: The method comprises: Receiving heterogeneous data from different data sources, wherein the heterogeneous data includes: data from different source devices and different data types; Parsing the heterogeneous data according to predetermined parsing rules; Performing standardized conversion processing on the parsed data based on predetermined standardized rules, wherein the standardized conversion processing includes: data coding conversion processing and telesignaling and telemetry value conversion processing; Send the standardized data to the data platform for subsequent use; The standardized conversion processing of the parsed data based on the predetermined standardized rules includes: Based on the preset encoding rules, the parsed data is subjected to data encoding conversion processing according to the data source device and data type; specifically, the encoding rules are shown in the following table: Table 1 Table 2 Table 3 Among them, Table 1 represents the encoding rules corresponding to the data source, Table 2 represents the encoding rules corresponding to the device type, and Table 3 represents the encoding rules corresponding to the signal type; Perform telesignaling and telemetering value conversion processing on the parsed data according to the received telesignaling and telemetering value data format; The heterogeneous data also includes: data of different fault type measurement points; the telesignaling and telemetering value conversion processing of the parsed data according to the accessed telesignaling and telemetering value data format includes: Based on the preset fault coding rules, the telesignaling and telemetry values ​​of the parsed data are converted according to the data formats of the telesignaling and telemetry values ​​from different fault type measuring points; specifically, the fault coding rules are determined according to the following method: the fault type measuring points are classified and numbered according to the components, and the fault type measuring points of each type of component are coded from 0001, and the number of fault type measuring points of each component is unlimited, so as to obtain the fault coding rules; wherein the telesignaling and telemetry values ​​of the fault type measuring points are determined according to the following method: according to the order of different types of components in the fault coding rules, every 32 fault information in each type of component are The telesignaling and telemetering values ​​of a fault type measuring point are composed. If the fault information is less than 32, all the remaining fault information are composed of the telesignaling and telemetering values ​​of a fault type measuring point; according to the order of different types of components in the fault coding rule, starting from the component corresponding to 0001, the telesignaling and telemetering values ​​of the fault type measuring points of each type of component are converted into binary digits; according to the order of different types of components in the fault coding rule, starting from the component corresponding to 0001, every 32 binary digits in the binary digits corresponding to each type of component are composed into a 32-bit binary digit to obtain the telesignaling and telemetering value of the fault type measuring point.

2. The method according to claim 1, characterized in that Receiving heterogeneous data from different data sources includes: Receive heterogeneous data from different data sources based on unidirectional and bidirectional switching modes.

3. A multi-source heterogeneous data processing device, characterized in that: The device comprises: A data receiving unit, used for receiving heterogeneous data from different data sources, wherein the heterogeneous data includes: data of different source devices and different data types; A parsing unit, used for parsing the heterogeneous data according to a predetermined parsing rule; A standardization conversion unit, used for performing standardization conversion processing on the parsed data based on a predetermined standardization rule, wherein the standardization conversion processing includes: data coding conversion processing and telesignaling and telemetry value conversion processing; A data sending unit is used to send the standardized data to the data platform for subsequent use; The standardization conversion unit comprises: The data encoding conversion module is used to perform data encoding conversion processing on the parsed data based on the preset encoding rules according to the data source device and data type; specifically, the encoding rules are shown in the following table: Table 1 Table 2 Table 3 Among them, Table 1 represents the encoding rules corresponding to the data source, Table 2 represents the encoding rules corresponding to the device type, and Table 3 represents the encoding rules corresponding to the signal type; The remote signal and telemetry value conversion module is used to convert the parsed data into remote signal and telemetry values ​​according to the received remote signal and telemetry value data format; The heterogeneous data includes: data of different fault type measurement points, and the remote signaling and telemetry value conversion module is specifically used for: Based on the preset fault coding rules, the telesignaling and telemetry values ​​of the parsed data are converted according to the data formats of the telesignaling and telemetry values ​​from different fault type measuring points; specifically, the fault coding rules are determined according to the following method: the fault type measuring points are classified and numbered according to the components, and the fault type measuring points of each type of component are coded from 0001, and the number of fault type measuring points of each component is unlimited, so as to obtain the fault coding rules; wherein the telesignaling and telemetry values ​​of the fault type measuring points are determined according to the following method: according to the order of different types of components in the fault coding rules, every 32 fault information in each type of component are The telesignaling and telemetering values ​​of a fault type measuring point are composed. If the fault information is less than 32, all the remaining fault information are composed of the telesignaling and telemetering values ​​of a fault type measuring point; according to the order of different types of components in the fault coding rule, starting from the component corresponding to 0001, the telesignaling and telemetering values ​​of the fault type measuring points of each type of component are converted into binary digits; according to the order of different types of components in the fault coding rule, starting from the component corresponding to 0001, every 32 binary digits in the binary digits corresponding to each type of component are composed into a 32-bit binary digit to obtain the telesignaling and telemetering value of the fault type measuring point.

4. The device according to claim 3, characterized in that The data receiving unit is specifically used for: Receive heterogeneous data from different data sources based on unidirectional and bidirectional switching modes.

5. A multi-source heterogeneous data processing system, characterized in that: The system comprises: a multi-source heterogeneous data processing device as described in any one of claims 3 to 4, and a data platform, wherein the data platform receives and stores standardized processed data from the multi-source heterogeneous data processing device for subsequent use.

6. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps of the method according to any one of claims 1 to 2 are implemented.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 2 are implemented.

Images