An energy monitoring data transmission system based on big data

Abstract

The present invention discloses an energy monitoring data transmission system based on big data, which belongs to the field of data transmission. The system includes a data layer, a service layer, a transmission layer and a terminal layer; the data layer includes a network information acquisition module, a transmission data acquisition module and an information data writing module; the network information acquisition module is used to collect the transmission speed, network jitter and data packet loss rate information data of each transmission link; the transmission data acquisition module is used to acquire the energy monitoring data that needs to be transmitted. In the early stage, the network environment information of each transmission link is collected, and the network environment index of each transmission link is determined, and then the transmission link with the largest network environment index is selected as the transmission link of the energy monitoring data. In the later stage, when the recorded transmission information reaches a certain scale, the link to be transmitted can be quickly selected directly according to the data volume of the energy monitoring data to be transmitted.

Description

Technical Field

[0001] The present invention relates to data transmission, and in particular to an energy monitoring data transmission system based on big data. Background Art

[0002] Energy, as a substance that can provide kinetic energy, mechanical energy and energy for humans, plays an important role in people's daily life and the stable development of society. In order to better control energy, IoT technology is usually used to monitor energy-related data (including but not limited to energy status, energy surplus, energy generation, etc.), and transmit the monitored data to the monitoring platform for managers to supervise energy. Due to the current Internet environment is relatively loaded, when transmitting energy monitoring data, it is easy to have excessive network fluctuations, resulting in data damage during transmission, data loss and untimely data transmission, which leads to data transmission to the monitoring platform. The situation is damaged or distorted, which in turn causes the supervisor to be unable to obtain real and complete energy monitoring data in time, resulting in unfavorable supervision. Summary of the invention

[0003] Purpose of the invention: The purpose of the present invention is to provide an energy monitoring data transmission system based on big data.

[0004] Technical solution: An energy monitoring data transmission system based on big data, including data layer, service layer, transmission layer and terminal layer;

[0005] The data layer includes a network information collection module, a transmission data acquisition module and an information data writing module; the network information collection module is used to collect information data on the transmission speed, network jitter and packet loss rate of each transmission link; the transmission data acquisition module is used to acquire energy monitoring data that needs to be transmitted; the information data writing module is used to write the data obtained by the network information collection module and the transmission data acquisition module to the service layer;

[0006] The service layer includes a data processing module, a transmission information recording module and an analysis and matching module; the data processing module is used to process the information data written into the service layer by the information data writing module, so as to detect the network environment of the transmission link and assign a data identity to the data to be transmitted; the transmission information recording module is used to record the amount of data during the energy monitoring data transmission process, the transmission link network environment index, the integrity of the data after transmission and the transmission link number; the analysis and matching module is used to select a suitable transmission link from the transmission information recording module for data transmission according to the amount of energy monitoring data to be transmitted after the information data recorded in the transmission information recording module reaches a certain scale;

[0007] The transmission layer includes an information data transmission module; the information data transmission module is used to transmit energy monitoring data according to the selected transmission link;

[0008] The terminal layer includes a user terminal system; the user terminal system is used to receive energy monitoring data from the transmission layer and display the received energy monitoring data.

[0009] Preferably, the data processing module includes a transmission link network environment detection module and a data identity assignment module;

[0010] Transmission link network environment detection module: used to determine the network environment index of each transmission link according to the transmission speed, network jitter and data packet loss rate information data of each transmission link collected by the network information collection module. The higher the network environment index, the better the network environment and the higher the transmission efficiency;

[0011] Data identity assignment module: used to assign data identity to the energy monitoring data that needs to be transmitted, thereby increasing the security of the transmitted energy monitoring data.

[0012] Preferably, when the transmission link network environment detection module detects the network environment index of each transmission link, it has the following steps:

[0013] ,

[0014] in, NEI is the network environment index of the transmission link, DS is the actual transmission speed of the transmission link, DS m is the base transmission speed of the transmission link, J is the jitter metric of the transmission link, PL is the packet loss rate of the transmission link, α , β , c is the weight coefficient, a+b+c=1 , respectively adjust the relative importance of each parameter in the network environment index, ex i is the jitter change each time, Z Total number of jitters, floor(x) To get the closest x A positive integer.

[0015] Preferably, in the process of assigning the identity of the energy monitoring data to be transmitted, after the terminal layer sends a data request command to the service layer, the service layer will open a unique temporary port for data transmission and inform the terminal layer of the temporary port number. At the same time, the service layer converts the energy monitoring data to be transmitted into binary data, converts the temporary port number into an identity identifier according to a preset code table, and inserts the identity identifier into the B position of the binary data.

[0016] ,

[0017] in, first , last They are the first and last digits of the temporary port number, ceiling(x) To take the closest x A positive integer of ;

[0018] Then the terminal layer is connected to the temporary port, and after receiving the binary data with the identity, it scans each bit of the binary data one by one, and then continues to scan the subsequent binary data bits after resolving and identifying the identity through the preset code table, so as to obtain the entire binary data, and after restoring the binary data, the transmitted energy monitoring data can be obtained.

[0019] Preferably, when B≥the number of bits of the binary data, the identity tag is inserted into the beginning of the binary data.

[0020] Preferably, after recording the amount of data, the network environment index of the transmission link, the integrity of the data after transmission, and the transmission link number during the energy monitoring data transmission process, the transmission information recording module will automatically generate the transmission link coefficient K according to the above recorded information:

[0021] ,

[0022] in, D is the amount of data, C For data integrity, is the overall scaling factor, To control the exponential factor of the data volume, To control the logarithmic factor of the network environment index, , Factors that control the impact of data integrity.

[0023] Preferably, the system is divided into two parts: early energy monitoring data transmission and late energy monitoring data transmission. In the early energy monitoring data transmission, the network environment index of each transmission link is determined by formula (1), and then the transmission link with the network environment index is selected as the transmission link of the energy monitoring data, and the data volume, transmission link network environment index, data integrity after transmission and transmission link number in the energy monitoring data transmission process are recorded by the transmission information recording module;

[0024] When the data in the transmission information recording module reaches a certain size, when the energy monitoring data is transmitted, the analysis and matching module finds all transmission records that meet the following conditions from the transmission information record according to the amount of energy monitoring data to be transmitted:

[0025] |Recorded data volume - current transmission data volume|≤current transmission data volume×0.9

[0026] Then, from all transmission records that meet the above conditions, find the transmission link with the largest transmission link coefficient, and use this transmission link to transmit the energy monitoring data that currently needs to be transmitted.

[0027] Preferably, after receiving the transmitted energy monitoring data, the user terminal system also includes operations of saving the energy monitoring data and displaying it in a preset data presentation format, and when an abnormality occurs in the energy data, it can also include an abnormality alarm operation. Beneficial Effects

[0028] (1) When transmitting energy monitoring data, the present invention collects network environment information of each transmission link in the early stage, determines the network environment index of each transmission link, and then selects the transmission link with the largest network environment index as the transmission link of the energy monitoring data, and records the information during the energy monitoring data transmission process, thereby ensuring the efficiency of the energy monitoring data during the transmission process, and avoiding the situation in which serious packet loss, data damage or data distortion (data after transmission is inconsistent with source data) occurs during the transmission of energy monitoring data. Later, when the recorded transmission information reaches a certain scale, the link to be transmitted can be quickly selected directly according to the amount of energy monitoring data to be transmitted.

[0029] (2) When transmitting energy monitoring data, the present invention will assign an identity to the energy monitoring data to be transmitted according to the port temporarily opened by the service layer, thereby ensuring the security of energy monitoring data transmission. Compared with the current encryption algorithm used to encrypt data to ensure the security of data transmission, the present invention ensures data security by assigning an identity identifier, without the need for additional dynamic keys. In addition, each time the data is transmitted, the temporary port opened by the service layer is different, so the identity identifier of each data transmission is different, thereby achieving the effect of dynamic encryption without the need for additional dynamic keys. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 It is a schematic diagram of the system principle of the present invention;

[0031] Figure 2 It is a data transmission schematic diagram of the present invention. DETAILED DESCRIPTION

[0032] In order to make the technical solution of the present invention clearer, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments. Example 1

[0033] like Figure 1 As shown in FIG. 1 , an energy monitoring data transmission system based on big data prepares test data of the same number as the number of transmission links and the data size is 1M in the early stage of energy monitoring data transmission, and transmits the test data through several transmission links at the same time. The transmission links are as follows: Figure 2 As shown, the network information collection module deployed in the data layer then collects the transmission speed, network jitter, and packet loss rate of each transmission link, as follows:

[0034] At the same time, the energy monitoring data to be transmitted is obtained through the transmission data acquisition module deployed in the data layer, and then the information data obtained by the network information collection module and the transmission data acquisition module is written into the service layer through the information data writing module also deployed in the data layer.

[0035] After receiving the data written by the information data writing module, the data processing module in the service layer will calculate the network environment index of each transmission link through the transmission link network environment detection module using the following formula: NEI , the higher the network environment index, the better the network environment and the higher the transmission efficiency:

[0036] ,

[0037] in, DS is the actual transmission speed of the transmission link, DS m=10 is the base transmission speed of the transmission link, J is the jitter metric of the transmission link, PL is the packet loss rate of the transmission link, α , β , c is the weight coefficient, which adjusts the relative importance of each parameter in the network environment index. a+b+c=1 ,Since transmission speed, network jitter and packet loss rate are important indicators for evaluating the quality of the network, we set α=0.34、β=0.33、γ=0.33 , ex i is the jitter change each time, Z Total number of jitters, floor(x) To get the closest x A positive integer.

[0038] Therefore, the network environment index of transmission link ① can be obtained as:

[0039] ,

[0040] The network environment index of transmission link ② is:

[0041] ,

[0042] The network environment index of transmission link ③ is:

[0043] ,

[0044] Therefore, when transmitting energy detection data, transmission link ② is selected as the transmission link to transmit the data. The energy monitoring data is transmitted to the user terminal system of the terminal layer through the information data transmission module in the transmission layer, so that the energy monitoring data is displayed according to the set data display format, and the energy monitoring data can be saved at the same time. At the same time, the transmission information recording module in the service layer records the amount of energy monitoring data during the transmission process, the transmission link network environment index, the integrity of the data after transmission (the closer the value is to 1, the higher the data integrity) and the transmission link number information. In the process of transmitting energy monitoring data, the transmission record information that can be obtained is as follows:

[0045] At the same time, the transmission information recording module will automatically generate the coefficient K of each transmission link according to the above recorded information data through the following formula:

[0046] ,

[0047] in, D is the amount of data, C For data integrity, is the overall scaling factor. In this embodiment, it is set to 1. In actual application, it can be adjusted according to specific circumstances. In order to control the exponential factor affected by the data volume, it is set to 0.01 in this embodiment. In actual application, if the data volume has a greater impact on the coefficient, a larger value can be selected. In order to control the logarithmic factor of the network environment index, it is set to 5 in this embodiment to adjust the sensitivity of network quality to the coefficient. , To control the factors affecting data integrity, in this embodiment, they are set to 2 and 0.1 respectively.

[0048] Therefore, the coefficient of transmission link ① is:

[0049] ,

[0050] The coefficient of transmission link ② is:

[0051] ,

[0052] The coefficient of transmission link ③ is:

[0053] ,

[0054] When the information recorded in the information recording module reaches a certain size, it enters the later stage of energy monitoring data transmission. At this time, in the process of energy monitoring data transmission, the energy monitoring data to be transmitted is 15MB. At this time, find the transmission record that meets the conditions according to the following conditions:

[0055] |Record data volume -15|≤1.5

[0056] The resulting transmission record is:

[0057] Since the transmission link coefficient in transmission record 2 is 1.63, which is greater than the transmission link coefficients of the other two transmission records, when transmitting the energy monitoring data, transmission link ② is used to transmit the energy monitoring data, and the energy monitoring data is transmitted to the user terminal system of the terminal layer through the information data transmission module in the transmission layer, so that the energy monitoring data is displayed according to the set data display format. Example 2

[0058] In Example 1, when the energy monitoring data is transmitted, the terminal layer will first send a data request command to the service layer. After receiving the data request command, the service layer will randomly select a port from the port numbers 1023~65535 to open. The service layer will open a unique temporary port 56730 for data transmission, and inform the terminal layer of the temporary port number 56730. If the service layer needs to transmit the value 128 of the energy monitoring, it will first convert it into binary data 10000000, and convert the temporary port number into an identity identifier efgc# according to a preset code table, and insert the identity identifier into the B position of the binary data.

[0059] ,

[0060] in, first , last They are the first and last digits of the temporary port number, ceiling(x) To take the closest x Thus, we can get the binary data 100efgh#00000 with identity.

[0061] Then the terminal layer is connected to the temporary port, and after receiving the binary data with the identity, it scans each bit of the binary data one by one, and then continues to scan the subsequent binary data bits after resolving and identifying the identity through the preset code table, so as to obtain the entire binary data, and after restoring the binary data, the transmitted energy monitoring data can be obtained.

[0062] The above preset code table is as follows:

[0063] If the service layer needs to transmit the value 5 detected by energy monitoring, it will first be converted into binary data 101. Since the number of inserted bits B = 3, which is equal to the number of binary data bits, the obtained identity is inserted into the beginning of the binary data, so that the binary data with the identity is efgh#101.

[0064] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. An energy monitoring data transmission system based on big data, characterized in that: Includes data layer, service layer, transport layer and terminal layer; The data layer includes a network information collection module, a transmission data acquisition module and an information data writing module; the network information collection module is used to collect information data on the transmission speed, network jitter and packet loss rate of each transmission link; the transmission data acquisition module is used to acquire energy monitoring data that needs to be transmitted; the information data writing module is used to write the data obtained by the network information collection module and the transmission data acquisition module to the service layer; The service layer includes a data processing module, a transmission information recording module and an analysis and matching module; the data processing module is used to process the information data written into the service layer by the information data writing module, so as to detect the network environment of the transmission link and assign a data identity to the data to be transmitted; the transmission information recording module is used to record the data volume, the transmission link network environment index, the integrity of the data after transmission and the transmission link number during the energy monitoring data transmission process; the analysis and matching module is used to select a suitable transmission link from the transmission information recording module for data transmission according to the data volume of the energy monitoring data to be transmitted after the information data recorded in the transmission information recording module reaches a certain scale; wherein the transmission link network environment index is: ， in, NEI is the network environment index of the transmission link, DS is the actual transmission speed of the transmission link, DS m is the base transmission speed of the transmission link, J is the jitter metric of the transmission link, PL is the packet loss rate of the transmission link, α , β , γ is the weight coefficient, α+β+γ=1 , respectively adjust the relative importance of each parameter in the network environment index, ex i is the jitter change each time, Z is Total number of jitters, floor(x) To get the closest x A positive integer of ; In the process of assigning the identity of the energy monitoring data to be transmitted, after the terminal layer sends a data request command to the service layer, the service layer will open a unique temporary port for data transmission and inform the terminal layer of the temporary port number. At the same time, the service layer converts the energy monitoring data to be transmitted into binary data, and converts the temporary port number into an identity according to the preset code table, and inserts the identity into the B position of the binary data. ， in, first , last They are the first and last digits of the temporary port number, ceiling(x) To get the closest x A positive integer of ; After recording the amount of data during the energy monitoring data transmission process, the transmission link network environment index, the integrity of the data after transmission, and the transmission link number, the transmission information recording module will automatically generate the transmission link coefficient K based on the above recorded information: ， in, D is the amount of data, C For data integrity, is the overall scaling factor, To control the exponential factor of the data volume, To control the logarithmic factor of the network environment index, , To control factors affecting data integrity; The transmission layer includes an information data transmission module; the information data transmission module is used to transmit energy monitoring data according to the selected transmission link; The terminal layer includes a user terminal system; the user terminal system is used to receive energy monitoring data from the transmission layer and display the received energy monitoring data.

2. The energy monitoring data transmission system based on big data according to claim 1 is characterized in that: The data processing module includes a transmission link network environment detection module and a data identity assignment module; Transmission link network environment detection module: used to determine the network environment index of each transmission link according to the transmission speed, network jitter and data packet loss rate information data of each transmission link collected by the network information collection module. The higher the network environment index, the better the network environment and the higher the transmission efficiency; Data identity assignment module: used to assign data identity to the energy monitoring data that needs to be transmitted, thereby increasing the security of the transmitted energy monitoring data.

3. The energy monitoring data transmission system based on big data according to claim 2 is characterized in that: During the data transmission process, when the terminal layer is connected to the temporary port and receives the binary data with identity, the system scans each bit of the binary data one by one, and then resolves and identifies the identity through a preset code table, and continues to scan subsequent binary data bits to obtain the entire binary data. After restoring the binary data, the transmitted energy monitoring data can be obtained.

4. The energy monitoring data transmission system based on big data according to claim 1 is characterized in that: When B≥the number of bits of the binary data, the identity tag is inserted at the beginning of the binary data.

5. The energy monitoring data transmission system based on big data according to claim 1 is characterized in that: The system is divided into two parts: the early stage of energy monitoring data transmission and the later stage of energy monitoring data transmission. In the early stage of energy monitoring data transmission, the network environment index of each transmission link is determined by formula (1), and then the transmission link with the largest network environment index is selected as the transmission link of energy monitoring data. The data volume, transmission link network environment index, data integrity after transmission and transmission link number in the process of energy monitoring data transmission are recorded by the transmission information recording module. When the data in the transmission information recording module reaches a certain size, when the energy monitoring data is transmitted, the analysis and matching module finds all transmission records that meet the following conditions from the transmission information record according to the amount of energy monitoring data to be transmitted: |Recorded data volume - current transmission data volume|≤current transmission data volume×0.1 Then, from all transmission records that meet the above conditions, find the transmission link with the largest transmission link coefficient, and use this transmission link to transmit the energy monitoring data that currently needs to be transmitted.

6. The energy monitoring data transmission system based on big data according to claim 1 is characterized in that: After receiving the transmitted energy monitoring data, the user terminal system also includes saving the energy monitoring data and displaying it in a preset data display format. In addition, when an abnormality occurs in the energy data, it can also include an abnormality alarm operation.

Images