A big data processing system and method based on the Internet of Things

Abstract

The present invention discloses a big data processing system and method based on the Internet of Things, which belongs to the technical field of computer big data processing. The system includes a data acquisition module, a data processing module, a data monitoring module and an alarm management module; the output end of the data acquisition module is connected to the input end of the data processing module; the output end of the data processing module is connected to the input end of the data monitoring module; the output end of the data monitoring module is connected to the input end of the data analysis module; the present invention also provides a method for implementing the system, which can effectively monitor and manage electricity consumption, and help green and sustainable development of energy.

Description

Technical Field

[0001] The present invention relates to the technical field of computer big data processing, and in particular to a big data processing system and method based on the Internet of Things. Background Art

[0002] The Internet of Things (IoT) is a technology that uses information sensing devices to transmit device data to the network according to agreed protocols for information exchange and communication. Big data technology is a new generation of architecture and technology designed to more economically extract value from high-frequency, large-capacity, different structures and types of data.

[0003] In the prior art, electricity consumption data is generally detected and transmitted by connecting the meter to the computer, which helps to achieve efficient data transmission and assist green and sustainable development. However, electricity consumption data is unstable and there is a temporary overload phenomenon. If every overload is judged as abnormal electricity consumption and an alarm message is pushed, it will cause confusion for on-site staff and waste manpower and material resources. Summary of the invention

[0004] The purpose of the present invention is to provide a big data processing system and method based on the Internet of Things to solve the problems raised in the above background technology.

[0005] In order to solve the above technical problems, the present invention provides the following technical solutions: a big data processing system based on the Internet of Things, the system includes a data acquisition module, a data processing module, a data monitoring module and an alarm management module;

[0006] The data acquisition module collects electricity consumption data through a smart meter, transmits the electricity consumption data to a computer network according to a communication protocol, and outputs the electricity consumption data. The output end of the data acquisition module is connected to the input end of the data processing module;

[0007] Smart meters add wireless WIFI or Bluetooth communication functions. On the basis of outdoor wireless network card equipment, the indoor smart meters are connected to the outdoor wireless network card and connected to the computer network. In the computer network, data messages are encrypted and transmitted according to the IEC104 protocol to improve the security of data message transmission.

[0008] The data processing module is used to receive the power consumption data, process the power consumption data according to the communication protocol, and output the processed data. The output end of the data processing module is connected to the input end of the data monitoring module;

[0009] The data message is received through the gateway, and then parsed according to the IEC104 protocol to ensure the accuracy of the data message parsing.

[0010] The data monitoring module is used to receive processing data, monitor and analyze the processing data, and output analysis data. The output end of the data monitoring module is connected to the input end of the alarm management module;

[0011] Through the large-screen display system, the analysis data can be intuitively displayed in the form of line graphs, bar charts, etc. according to the time dimension.

[0012] The alarm management module is used to receive analysis data, push alarm information and dispatch work orders for maintenance based on the analysis data.

[0013] Push warning information via SMS or WeChat public accounts to remind users of abnormal situations in a timely manner.

[0014] Work orders can be circulated through WeChat public accounts or computer cloud platforms to intuitively display the status of work orders.

[0015] The data acquisition module includes a data acquisition unit and a data transmission unit;

[0016] The data collection unit is used to collect power consumption data and output the power consumption data, and the output end of the data collection unit is connected to the input end of the data transmission unit;

[0017] The data transmission unit is used to receive the power consumption data output by the data acquisition unit, transmit it according to the communication protocol, and output the transmission data. The output end of the data transmission unit is connected to the input end of the data processing module.

[0018] The data processing module includes a data receiving unit and a data processing unit;

[0019] The data receiving unit is used to receive the transmission data of the data transmission unit and output the received data, and the output end of the data receiving unit is connected to the input end of the data processing unit;

[0020] The data processing unit is used to receive the received data output by the data receiving unit, process the received data according to the communication protocol, and output the processed data. The output end of the data processing unit is connected to the input end of the data monitoring module.

[0021] The data monitoring module includes a data monitoring unit and a data analysis unit;

[0022] The data monitoring unit is used to receive the processed data output by the data processing unit and output monitoring data, and the output end of the data monitoring unit is connected to the input end of the data analysis unit;

[0023] The data analysis unit is used to receive the monitoring data output by the data monitoring unit, analyze the monitoring data, and output the analysis data. The output end of the data analysis unit is connected to the input end of the alarm management module.

[0024] The alarm management module includes an alarm management unit and a work order management unit;

[0025] The alarm management unit is used to receive the analysis data output by the data analysis unit and output alarm information, and the output end of the alarm management unit is connected to the input end of the work order management unit;

[0026] The work order management unit includes a work order registration unit, a work order allocation unit, a work order acceptance unit and a work order evaluation unit;

[0027] The work order registration unit is used to receive the alarm information output by the alarm management unit, and output a registered work order according to the alarm information, and the output end of the work order registration unit is connected to the input end of the work order allocation unit;

[0028] The work order distribution unit is used to receive the registered work order output by the work order registration unit, distribute the registered work order to the maintenance personnel, and output the distributed work order, and the output end of the work order distribution unit is connected to the input end of the work order acceptance unit;

[0029] The work order acceptance unit is used to receive the assigned work order output by the work order allocation unit, the maintenance personnel accept the assigned work order, perform maintenance work, and output the accepted work order, and the output end of the work order acceptance unit is connected to the input end of the work order evaluation unit;

[0030] The work order evaluation unit is used to receive the work order accepted by the work order acceptance unit and evaluate the work of the maintenance personnel.

[0031] A big data processing method based on the Internet of Things, the method comprising the following steps:

[0032] S6-1, collecting electricity consumption data, transmitting the electricity consumption data according to the communication protocol, and outputting the electricity consumption data;

[0033] S6-2, receiving power consumption data, processing the power consumption data according to the communication protocol, and outputting the processed data;

[0034] S6-3, receiving processing data, monitoring and analyzing the processing data, and outputting analysis data;

[0035] S6-4. Receive analysis data, push alarm information and issue maintenance work orders based on the analysis data.

[0036] In step S6-1, the communication protocol includes:

[0037] S7-1, the client establishes a connection with the server and sends a link start frame;

[0038] S7-2, after receiving the link start frame, the server sends a start confirmation frame to the client;

[0039] S7-3, after receiving the start confirmation frame, the client sends a general call data request frame;

[0040] S7-4, after receiving the general call data request, the server sends a general call data response frame, and then continues to send the general call data; after the general call data is sent, it sends a general call data end frame;

[0041] S7-5. After receiving the general call data end frame, the client sends a time synchronization request frame;

[0042] S7-6. After receiving the time synchronization request frame, the server sends a time synchronization response frame;

[0043] S7-7. The server actively sends a change data frame to the client. At the same time, upon receiving a control command sent by the client, the server replies with the corresponding operation result.

[0044] In step S6-3, the monitoring and analysis includes:

[0045] S8-1, obtain processing data, in which the real-time current I is obtained. r , real-time voltage U r , based on the power calculation formula, calculate the power consumption P r =I r *U r ;

[0046] S8-2, the system sets the threshold power to P max , when the power P r <Threshold power P max When the power consumption P r ≥Threshold power P max When the time judgment model is constructed, if the duration exceeds the output value T of the time judgment model r , it means the monitoring data is abnormal;

[0047] S8-3. When the monitoring data is abnormal, push the alarm information and issue a work order for maintenance.

[0048] In step S8-2, the time judgment model includes:

[0049] S9-1, obtaining historical data, a set of durations A={t0(1), t0(2), ..., t0(n)} during which the power consumption exceeds the threshold power without a fault, and taking the time set A as the original data sequence;

[0050] S9-2, perform cumulative calculation on the data items in the time set A to generate a cumulative sequence B: (1) =(t1(1),t1(2),…,t1(n));

[0051] S9-3, calculate the adjacent value generation number: z1(n)=at0(n)+(1-a)t0(n-1);

[0052] S9-4, establish a whitening model: dt1(x) / dx+at1(x)=b, dt1 is a differential equation, a is the development coefficient, b is the gray action, and the values ​​of a and b can be calculated according to the least squares method;

[0053] S9-5. According to the model t1(x+1)=(t0(1)-b / a)e -a + b / a, output the predicted time output value t1(x+1), and record the predicted time output value t1(x+1) as the specified time T r .

[0054] In the absence of faults, it is a low-probability event that the power consumption exceeds the threshold power. The use of a grayscale prediction model can achieve a high-precision prediction analysis.

[0055] In step S6-4, the dispatching of the work order includes:

[0056] S10-1. When the monitoring data is abnormal, record the abnormal information and register a work order;

[0057] S10-2, assigning the registered work order to maintenance personnel;

[0058] S10-3, the maintenance personnel receive the assigned work order and go to the site for maintenance;

[0059] S10-4. After the maintenance personnel complete the work, the customer evaluates the maintenance situation and forms an evaluation work order.

[0060] Compared with the prior art, the beneficial effects achieved by the present invention are:

[0061] 1. Real-time monitoring of the electricity consumption of enterprises in the park, management of the electricity consumption in the park, and improvement of management and control efficiency;

[0062] 2. No need for personnel on duty or inspection, IoT sensing can replace on-site inspection, effectively saving manpower, material resources and time costs;

[0063] 3. Monitor electricity consumption data, predict the duration of abnormal electricity consumption, and push alarm information in time. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0065] Figure 1 It is a structural schematic diagram of a big data processing system based on the Internet of Things of the present invention;

[0066] Figure 2 It is a flow chart of a big data processing method based on the Internet of Things of the present invention. DETAILED DESCRIPTION

[0067] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0068] See also Figure 1-Figure 2 , the present invention provides a technical solution:

[0069] A big data processing system based on the Internet of Things, the system includes a data acquisition module, a data processing module, a data monitoring module and an alarm management module;

[0070] The data acquisition module collects electricity consumption data through a smart meter, transmits the electricity consumption data to a computer network according to a communication protocol, and outputs the electricity consumption data. The output end of the data acquisition module is connected to the input end of the data processing module;

[0071] The data processing module is used to receive the power consumption data, process the power consumption data according to the communication protocol, and output the processed data. The output end of the data processing module is connected to the input end of the data monitoring module;

[0072] The data monitoring module is used to receive processing data, monitor and analyze the processing data, and output analysis data. The output end of the data monitoring module is connected to the input end of the alarm management module;

[0073] The alarm management module is used to receive analysis data, push alarm information and dispatch work orders for maintenance based on the analysis data.

[0074] The data acquisition module includes a data acquisition unit and a data transmission unit;

[0075] The data collection unit is used to collect power consumption data and output the power consumption data, and the output end of the data collection unit is connected to the input end of the data transmission unit;

[0076] The data transmission unit is used to receive the power consumption data output by the data acquisition unit, transmit it according to the communication protocol, and output the transmission data. The output end of the data transmission unit is connected to the input end of the data processing module.

[0077] The data processing module includes a data receiving unit and a data processing unit;

[0078] The data receiving unit is used to receive the transmission data of the data transmission unit and output the received data, and the output end of the data receiving unit is connected to the input end of the data processing unit;

[0079] The data processing unit is used to receive the received data output by the data receiving unit, process the received data according to the communication protocol, and output the processed data. The output end of the data processing unit is connected to the input end of the data monitoring module.

[0080] The data monitoring module includes a data monitoring unit and a data analysis unit;

[0081] The data monitoring unit is used to receive the processed data output by the data processing unit and output monitoring data, and the output end of the data monitoring unit is connected to the input end of the data analysis unit;

[0082] The data analysis unit is used to receive the monitoring data output by the data monitoring unit, analyze the monitoring data, and output the analysis data. The output end of the data analysis unit is connected to the input end of the alarm management module.

[0083] The alarm management module includes an alarm management unit and a work order management unit;

[0084] The alarm management unit is used to receive the analysis data output by the data analysis unit and output alarm information, and the output end of the alarm management unit is connected to the input end of the work order management unit;

[0085] The work order management unit includes a work order registration unit, a work order allocation unit, a work order acceptance unit and a work order evaluation unit;

[0086] The work order registration unit is used to receive the alarm information output by the alarm management unit, and output a registered work order according to the alarm information, and the output end of the work order registration unit is connected to the input end of the work order allocation unit;

[0087] The work order distribution unit is used to receive the registered work order output by the work order registration unit, distribute the registered work order to the maintenance personnel, and output the distributed work order, and the output end of the work order distribution unit is connected to the input end of the work order acceptance unit;

[0088] The work order acceptance unit is used to receive the assigned work order output by the work order allocation unit, the maintenance personnel accept the assigned work order, perform maintenance work, and output the accepted work order, and the output end of the work order acceptance unit is connected to the input end of the work order evaluation unit;

[0089] The work order evaluation unit is used to receive the work order accepted by the work order acceptance unit and evaluate the work of the maintenance personnel.

[0090] A big data processing method based on the Internet of Things, the method comprising the following steps:

[0091] S6-1, collecting electricity consumption data, transmitting the electricity consumption data according to the communication protocol, and outputting the electricity consumption data;

[0092] S6-2, receiving power consumption data, processing the power consumption data according to the communication protocol, and outputting the processed data;

[0093] S6-3, receiving processing data, monitoring and analyzing the processing data, and outputting analysis data;

[0094] S6-4. Receive analysis data, push alarm information and issue maintenance work orders based on the analysis data.

[0095] In step S6-1, the communication protocol includes:

[0096] S7-1, the client establishes a connection with the server and sends a link start frame;

[0097] S7-2, after receiving the link start frame, the server sends a start confirmation frame to the client;

[0098] S7-3, after receiving the start confirmation frame, the client sends a general call data request frame;

[0099] S7-4, after receiving the general call data request, the server sends a general call data response frame, and then continues to send the general call data; after the general call data is sent, it sends a general call data end frame;

[0100] S7-5. After receiving the general call data end frame, the client sends a time synchronization request frame;

[0101] S7-6. After receiving the time synchronization request frame, the server sends a time synchronization response frame;

[0102] S7-7. The server actively sends a change data frame to the client. At the same time, upon receiving a control command sent by the client, the server replies with the corresponding operation result.

[0103] In step S6-3, the monitoring and analysis includes:

[0104] S8-1, obtain processing data, in which the real-time current I is obtained. r , real-time voltage U r , based on the power calculation formula, calculate the power consumption P r =I r *U r ;

[0105] S8-2, the system sets the threshold power to P max , when the power P r <Threshold power P max When the power consumption P r ≥Threshold power P max When the time judgment model is constructed, if the duration exceeds the output value T of the time judgment model r , it means the monitoring data is abnormal;

[0106] S8-3. When the monitoring data is abnormal, push the alarm information and issue a work order for maintenance.

[0107] In step S8-2, the time judgment model includes:

[0108] S9-1, obtaining historical data, a set of durations A={t0(1), t0(2), ..., t0(n)} during which the power consumption exceeds the threshold power without a fault, and taking the time set A as the original data sequence;

[0109] S9-2, perform cumulative calculation on the data items in the time set A to generate a cumulative sequence B: (1) =(t1(1),t1(2),…,t1(n));

[0110] S9-3, calculate the adjacent value generation number: z1(n)=at0(n)+(1-a)t0(n-1);

[0111] S9-4, establish a whitening model: dt1(x) / dx+at1(x)=b, dt1 is a differential equation, a is the development coefficient, b is the gray action, and the values ​​of a and b can be calculated according to the least squares method;

[0112] S9-5. According to the model t1(x+1)=(t0(1)-b / a)e -a+ b / a, output the predicted time output value t1(x+1), and record the predicted time output value t1(x+1) as the specified time T r .

[0113] In step S6-4, the dispatching of the work order includes:

[0114] S10-1. When the monitoring data is abnormal, record the abnormal information and register a work order;

[0115] S10-2, assigning the registered work order to maintenance personnel;

[0116] S10-3, the maintenance personnel receive the assigned work order and go to the site for maintenance;

[0117] S10-4. After the maintenance personnel complete the work, the customer evaluates the maintenance situation and forms an evaluation work order.

[0118] In this embodiment:

[0119] Obtain the power consumption data of a factory enterprise and find that within one month, the durations of power consumption exceeding the threshold power without any fault are 3, 5, 10, 8, and 20 seconds respectively. Add the durations to the time set A, and the time set A = {3, 5, 10, 8, 20}.

[0120] The data items in the time set A are accumulated and calculated to obtain the accumulated sequence B (3, 8, 18, 26, 40);

[0121] Calculate the number of neighbor value generators: z1(n)=at0(n)+(1-a)t0(n-1);

[0122] Establish a whitening model: dt1(x) / dx+at1(x)=b, dt1 is a differential equation, a is the development coefficient, b is the gray action, and the values ​​of a and b are calculated according to the least squares method;

[0123] According to the model t1(x+1)=(t0(1)-b / a)e -a + b / a, output the predicted time output value t1(x+1), and record the predicted time output value t1(x+1) as the specified time T r .

[0124] Collect power consumption in real time to obtain the power consumption P of the enterprise r is 4.2kW, the threshold power P max Assuming it is 4kW, it is found that the power consumption P r ≥Threshold power P max , and the duration exceeds the specified time T r , so push the alarm information and dispatch the work order for maintenance.

[0125] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0126] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A big data processing method based on the Internet of Things, characterized in that: The method comprises the following steps: S6-1, collecting electricity consumption data, transmitting the electricity consumption data according to the communication protocol, and outputting the electricity consumption data; S6-2, receiving power consumption data, processing the power consumption data according to the communication protocol, and outputting the processed data; S6-3, receiving processing data, monitoring and analyzing the processing data, and outputting analysis data; S6-4, receiving analysis data, pushing alarm information and dispatching work orders for maintenance based on the analysis data; In step S6-3, the monitoring and analysis includes: S8-1, obtain processing data, in which the real-time current I is obtained. r , real-time voltage U r , based on the power calculation formula, calculate the power consumption P r =I r *U r ; S8-2, the system sets the threshold power to P max , when the power P r <Threshold power P max When the power consumption P r ≥Threshold power P max When the time judgment model is constructed, if the duration exceeds the output value T of the time judgment model r , it means the monitoring data is abnormal; S8-3. When the monitoring data is abnormal, push the alarm information and send the work order for maintenance; In step S8-2, the time judgment model includes: S9-1, obtaining historical data, a set of durations A={t0(1), t0(2), ..., t0(n)} during which the power consumption exceeds the threshold power without a fault, and taking the time set A as the original data sequence; S9-2, perform cumulative calculation on the data items in the time set A to generate a cumulative sequence B: (1) =(t1(1),t1(2),…,t1(n)); S9-3, calculate the adjacent value generation number: z1(n)=at0(n)+(1-a)t0(n-1); S9-4, establish a whitening model: dt1(x) / dx+at1(x)=b, dt1 is a differential equation, a is the development coefficient, b is the gray action, and the values ​​of a and b are calculated according to the least squares method; S9-5. According to the model t1(x+1)=(t0(1)-b / a)e -a + b / a, output the predicted time output value t1(x+1), and record the predicted time output value t1(x+1) as the specified time T r .

2. The method for processing big data based on the Internet of Things according to claim 1, characterized in that: In step S6-1, the communication protocol includes: S7-1, the client establishes a connection with the server and sends a link start frame; S7-2, after receiving the link start frame, the server sends a start confirmation frame to the client; S7-3, after receiving the start confirmation frame, the client sends a general call data request frame; S7-4, after receiving the general call data request, the server sends a general call data response frame, and then continues to send the general call data; after the general call data is sent, it sends a general call data end frame; S7-5. After receiving the general call data end frame, the client sends a time synchronization request frame; S7-6. After receiving the time synchronization request frame, the server sends a time synchronization response frame; S7-7. The server actively sends a change data frame to the client. At the same time, upon receiving a control command sent by the client, the server replies with the corresponding operation result.

3. The method for processing big data based on the Internet of Things according to claim 1, characterized in that: In step S6-4, the dispatching of the work order includes: S10-1. When the monitoring data is abnormal, record the abnormal information and register a work order; S10-2, assigning the registered work order to maintenance personnel; S10-3, maintenance personnel receive the assigned work order and go to the site for maintenance; S10-4. After the maintenance personnel complete the work, the customer evaluates the maintenance situation and forms an evaluation work order.

4. A big data processing system based on the Internet of Things, using the big data processing method based on the Internet of Things as claimed in claim 1, characterized in that: The system includes a data acquisition module, a data processing module, a data monitoring module and an alarm management module; The data acquisition module collects electricity consumption data through a smart meter, transmits the electricity consumption data to a computer network according to a communication protocol, and outputs the electricity consumption data. The output end of the data acquisition module is connected to the input end of the data processing module; The data processing module is used to receive the power consumption data, process the power consumption data according to the communication protocol, and output the processed data. The output end of the data processing module is connected to the input end of the data monitoring module; The data monitoring module is used to receive processing data, monitor and analyze the processing data, and output analysis data. The output end of the data monitoring module is connected to the input end of the alarm management module; The alarm management module is used to receive analysis data, push alarm information and dispatch work orders for maintenance based on the analysis data.

5. The big data processing system based on the Internet of Things according to claim 4, characterized in that: The data acquisition module includes a data acquisition unit and a data transmission unit; The data collection unit is used to collect power consumption data and output the power consumption data, and the output end of the data collection unit is connected to the input end of the data transmission unit; The data transmission unit is used to receive the power consumption data output by the data acquisition unit, transmit it according to the communication protocol, and output the transmission data. The output end of the data transmission unit is connected to the input end of the data processing module.

6. The big data processing system based on the Internet of Things according to claim 5, characterized in that: The data processing module includes a data receiving unit and a data processing unit; The data receiving unit is used to receive the transmission data of the data transmission unit and output the received data, and the output end of the data receiving unit is connected to the input end of the data processing unit; The data processing unit is used to receive the received data output by the data receiving unit, process the received data according to the communication protocol, and output the processed data. The output end of the data processing unit is connected to the input end of the data monitoring module.

7. The big data processing system based on the Internet of Things according to claim 6, characterized in that: The data monitoring module includes a data monitoring unit and a data analysis unit; The data monitoring unit is used to receive the processed data output by the data processing unit and output monitoring data, and the output end of the data monitoring unit is connected to the input end of the data analysis unit; The data analysis unit is used to receive the monitoring data output by the data monitoring unit, analyze the monitoring data, and output the analysis data. The output end of the data analysis unit is connected to the input end of the alarm management module.

8. The big data processing system based on the Internet of Things according to claim 7, characterized in that: The alarm management module includes an alarm management unit and a work order management unit; The alarm management unit is used to receive the analysis data output by the data analysis unit and output alarm information, and the output end of the alarm management unit is connected to the input end of the work order management unit; The work order management unit includes a work order registration unit, a work order allocation unit, a work order acceptance unit and a work order evaluation unit; The work order registration unit is used to receive the alarm information output by the alarm management unit, and output a registered work order according to the alarm information, and the output end of the work order registration unit is connected to the input end of the work order allocation unit; The work order distribution unit is used to receive the registered work order output by the work order registration unit, distribute the registered work order to the maintenance personnel, and output the distributed work order, and the output end of the work order distribution unit is connected to the input end of the work order acceptance unit; The work order acceptance unit is used to receive the assigned work order output by the work order allocation unit, the maintenance personnel accept the assigned work order, perform maintenance work, and output the accepted work order, and the output end of the work order acceptance unit is connected to the input end of the work order evaluation unit; The work order evaluation unit is used to receive the work order accepted by the work order acceptance unit and evaluate the work of the maintenance personnel.

Images