Information collection method, system and storage medium based on multiple data sources of the Internet of Things

Abstract

The present invention belongs to the field of information collection technology, and specifically relates to an information collection method, system and storage medium based on multiple data sources of the Internet of Things. The method includes S1, different collection modules respectively send their own monitoring data to an intermediate module, and the intermediate module continues to transmit the monitoring data to a remote module; S2, after receiving different monitoring data, the remote module divides all the monitoring data into three data groups, and performs corresponding priority data management based on the characteristic values ​​corresponding to the data groups; S3, when the total number of all collection modules changes, the intermediate module receives the monitoring data, selectively performs first to fourth processing, and records the second time corresponding to the monitoring data and the time difference between the second time corresponding to the monitoring data and the first time in a first record table. The present invention can cope with the situation where the total number of all collection modules changes.

Description

Technical Field

[0001] The present invention belongs to the field of information collection technology, and in particular relates to an information collection method, system and storage medium based on multiple data sources of the Internet of Things. Background Art

[0002] Currently, the use of IoT technology to collect monitoring data from different monitoring points and conduct comprehensive analysis of these data is becoming increasingly common. Chinese patent application publication number CN115834628A discloses an IoT data collection system that includes multiple information collection points connected to a monitoring terminal. The monitoring terminal includes a server connected to the multiple information collection points, which is connected to a display screen and a PC, which is wirelessly connected to an intelligent terminal. Each information collection point includes a temperature and humidity sensor, a wind direction and wind speed detector, and a rainfall sensor. The temperature and humidity sensors, wind direction and wind speed detectors, and rainfall sensors are connected to a control processing unit, which is connected to a communication unit. When data in a local area exceeds a set threshold, an early warning is issued via the intelligent terminal or PC. In addition, the patent application with publication number WO2020248274A1 discloses a smart Internet of Things information collection and transmission system, which includes a cloud server and a data gateway. The cloud server is configured with a data analysis unit and a command controller. The data gateway is connected to the remote server and the information sensor. The data gateway is configured with a command distributor, which receives the collection frequency command sent by the command controller and sends the collection frequency command to the information sensor. The smart Internet of Things information collection and transmission system can change the collection data request frequency according to the change of the information flow. However, the above patent application cannot adapt to the situation where the total number of all collection nodes changes. Summary of the Invention

[0003] The present invention provides an intermediate module to receive monitoring data from different collection modules and transmit the multiple monitoring data to a remote module for data management. The intermediate module also selects to execute the first to fourth processing steps if the total number of all collection modules changes. The present invention aims to adapt to changes in the total number of all collection modules during the monitoring data collection process.

[0004] In order to achieve the above-mentioned object of the invention, the present invention provides the following information collection method based on multiple data sources of the Internet of Things, which mainly includes the following steps:

[0005] S1. Several acquisition modules are set up to collect monitoring data respectively. At the same time, different acquisition modules send their own monitoring data to the intermediate module respectively. After each receiving monitoring data, the intermediate module continues to transmit the received monitoring data to the remote module.

[0006] S2. The remote module receives the monitoring data sent by the intermediate module, and the remote module determines whether the total number of different monitoring data currently received is greater than a preset total number threshold. If so, the remote module divides all the monitoring data into three data groups, and performs data management with corresponding priority based on the characteristic values ​​corresponding to each data group. If not, the remote module continues to receive the monitoring data sent by the intermediate module.

[0007] S3. When the total number of all the acquisition modules changes, the intermediate module receives the monitoring data, records the code of the acquisition module that sends the monitoring data, the first time corresponding to the monitoring data, and the second time corresponding to the monitoring data. The intermediate module determines whether there is a recorded code in the first record table. If not, the first processing is performed, followed by the second processing. If yes, the module continues to determine whether the acquisition process of the acquisition module corresponding to the recorded code meets the preset conditions. If yes, the second processing is performed. If not, the third processing is performed, and the intermediate module performs the fourth processing. The intermediate module records the second time corresponding to the monitoring data and the time difference between the second time corresponding to the monitoring data and the first time in the first record table.

[0008] As a preferred technical solution of the present invention, the intermediate module stores a first record table and a second record table. The data records in the first record table correspond to two data rows, and the data records sequentially include codes occupying the upper and lower data rows, approval marks occupying the upper and lower data rows, several second times occupying the upper data row, and several time differences occupying the lower data row; the data records in the second record table correspond to several data rows, and the data records sequentially include first codes occupying all data rows, several second codes occupying the upper and lower data rows, several specific values ​​occupying the upper and lower data rows, several first time differences occupying the upper data row corresponding to each second code, and several second time differences occupying the lower data row corresponding to each second code.

[0009] As a preferred technical solution of the present invention, the first time corresponding to the monitoring data refers to the time when the corresponding acquisition module sends the monitoring data, and the second time corresponding to the monitoring data refers to the time when the intermediate module receives the monitoring data.

[0010] As a preferred technical solution of the present invention, the intermediate module performs the first processing, including the following steps:

[0011] S311, recording the code of the acquisition module that sends the monitoring data as the code in the first record table, setting the corresponding approval flag in the first record table to 0, and recording the code of the acquisition module that sends the monitoring data as the first code in the second record table;

[0012] S312. Collect different codes in the first record table, as well as several time difference values ​​occupying the lower data rows corresponding to different codes, and add the different codes into the second record table corresponding to the added first codes, and add several time difference values ​​occupying the lower data rows corresponding to each code in sequence as several first time difference values ​​occupying the upper data rows corresponding to the corresponding added second codes.

[0013] As a preferred technical solution of the present invention, the intermediate module performs the second processing, including the following steps:

[0014] S321, determining a second time corresponding to the monitoring data, a third time that is a preset time interval before the second time corresponding to the monitoring data, and a fourth time that is twice the preset time interval before the second time corresponding to the monitoring data;

[0015] S322: Determine, based on the first record table, whether other monitoring data is received within the time interval from the fourth time to the second time corresponding to the monitoring data, where the other monitoring data refers to monitoring data sent by the acquisition module corresponding to the code corresponding to the approval identifier with a content of 0 in the first record table. If so, terminate the second process; otherwise, proceed to the next step.

[0016] S323. Based on the first record table, determine whether other monitoring data is received within the time interval from the third time to the second time corresponding to the monitoring data, where the other monitoring data refers to the monitoring data sent by the acquisition module corresponding to the code corresponding to the approval identifier with the content of 1 in the first record table. If not, end the second processing. If yes, determine the lower data row corresponding to the code of the acquisition module that sends the other monitoring data in the data record corresponding to the code of the acquisition module that sends the monitoring data in the second record table, record the time difference corresponding to the other monitoring data as the second time difference of the lower data row, and end the second processing.

[0017] As a preferred technical solution of the present invention, the intermediate module performs the third processing, including the following steps:

[0018] S331: Determine a second time corresponding to the monitoring data, and a fifth time that is a preset time interval before the second time corresponding to the monitoring data, and determine, based on the first record table, whether other monitoring data is received within the time interval from the fifth time to the second time corresponding to the monitoring data, where the other monitoring data refers to monitoring data sent by the acquisition module corresponding to the code corresponding to the approval identifier with a content of 0 in the first record table. If no, terminate the third process; if yes, proceed to the next step.

[0019] S332. Determine whether the total number of other monitoring data received is multiple. If yes, end the third processing. If not, determine the lower data row corresponding to the code of the acquisition module that sends the monitoring data in the data record corresponding to the code of the acquisition module that sends other monitoring data in the second record table, record the time difference corresponding to the monitoring data as the second time difference of the lower data row, and end the third processing.

[0020] As a preferred technical solution of the present invention, the intermediate module performs the fourth processing, comprising the following steps:

[0021] S341: Count the total number of the added second time difference values ​​in the data row below the second record table to which the second time difference value is added, and determine whether the total number is greater than or equal to a preset total number threshold. If not, terminate the fourth process; if so, proceed to the next step.

[0022] S342: Perform a specific operation based on all second time difference values ​​in the lower data row to which the second time difference value is added and all first time difference values ​​in the upper data row above the lower data row in the second record table, and record the operation result as a specific value corresponding to both the lower data row and the upper data row;

[0023] S343. Determine whether the specific numerical value is greater than a preset specific numerical value threshold. If so, delete the data record containing the first code corresponding to the specific numerical value in the second record, and set the approval flag to -1 in the data record corresponding to the first code in the first record table. If not, delete the data record containing the first code corresponding to the specific numerical value in the second record, and set the approval flag to 1 in the data record corresponding to the first code in the first record table.

[0024] As a preferred technical solution of the present invention, the process of the remote module dividing all the monitoring data into three data groups includes: calculating the first standard data based on all the monitoring data, calculating the difference between each monitoring data and the first standard data, dividing several monitoring data whose corresponding difference is less than or equal to the preset first difference threshold into the first data group, and dividing several monitoring data whose corresponding difference is greater than the preset first difference threshold into the second data group, and calculating the second standard data based on all the monitoring data in the second data group, calculating the difference between each monitoring data and the second standard data, and dividing several monitoring data whose corresponding difference is greater than the preset second difference threshold into the third data group, and also assigning a first characteristic value to each monitoring data in the first data group, assigning a second characteristic value to each monitoring data in the second data group, and assigning a third characteristic value to each monitoring data in the third data group, the first characteristic value is less than the second characteristic value, the second characteristic value is less than the third characteristic value, and using the formula for each data group. Calculate the corresponding characteristic value, where For the The characteristic values ​​of the data set, For the The total number of monitoring data contained in the data group, To send the The first The weight value set according to the type of the acquisition module of the monitoring data, For the The data group corresponds to Characteristic value.

[0025] The present invention also provides an information collection system based on multiple data sources of the Internet of Things, including the following modules:

[0026] an intermediate module, configured to continue transmitting the monitoring data to the remote module after each receipt of the monitoring data, and to receive the monitoring data when the total number of all the acquisition modules changes, record the code of the acquisition module that sends the monitoring data, the first time corresponding to the monitoring data, and the second time corresponding to the monitoring data, determine whether the recorded code exists in the first record table, and if not, perform a first process, followed by a second process, and if yes, continue to determine whether the acquisition process of the acquisition module corresponding to the recorded code meets a preset condition, and if yes, perform a second process, and if not, perform a third process, and then perform a fourth process, and record the second time corresponding to the monitoring data and the time difference between the second time corresponding to the monitoring data and the first time in the first record table;

[0027] The acquisition module is used to collect monitoring data and send its own monitoring data to the intermediate module;

[0028] The remote module is used to receive the monitoring data sent by the intermediate module and determine whether the total number of different monitoring data currently received is greater than the preset total number threshold. If it is greater than, all the monitoring data are divided into N data groups. For each data group, data management with corresponding priority is performed based on the characteristic value corresponding to the data group. If it is not greater than, the monitoring data sent by the intermediate module continues to be received.

[0029] The present invention also provides a storage medium, wherein the storage medium stores program instructions, wherein when the program instructions are executed, the device where the storage medium is located is controlled to execute any one of the above methods.

[0030] Compared with the prior art, the beneficial effects of the present invention are at least as follows:

[0031] In the present invention, first, different acquisition modules send their own monitoring data to the intermediate module, and the intermediate module continues to transmit the received monitoring data to the remote module after each monitoring data is received; second, after receiving a certain amount of monitoring data, the remote module divides all the monitoring data into three data groups and performs data management of corresponding priorities based on the characteristic values ​​corresponding to each data group; finally, when the total number of all acquisition modules changes, the intermediate module receives the monitoring data, determines whether there is a recorded code in the first record table, and if not, performs a first process, then performs a second process, and if yes, continues to determine whether the acquisition process of the acquisition module corresponding to the recorded code meets the preset conditions, and if yes, performs a second process, and if not, performs a third process, and then performs a fourth process, and also records the second time corresponding to the monitoring data and the time difference between the second time corresponding to the monitoring data and the first time in the first record table. The present invention not only ensures that no other acquisition modules that interfere with the original acquisition module are added during the acquisition process, thereby ensuring the normal operation of the acquisition process, but also ensures the security of the large amount of monitoring data collected by different acquisition modules. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 This is a flowchart of the steps of the information collection method based on multiple data sources of the Internet of Things of the present invention;

[0033] Figure 2 This is a structural diagram of the information collection system based on multiple data sources of the Internet of Things of the present invention. DETAILED DESCRIPTION

[0034] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0035] It is understood that the terms "first," "second," etc., used herein may be used to describe various elements, but unless otherwise specified, these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, a first xx script may be referred to as a second xx script, and similarly, a second xx script may be referred to as a first xx script without departing from the scope of this application.

[0036] References Figure 1 As shown, the present invention provides an information collection method based on multiple data sources of the Internet of Things, which is implemented by executing the following main steps:

[0037] S1. Set up several acquisition modules to collect monitoring data respectively. At the same time, different acquisition modules send their own monitoring data to the intermediate module respectively. After each receiving monitoring data, the intermediate module continues to transmit the received monitoring data to the remote module.

[0038] S2. The remote module receives the monitoring data sent by the intermediate module, and determines whether the total number of different monitoring data currently received is greater than a preset total number threshold. If so, the remote module divides all the monitoring data into three data groups, and performs data management with corresponding priority based on the characteristic values ​​corresponding to each data group. If not, the remote module continues to receive monitoring data sent by the intermediate module.

[0039] S3. When the total number of all acquisition modules changes, the intermediate module receives the monitoring data, records the code of the acquisition module that sends the monitoring data, the first time corresponding to the monitoring data, and the second time corresponding to the monitoring data, and determines whether the recorded code exists in the first record table. If not, the intermediate module performs a first process, followed by a second process. If yes, the intermediate module continues to determine whether the acquisition process of the acquisition module corresponding to the recorded code meets a preset condition. If yes, the intermediate module performs a second process. If not, the intermediate module performs a third process, and the intermediate module performs a fourth process. The intermediate module records the second time corresponding to the monitoring data and the time difference between the second time corresponding to the monitoring data and the first time in the first record table.

[0040] Furthermore, the first time corresponding to the monitoring data refers to the time when the corresponding acquisition module sends the monitoring data, and the second time corresponding to the monitoring data refers to the time when the intermediate module receives the monitoring data.

[0041] Specifically, first, several acquisition modules collect monitoring data from different monitoring points respectively. Each acquisition module sends its own monitoring data to the intermediate module. After receiving each monitoring data, the intermediate module continues to transmit the received monitoring data to the remote module. Secondly, the remote module receives the monitoring data sent by the intermediate module and determines whether the total number of different monitoring data currently received is greater than the total number threshold. The total number threshold is set in the actual application scenario. If it is greater, all the monitoring data are divided into three data groups. The division process will be described below. For each data group, the corresponding priority data management is performed based on the characteristic value corresponding to the data group. If it is not greater, the remote module continues to receive the monitoring data sent by the intermediate module. Finally, when the total number of all acquisition modules changes, which in this embodiment specifically refers to the case where the total number of acquisition modules increases, the intermediate module receives monitoring data, records the code of the acquisition module that sends the monitoring data, the first time corresponding to the monitoring data, and the second time corresponding to the monitoring data, wherein the first time corresponding to the monitoring data refers to the time when the corresponding acquisition module sends the monitoring data, and the second time corresponding to the monitoring data refers to the time when the intermediate module receives the monitoring data. The intermediate module determines whether there is a recorded code in the first record table. If not, the first processing is performed, and then the second processing is performed. If so, the first record table is referred to to determine whether the acquisition process of the acquisition module corresponding to the recorded code meets the preset conditions. In this embodiment, when the approval mark in the data record corresponding to the recorded code in the first record table is 0 , the correspondence here means that the code in the data record is the same as the recorded code, and the acquisition process of the acquisition module corresponding to the recorded code is determined to meet the preset conditions. If so, that is, when the acquisition process of the acquisition module corresponding to the recorded code is approved as unknown, the second processing is performed. If not, that is, when the acquisition process of the acquisition module corresponding to the recorded code is approved, the third processing is performed. On this basis, the intermediate module performs the fourth processing, and also determines the data record corresponding to the recorded code in the first record table, and records the second time corresponding to the monitoring data, and the time difference between the second time corresponding to the monitoring data and the first time corresponding to the monitoring data in the data record. The specific processes of the first processing to the fourth processing will be described below. It should be noted that in this step, the intermediate module still sends the received monitoring data to the remote module.

[0042] Furthermore, the intermediate module stores a first record table and a second record table. The data records in the first record table correspond to two data rows, and the data records include, in sequence, codes occupying the upper and lower data rows, approval marks occupying the upper and lower data rows, several second times occupying the upper data row, and several time differences occupying the lower data row; the data records in the second record table correspond to several data rows, and the data records include, in sequence, first codes occupying all data rows, several second codes occupying the upper and lower data rows, several specific values ​​occupying the upper and lower data rows, several first time differences occupying the upper data row corresponding to each second code, and several second time differences occupying the lower data row corresponding to each second code.

[0043] Specifically, the first record table and the second record table are introduced here. The data records in the first record table correspond to two data rows. The data records sequentially include codes occupying the upper and lower data rows, approval marks occupying the upper and lower data rows, several second times occupying the upper data row, and several time differences occupying the lower data row. For ease of understanding, for example, a data record is , "101" corresponds to the code, "1" corresponds to the approval mark, "79" corresponds to a second time occupying the upper data row, indicating that a monitoring data sent by the acquisition module coded as "101" arrives at the middle module at the 79th second, and "10" corresponds to a time difference value occupying the lower data row, indicating the time difference value corresponding to the same monitoring data sent by the acquisition module coded as "101", specifically the second time corresponding to this monitoring data minus the first time corresponding to this monitoring data. In addition, the data records in the second record table correspond to several data rows, and the data records sequentially include the first code occupying all data rows, several second codes occupying the upper and lower data rows, several specific values ​​occupying the upper and lower data rows, several first time differences occupying the upper data row corresponding to each second code, and several second time differences occupying the lower data row corresponding to each second code. For ease of understanding, for example, a data record is , "103" corresponds to the first code, "101" corresponds to the second code, "0.3" corresponds to a specific value, "10" corresponds to a first time difference value occupying the upper data row, indicating the time difference value corresponding to a monitoring data sent by the acquisition module coded as "101" before the newly added acquisition module coded as "103", and "20" corresponds to a second time difference value occupying the lower data row, indicating the time difference value corresponding to a monitoring data sent by the acquisition module coded as "101" after the newly added acquisition module coded as "103".

[0044] Furthermore, the intermediate module performs a first process, comprising the following steps:

[0045] S311, recording the code of the acquisition module that sends the monitoring data as the code in the first record table, setting the corresponding approval flag in the first record table to 0, and recording the code of the acquisition module that sends the monitoring data as the first code in the second record table;

[0046] S312. Collect different codes in the first record table, as well as several time difference values ​​occupying the lower data rows corresponding to different codes, and add the different codes into the second record table corresponding to the added first codes, and add several time difference values ​​occupying the lower data rows corresponding to each code in sequence as several first time difference values ​​occupying the upper data rows corresponding to the corresponding added second codes.

[0047] Specifically, the first processing process is described here. First, a new data record is created in the first record table, and the code of the acquisition module sending the monitoring data is recorded as the code in this data record. The approval flag in this data record is set to 0, indicating that the approval process of the acquisition module sending the monitoring data cannot be determined temporarily. A new data record is created in the second record table, and the code of the acquisition module sending the monitoring data is recorded as the first code in this data record. Next, different codes and the corresponding time difference values ​​occupying the lower data rows are collected in the first record table. It should be noted that in this embodiment, the initial first record table is not empty and can be filled during the execution of S1. For each code, the code is added to the second record table as the second code corresponding to the added first code. The corresponding time difference values ​​occupying the lower data rows are sequentially added as the first time difference values ​​corresponding to the added second code occupying the upper data rows.

[0048] Furthermore, the intermediate module performs a second process, comprising the following steps:

[0049] S321, determining a second time corresponding to the monitoring data, a third time that is a preset time interval before the second time corresponding to the monitoring data, and a fourth time that is twice the preset time interval before the second time corresponding to the monitoring data;

[0050] S322: Based on the first record table, determine whether other monitoring data is received within the time interval from the fourth time to the second time corresponding to the monitoring data, where the other monitoring data refers to monitoring data sent by the acquisition module corresponding to the code corresponding to the approval identifier with a content of 0 in the first record table. If so, terminate the second process; otherwise, proceed to the next step.

[0051] S323. Based on the first record table, determine whether other monitoring data is received within the time interval from the third time to the second time corresponding to the monitoring data, where the other monitoring data refers to the monitoring data sent by the acquisition module corresponding to the code corresponding to the approval identifier with the content of 1 in the first record table. If not, end the second processing. If yes, determine the lower data row corresponding to the code of the acquisition module that sends the other monitoring data in the data record corresponding to the code of the acquisition module that sends the monitoring data in the second record table, record the time difference corresponding to the other monitoring data as the second time difference of the lower data row, and end the second processing.

[0052] Specifically, the second processing step is described herein. First, a second time corresponding to the monitoring data is determined, followed by a third time interval that precedes the second time corresponding to the monitoring data and is separated by a preset time interval, and a fourth time interval that precedes the second time corresponding to the monitoring data and is separated by twice the preset time interval. The preset time interval is set in an actual application scenario. Second, based on the first record table, it is determined whether other monitoring data has been received within the time interval from the fourth time to the second time corresponding to the monitoring data. The other monitoring data herein refers to monitoring data sent by the collection module corresponding to the code corresponding to the approval identifier with a content of 0 in the first record table. If so, since multiple monitoring data sent by the collection module with the corresponding approval identifier of 0 have been received, it is unknown whether the collection process of the collection module with the corresponding approval identifier of 0 is approved. Even if there is monitoring data sent by the collection module with the corresponding approval identifier of 1 that is interfered with, it is impossible to determine which collection module interfered with the monitoring data sent by the collection module with the corresponding approval identifier of 1. Therefore, the second processing step is terminated. If not, the next step is continued. Finally, based on the first record table, determine whether other monitoring data is received within the time interval from the third time to the second time corresponding to the monitoring data. The other monitoring data here refers to the monitoring data sent by the acquisition module corresponding to the code corresponding to the approval identifier with the content of 1 in the first record table. If not, since there is no monitoring data sent by the acquisition module with the corresponding approval identifier of 1 that is interfered with, the second processing is terminated. If so, determine the data record corresponding to the code of the acquisition module that sends the monitoring data in the second record table. The correspondence here means that the first code in the data record is the same as the code of the acquisition module that sends the monitoring data. Determine the lower data row corresponding to the code of the acquisition module that sends other monitoring data in the data record. The code of the acquisition module that sends other monitoring data corresponds to the second code in the data record. Record the time difference corresponding to the other monitoring data as the second time difference of the lower data row, and terminate the second processing. If multiple other monitoring data are received, it is necessary to repeat the above operations before terminating the second processing.

[0053] Furthermore, the intermediate module performs a third process, including the following steps:

[0054] S331: Determine the second time corresponding to the monitoring data, and a fifth time that is a preset time interval before the second time corresponding to the monitoring data, and determine, based on the first record table, whether other monitoring data is received within the time interval from the fifth time to the second time corresponding to the monitoring data, where the other monitoring data refers to monitoring data sent by the acquisition module corresponding to the code corresponding to the approval identifier with a content of 0 in the first record table. If no, terminate the third process; if yes, proceed to the next step.

[0055] S332. Determine whether the total number of other monitoring data received is multiple. If yes, end the third processing. If not, determine the lower data row corresponding to the code of the acquisition module that sends the monitoring data in the data record corresponding to the code of the acquisition module that sends other monitoring data in the second record table, record the time difference corresponding to the monitoring data as the second time difference of the lower data row, and end the third processing.

[0056] Specifically, the process of the third processing is introduced here. First, the second time corresponding to the monitoring data and the fifth time before and after the second time corresponding to the monitoring data and the preset time interval are determined. Then, according to the first record table, it is judged whether other monitoring data are received in the time interval from the fifth time to the second time corresponding to the monitoring data. The other monitoring data here refers to the monitoring data sent by the acquisition module corresponding to the code corresponding to the approval identifier with content 0 in the first record table. If not, since the monitoring data is not interfered with by other monitoring data, the third processing is terminated. If yes, proceed to the next step. Secondly, determine whether the total number of other monitoring data received is multiple. If so, since it is impossible to determine which other monitoring data is interfering with the monitoring data, end the third processing. If not, determine the data record corresponding to the code of the acquisition module that sends other monitoring data in the second record table. The correspondence here means that the first code in the data record is the same as the code of the acquisition module that sends other monitoring data. Determine the lower data row corresponding to the code of the acquisition module that sends the monitoring data in the data record. The code of the acquisition module that sends the monitoring data corresponds to the second code in the data record. Record the time difference corresponding to the monitoring data as the second time difference in the lower data row, and end the third processing.

[0057] Furthermore, the intermediate module performs a fourth process, comprising the following steps:

[0058] S341: Count the total number of the added second time difference values ​​in the data row below the second record table to which the second time difference value is added, and determine whether the total number is greater than or equal to a preset total number threshold. If not, terminate the fourth process; if so, proceed to the next step.

[0059] S342: Perform a specific operation based on all second time difference values ​​in the lower data row to which the second time difference value is added and all first time difference values ​​in the upper data row above the lower data row in the second record table, and record the operation result as a specific value corresponding to both the lower data row and the upper data row;

[0060] S343. Determine whether the specific numerical value is greater than a preset specific numerical value threshold. If so, delete the data record containing the first code corresponding to the specific numerical value in the second record, and set the approval flag to -1 in the data record corresponding to the first code in the first record table. If not, delete the data record containing the first code corresponding to the specific numerical value in the second record, and set the approval flag to 1 in the data record corresponding to the first code in the first record table.

[0061] Specifically, the process of the fourth processing is introduced here. First, based on the processing results of the second processing or the third processing, the lower data row to which the second time difference value is added is determined in the second record table, and the total number of second time difference values ​​added up to the current time is counted in the lower data row, and it is determined whether the total number is greater than or equal to the total number threshold. The total number threshold is set in the actual application scenario. If not, the fourth processing is terminated. If so, proceed to the next step. Secondly, a specific operation is performed based on all the second time difference values ​​in the lower data row to which the second time difference value is added in the second record table, and all the first time difference values ​​in the upper data row above the lower data row. When the total number of all the first time difference values ​​in the upper data row is different from the total number of all the second time difference values ​​in the lower data row, a certain number of first time difference values ​​are selected from all the first time difference values ​​in the upper data row to participate in the specific operation. The certain number is the total number of all the second time difference values ​​in the lower data row. The specific operation is an operation that can calculate the degree of deviation between two groups of values, such as an algorithm for calculating the Euclidean distance. After obtaining the operation result, the operation result is recorded as the specific value corresponding to the lower data row and the upper data row. Finally, determine whether the specific value is greater than a specific value threshold. The specific value threshold is set in the actual application scenario. If so, because the acquisition process of the original acquisition module has been greatly affected after the new acquisition module is added, the data record where the first code corresponding to the specific value is located is deleted from the second record, and at the same time, the approval mark is set to -1 in the data record corresponding to the first code in the first record table. The correspondence here means that the code in the data record is the same as the first code, that is, the acquisition module is not allowed to be added, that is, the corresponding acquisition module is not allowed to send monitoring data again. If not, because the acquisition process of the original acquisition module has not been greatly affected after the new acquisition module is added, the data record where the first code corresponding to the specific value is located is deleted from the second record, and at the same time, the approval mark is set to 1 in the data record corresponding to the first code in the first record table, that is, the acquisition module is allowed to be added.

[0062] Furthermore, the process of the remote module dividing all the monitoring data into three data groups includes: calculating the first standard data based on all the monitoring data, calculating the difference between each monitoring data and the first standard data, dividing a number of monitoring data whose corresponding difference is less than or equal to the preset first difference threshold into the first data group, dividing a number of monitoring data whose corresponding difference is greater than the preset first difference threshold into the second data group, and calculating the second standard data based on all the monitoring data in the second data group, calculating the difference between each monitoring data and the second standard data, dividing a number of monitoring data whose corresponding difference is greater than the preset second difference threshold into the third data group, and assigning a first characteristic value to each monitoring data in the first data group, assigning a second characteristic value to each monitoring data in the second data group, and assigning a third characteristic value to each monitoring data in the third data group, the first characteristic value is less than the second characteristic value, the second characteristic value is less than the third characteristic value, and using the formula for each data group Calculate the corresponding characteristic value, where For the The characteristic values ​​of the data set, For the The total number of monitoring data contained in the data group, To send the The first The weight value is set according to the type of monitoring data collection module. For the The data group corresponds to Characteristic value.

[0063] Specifically, here is introduced the process of the remote module dividing all the monitoring data into three data groups. First, the first standard data is calculated based on all the monitoring data. The first standard data is, for example, the average data of all the monitoring data. The difference between each monitoring data and the first standard data is calculated, and several monitoring data whose corresponding differences are less than or equal to the first difference threshold are divided into the first data group. Several monitoring data whose corresponding differences are greater than the first difference threshold are divided into the second data group. The first difference threshold is set in the actual application scenario. At this time, it is considered that the second data group is more important than the first data group. Secondly, the second standard data is calculated based on all the monitoring data in the second data group. The second standard data is, for example, The average data of all monitoring data is calculated, and the difference between each monitoring data and the second standard data is calculated. Several monitoring data whose corresponding difference is greater than the second difference threshold are divided into the third data group. The second difference threshold is set in the actual application scenario. The remaining monitoring data still belong to the second data group. At this time, it is considered that the third data group is more important than the second data group. Finally, the first characteristic value is assigned to each monitoring data in the first data group, the second characteristic value is assigned to each monitoring data in the second data group, and the third characteristic value is assigned to each monitoring data in the third data group. The first characteristic value is less than the second characteristic value, and the second characteristic value is less than the third characteristic value. Then, the formula is used for each data group. Calculate the corresponding characteristic value, where For the The characteristic values ​​of the data set, For the The total number of monitoring data contained in the data group, To send the The first The weight value is set according to the type of acquisition module of each monitoring data. The larger the weight value, the more important the monitoring data of the corresponding type of acquisition module is. For the The data group corresponds to Characteristic value: the larger the characteristic value corresponding to the data group, the more important the data group is.

[0064] The following describes how the remote module performs data management with corresponding priorities based on the characteristic values ​​corresponding to the data groups. Continuing with the above content, the more important the data group, the higher the priority of its data management should be. The security of data management with high priority is better than that of data management with low priority. For ease of understanding, for example, the data group with the first-ranked corresponding characteristic value is encrypted and stored separately, and the other two data groups are stored together, but the data group with the second-ranked corresponding characteristic value is encrypted.

[0065] According to another aspect of the embodiment of the present invention, Figure 2 As shown, an information collection system based on multiple data sources of the Internet of Things is also provided, including an intermediate module, a collection module, and a remote module, which is used to implement the information collection method based on multiple data sources of the Internet of Things as described above.

[0066] The specific functions of each module are as follows:

[0067] an intermediate module, configured to continue transmitting the monitoring data to the remote module after each receipt of the monitoring data, and to receive the monitoring data when the total number of all the acquisition modules changes, record the code of the acquisition module that sends the monitoring data, the first time corresponding to the monitoring data, and the second time corresponding to the monitoring data, determine whether the recorded code exists in the first record table, and if not, perform a first process, followed by a second process, and if yes, continue to determine whether the acquisition process of the acquisition module corresponding to the recorded code meets a preset condition, and if yes, perform a second process, and if not, perform a third process, and then perform a fourth process, and record the second time corresponding to the monitoring data and the time difference between the second time corresponding to the monitoring data and the first time in the first record table;

[0068] The acquisition module is used to collect monitoring data and send its own monitoring data to the intermediate module;

[0069] The remote module is used to receive the monitoring data sent by the intermediate module and determine whether the total number of different monitoring data currently received is greater than the preset total number threshold. If it is greater than, all the monitoring data are divided into three data groups. For each data group, data management with corresponding priority is performed based on the characteristic value corresponding to the data group. If it is not greater than, the monitoring data sent by the intermediate module continues to be received.

[0070] According to another aspect of an embodiment of the present invention, a storage medium is provided. The storage medium stores program instructions, wherein when the program instructions are executed, the device where the storage medium is located is controlled to execute any one of the above methods.

[0071] It should be understood that, although the various steps in the flow chart of each embodiment of the present invention are shown in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless otherwise specified herein, the execution of these steps is not strictly limited in order, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0072] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing the relevant hardware through a computer program. The above-described program can be stored in a non-volatile computer-readable storage medium. When executed, the program can include the processes of the above-described method embodiments. Any reference to memory, storage, database, or other media used in the various embodiments provided herein may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct RAMbus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM).

[0073] The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0074] The above embodiments merely illustrate several implementations of the present invention, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that a person skilled in the art would be able to make numerous variations and improvements without departing from the scope of the present invention, all of which fall within the scope of protection of the present invention.

[0075] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. An information collection method based on multiple data sources of the Internet of Things, characterized in that: The steps include: S1. Set up several acquisition modules to collect monitoring data respectively. At the same time, different acquisition modules send their own monitoring data to the intermediate module respectively. After each receiving monitoring data, the intermediate module continues to transmit the received monitoring data to the remote module. S2. The remote module receives the monitoring data sent by the intermediate module, and determines whether the total number of different monitoring data currently received is greater than a preset total number threshold. If so, the remote module divides all the monitoring data into three data groups, and performs data management with corresponding priority based on the characteristic values ​​corresponding to each data group. If not, the remote module continues to receive the monitoring data sent by the intermediate module. S3. When the total number of all acquisition modules changes, the intermediate module receives the monitoring data, records the code of the acquisition module that sends the monitoring data, the first time corresponding to the monitoring data, and the second time corresponding to the monitoring data. The intermediate module determines whether the recorded code exists in the first record table. If not, the intermediate module performs a first process, followed by a second process. If yes, the intermediate module continues to determine whether the acquisition process of the acquisition module corresponding to the recorded code meets the preset conditions. If yes, the intermediate module performs a second process. If not, the intermediate module performs a third process, and the intermediate module performs a fourth process. The intermediate module records the second time corresponding to the monitoring data and the time difference between the second time corresponding to the monitoring data and the first time in the first record table. The first time corresponding to the monitoring data refers to the time when the corresponding acquisition module sends the monitoring data, and the second time corresponding to the monitoring data refers to the time when the intermediate module receives the monitoring data. The intermediate module stores a first record table and a second record table. The data records in the first record table correspond to two data rows, and the data records sequentially include codes occupying the upper and lower data rows, approval identifiers occupying the upper and lower data rows, a plurality of second times occupying the upper data row, and a plurality of time differences occupying the lower data row. The data records in the second record table correspond to a plurality of data rows, and the data records sequentially include first codes occupying all data rows, a plurality of second codes occupying the upper and lower data rows, a plurality of specific values ​​occupying the upper and lower data rows, a plurality of first time differences occupying the upper data row corresponding to each second code, and a plurality of second time differences occupying the lower data row corresponding to each second code. The specific value refers to performing a specific operation based on all the second time difference values ​​in the lower data row to which the second time difference value is added and all the first time difference values ​​in the upper data row above the lower data row in the second record table, and recording the operation result as the specific value corresponding to both the lower data row and the upper data row; The first time difference value refers to collecting different codes and the time difference values ​​corresponding to the different codes occupying the lower data rows in the first record table, and adding the different codes into the second code corresponding to the added first code in the second record table, and further adding the time difference values ​​corresponding to each code occupying the lower data rows in sequence as the first time difference values ​​corresponding to the added second code occupying the upper data rows; The second time difference value refers to determining, based on the first record table, whether other monitoring data is received within the time interval from the third time to the second time corresponding to the monitoring data, where the other monitoring data refers to the monitoring data sent by the acquisition module corresponding to the code corresponding to the approval identifier with a content of 1 in the first record table. If not, the second processing is terminated. If so, the data row corresponding to the code of the acquisition module sending the other monitoring data is determined in the data record corresponding to the code of the acquisition module sending the monitoring data in the second record table, and the time difference corresponding to the other monitoring data is recorded as the second time difference value of the data row below. The intermediate module performs the first processing, including the following steps: S311, recording the code of the acquisition module that sends the monitoring data as the code in the first record table, setting the corresponding approval flag in the first record table to 0, and recording the code of the acquisition module that sends the monitoring data as the first code in the second record table; S312: Collect different codes and the time difference values ​​corresponding to the different codes occupying the lower data rows in the first record table, and add the different codes as second codes corresponding to the added first codes in the second record table. Also, add the time difference values ​​corresponding to each code occupying the lower data rows in sequence as the first time difference values ​​corresponding to the added second codes occupying the upper data rows. The intermediate module performs the second processing, including the following steps: S321, determining a second time corresponding to the monitoring data, a third time that is a preset time interval before the second time corresponding to the monitoring data, and a fourth time that is twice the preset time interval before the second time corresponding to the monitoring data; S322: Based on the first record table, determine whether other monitoring data is received within the time interval from the fourth time to the second time corresponding to the monitoring data, where the other monitoring data refers to monitoring data sent by the acquisition module corresponding to the code corresponding to the approval identifier with a content of 0 in the first record table. If so, terminate the second process; otherwise, proceed to the next step. S323. Determine, based on the first record table, whether other monitoring data is received within the time interval from the third time to the second time corresponding to the monitoring data. The other monitoring data refers to monitoring data sent by the acquisition module corresponding to the code corresponding to the approval identifier with a value of 1 in the first record table. If not, terminate the second process. If so, determine the next data row corresponding to the code of the acquisition module that sent the other monitoring data in the data record corresponding to the code of the acquisition module that sent the monitoring data in the second record table, record the time difference corresponding to the other monitoring data as the second time difference in the next data row, and terminate the second process. The intermediate module performs the third processing, including the following steps: S331: Determine the second time corresponding to the monitoring data, and a fifth time that is a preset time interval before the second time corresponding to the monitoring data, and determine, based on the first record table, whether other monitoring data is received within the time interval from the fifth time to the second time corresponding to the monitoring data, where the other monitoring data refers to monitoring data sent by the acquisition module corresponding to the code corresponding to the approval identifier with a content of 0 in the first record table. If no, terminate the third process; if yes, proceed to the next step. S332. Determine whether the total number of received other monitoring data is multiple. If so, terminate the third process. If not, determine the next data row corresponding to the code of the acquisition module that sent the monitoring data in the data record corresponding to the code of the acquisition module that sent the other monitoring data in the second record table, record the time difference corresponding to the monitoring data as the second time difference of the next data row, and terminate the third process. The intermediate module performs the fourth processing, including the following steps: S341: Count the total number of the added second time difference values ​​in the data row below the second record table to which the second time difference value is added, and determine whether the total number is greater than or equal to a preset total number threshold. If not, terminate the fourth process; if so, proceed to the next step. S342: Perform a specific operation based on all second time difference values ​​in the lower data row to which the second time difference value is added and all first time difference values ​​in the upper data row above the lower data row in the second record table, and record the operation result as a specific value corresponding to both the lower data row and the upper data row; S343. Determine whether the specific numerical value is greater than a preset specific numerical value threshold. If so, delete the data record containing the first code corresponding to the specific numerical value in the second record, and set the approval flag to -1 in the data record corresponding to the first code in the first record table. If not, delete the data record containing the first code corresponding to the specific numerical value in the second record, and set the approval flag to 1 in the data record corresponding to the first code in the first record table.

2. The method according to claim 1, characterized in that The process of the remote module dividing all the monitoring data into three data groups includes: calculating the first standard data based on all the monitoring data, calculating the difference between each monitoring data and the first standard data, dividing a number of monitoring data whose corresponding difference is less than or equal to the preset first difference threshold into the first data group, dividing a number of monitoring data whose corresponding difference is greater than the preset first difference threshold into the second data group, and calculating the second standard data based on all the monitoring data in the second data group, calculating the difference between each monitoring data and the second standard data, dividing a number of monitoring data whose corresponding difference is greater than the preset second difference threshold into the third data group, and assigning a first characteristic value to each monitoring data in the first data group, assigning a second characteristic value to each monitoring data in the second data group, and assigning a third characteristic value to each monitoring data in the third data group, the first characteristic value is less than the second characteristic value, the second characteristic value is less than the third characteristic value, and using the formula for each data group Calculate the corresponding characteristic value, where is the characteristic value of the mth data group, n is the total number of monitoring data contained in the mth data group, is the weight value set according to the type of the acquisition module that sends the i-th monitoring data in the m-th data group, is the mth characteristic value corresponding to the mth data group.

3. An information collection system based on multiple data sources of the Internet of Things, used to implement the method according to any one of claims 1-2, characterized in that: Includes the following modules: an intermediate module, configured to continue transmitting the monitoring data to the remote module after each receipt of the monitoring data, and to receive the monitoring data when the total number of all the acquisition modules changes, record the code of the acquisition module that sends the monitoring data, the first time corresponding to the monitoring data, and the second time corresponding to the monitoring data, determine whether the recorded code exists in the first record table, and if not, perform a first process, followed by a second process, and if yes, continue to determine whether the acquisition process of the acquisition module corresponding to the recorded code meets a preset condition, and if yes, perform a second process, and if not, perform a third process, and then perform a fourth process, and record the second time corresponding to the monitoring data and the time difference between the second time corresponding to the monitoring data and the first time in the first record table; The acquisition module is used to collect monitoring data and send its own monitoring data to the intermediate module; The remote module is used to receive the monitoring data sent by the intermediate module and determine whether the total number of different monitoring data currently received is greater than the preset total number threshold. If it is greater than, all the monitoring data are divided into N data groups. For each data group, data management with corresponding priority is performed based on the characteristic value corresponding to the data group. If it is not greater than, the monitoring data sent by the intermediate module continues to be received.

4. A storage medium, characterized in that The storage medium stores program instructions, wherein when the program instructions are executed, the device where the storage medium is located is controlled to execute the method according to any one of claims 1 to 2.

Images