Real-time monitoring system and method for Internet of Things device traffic

By installing traffic calculation modules on IoT devices and device management platforms, and combining operator data to monitor and calculate the traffic consumption of IoT devices in real time, the shortcomings of traffic statistics in the existing technology are solved, real-time and accurate traffic monitoring and Data analysis improves the reliability and business efficiency of equipment management.

CN117376209BActive Publication Date: 2024-11-15GUANGDONG JUCHEN JINLI COMM EQUIP TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311592692.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-11-24
Publication Date
2024-11-15
Estimated Expiration
2043-11-24

AI Technical Summary

Technical Problem

The existing IoT device traffic management methods have problems such as single source of traffic statistics, large errors, uneven distribution, and the inability to accurately monitor the equipment traffic consumption status in real time, which limits the management and data analysis of IoT devices.

Method used

Propose a real-time monitoring method for IoT equipment traffic, by installing traffic calculation modules on terminal equipment and device management platforms, monitoring traffic consumption in real time, and obtaining call order traffic data through operator IoT cards, combining multi-source data for real-time and quasi-real-time Traffic calculation ensures the integrity and accuracy of the data.

Benefits of technology

Real-time monitoring and accurate statistics of IoT device traffic is realized, data integrity and accuracy are ensured, subsequent data analysis and real-time monitoring are supported, and equipment stability and business efficiency are improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117376209B_ABST
    Figure CN117376209B_ABST
Patent Text Reader

Abstract

The present invention relates to a method for real-time monitoring of flow of IoT devices, including obtaining flow consumption data f1 of a terminal device in a preset second time period, i.e., a unit time period, and flow consumption data f2 of a device management platform in a unit time period at intervals of a first time period; calculating the real-time flow consumption of the terminal device from the first time period of the current moment according to a first rule based on the flow consumption data f1 and the flow consumption data f2; obtaining flow consumption data f3 of an operator IoT card associated with the terminal device at intervals of a third time period; and calculating the quasi-real-time flow consumption of the terminal device from the third time period of the current moment according to a second rule based on the flow consumption data f1, the flow consumption data f2, and the flow consumption data f3. The present invention collects and analyzes flow data of IoT devices, calculates real-time and quasi-real-time device flow consumption data, provides reliable data guarantee for subsequent data analysis and prediction, assists operators in equipment management and flow allocation, and improves operational efficiency and user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of data monitoring technology, and in particular to a real-time monitoring system and method for flow of Internet of Things devices. Background Art

[0002] The rapid development of the Internet of Things has led to a large number of IoT devices connected to the network, of which IoT devices are an essential component of the connection. In order to facilitate the management of IoT devices, it is necessary to collect and monitor device traffic data.

[0003] However, there are some problems with the current traffic management methods for IoT devices, such as a single source of traffic statistics, distortion, large errors, uneven distribution, and the inability to accurately monitor device traffic consumption in real time, which limits the development of the IoT and correspondingly makes it impossible to guarantee the subsequent data analysis and prediction process. Summary of the invention

[0004] The purpose of the present invention is to solve at least one of the deficiencies of the prior art and to provide a real-time monitoring system and method for the flow of IoT devices.

[0005] In order to achieve the above object, the present invention adopts the following technical solutions:

[0006] Specifically, a real-time monitoring method for IoT device traffic is proposed, including the following:

[0007] At every first time period, obtain the flow consumption data f1 of the terminal device in a preset second time period, i.e., a unit time period, and the flow consumption data f2 of the device management platform in the unit time period;

[0008] Calculate the real-time traffic consumption of the terminal device for the first time period from the current moment according to the first rule based on the traffic consumption data f1 and the traffic consumption data f2;

[0009] Every third time period, obtain the traffic consumption data f3 of the operator's IoT card associated with the terminal device;

[0010] Calculate the quasi-real-time traffic consumption of the terminal device for a third time period from the current moment according to the second rule based on the traffic consumption data f1, the traffic consumption data f2 and the traffic consumption data f3;

[0011] The real-time traffic consumption and quasi-real-time traffic consumption are fed back for subsequent data analysis and real-time monitoring.

[0012] Further, specifically, the process of obtaining the traffic consumption data f1 includes:

[0013] Setting a flow calculation module in the terminal device;

[0014] The traffic calculation module monitors the gateway traffic consumption between the terminal device and the device management platform in real time;

[0015] At first intervals, the traffic calculation module counts the traffic passing through the terminal device within the unit time to obtain traffic consumption data f1.

[0016] Further, specifically, the process of obtaining the traffic consumption data f2 includes:

[0017] Set up a flow calculation module in the device management platform;

[0018] The traffic calculation module is used to monitor in real time the traffic consumption of the terminal devices entering and leaving the device management platform via the Internet;

[0019] At first intervals, the traffic calculation module counts the traffic passing through the device management platform within the unit time to obtain traffic consumption data f2.

[0020] Further, specifically, the process of obtaining the traffic consumption data f3 includes:

[0021] The device management platform communicates with the operator's IoT card interface to obtain call bill traffic usage data.

[0022] Every third time period, the device management platform obtains the traffic consumption data f3 through the operator's call bill traffic statistics interface and feeds it back to the device traffic statistics module.

[0023] Further, specifically, calculating the real-time traffic consumption of the terminal device for the first time period from the current moment according to the first rule includes:

[0024] When the first time period from the current moment is just included in the collection time period of the collected f1 and f2 data, the real-time consumption flow y1.flow = (f1.flow*first time period / second time period+f2.flow*first time period / second time period / 2), where f1.flow represents the flow consumption data f1' including the first time period from the current moment, and f2.flow represents the flow consumption data f2' including the first time period from the current moment;

[0025] When the first duration from the current moment is partially included in the collection time period of the collected f1 and f2 data, then y1.flow = (f1 mode.flow * first duration / second duration + f2.flow * first duration / second duration / 2) or y1.flow = (f1.flow * first duration / second duration + f2 mode.flow * first duration / second duration / 2),

[0026] Where f1 modulo.flow represents the simulated calculation amount of the flow consumption data f1 for the first time period from the current moment, and f2 modulo.flow represents the simulated calculation amount of the flow consumption data f2 for the first time period from the current moment.

[0027] And f1 mod.flow = (f1a.flow + f1b.flow) / 2, f2 mod.flow = (f2a.flow + f2b.flow) / 2, where f1a.flow and f1b.flow as well as f2a.flow and f2b.flow are the sampling data a and b of f1 and f2 respectively, and the sampling data a and b as a whole just contain the time period of the first time length from the current moment;

[0028] If the first time period from the current moment is missing in any of the collected f1 or f2 data, y1.flow = non-missing side.flow * first time period / second time period, where non-missing side.flow is the non-missing f1.flow or f2.flow;

[0029] When the collection time periods of the collected f1 and f2 data are missing the first time period from the current moment, the y1.flow at this moment is the y1.flow calculated at the previous moment. 前 and y1.flow calculated at the next moment 后 The average of the two.

[0030] Further, specifically, the quasi-real-time consumption flow of the terminal device for the third time period from the current time is calculated according to the second rule, including:

[0031] Calculate the sum ft1 of f1 within the third time period from the current moment, and the sum ft2 of f2 within the third time period from the current moment;

[0032] Then the quasi-real-time consumption flow y2.flow = ((ft1.flow + ft2.flow) / 2 + ft3.flow) / 2.

[0033] Further, specifically, the first duration is 30 seconds, the second duration is 60 seconds, and the third duration is 300 seconds.

[0034] The present invention also proposes a real-time monitoring system for Internet of Things device traffic, comprising:

[0035] The terminal equipment to be monitored;

[0036] A device management platform, which is in communication connection with the terminal device;

[0037] An operator IoT card, which is connected to the device management platform for counting operator traffic consumption of terminal devices;

[0038] Device traffic statistics module, including:

[0039] The first data collection unit is used to obtain, at intervals of a first time period, flow consumption data f1 of the terminal device in a preset second time period, i.e., a unit time period, and flow consumption data f2 of the device management platform in the unit time period;

[0040] A real-time traffic consumption calculation unit, configured to calculate the real-time traffic consumption of the terminal device for a first time period from the current moment according to a first rule based on the traffic consumption data f1 and the traffic consumption data f2;

[0041] The second data collection unit is used to obtain the traffic consumption data f3 of the operator's IoT card associated with the terminal device every third time period;

[0042] A quasi-real-time traffic consumption calculation unit, configured to calculate the quasi-real-time traffic consumption of the terminal device for a third time period from the current moment according to a second rule based on the traffic consumption data f1, the traffic consumption data f2, and the traffic consumption data f3;

[0043] The data feedback unit is used to feed back the real-time traffic consumption and quasi-real-time traffic consumption for subsequent data analysis and real-time monitoring.

[0044] Further, specifically, the first duration is 30 seconds, the second duration is 60 seconds, and the third duration is 300 seconds.

[0045] The beneficial effects of the present invention are:

[0046] The present invention proposes a real-time monitoring method for IoT device traffic, which has the following beneficial effects:

[0047] 1. Real-time monitoring of traffic consumption: By installing traffic calculation modules on terminal devices and device management platforms, the traffic consumption between devices and device management platforms can be monitored in real time, including traffic consumption within the terminal devices and traffic consumption in and out of the terminal devices through the Internet.

[0048] 2. Accurate traffic statistics: Through traffic calculation modules from different sources and operator interfaces, the traffic consumption data of terminal devices, device management platforms and operator IoT cards can be obtained, counted and recorded. This can achieve accurate statistics of device traffic consumption within a unit time.

[0049] 3. Data integrity compensation: In the case of missing data within a specified statistical time period, traffic data can be compensated through data sampling simulation calculation and post-supplementary simulation calculation to ensure the integrity and accuracy of statistical data. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The above and other features of the present disclosure will become more apparent by describing in detail the embodiments shown in the accompanying drawings. The same reference numerals in the accompanying drawings of the present disclosure represent the same or similar elements. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure. For those skilled in the art, other accompanying drawings can be obtained based on these accompanying drawings without creative work. In the accompanying drawings:

[0051] Figure 1 It is a flow chart of the method for real-time monitoring of the flow of IoT devices of the present invention;

[0052] Figure 2 The figure shows the operation principle diagram of the real-time monitoring system for the flow of IoT devices of the present invention;

[0053] Figure 3 The figure is a schematic diagram of the flow chart of real-time and quasi-real-time traffic consumption statistics of devices in the real-time monitoring method of the Internet of Things device traffic of the present invention. DETAILED DESCRIPTION

[0054] The following will be combined with the embodiments and drawings to clearly and completely describe the concept, specific structure and technical effects of the present invention, so as to fully understand the purpose, scheme and effect of the present invention. It should be noted that the embodiments in this application and the features in the embodiments can be combined with each other without conflict. The same reference numerals used throughout the drawings indicate the same or similar parts.

[0055] Reference Figure 1 as well as Figure 3 Embodiment 1: Based on the above idea, the present invention proposes a method for real-time monitoring of IoT device traffic, including the following:

[0056] Step 110: Obtain, at every first time interval, traffic consumption data f1 of the terminal device in a preset second time interval, i.e., a unit time interval, and traffic consumption data f2 of the device management platform in the unit time interval;

[0057] Step 120, calculating the real-time traffic consumption of the terminal device for a first time period from the current moment according to a first rule based on the traffic consumption data f1 and the traffic consumption data f2;

[0058] Step 130: Obtain the traffic consumption data f3 of the operator's IoT card associated with the terminal device every third time period;

[0059] Step 140, calculating the quasi-real-time traffic consumption of the terminal device for a third time period from the current moment according to the second rule based on the traffic consumption data f1, the traffic consumption data f2 and the traffic consumption data f3;

[0060] Step 150: Feedback the real-time traffic consumption and quasi-real-time traffic consumption for subsequent data analysis and real-time monitoring.

[0061] Subsequent data analysis and real-time monitoring can start from the following ideas:

[0062] 1. Providing accurate traffic data foundation: Through the method and algorithm of the present invention, accurate device traffic consumption data can be obtained, providing a reliable data foundation for subsequent traffic processing and analysis. This helps to conduct accurate traffic analysis and optimize strategy formulation.

[0063] 2. Real-time monitoring and fault diagnosis: By monitoring the flow consumption of equipment in real time, abnormal conditions and faults can be discovered in time, and real-time monitoring and fault diagnosis can be performed. This helps to improve the stability and reliability of equipment and reduce the occurrence and impact of faults.

[0064] 3. Data analysis and optimization decision-making: By analyzing the device traffic data, we can obtain the device usage and trends, and provide a basis for subsequent business optimization and decision-making. This helps to improve business efficiency and user experience, and optimize resource allocation and network configuration.

[0065] As a preferred embodiment of the present invention, specifically, the process of acquiring the flow consumption data f1 includes:

[0066] Setting a flow calculation module in the terminal device;

[0067] The traffic calculation module monitors the gateway traffic consumption between the terminal device and the device management platform in real time;

[0068] At first intervals, the traffic calculation module counts the traffic passing through the terminal device within the unit time to obtain traffic consumption data f1.

[0069] In this preferred embodiment, in actual application, the process of obtaining the flow consumption data f1 includes the following process:

[0070] 1. The terminal device has a built-in or third-party flow calculation module (such as Softflowd) installed.

[0071] 2. The traffic calculation module monitors the gateway traffic consumption between the terminal device and the device management platform in real time.

[0072] 3. Every 30 seconds, the traffic calculation module feeds back the traffic consumption data f1 counted by the terminal device within the unit time (60 seconds) to the device traffic statistics module.

[0073] JSON sample data after f1 conversion:

[0074] {"device":"jkc001","source":"terminal","flow":"1024","unit":"kb","start":"2023-01-0112:00:00","end":"2023-01-01 12:01:00"}

[0075] Field Description:

[0076] device: device id

[0077] source: data source (terminal represents terminal device)

[0078] flow: usage flow

[0079] unit: flow unit

[0080] start: Statistics start time

[0081] end: Statistics end time

[0082] 4. After receiving the f1 data, the device traffic statistics module further processes and records it.

[0083] It should be noted that the traffic calculation module of each type of device needs to be designed and implemented according to specific business requirements and device characteristics, and is not within the scope of the present invention. The traffic calculation module can capture the traffic consumption data between the device and the device management platform in real time by monitoring network data packets, parsing and counting data flows, etc.

[0084] As a preferred embodiment of the present invention, specifically, the process of acquiring the flow consumption data f2 includes setting a flow calculation module in the device management platform;

[0085] The traffic calculation module is used to monitor in real time the traffic consumption of the terminal devices entering and leaving the device management platform via the Internet;

[0086] At first intervals, the traffic calculation module counts the traffic passing through the device management platform within the unit time to obtain traffic consumption data f2.

[0087] In this preferred embodiment, in actual application, the process of obtaining the flow consumption data f2 includes the following process:

[0088] 1. Install a third-party flow calculation module (such as Softflowd) on the device management platform.

[0089] 2. The traffic calculation module monitors in real time the traffic consumption in and out of the terminal device through the Internet through the device management platform.

[0090] 3. Every 30 seconds, the traffic calculation module feeds back the traffic consumption data f2 counted by the device management platform within the unit time (60 seconds) to the device traffic statistics module.

[0091] JSON sample data after f2 conversion:

[0092] {"device":"jkc001","source":"dmp","flow":"1024","unit":"kb","start":"2023-01-0112:00:00","end":"2023-01-01 12:01:00"}

[0093] Field Description:

[0094] device: device id

[0095] source: data source (dmp stands for device management platform)

[0096] flow: usage flow

[0097] unit: flow unit

[0098] start: Statistics start time

[0099] end: Statistics end time

[0100] 4. After receiving the f2 data, the device traffic statistics module further processes and records it.

[0101] It should be noted that the traffic calculation module installed in the device management platform needs to support real-time monitoring and statistics of traffic received or sent to terminal devices via the Internet, which is not within the scope of the present invention. The traffic calculation module can capture traffic consumption data entering and leaving terminal devices via the Internet by monitoring network data packets, parsing and counting data flows, etc.

[0102] As a preferred embodiment of the present invention, specifically, the process of acquiring the flow consumption data f3 includes:

[0103] The device management platform communicates with the operator's IoT card interface to obtain call bill traffic usage data.

[0104] Every third time period, the device management platform obtains the traffic consumption data f3 through the operator's call bill traffic statistics interface and feeds it back to the device traffic statistics module.

[0105] In this preferred embodiment, in actual application, the process of obtaining the flow consumption data f3 includes the following process:

[0106] 1. The device management platform communicates with the operator's IoT card interface to obtain call bill traffic usage data.

[0107] 2. Every 300 seconds, the device management platform obtains the device traffic consumption data f3 through the operator's call bill traffic statistics interface every 5 minutes and feeds it back to the device traffic statistics module.

[0108] JSON sample data after f3 conversion:

[0109] {"device":"jkc001","source":"cm","flow":"102400","unit":"kb","start":"2023-01-01

[0110] 12:05:00","end":"2023-01-01 12:00:00"}

[0111] Field Description:

[0112] device: device id

[0113] source: data source (cm stands for China Mobile)

[0114] flow: usage flow

[0115] unit: flow unit

[0116] start: Statistics start time

[0117] end: Statistics end time

[0118] 3. After receiving the f3 data, the device traffic statistics module further processes and records it.

[0119] It should be noted that the device management platform needs to be connected to the interface of the operator's IoT card to obtain the traffic usage data of the call list, which is not within the scope of the present invention. The traffic consumption of the device can be obtained through the operator interface, and the data is obtained based on the statistics of the IoT card in the operator's traffic calculation.

[0120] As a preferred implementation of the present invention, specifically, calculating the real-time consumption flow of the terminal device for the first time period from the current moment according to the first rule includes:

[0121] When the first time period from the current moment is just included in the collection time period of the collected f1 and f2 data, the real-time consumption flow y1.flow = (f1.flow*first time period / second time period+f2.flow*first time period / second time period / 2), where f1.flow represents the flow consumption data f1' including the first time period from the current moment, and f2.flow represents the flow consumption data f2' including the first time period from the current moment;

[0122] When the first duration from the current moment is partially included in the collection time period of the collected f1 and f2 data, then y1.flow = (f1 mode.flow * first duration / second duration + f2.flow * first duration / second duration / 2) or y1.flow = (f1.flow * first duration / second duration + f2 mode.flow * first duration / second duration / 2),

[0123] Where f1 modulo.flow represents the simulated calculation amount of the flow consumption data f1 for the first time period from the current moment, and f2 modulo.flow represents the simulated calculation amount of the flow consumption data f2 for the first time period from the current moment.

[0124] And f1 mod.flow = (f1a.flow + f1b.flow) / 2, f2 mod.flow = (f2a.flow + f2b.flow) / 2, where f1a.flow and f1b.flow as well as f2a.flow and f2b.flow are the sampling data a and b of f1 and f2 respectively, and the sampling data a and b as a whole just contain the time period of the first time length from the current moment;

[0125] If the first time period from the current moment is missing in any of the collected f1 or f2 data, y1.flow = non-missing side.flow * first time period / second time period, where non-missing side.flow is the non-missing f1.flow or f2.flow;

[0126] When the collection time periods of the collected f1 and f2 data are missing the first time period from the current moment, the y1.flow at this moment is the y1.flow calculated at the previous moment. 前 and y1.flow calculated at the next moment 后 The average of the two.

[0127] In this preferred embodiment, when the first time length is 30 seconds, the second time length is 60 seconds, and the third time length is 300 seconds, the device traffic statistics module calculates the device's real-time (every 30 seconds) traffic consumption, and feeds back the device traffic consumption data within the unit time length of 30 seconds to the subsequent data analysis and real-time monitoring module for further processing;

[0128] The following is the calculation formula for the real-time flow y1 of the device within a unit time of 30 seconds in various cases:

[0129] When a 30-second statistical time period is specified and the collected f1 and f2 data happen to contain the traffic statistics data for this time period: y1.flow = (f1.flow / 2 + f2.flow / 2) / 2

[0130] For example, if you specify the statistical time period: 2023-01-01 12:00:15 to 2023-01-01 12:00:45, you can find the traffic statistics data that just includes this time period in f1 and f2.

[0131] f1.start=2023-01-01 12:00:00

[0132] f1.end = 2023-01-01 12:01:00

[0133] f1.flow=500

[0134] f1.unit = kb

[0135] f2.start=2023-01-01 12:00:00

[0136] f2.end = 2023-01-01 12:01:00

[0137] f2.flow=600

[0138] f2.unit = kb

[0139] y1.flow=(500 / 2+600 / 2) / 2=275kb

[0140] When the 30-second time period is specified and the collected f1 or f2 data does not contain the traffic statistics data of this time period, it is necessary to perform data sampling simulation calculation on f1 or f2 first. Take f1 for example: f1 mode.flow = total f1 in the specified 30-second time period / number of f1. y1.flow = (f1 mode.flow / 2 + f2.flow / 2) / 2

[0141] Example: Specify the statistical time period: 2023-01-01 12:00:45 to 2023-01-01 12:01:15

[0142] f1a.start=2023-01-01 12:00:00

[0143] f1a.end = 2023-01-01 12:01:00

[0144] f1a.flow=500

[0145] f1a.unit = kb

[0146] f1b.start=2023-01-01 12:01:00

[0147] f1b.end = 2023-01-01 12:02:00

[0148] f1b.flow=600

[0149] f1b.unit = kb

[0150] f2.start=2023-01-01 12:00:30

[0151] f2.end = 2023-01-01 12:01:30

[0152] f2.flow=700

[0153] f2.unit = kb

[0154] f1module.flow=(f1a.flow+f1b.flow) / 2=(500+600) / 2=550kb

[0155] y1.flow=(f1module.flow / 2+f2.flow / 2) / 2=(550 / 2+700 / 2) / 2=312.5kb

[0156] When the collected f1 or f2 data is missing from the specified 30-second statistical time period, the missing data needs to be excluded. For example, if f1 is missing, y1.flow = f2.flow / 2

[0157] When the collected f1 and f2 data are both missing the traffic statistics data in the specified 30-second time period, the real-time traffic statistics in the 30-second time period will be temporarily shelved. After 300 seconds, the traffic data in the time period will be supplemented by simulation calculation: y1.flow = (data with traffic records before the missing time period of y1 + data with traffic records after the missing time period of y1) / 2

[0158] Example: Specify missing statistics time period: 2023-01-01 12:04:00 to 2023-01-01 12:06:00

[0159] y1a.start~y1a.end=2023-01-01 12:03:00~2023-01-01 12:04:00

[0160] y1a.flow=250

[0161] y1a.unit=kb

[0162] y1b.start~y1b.end(missing)=2023-01-01 12:04:00~2023-01-01 12:05:00

[0163] y1c.start~y1c.end(missing)=2023-01-01 12:05:00~2023-01-01 12:06:00

[0164] y1d.start~y1d.end=2023-01-01 12:06:00~2023-01-01 12:07:00

[0165] y1d.flow=300

[0166] y1d.unit = kb

[0167] y1b.flow=y1c.flow=(y1a.flow+y1d.flow) / 2=(250+300) / 2=275kb

[0168] As a preferred implementation of the present invention, specifically, calculating the quasi-real-time consumption flow of the terminal device for a third time period from the current moment according to the second rule includes:

[0169] Calculate the sum ft1 of f1 within the third time period from the current moment, and the sum ft2 of f2 within the third time period from the current moment;

[0170] Then the quasi-real-time consumption flow y2.flow = ((ft1.flow + ft2.flow) / 2 + ft3.flow) / 2.

[0171] In this preferred embodiment,

[0172] The device traffic statistics module calculates the device traffic consumption in quasi-real time (every 300 seconds), and feeds back the device traffic consumption data within a unit time of 300 seconds to the subsequent data analysis and real-time monitoring module for further processing;

[0173] The calculation formula for the quasi-real-time flow rate y2 of the device within a unit time of 300 seconds is:

[0174] ft1 (traffic data collected by the terminal device within a specified 300-second period) = sum of f1 containing the specified 300-second period (6 in total) / 6*5

[0175] ft2 (flow data collected by the device management platform within a specified 300-second period) = sum of f2 containing the specified 300-second period (6 in total) / 6*5

[0176] ft3 (traffic data collected by the operator interface within a specified 300-second period) = the sum of the traffic in f3 including the specified 300-second period, according to the weight of the time period

[0177] y2.flow=((ft1.flow+ft2.flow) / 2+ft3.flow) / 2

[0178] Note: Based on the trust in the operator's traffic data, the weight of the operator interface data in the quasi-real-time traffic data is the same as the arithmetic average of the device terminal and the device management platform.

[0179] Example: Specify the statistical time period: 2023-01-01 12:00:45 to 2023-01-01 12:05:45 (300 seconds)

[0180] t.start = 2023-01-01 12:00:45

[0181] t.end = 2023-01-01 12:05:45

[0182]

[0183] ft1.flow=(f1a.flow+f1b.flow+f1c.flow+f1d.flow+f1e.flow+f1f.flow) / 6*5=(500+600+700+800+900+1000) / 6*5=3750kb

[0184] ft2.flow=(f2a.flow+f2b.flow+f2c.flow+f2d.flow+f2e.flow+f2f.flow) / 6*5=(550+650+750+850+950+1050) / 6*5=4000kb

[0185] ft3.flow=(f3a.end-t.start) / 300*3500+(t.end-f3b.start) / 300*4000=255 / 300

[0186] *3500+45 / 300*4000=3575

[0187] y2.flow=((ft1.flow+ft2.flow) / 2+ft3.flow) / 2=((3750+4000) / 2+3575) / 2=3725kb.

[0188] Reference Figure 2 The present invention also proposes a real-time monitoring system for Internet of Things device traffic, including:

[0189] The terminal equipment to be monitored;

[0190] A device management platform, which is in communication connection with the terminal device;

[0191] An operator IoT card, which is connected to the device management platform for counting operator traffic consumption of terminal devices;

[0192] Device traffic statistics module, including:

[0193] The first data collection unit is used to obtain, at intervals of a first time period, flow consumption data f1 of the terminal device in a preset second time period, i.e., a unit time period, and flow consumption data f2 of the device management platform in the unit time period;

[0194] A real-time traffic consumption calculation unit, configured to calculate the real-time traffic consumption of the terminal device for a first time period from the current moment according to a first rule based on the traffic consumption data f1 and the traffic consumption data f2;

[0195] The second data collection unit is used to obtain the traffic consumption data f3 of the operator's IoT card associated with the terminal device every third time period;

[0196] A quasi-real-time traffic consumption calculation unit, configured to calculate the quasi-real-time traffic consumption of the terminal device for a third time period from the current moment according to a second rule based on the traffic consumption data f1, the traffic consumption data f2, and the traffic consumption data f3;

[0197] The data feedback unit is used to feed back the real-time traffic consumption and quasi-real-time traffic consumption for subsequent data analysis and real-time monitoring.

[0198] The real-time monitoring system for IoT device traffic proposed by the present invention has the following advantages:

[0199] 1. Sources of equipment traffic data sampling. The present invention combines the real-time traffic statistics sampling of terminal equipment every 30 seconds, the real-time traffic statistics sampling of the equipment management platform every 30 seconds, and the quasi-real-time traffic statistics sampling of operators every 5 minutes. This avoids the problem of low data accuracy caused by failure, distortion and error of traffic data from a single source.

[0200] 2. Real-time and quasi-real-time algorithm processing of device traffic statistics

[0201] 1. Calculation of real-time device traffic within a unit time: Calculate the real-time device traffic based on the traffic consumption data of the terminal device and the device management platform collected within a specified statistical 30-second time period. The key point of this algorithm is to perform data simulation calculation and data compensation based on the collected data to ensure the accuracy of real-time traffic.

[0202] 2. Calculation of quasi-real-time device traffic within a unit time: Calculate the quasi-real-time device traffic based on the traffic consumption data of the terminal device, device management platform, and operator interface collected within a specified statistical time period of 300 seconds. The key point of this algorithm is to calculate the quasi-real-time traffic data based on the trust in the operator's traffic data using arithmetic average and weight.

[0203] The invention is the collection and processing algorithm of traffic consumption at the terminal device end, the device management platform end and the operator end. By real-time monitoring and statistics of device traffic consumption data, and calculating real-time traffic every 60 seconds and quasi-real-time traffic every 300 seconds within a unit time, the monitoring and statistics of device traffic are more accurate and reliable. This invention can be protected within the scope to prevent others from using the same method and algorithm to collect and process device traffic without permission.

[0204] In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of software functional modules.

[0205] If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or system that can carry the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal and software distribution medium, etc.

[0206] Although the description of the present invention has been quite detailed and specifically describes several described embodiments, it is not intended to be limited to any of these details or embodiments or any particular embodiment, but should be regarded as providing a broad possible interpretation of these claims in view of the prior art by reference to the appended claims, thereby effectively covering the intended scope of the present invention. In addition, the above description of the present invention is based on the embodiments foreseeable by the inventor, and its purpose is to provide a useful description, and those non-substantial changes to the present invention that have not yet been foreseen may still represent equivalent changes to the present invention.

[0207] The above is only a preferred embodiment of the present invention. The present invention is not limited to the above implementation. As long as the technical effect of the present invention is achieved by the same means, it should belong to the protection scope of the present invention. Within the protection scope of the present invention, its technical scheme and / or implementation method can have various modifications and changes.

Claims

1. A method for real-time monitoring of Internet of Things device traffic, characterized in that: Includes the following: At every first time period, obtain the flow consumption data f1 of the terminal device in a preset second time period, i.e., a second unit time period, and the flow consumption data f2 of the device management platform in the second unit time period; Calculate the real-time traffic consumption of the terminal device for the first time period from the current moment according to the first rule based on the traffic consumption data f1 and the traffic consumption data f2; Every third time period, obtain the traffic consumption data f3 of the operator IoT card associated with the terminal device; Calculate the quasi-real-time traffic consumption of the terminal device for a third time period from the current moment according to the second rule based on the traffic consumption data f1, the traffic consumption data f2 and the traffic consumption data f3; Feedback the real-time traffic consumption and quasi-real-time traffic consumption for subsequent data analysis and real-time monitoring; Among them, the first duration is the first unit duration, the second duration is the second unit duration, and the third duration is the third unit duration; Specifically, the real-time traffic consumption of the terminal device for the first time period from the current moment is calculated according to the first rule, including: When the first time period from the current moment is included in the collection time period of the collected f1 and f2 data, the real-time consumption flow y1.flow = (f1.flow*first time period / second time period + f2.flow*first time period / second time period / 2), where f1.flow represents the flow consumption data f1 including the first time period from the current moment, and f2.flow represents the flow consumption data f2 including the first time period from the current moment; When the first duration from the current moment is partially included in the collection time period of the collected f1 and f2 data, then y1.flow=(f1 mode.flow*first duration / second duration+f2.flow*first duration / second duration / 2) or y1.flow= (f1.flow*first duration / second duration+ f2 mode.flow*first duration / second duration / 2), Where f1 modulo.flow represents the simulated calculation amount of the flow consumption data f1 for the first time period from the current moment, and f2 modulo.flow represents the simulated calculation amount of the flow consumption data f2 for the first time period from the current moment. And f1 module.flow = (f1a.flow + f1b.flow) / 2, f2 module.flow = (f2a.flow + f2b.flow) / 2, where f1a.flow is the a-th sampling data of f1, f1b.flow is the b-th sampling data of f1, f2a.flow is the a-th sampling data of f2, f2b.flow is the b-th sampling data of f2, and the two sampling data a and b as a whole include the time period of the first duration from the current moment; If the first time period from the current moment is missing in any of the collected f1 or f2 data, y1.flow = non-missing side.flow * first time period / second time period, where non-missing side.flow is the non-missing f1.flow or f2.flow; When the collection time periods of the collected f1 and f2 data are both missing the first time period from the current moment, then y1.flow at this time is calculated at the previous moment The value calculated at the next moment The average of the two; The first duration is 30 seconds, the second duration is 60 seconds, and the third duration is 300 seconds. The device traffic statistics module calculates the device traffic consumption in real time, that is, every 30 seconds, and feeds back the device traffic consumption data within the first unit duration of 30 seconds to the subsequent data analysis and real-time monitoring module for further processing; Specifically, the quasi-real-time consumption flow of the terminal device for the third time period from the current time is calculated according to the second rule, including: Calculate the sum of f1 within the third time period from the current moment, ft1.flow, which is the flow data collected by the terminal device within a specified 300-second period, and the sum of f2 within the third time period from the current moment, ft2.flow, which is the flow data collected by the device management platform within a specified 300-second period; Then the quasi-real-time consumption flow y2.flow = ((ft1.flow + ft2.flow) / 2 + ft3.flow) / 2; ft3.flow is the flow data collected by the operator interface within a specified 300-second period. The device traffic statistics module calculates the device traffic consumption in quasi-real time, that is, every 300 seconds, and feeds back the device traffic consumption data within the third unit time of 300 seconds to the subsequent data analysis and real-time monitoring module for further processing; The calculation formula for the quasi-real-time flow rate y2 of the device within the third unit time of 300 seconds is: ft1.flow = the sum of f1 in the specified 300 second time period / 6 * 5 ft2.flow = The sum of f2 for the specified 300 second time period / 6 * 5 ft3.flow = The total flow of f3 with a specified 300-second time period, based on the weight of the time period y2.flow = ((ft1.flow + ft2.flow) / 2 + ft3.flow) / 2 It is also agreed that, based on the trust in the operator's traffic data, the weight of the operator's interface data in the quasi-real-time traffic data is the same as the arithmetic average of the device terminal and the device management platform.

2. The method for real-time monitoring of Internet of Things device traffic according to claim 1 is characterized in that: Specifically, the process of obtaining the traffic consumption data f1 includes: A flow calculation module is provided in the terminal device; The traffic calculation module monitors the gateway traffic consumption between the terminal device and the device management platform in real time; At every first time period, the traffic calculation module counts the traffic passing through the terminal device within a second unit time period to obtain traffic consumption data f1.

3. The method for real-time monitoring of Internet of Things device traffic according to claim 1 is characterized in that: Specifically, the process of obtaining the traffic consumption data f2 includes: Set up a flow calculation module in the device management platform; The traffic calculation module monitors the traffic consumption of the terminal devices in and out of the device management platform via the Internet in real time; At every first time period, the traffic calculation module counts the traffic passing through the device management platform within a second unit time period to obtain traffic consumption data f2.

4. The method for real-time monitoring of Internet of Things device traffic according to claim 1, characterized in that: Specifically, the process of obtaining the traffic consumption data f3 includes: The device management platform communicates with the operator's IoT card interface to obtain the traffic usage data of the call bill; Every third time period, the device management platform obtains the traffic consumption data f3 through the operator's call bill traffic statistics interface and feeds it back to the device traffic statistics module.

5. The real-time monitoring system for IoT device traffic is characterized by: include: The terminal equipment to be monitored; A device management platform, which is in communication connection with the terminal device; An operator IoT card, which is connected to the device management platform for counting operator traffic consumption of terminal devices; Device traffic statistics module, including: The first data collection unit is used to obtain the flow consumption data f1 of the terminal device in a preset second time period, i.e., a second unit time period, and the flow consumption data f2 of the device management platform in the unit time period at intervals of a first time period; A real-time traffic consumption calculation unit, configured to calculate the real-time traffic consumption of the terminal device for a first time period from the current moment according to a first rule based on the traffic consumption data f1 and the traffic consumption data f2; The second data collection unit is used to obtain the flow consumption data f3 of the operator IoT card associated with the terminal device every third time length; A quasi-real-time traffic consumption calculation unit, configured to calculate the quasi-real-time traffic consumption of the terminal device for a third time period from the current moment according to a second rule based on the traffic consumption data f1, the traffic consumption data f2, and the traffic consumption data f3; A data feedback unit, used to feed back the real-time traffic consumption and quasi-real-time traffic consumption for subsequent data analysis and real-time monitoring; Among them, the first duration is the first unit duration, the second duration is the second unit duration, and the third duration is the third unit duration; Specifically, the real-time traffic consumption of the terminal device for the first time period from the current moment is calculated according to the first rule, including: When the first time period from the current moment is included in the collection time period of the collected f1 and f2 data, the real-time consumption flow y1.flow = (f1.flow*first time period / second time period + f2.flow*first time period / second time period / 2), where f1.flow represents the flow consumption data f1 including the first time period from the current moment, and f2.flow represents the flow consumption data f2 including the first time period from the current moment; When the first duration from the current moment is partially included in the collection time period of the collected f1 and f2 data, then y1.flow=(f1 mode.flow*first duration / second duration+f2.flow*first duration / second duration / 2) or y1.flow= (f1.flow*first duration / second duration+ f2 mode.flow*first duration / second duration / 2), Where f1 modulo.flow represents the simulated calculation amount of the flow consumption data f1 for the first time period from the current moment, and f2 modulo.flow represents the simulated calculation amount of the flow consumption data f2 for the first time period from the current moment. And f1 module.flow = (f1a.flow + f1b.flow) / 2, f2 module.flow = (f2a.flow + f2b.flow) / 2, where f1a.flow is the a-th sampling data of f1, f1b.flow is the b-th sampling data of f1, f2a.flow is the a-th sampling data of f2, f2b.flow is the b-th sampling data of f2, and the two sampling data a and b as a whole include the time period of the first duration from the current moment; If the first time period from the current moment is missing in any of the collected f1 or f2 data, y1.flow = non-missing side.flow * first time period / second time period, where non-missing side.flow is the non-missing f1.flow or f2.flow; When the collection time periods of the collected f1 and f2 data are both missing the first time period from the current moment, then y1.flow at this time is calculated at the previous moment The value calculated at the next moment The average of the two; The first duration is 30 seconds, the second duration is 60 seconds, and the third duration is 300 seconds. The device traffic statistics module calculates the device traffic consumption in real time, that is, every 30 seconds, and feeds back the device traffic consumption data within the first unit duration of 30 seconds to the subsequent data analysis and real-time monitoring module for further processing; Specifically, the quasi-real-time consumption flow of the terminal device for the third time period from the current time is calculated according to the second rule, including: Calculate the sum of f1 within the third time period from the current moment, ft1.flow, which is the flow data collected by the terminal device within a specified 300-second period, and the sum of f2 within the third time period from the current moment, ft2.flow, which is the flow data collected by the device management platform within a specified 300-second period; Then the quasi-real-time consumption flow y2.flow = ((ft1.flow + ft2.flow) / 2 + ft3.flow) / 2; ft3.flow is the flow data collected by the operator interface within a specified 300-second period. The device traffic statistics module calculates the device traffic consumption in quasi-real time, that is, every 300 seconds, and feeds back the device traffic consumption data within the third unit time of 300 seconds to the subsequent data analysis and real-time monitoring module for further processing; The calculation formula for the quasi-real-time flow rate y2 of the device within the third unit time of 300 seconds is: ft1.flow = the sum of f1 in the specified 300 second time period / 6 * 5 ft2.flow = sum of f2 including the specified 300 second time period / 6 * 5 ft3.flow = The total flow of f3 with a specified 300-second time period, based on the weight of the time period y2.flow = ((ft1.flow + ft2.flow) / 2 + ft3.flow) / 2 It is also agreed that, based on the trust in the operator's traffic data, the weight of the operator's interface data in the quasi-real-time traffic data is the same as the arithmetic average of the device terminal and the device management platform.