A data processing system based on the Internet of Things

Abstract

The invention relates to the technical field of data processing, and in particular to a data processing system based on the Internet of Things, comprising a monitoring center, wherein the monitoring center is communicatively connected with a data acquisition module, a data receiving module, an Internet of Things network topology module and a path transmission module; the data acquisition module comprises a plurality of data acquisition nodes, and the data acquisition nodes are used to acquire crop images of various agricultural areas; the crop images are converted into crop data streams, and a data transmission state is set for each crop data stream; the data receiving module is used to receive the crop data streams; the Internet of Things network topology module identifies and marks all data acquisition nodes and data receiving center nodes, and performs topological modeling on the Internet of Things network; the path transmission module is used to determine the data transmission paths of the crop data streams in the real-time transmission state and the cache transmission state respectively based on the Internet of Things network topology model, so that the data transmission process is more efficient and reliable.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a data processing system based on the Internet of Things. Background Art

[0002] Agriculture is the largest production industry in my country. At present, agricultural pest and disease monitoring in my country mainly relies on years of accumulated experience and professional books and materials on agricultural pest and disease, which has the problems of large manual labor and low work efficiency. How to realize real-time monitoring of pests and diseases in agricultural areas through the Internet of Things, while ensuring the efficiency of data transmission and the real-time transmission of agricultural data related to pests and diseases, so as to ensure the development of agriculture is an issue that we urgently need to solve. This paper provides a data processing system based on the Internet of Things. Summary of the invention

[0003] In order to solve the above technical problems, the object of the present invention is to provide a data processing system based on the Internet of Things, including a monitoring center, wherein the monitoring center is communicatively connected with a data acquisition module, a data receiving module, an Internet of Things network topology module and a path transmission module;

[0004] The data acquisition module includes a plurality of data acquisition nodes, which are used to collect crop images of various agricultural areas; convert the crop images into crop data streams, and set data transmission status for each crop data stream;

[0005] The data receiving module is used to receive crop data stream;

[0006] The Internet of Things network topology module identifies and marks all data collection nodes and data receiving center nodes, and performs topology modeling on the Internet of Things network;

[0007] The path transmission module is used to determine the data transmission paths of the crop data streams in the real-time transmission state and the cache transmission state respectively based on the Internet of Things network topology model.

[0008] Furthermore, the data collection node is used to collect crop images of each agricultural area; the process of converting the crop images into crop data streams and setting data transmission states for each crop data stream includes:

[0009] A crop information input unit is provided, wherein the crop information input unit is used to input the photographed crop image, perform data format preprocessing on the input crop image, convert it into a crop data stream and send it to the feature extraction unit;

[0010] A feature extraction unit is provided, wherein the feature extraction unit is used to store reference crop images when crops grow normally, and to copy the input crop data stream, perform data format preprocessing on the copied crop data stream, convert it into a crop image, perform feature extraction on the crop image, generate a feature extraction result, and set importance for the input crop data stream according to the feature extraction result.

[0011] Furthermore, the process of the feature extraction unit extracting features from the crop image, generating feature extraction results, and setting importance for the input crop data stream according to the feature extraction results includes:

[0012] Converting the crop image and the reference crop image into grayscale images, comparing each pixel value in the grayscale image of the crop image and the grayscale image of the reference crop image one by one, subtracting pixel values ​​at the same position to obtain difference values, converting the difference values ​​into pixel values ​​of a binary image, and generating a binary image;

[0013] Set a primary pixel threshold, a secondary pixel threshold and two pixel point traversal pointers, and the two pixel point traversal pointers start traversing from the first pixel point and the last pixel point of the binary image area at the same time;

[0014] Mark the pixel point area in the binary image whose pixel value is less than the primary pixel threshold as a normal area;

[0015] Mark the pixel point area in the binary image whose pixel value is greater than or equal to the primary pixel threshold and less than the secondary pixel threshold as the primary damage area;

[0016] Marking the pixel point area in the binary image whose pixel value is greater than or equal to the secondary pixel threshold as the secondary damage area;

[0017] The area of ​​the normal area, the primary damaged area and the secondary damaged area in the binary image are respectively obtained, and the area of ​​each area in the binary image is weighted averaged to obtain the crop damage coefficient. According to the crop damage coefficient, the data transmission state is set for the input crop data stream, and the data transmission state includes real-time transmission state, cache transmission state and offline transmission state.

[0018] Furthermore, the process of the data receiving module receiving the crop data stream includes:

[0019] The data receiving module comprises a local data receiving node and a central data receiving node. The local data receiving node is used to receive crop data streams in an offline transmission state, and the central data receiving node is used to receive crop data streams in a real-time transmission state and a cached transmission state.

[0020] Furthermore, the Internet of Things network topology module identifies and marks all data collection nodes and data receiving center nodes, and the process of topological modeling of the Internet of Things network includes:

[0021] Acquire location features of the data acquisition node and the data receiving center node, and acquire the communication path and communication connection mode between the data acquisition node and the data receiving center node, wherein the communication connection mode includes wired connection and wireless connection;

[0022] The Internet of Things network topology model is constructed based on the location characteristics, communication paths and communication connection methods of data acquisition nodes and data receiving nodes.

[0023] Furthermore, the process of the path transmission module determining the data transmission path of the crop data stream in real-time transmission state based on the Internet of Things network topology model includes:

[0024] Obtaining the location characteristics of the data collection node where the crop data stream is generated and the state information of the crop data stream;

[0025] When the state information of the crop data stream is in a real-time transmission state, a plurality of communication paths in which the communication connection mode between the data collection node where the crop data stream is located and the data receiving center node in the Internet of Things network topology model is a wired connection are obtained, and data transmission coefficients of the plurality of communication paths are analyzed. According to the data transmission coefficient analysis results, the plurality of communication paths are sorted from low to high according to the data transmission coefficients, and the communication paths with the top five data transmission coefficients are selected as real-time transmission paths;

[0026] The crop data stream is divided into five network slices, and one network slice is allocated to each real-time transmission path. The data receiving center node receives the network slices and fuses them to obtain a complete crop data stream, and feeds back data reception success information to the data collection node through each real-time transmission path;

[0027] Set a data feedback time threshold, and when the data collection node receives the data reception success information fed back by each real-time transmission path within the data feedback time threshold, the real-time transmission path is marked as a normal state;

[0028] When there is a real-time transmission path in which the data collection node has not received feedback of successful data reception within the data feedback time threshold, the data collection node sends the network slice to the data receiving central node for a second time through the real-time transmission path. When the data collection node has not received feedback of successful data reception of the second-sent network slice within the data feedback time threshold, the current real-time transmission path is marked as a full-load operation state, and the sending of network slices to the real-time transmission path is stopped; and a real-time transmission path is reselected from the communication paths other than the top ten communication paths with the data transmission coefficient according to the data transmission coefficient.

[0029] Furthermore, the process of the path transmission module determining the data transmission path of the crop data stream in the cache transmission state based on the Internet of Things network topology model includes:

[0030] When the state information of the crop data stream is a cache transmission state, a real-time transmission path between a data collection node where the crop data stream is located and a data receiving center node in the Internet of Things network topology model and a wireless communication path in which the communication connection mode is a wireless connection are obtained;

[0031] Determine whether the real-time transmission path is in a full-load operation state, and when the real-time transmission path is in a full-load operation state, transmit the crop data stream to the data receiving central node through the wireless communication path;

[0032] When the real-time transmission path is not in full-load operation, the crop data stream is converted into data slices and transmitted to the data receiving central node through the real-time transmission path. When the data receiving central node receives the crop data stream, it feeds back the data receiving success information to the data collection node, and marks the round-trip delay between the data collection node sending the data slice and receiving the corresponding data receiving success information as T. i , and through the formula P i =(T i -T i-1 ) / T i ×100% to obtain the round-trip delay variation, where T i-1 Indicates the round trip delay of the previous data slice;

[0033] Set the change amplitude threshold. If P i If it is greater than or equal to the change amplitude threshold, it means that the current real-time transmission path is close to full load, and the data collection node will slice the data that has not been transmitted through the real-time transmission path through the wireless communication path parameters;

[0034] If P i If the value is less than the change amplitude threshold, it means that the current real-time transmission path is not close to the full load state, and the data acquisition node continues to transmit data slices through the current real-time transmission path.

[0035] Furthermore, the path transmission module performs data transmission coefficient analysis on a plurality of communication paths, and the process of obtaining the transmission coefficient of the communication paths includes:

[0036] A plurality of communication paths in which the communication connection mode between the data collection node where the crop data flow is located and the data receiving center node in the Internet of Things network topology model is a wired connection are obtained. The data collection node sends a detection network slice to the data receiving center node through the communication path. After the data receiving center node receives the detection network slice, it resends the detection network slice to the data collection node, collects the round-trip delay of the detection network slice, and obtains the transmission coefficient of the communication path according to the round-trip delay.

[0037] Compared with the prior art, the present invention has the following beneficial effects:

[0038] 1. The present invention first performs topological modeling on the Internet of Things network, which includes identifying and marking all sensor devices, data acquisition nodes and data receiving nodes. By constructing a network topology model, we can understand the structure and connection relationship of the entire network.

[0039] 2. Analyze agricultural data related to pest and disease data. This includes obtaining crop damage coefficients by evaluating the data generated by different data transmission nodes. By analyzing the obtained crop damage coefficients, it can be determined which data needs to be transmitted in real time and which can be cached and processed offline, ensuring the effectiveness of data transmission.

[0040] 3. Based on the network topology model and data transmission status, determine the various characteristic paths from the data collection node to the data receiving center node, and obtain the optimal path by monitoring the performance and reliability of the data transmission path, making the data transmission process more efficient and reliable. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 This is a schematic diagram of a data processing system based on the Internet of Things according to an embodiment of the present application. DETAILED DESCRIPTION

[0042] The following is a clear and complete description of the technical solutions in the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0043] like Figure 1 As shown, a data processing system based on the Internet of Things includes a monitoring center, and the monitoring center is communicatively connected with a data acquisition module, a data receiving module, an Internet of Things network topology module and a path transmission module;

[0044] The data acquisition module includes a plurality of data acquisition nodes, which are used to collect crop images of various agricultural areas; convert the crop images into crop data streams, and set data transmission status for each crop data stream;

[0045] The data receiving module is used to receive crop data stream;

[0046] The Internet of Things network topology module identifies and marks all data collection nodes and data receiving center nodes, and performs topology modeling on the Internet of Things network;

[0047] The path transmission module is used to determine the data transmission paths of the crop data streams in the real-time transmission state and the cache transmission state respectively based on the Internet of Things network topology model.

[0048] It should be further explained that, in the specific implementation process, the data collection node is used to collect crop images of each agricultural area; the process of converting the crop images into crop data streams and setting the data transmission state for each crop data stream includes:

[0049] A crop information input unit is provided, wherein the crop information input unit is used to input the photographed crop image, perform data format preprocessing on the input crop image, convert it into a crop data stream and send it to the feature extraction unit;

[0050] A feature extraction unit is provided, wherein the feature extraction unit is used to store reference crop images when crops grow normally, and to copy the input crop data stream, perform data format preprocessing on the copied crop data stream, convert it into a crop image, perform feature extraction on the crop image, generate a feature extraction result, and set importance for the input crop data stream according to the feature extraction result.

[0051] It should be further explained that, in a specific implementation process, the feature extraction unit extracts features from the crop image, generates feature extraction results, and sets importance for the input crop data stream according to the feature extraction results, including:

[0052] Converting the crop image and the reference crop image into grayscale images, comparing each pixel value in the grayscale image of the crop image and the grayscale image of the reference crop image one by one, subtracting pixel values ​​at the same position to obtain difference values, converting the difference values ​​into pixel values ​​of a binary image, and generating a binary image;

[0053] Set a primary pixel threshold, a secondary pixel threshold and two pixel point traversal pointers, and the two pixel point traversal pointers start traversing from the first pixel point and the last pixel point of the binary image area at the same time;

[0054] Mark the pixel point area in the binary image whose pixel value is less than the primary pixel threshold as a normal area;

[0055] Mark the pixel point area in the binary image whose pixel value is greater than or equal to the primary pixel threshold and less than the secondary pixel threshold as the primary damage area;

[0056] Marking the pixel point area in the binary image whose pixel value is greater than or equal to the secondary pixel threshold as the secondary damage area;

[0057] The area of ​​the normal area, the primary damaged area and the secondary damaged area in the binary image are respectively obtained, and the area of ​​each area in the binary image is weighted averaged to obtain the crop damage coefficient. According to the crop damage coefficient, the data transmission state is set for the input crop data stream, and the data transmission state includes real-time transmission state, cache transmission state and offline transmission state.

[0058] It should be further explained that, in a specific implementation process, the process of the data receiving module receiving the crop data stream includes:

[0059] The data receiving module comprises a local data receiving node and a central data receiving node. The local data receiving node is used to receive crop data streams in an offline transmission state, and the central data receiving node is used to receive crop data streams in a real-time transmission state and a cached transmission state.

[0060] It should be further explained that, in the specific implementation process, the Internet of Things network topology module identifies and marks all data collection nodes and data receiving center nodes, and the process of topological modeling of the Internet of Things network includes:

[0061] Acquire location features of the data acquisition node and the data receiving center node, and acquire the communication path and communication connection mode between the data acquisition node and the data receiving center node, wherein the communication connection mode includes wired connection and wireless connection;

[0062] The Internet of Things network topology model is constructed based on the location characteristics, communication paths and communication connection methods of data acquisition nodes and data receiving nodes.

[0063] It should be further explained that, in a specific implementation process, the process in which the path transmission module determines the data transmission path of the crop data stream in real-time transmission state based on the Internet of Things network topology model includes:

[0064] Obtaining the location characteristics of the data collection node where the crop data stream is generated and the state information of the crop data stream;

[0065] When the state information of the crop data stream is in a real-time transmission state, a plurality of communication paths in which the communication connection mode between the data collection node where the crop data stream is located and the data receiving center node in the Internet of Things network topology model is a wired connection are obtained, and data transmission coefficients of the plurality of communication paths are analyzed. According to the data transmission coefficient analysis results, the plurality of communication paths are sorted from low to high according to the data transmission coefficients, and the communication paths with the top five data transmission coefficients are selected as real-time transmission paths;

[0066] The crop data stream is divided into five network slices, and one network slice is allocated to each real-time transmission path. The data receiving center node receives the network slices and fuses them to obtain a complete crop data stream, and feeds back data reception success information to the data collection node through each real-time transmission path;

[0067] Set a data feedback time threshold, and when the data collection node receives the data reception success information fed back by each real-time transmission path within the data feedback time threshold, the real-time transmission path is marked as a normal state;

[0068] When there is a real-time transmission path in which the data collection node has not received feedback of successful data reception within the data feedback time threshold, the data collection node sends the network slice to the data receiving central node for a second time through the real-time transmission path. When the data collection node has not received feedback of successful data reception of the second-sent network slice within the data feedback time threshold, the current real-time transmission path is marked as a full-load operation state, and the sending of network slices to the real-time transmission path is stopped; and a real-time transmission path is reselected from the communication paths other than the top ten communication paths with the data transmission coefficient according to the data transmission coefficient.

[0069] It should be further explained that, in a specific implementation process, the process in which the path transmission module determines the data transmission path of the crop data stream in the cache transmission state based on the Internet of Things network topology model includes:

[0070] When the state information of the crop data stream is a cache transmission state, a real-time transmission path between a data collection node where the crop data stream is located and a data receiving center node in the Internet of Things network topology model and a wireless communication path in which the communication connection mode is a wireless connection are obtained;

[0071] Determine whether the real-time transmission path is in a full-load operation state, and when the real-time transmission path is in a full-load operation state, transmit the crop data stream to the data receiving central node through the wireless communication path;

[0072] When the real-time transmission path is not in full-load operation, the crop data stream is converted into data slices and transmitted to the data receiving central node through the real-time transmission path. When the data receiving central node receives the crop data stream, it feeds back the data receiving success information to the data collection node, and marks the round-trip delay between the data collection node sending the data slice and receiving the corresponding data receiving success information as T. i , and through the formula P i =(T i -T i-1 ) / T i ×100% to obtain the round-trip delay variation, where T i-1 Indicates the round trip delay of the previous data slice;

[0073] Set the change amplitude threshold. If P i If it is greater than or equal to the change amplitude threshold, it means that the current real-time transmission path is close to full load, and the data collection node will slice the data that has not been transmitted through the real-time transmission path through the wireless communication path parameters;

[0074] If P i If the value is less than the change amplitude threshold, it means that the current real-time transmission path is not close to the full load state, and the data acquisition node continues to transmit data slices through the current real-time transmission path.

[0075] It should be further explained that, in a specific implementation process, the path transmission module performs data transmission coefficient analysis on a plurality of communication paths, and the process of obtaining the transmission coefficient of the communication path includes:

[0076] A plurality of communication paths in which the communication connection mode between the data collection node where the crop data flow is located and the data receiving center node in the Internet of Things network topology model is a wired connection are obtained. The data collection node sends a detection network slice to the data receiving center node through the communication path. After the data receiving center node receives the detection network slice, it resends the detection network slice to the data collection node, collects the round-trip delay of the detection network slice, and obtains the transmission coefficient of the communication path according to the round-trip delay.

[0077] The above embodiments are only used to illustrate the technical method of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical method of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical method of the present invention.

Claims

1. A data processing system based on the Internet of Things, including a monitoring center, characterized in that: The monitoring center is communicatively connected with a data acquisition module, a data receiving module, an Internet of Things network topology module and a path transmission module; The data acquisition module includes a plurality of data acquisition nodes, which are used to collect crop images of various agricultural areas; convert the crop images into crop data streams, and set data transmission status for each crop data stream; The data collection nodes collect images of crops in various agricultural areas; The process of converting the crop image into a crop data stream and setting a data transmission state for each crop data stream comprises: A crop information input unit is provided, wherein the crop information input unit is used to input the photographed crop image, perform data format preprocessing on the input crop image, convert it into a crop data stream and send it to the feature extraction unit; A feature extraction unit is provided, wherein the feature extraction unit is used to store a reference crop image when the crop grows normally, and to copy the input crop data stream, perform data format preprocessing on the copied crop data stream, convert it into a crop image, perform feature extraction on the crop image, generate a feature extraction result, and set importance for the input crop data stream according to the feature extraction result; The process of the feature extraction unit extracting features from the crop image, generating feature extraction results, and setting importance for the input crop data stream according to the feature extraction results includes: Converting the crop image and the reference crop image into grayscale images, comparing each pixel value in the grayscale image of the crop image and the grayscale image of the reference crop image one by one, subtracting pixel values ​​at the same position to obtain difference values, converting the difference values ​​into pixel values ​​of a binary image, and generating a binary image; Set a primary pixel threshold, a secondary pixel threshold and two pixel point traversal pointers, and the two pixel point traversal pointers start traversing from the first pixel point and the last pixel point of the binary image area at the same time; Mark the pixel point area in the binary image whose pixel value is less than the primary pixel threshold as a normal area; Mark the pixel point area in the binary image whose pixel value is greater than or equal to the primary pixel threshold and less than the secondary pixel threshold as the primary damage area; Marking the pixel point area in the binary image whose pixel value is greater than or equal to the secondary pixel threshold as the secondary damage area; The area of ​​the normal area, the primary damaged area and the secondary damaged area in the binary image are respectively obtained, and the area of ​​each area in the binary image is weighted averaged to obtain a crop damage coefficient, and a data transmission state is set for the input crop data stream according to the crop damage coefficient, wherein the data transmission state includes a real-time transmission state, a cache transmission state and an offline transmission state; The data receiving module is used to receive crop data streams, and the data receiving module includes a data receiving local node and a data receiving central node. The data receiving local node is used to receive crop data streams in an offline transmission state, and the data receiving central node is used to receive crop data streams in a real-time transmission state and a cached transmission state. The Internet of Things network topology module identifies and marks all data collection nodes and data receiving center nodes, and performs topology modeling on the Internet of Things network; The path transmission module is used to determine the data transmission paths of the crop data streams in the real-time transmission state and the cache transmission state respectively based on the Internet of Things network topology model; The process of determining the data transmission path of the crop data stream in real-time transmission state by the path transmission module based on the Internet of Things network topology model includes: Obtaining the location characteristics of the data collection node where the crop data stream is generated and the state information of the crop data stream; When the state information of the crop data stream is in a real-time transmission state, a plurality of communication paths in which the communication connection mode between the data collection node where the crop data stream is located and the data receiving center node in the Internet of Things network topology model is a wired connection are obtained, and data transmission coefficients of the plurality of communication paths are analyzed. According to the data transmission coefficient analysis results, the plurality of communication paths are sorted from low to high according to the data transmission coefficients, and the communication paths with the top five data transmission coefficients are selected as real-time transmission paths; The crop data stream is divided into five network slices, and one network slice is allocated to each real-time transmission path. The data receiving center node receives the network slices and fuses them to obtain a complete crop data stream, and feeds back data reception success information to the data collection node through each real-time transmission path; Set a data feedback time threshold, and when the data collection node receives the data reception success information fed back by each real-time transmission path within the data feedback time threshold, the real-time transmission path is marked as a normal state; When there is a real-time transmission path where the data collection node has not received feedback of successful data reception within the data feedback time threshold, the data collection node sends the network slice to the data receiving central node for a second time through the real-time transmission path. When the data collection node has not received feedback of successful data reception of the second-sent network slice within the data feedback time threshold, the current real-time transmission path is marked as a full-load operation state, and the sending of network slices to the real-time transmission path is stopped; and a real-time transmission path is reselected from communication paths other than the top ten communication paths with the data transmission coefficient according to the data transmission coefficient; The process of determining the data transmission path of the crop data stream in the cache transmission state based on the Internet of Things network topology model by the path transmission module includes: When the state information of the crop data stream is a cache transmission state, a real-time transmission path between a data collection node where the crop data stream is located and a data receiving center node in the Internet of Things network topology model and a wireless communication path in which the communication connection mode is a wireless connection are obtained; Determine whether the real-time transmission path is in a full-load operation state, and when the real-time transmission path is in a full-load operation state, transmit the crop data stream to the data receiving central node through the wireless communication path; When the real-time transmission path is not in full-load operation, the crop data stream is converted into data slices and transmitted to the data receiving central node through the real-time transmission path. When the data receiving central node receives the crop data stream, it feeds back the data receiving success information to the data collection node, and marks the round-trip delay between the data collection node sending the data slice and receiving the corresponding data receiving success information as T. i , and through the formula P i =(T i -T i-1 ) / T i ×100% to obtain the round-trip delay variation, where T i-1 Indicates the round trip delay of the previous data slice; Set the change amplitude threshold. If P i If it is greater than or equal to the change amplitude threshold, it means that the current real-time transmission path is close to full load, and the data collection node transmits the data slices that are not transmitted through the real-time transmission path through the wireless communication path; If P i If the value is less than the change amplitude threshold, it means that the current real-time transmission path is not close to the full load state, and the data acquisition node continues to transmit data slices through the current real-time transmission path.

2. The data processing system based on the Internet of Things according to claim 1, characterized in that: The Internet of Things network topology module identifies and marks all data collection nodes and data receiving center nodes, and the process of topological modeling of the Internet of Things network includes: Acquire location features of the data acquisition node and the data receiving center node, and acquire the communication path and communication connection mode between the data acquisition node and the data receiving center node, wherein the communication connection mode includes wired connection and wireless connection; The Internet of Things network topology model is constructed based on the location characteristics, communication paths and communication connection methods of data acquisition nodes and data receiving nodes.

3. The data processing system based on the Internet of Things according to claim 2 is characterized in that: The path transmission module performs data transmission coefficient analysis on a plurality of communication paths, and the process of obtaining the transmission coefficient of the communication paths includes: A plurality of communication paths in which the communication connection mode between the data collection node where the crop data flow is located and the data receiving center node in the Internet of Things network topology model is a wired connection are obtained. The data collection node sends a detection network slice to the data receiving center node through the communication path. After the data receiving center node receives the detection network slice, it resends the detection network slice to the data collection node, collects the round-trip delay of the detection network slice, and obtains the transmission coefficient of the communication path according to the round-trip delay.

Images