A method and system for transmitting field data based on the Internet of Things

Abstract

This invention discloses a method and system for field data transmission based on the Internet of Things (IoT), relating to the field of communication technology. Its main purpose is to address the problems of low effectiveness and security in field data transmission. The method primarily includes: a first server sending status query commands to each data acquisition device, the status query commands carrying the expected data transmission time period, data volume, and data target; after the data acquisition device determines that it is in a connected state based on the time period, data volume, and data target, it sends a transmission request to the first server, the transmission request containing a matching first transmission protocol and a transmission key; upon receiving the transmission request, the first server sends a transmission command to a second server using the first transmission protocol; the second server establishes a transmission path with the data acquisition device according to the first transmission protocol and transmission key, and the data acquisition device sends the collected field data to the second server according to the time period, data volume, and data target. This method is mainly used for transmitting field data.

Description

Technical Field

[0001] This invention relates to the field of communication technology, and in particular to a method and system for field data transmission based on the Internet of Things. Background Technology

[0002] With the advent of the big data era, in order to achieve the authenticity of data collection, a large amount of on-site data needs to be transmitted to the processor for data processing, so as to carry out data monitoring and other operations according to the needs of different enterprises.

[0003] Currently, when transmitting field data, the data is typically loaded directly into storage devices and then exported from storage to the processor, or uploaded directly via the internet. However, internet outages significantly impact the effectiveness of field data transmission. Furthermore, loading data into storage devices consumes substantial hardware resources, manpower, and time, and data security cannot be guaranteed. Therefore, there is an urgent need for an IoT-based field data transmission method to address these issues. Summary of the Invention

[0004] In view of this, the present invention provides a field data transmission method and system based on the Internet of Things, the main purpose of which is to address the problem of low effectiveness and security of existing field data transmission.

[0005] According to one aspect of the present invention, a field data transmission method based on the Internet of Things is provided, comprising:

[0006] The first server sends a status query instruction to each data acquisition device. The status query instruction carries the expected time period, data volume, and data target of the data to be transmitted.

[0007] After the acquisition device determines that the connection is established based on the time period, data volume, and data target, it sends a transmission request to the first server. The transmission request includes a matching first transmission protocol and a transmission key.

[0008] When the first server receives the transmission request, it sends a transmission instruction to the second server through the instruction first transmission protocol. The transmission instruction is the first transmission protocol that matches the acquisition device and the transmission key.

[0009] The second server establishes a transmission path with the acquisition device according to the first transmission protocol and the transmission key, and the acquisition device sends the acquired field data to the second server according to the time period, the data volume, and the data target.

[0010] Furthermore, the method also includes:

[0011] After receiving the field data uploaded by the acquisition device through the second server, the second server classifies the data type, data business object, and data sensitivity of the field data to determine the storage type of the field data. The storage type includes local storage, cache storage, and cloud storage.

[0012] When the storage type is determined to be local storage, the second server performs storage clustering processing on the field data and sends the clustered field data to the data warehouse of the corresponding clustering type;

[0013] When the storage type is determined to be cache storage, the second server parses the local cache space and stores the field data into the parsed local cache space according to the device model of the acquisition device;

[0014] When the storage type is determined to be cloud storage, the second server determines the second transmission protocol of the cloud storage space to transmit the field data to the cloud storage space.

[0015] Furthermore, the method also includes:

[0016] The first server obtains the amount of data stored by the second server according to different storage types, and the data target is determined based on the business object identifier;

[0017] The first server sends a data transmission time compatibility request to the third server, wherein the third server is a server in a transmission system that has the same processing function as the first server.

[0018] After the first server receives the time compatibility information from the third server, it determines the time period by combining the data volume, the data target, and the time compatibility information.

[0019] Furthermore, the method also includes:

[0020] After the first server receives the transmission request, it establishes an Internet of Things (IoT) network structure containing the device identifier of the data acquisition device.

[0021] After sending the collected field data to the second server, the first server plots the data flow corresponding to different historical time nodes of the IoT network structure according to the transmission path and generates transmission monitoring information.

[0022] Furthermore, the method also includes:

[0023] The acquisition device obtains the device running time, device acquisition efficiency, and device type, and determines whether the time period, data volume, and data target corresponding to the device running time, device acquisition efficiency, and device type are in a connected state based on the preset device running state mapping relationship. The preset device running state mapping relationship includes the connection state of different device running times, different device acquisition efficiencies, and different device types corresponding to different time periods, different data volumes, and different data targets.

[0024] According to another aspect of the present invention, an Internet of Things (IoT) based field data transmission system is provided, comprising:

[0025] The system comprises a first server, several acquisition devices, and a second server. The first server is communicatively connected to each of the acquisition devices. The first server is also communicatively connected to the second server. The second server is communicatively connected to each of the acquisition devices based on the first transmission protocol and the transmission key.

[0026] The first server is used to send a status query instruction to each acquisition device. The status query instruction carries the expected time period, data volume, and data target of the data to be transmitted. When the transmission request is received, the server sends a transmission instruction to the second server through the instruction first transmission protocol. The transmission instruction is the first transmission protocol matched with the acquisition device and the transmission key.

[0027] The data acquisition device is used to send a transmission request to the first server after determining that the connection status is determined according to the received status query instruction. The transmission request includes a matching first transmission protocol and a transmission key. The data acquisition device is also used to send the acquired field data to the second server according to the time period, the data volume, and the data target.

[0028] The second server is used to establish a transmission path with the acquisition device according to the first transmission protocol and the transmission key.

[0029] Furthermore, the second server is also used to receive the field data uploaded by the acquisition device, classify the data type, data business object, and data sensitivity of the field data, and determine the storage type of the field data, including local storage, cache storage, and cloud storage;

[0030] When the storage type is determined to be local storage, the field data is subjected to storage clustering processing, and the clustered field data is sent to the data warehouse of the corresponding clustering type.

[0031] When the storage type is determined to be cache storage, the local cache space is parsed, and the field data is stored in the parsed local cache space according to the device model of the acquisition device;

[0032] When the storage type is determined to be cloud storage, the second transmission protocol of the cloud storage space is determined to transmit the field data to the cloud storage space.

[0033] Furthermore, the first server is also used to obtain the amount of data stored by the second server according to different storage types, and to determine the data target based on the business object identifier;

[0034] Send a data transmission time compatibility request to a third server, wherein the third server is a server in a transmission system that has the same processing function as the first server;

[0035] After obtaining the time compatibility information fed back by the third server, the time period is determined by combining the data volume, the data target, and the time compatibility information.

[0036] Furthermore, the first server is also configured to establish an Internet of Things (IoT) network structure containing the device identifier of the acquisition device upon receiving the transmission request;

[0037] After the acquisition device sends the acquired field data to the second server, the first server plots the data flow corresponding to different historical time nodes of the IoT network structure according to the transmission path and generates transmission monitoring information.

[0038] Furthermore, the acquisition device is also used to acquire device running time, device acquisition efficiency, and device type, and to determine whether the time period, data volume, and data target corresponding to the device running time, device acquisition efficiency, and device type are in a connected state based on a preset device running state mapping relationship. The preset device running state mapping relationship includes the connected states of different device running times, different device acquisition efficiencies, and different device types corresponding to different time periods, different data volumes, and different data targets.

[0039] By employing the above-described technical solutions, the technical solutions provided by the embodiments of the present invention have at least the following advantages:

[0040] This invention provides a method and system for field data transmission based on the Internet of Things (IoT). Compared with existing technologies, this invention's embodiments involve a first server sending a status query command to each data acquisition device. This status query command carries the expected data transmission time period, data volume, and data target. After the data acquisition device determines a connected state based on the time period, data volume, and data target, it sends a transmission request to the first server. This transmission request includes a matching first transmission protocol and a transmission key. When the first server receives the transmission request, it sends a transmission command to a second server using the first transmission protocol. This transmission command is the first transmission protocol matched to the data acquisition device, along with the transmission key. The second server establishes a transmission path with the data acquisition device according to the first transmission protocol and the transmission key. The data acquisition device then sends the collected field data to the second server according to the time period, data volume, and data target. By isolating the second server from the data acquisition device before determining the field data, the first server further ensures the security of data transmission based on the first transmission protocol and the transmission key. Furthermore, establishing a transmission path between the server and the data acquisition device only after determining a connected state based on the time period, data volume, and data target ensures the effectiveness of field data transmission.

[0041] The above description is merely an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention and to implement it in accordance with the contents of the specification, and in order to make the above and other objects, features and advantages of the present invention more apparent and understandable, specific embodiments of the present invention are described below. Attached Figure Description

[0042] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit the invention. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:

[0043] Figure 1 A flowchart of a field data transmission method based on the Internet of Things provided by an embodiment of the present invention is shown;

[0044] Figure 2 This diagram illustrates a connection relationship of a transmission system according to an embodiment of the present invention.

[0045] Figure 3 A flowchart of another IoT-based field data transmission method provided by an embodiment of the present invention is shown;

[0046] Figure 4 This diagram illustrates a connection relationship between two transmission systems according to an embodiment of the present invention.

[0047] Figure 5a This diagram illustrates an Internet of Things (IoT) network structure according to an embodiment of the present invention.

[0048] Figure 5b This diagram illustrates another Internet of Things (IoT) network structure provided by an embodiment of the present invention.

[0049] Figure 6 This diagram illustrates a block diagram of an IoT-based field data transmission system provided by an embodiment of the present invention. Detailed Implementation

[0050] Exemplary embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0051] This invention provides a field data transmission method based on the Internet of Things (IoT), such as... Figure 1 As shown, the method includes:

[0052] 101. Send status query commands to each data acquisition device through the first server.

[0053] In this embodiment of the invention, the transmission of field data is accomplished based on a first server, a second server, and several acquisition devices, and the connection relationship between the three is as follows: Figure 2 As shown in the diagram. The first server acts as a control server, regulating the data transmission process between the acquisition devices and the second server. The acquisition devices collect field data and send it to the second server. The second server stores the received field data. Before data transmission, the first server queries whether each acquisition device can transmit data under the expected data transmission conditions by sending a status query command. The status query command carries the expected data transmission time period, data volume, and data target. The time period is the specific time range for the expected data transmission, such as 1:00-2:00 or 23:00-24:00. The data volume is the amount of data that the expected transmission capacity and storage capacity of the storage devices can allow. The data target includes the specific content of the data and / or the target storage space for transmission; for example, the specific data content is the pressure data of a gas pipeline, and the target storage space is a gas pipeline monitoring database. The acquisition devices can be sensing devices, such as temperature sensors or pressure sensors, or data monitoring components, such as click volume monitoring components or transaction monitoring components.

[0054] It should be noted that the content carried by the status query command can be determined based on system performance monitoring data of data transmission and pre-defined data mapping relationships. For example, the data transmission volume for different time periods can be calculated based on system performance monitoring, and the time period with the largest data transmission volume can be determined as the time period, and the data transmission volume can be determined as the data volume. Alternatively, it can be based on user settings, such as obtaining the data target and time period input by the user through the data transmission interface. Of course, a combination of automatic system determination and user settings can also be used. For example, the data target can be determined based on user settings, and the event segment and data volume corresponding to the data target can be determined based on system performance monitoring data. This embodiment of the invention does not impose specific limitations.

[0055] 102. After the acquisition device determines that the data is in a connected state based on the time period, data volume, and data target, it sends a transmission request to the first server.

[0056] In this embodiment of the invention, each acquisition device stores its own data transmission attributes, such as the business object of data acquisition, the allowed data transmission time, and the amount of data acquired since the last data transmission. After receiving a status query command, each acquisition device determines the data target corresponding to the data volume in the status query command based on its own data transmission attributes, and whether data transmission is possible within the time period. If yes, it is determined to be in a connected state; otherwise, it is determined to be in a disconnected state. After determining to be in a connected state, the acquisition device sends a transmission request to the first server. The transmission request includes a first transmission protocol and a transmission key matching the current acquisition device, so as to establish a connection with the data receiving server (second server) subsequently.

[0057] It should be noted that querying the status of the acquisition device ensures that it is in a connectable state, preventing invalid data transmission in a disconnected state, thereby reducing the data transmission failure rate and ensuring the effectiveness of data transmission. Furthermore, data transmission based on the first transmission protocol and transmission key sent by the acquisition device further ensures the security of data transmission.

[0058] 103. After the first server receives the transmission request, it sends a transmission instruction to the second server through the instruction first transmission protocol.

[0059] In this embodiment of the invention, when a first server receives a transmission request from a data acquisition device, indicating that the current data acquisition device can transmit data within the expected transmission time period, the first server generates a transmission instruction to be sent to a second server based on the transmission request. This instruction instructs the second server to establish a transmission path with the current data acquisition device. The transmission instruction consists of the first transmission protocol matched with the data acquisition device and the transmission key. The first transmission protocol may include Transmission Control Protocol (TCP), User Datagram Protocol (UDP), Internet Protocol (IP), etc., and this embodiment of the invention does not impose specific limitations.

[0060] It should be noted that before data transmission, the first server confirms the connectivity of the acquisition devices to identify those that meet the expected data transmission time period, data volume, and data target, filtering out those unable to transmit data normally. The first transmission protocol and transmission key matching the acquired device are then sent to the second server. This effectively ensures the validity and security of the transmission path established between the data storage server and the acquisition devices, thus guaranteeing the effectiveness of data transmission. Furthermore, through bidirectional control between the first and second servers, invalid connections between the acquisition devices and the second server can be avoided during non-data transmission periods, achieving isolation between the acquisition devices and the second server, reducing the resource consumption of the second server, and thereby further improving system security while reducing system resource consumption.

[0061] 104. The second server establishes a transmission path with the acquisition device according to the first transmission protocol and the transmission key, and the acquisition device sends the acquired field data to the second server according to the time period, the data volume, and the data target.

[0062] In this embodiment of the invention, the transmission path established between the second server and each acquisition device can be one or more. That is, the acquisition device can send field data to the second server serially through one transmission path, or it can send field data to the second server in parallel through multiple transmission paths. This embodiment of the invention does not make specific limitations. The field data transmission of the acquisition device is based on the time period, data volume, and data target. It can control the time period and data volume of field data transmission, and can also filter the transmitted data content. The time period, data volume, and data target can be configured by the user through an interactive interface. Therefore, through pre-configuration, the optimal time period for data transmission can be selected to balance network transmission traffic; and only the field data that needs to be stored is transmitted to avoid unnecessary resource occupation and consumption. Thus, while ensuring flexible configuration and accurate control of field data transmission, resource occupation and consumption are reduced.

[0063] It should be noted that the above-mentioned on-site data transmission method can be applied to any scenario that requires data collection and transmission. It can be a data monitoring scenario for physical equipment, such as a gas pipeline transportation data monitoring scenario, or a virtual data stream monitoring scenario, such as a platform sales volume data monitoring scenario. This embodiment of the invention does not impose any specific limitations.

[0064] In one embodiment of the present invention, for further illustration and limitation, such as Figure 3 As shown, the method further includes:

[0065] 201. After receiving the field data uploaded by the acquisition device through the second server, the second server classifies the data type, data service object, and data sensitivity of the field data to determine the storage type of the field data.

[0066] 202. When the storage type is determined to be local storage, the second server performs storage clustering processing on the field data and sends the clustered field data to the data warehouse of the corresponding clustering type.

[0067] 203. When the storage type is determined to be cache storage, the second server parses the local cache space and stores the field data into the parsed local cache space according to the device model of the acquisition device.

[0068] 204. When the storage type is determined to be cloud storage, the second server determines the second transmission protocol of the cloud storage space to transmit the field data to the cloud storage space.

[0069] In this embodiment of the invention, after the second server receives the field data, it needs to store the field data. During data storage, the field data needs to be classified according to one or more of the following: data type, data business object, and data sensitivity. Based on the classification results, the appropriate storage type is determined. Storage types include local storage, cache storage, and cloud storage. Data types include numeric, text, character, and Boolean types, etc., which are not specifically limited in this embodiment. The data business object is used to characterize the data source or associated object of the field data. For example, the data business object for gas pipeline pressure data is gas pipeline pressure; the data business object for short video click traffic data is short video click traffic. Data sensitivity characterizes the confidentiality and security requirements of the field data. It can be configured based on the specific content of the field data. For example, for field data containing important information such as ID card information and bank card information, the data sensitivity can be configured to a maximum of 10; for field data containing important equipment monitoring data, the data sensitivity can be configured to 6; and for field data containing log data and general equipment monitoring data, the data sensitivity can be configured to 3.

[0070] When determining the storage type based on one of the following: data type, data business object, or data sensitivity, a pre-defined mapping relationship can be used. For example, a mapping relationship can be pre-established between numeric data types and local storage, and between text data types and cached storage. When the field data is identified as numeric, the storage type can be determined to be local storage. When determining the storage type based on two or three of these factors, a pre-configured many-to-one mapping relationship can be used. For example, if the field data is text data and the data business object is pipeline pressure status, a mapping relationship can be established with cached storage; if the field data is numeric data and the data business object is pressure and temperature data, a mapping relationship can be established with cloud storage. In this case, the storage type is cloud storage only if the field data type is numeric and the data target matches pressure and temperature. Alternatively, a trained storage type classification model can be used to perform classification prediction based on the data type, data business object, and data sensitivity of the field data to determine the storage type. Among them, the storage type classification model is a neural network model, such as a binary tree model. This neural network model is trained based on historical field data samples labeled with different storage types and corresponding to the same data type, data business object and data sensitivity.

[0071] After determining the storage type, if it is local storage, due to the large amount of data in local storage, to further achieve refined data storage and management, the field data needs to be clustered according to a preset clustering type. This classifies the field data into at least one clustering type, and stores the data of different clustering types in the corresponding data warehouse. The clustering type can be based on the business object, the type of acquisition device, or the data acquisition time; this embodiment of the invention does not impose specific limitations. The clustering method can be K-means clustering or density-based distance methods, etc. The data warehouse can be a relational database, such as MySQL, Oracle, MariaDB, etc., or a non-relational database, such as BigTable MongoDB, etc., and can be customized according to the specific data type and storage requirements of the field data; this embodiment of the invention does not impose specific limitations.

[0072] If the storage type is determined to be cache storage, the field data needs to be stored according to the device model of the acquisition device. That is, the local cache space is parsed, the cache space that matches the device model of the acquisition device corresponding to the current field data is determined, and the current field data is stored in that space.

[0073] If the storage type is determined to be cloud storage, it indicates that the field data needs to be uploaded to the cloud via the network. Therefore, it is necessary to determine the second transmission protocol to be sent to the cloud storage space, encrypt the field data to be sent based on this protocol, and transmit the encrypted field data to the cloud storage space to ensure the security of the field data transmission process.

[0074] In one embodiment of the present invention, for further explanation and limitation, the method further includes:

[0075] The first server obtains the amount of data stored by the second server according to different storage types, and the data target is determined based on the business object identifier;

[0076] The first server sends a data transmission time compatibility request to the third server.

[0077] After the first server receives the time compatibility information from the third server, it determines the time period by combining the data volume, the data target, and the time compatibility information.

[0078] In this embodiment of the invention, before sending a status query command to the data acquisition device, the first server needs to query the second server for the amount of data that different storage types of storage space can allow. For example, the remaining available storage space in the cloud is 'a', the remaining available storage space in the local storage is 'b', and the available storage space in the local cache is 'c'. The server then determines the business object that is expected to transmit data based on the business object identifier, and further determines the data target based on the business object. Specifically, this can be determined based on a preset mapping relationship between business objects and data targets. For example, business object A corresponds to temperature and pressure data of a gas pipeline, and business object B corresponds to equipment control commands and equipment operation data. Users can configure and modify the data content and storage space through an interactive interface according to the real-time needs of the business, thereby achieving flexible configuration of the acquired data content and data storage address.

[0079] In this embodiment of the invention, multiple transmission systems can coexist. Different transmission systems are used to transmit field data from different acquisition devices. For example, transmission system 1 is connected to acquisition devices 1-50, and transmission system 2 is connected to acquisition devices 51-100. Each transmission system includes a first server and a second server, and they share storage space. Taking two transmission systems as an example, the connection relationship is as follows: Figure 4 As shown. The third server is a server in another transmission system, equivalent to the function of the first server in the current system; that is, the third server is a server in a transmission system with the same processing capabilities as the first server. Simultaneously, the system containing the third server also includes a fourth server with the same functionality as the second server. Here, the third server is not limited to one; that is, the transmission systems coexisting with the current execution system are not limited to one. Data transmission between different transmission systems can be parallel or serial. For example, when sending data to local storage, multiple systems can perform data transmission in parallel; however, when sending data to cloud storage, considering the network requirements for remote data transmission, multiple transmission systems use a serial method with staggered transmission time periods to achieve data transmission.

[0080] To accurately determine the data transmission status of other transmission systems, the first server sends a data transmission time compatibility request to the third server to obtain the time compatibility information of the transmission system where the third server is located. This time compatibility information includes at least one of the compatible time periods during which the transmission system can perform parallel data transmission with other transmission systems, and the incompatible time periods during which it cannot perform parallel data transmission with other transmission systems. Based on this time compatibility information, the allowed time periods for the second server to perform data transmission can be determined, i.e., the time periods. For example, the compatible time periods obtained from the third server may be multiple time periods such as 12:00 to 1:00, 15:00 to 17:00, 21:00 to 22:00. These time periods can be used as the time periods, or they can be further filtered according to the data target and data volume to determine one or more time periods as the time periods. It should be noted that this description is based on the transmission systems where the first and second servers are located. When other transmission systems are used as the execution subjects, it is also necessary to obtain the time compatibility information of the transmission system where the first server is located to achieve mutual exchange of compatibility information and ensure stable and efficient data transmission.

[0081] In one embodiment of the present invention, for further explanation and limitation, the method further includes:

[0082] After the first server receives the transmission request, it establishes an Internet of Things (IoT) network structure containing the device identifier of the data acquisition device.

[0083] After sending the collected field data to the second server, the first server plots the data flow corresponding to different historical time nodes of the IoT network structure according to the transmission path and generates transmission monitoring information.

[0084] In this embodiment of the invention, since there are many data acquisition devices that need to transmit data on-site, in order to monitor the data transmission process more intuitively, after the first server receives the transmission request sent by the data acquisition device, it confirms that the current data acquisition device is in a connected state and can establish a transmission path. Then, it constructs an IoT network structure based on the device identifier of the data acquisition device. In the IoT network structure, only the data acquisition devices in a connected state can be displayed, as shown in Figure 5(a), or all data acquisition devices can be displayed, and the data acquisition devices in a connected state can be connected to the second server, as shown in Figure 5(b). After the data acquisition device sends the on-site data to the second server, the first server draws the data flow in the constructed IoT network structure according to the data transmission process at different historical time points, in order to generate transmission monitoring information for visualizing the on-site data transmission process. Specifically, different colored lines can be used to draw the transmission paths at different historical time points, or different layers or different sheets of transmission monitoring diagrams can be drawn for different historical time points. The specific implementation can be customized according to specific application requirements, and this embodiment of the invention does not impose specific limitations.

[0085] It should be noted that by constructing an IoT network structure and drawing data flow according to the data transmission path at different time points, the connection status between the acquisition device and the server, as well as the completion time and progress of data transmission, can be intuitively displayed. This can help monitoring personnel to capture the data transmission process more conveniently and efficiently, discover data transmission problems in a timely manner, and thus improve the efficiency of data transmission monitoring.

[0086] In one embodiment of the present invention, for further explanation and limitation, the method further includes: acquiring device running time, device acquisition efficiency, and device type through the acquisition device, and determining whether the time period, data volume, and data target corresponding to the device running time, device acquisition efficiency, and device type are in a connected state based on a preset device running state mapping relationship.

[0087] In this embodiment of the invention, each data acquisition device is configured with corresponding device running time, device acquisition efficiency, and device type. Device running time refers to the time period during which the data acquisition device operates. For example, some data acquisition devices monitor objects that only operate within a fixed time period, meaning they only collect valid data within that fixed time period; other data acquisition devices collect data in stages, i.e., at regular intervals. Device acquisition efficiency is equal to the ratio of the amount of data acquired to the data acquisition time, i.e., the amount of data acquired per unit time. Preferably, the device type is classified according to the content of the acquired data, i.e., based on the corresponding business object. Of course, it can also be classified according to other attributes of the data acquisition device, such as the data type of the acquired data, the storage space corresponding to the data acquisition device, etc., which can be customized according to specific application scenarios. This embodiment of the invention does not impose specific limitations.

[0088] After receiving the data volume, time period, and data target from the first server, it is necessary to determine whether the device is in a connected state based on a preset device operation status mapping relationship. This preset device operation status mapping relationship includes the connection status of different device operating times, different device acquisition efficiencies, and different device types corresponding to different time periods, data volumes, and data targets. If the current acquisition device's device operating time, device acquisition efficiency, device type, and the received data volume, time period, and data target all match the same mapping relationship in the preset device operation status mapping relationship, then the acquisition device is determined to be in a connected state; otherwise, the acquisition device is determined to be in a disconnected state.

[0089] This invention provides a field data transmission method based on the Internet of Things (IoT). Compared with existing technologies, this invention's embodiments involve a first server sending a status query command to each data acquisition device. This status query command carries the expected data transmission time period, data volume, and data target. After the data acquisition device determines a connected state based on the time period, data volume, and data target, it sends a transmission request to the first server. This transmission request includes a matching first transmission protocol and a transmission key. When the first server receives the transmission request, it sends a transmission command to a second server using the first transmission protocol. This transmission command is the first transmission protocol matched to the data acquisition device, along with the transmission key. The second server establishes a transmission path with the data acquisition device according to the first transmission protocol and the transmission key. The data acquisition device then sends the collected field data to the second server according to the time period, data volume, and data target. By isolating the second server from the data acquisition device before determining the field data, the first server further ensures the security of data transmission based on the first transmission protocol and the transmission key. Furthermore, establishing a transmission path between the server and the data acquisition device only after determining a connected state based on the time period, data volume, and data target ensures the effectiveness of field data transmission.

[0090] Furthermore, as a response to the above Figure 1 The implementation of the method shown in this embodiment of the invention provides a field data transmission system based on the Internet of Things, such as... Figure 6 As shown, the system includes: a first server 31, several acquisition devices 32, and a second server 33.

[0091] The first server is communicatively connected to each of the acquisition devices, the first server is communicatively connected to the second server, and the second server is communicatively connected to each of the acquisition devices based on the first transmission protocol and the transmission key.

[0092] The first server is used to send a status query instruction to each acquisition device. The status query instruction carries the expected time period, data volume, and data target of the data to be transmitted. When the transmission request is received, the server sends a transmission instruction to the second server through the instruction first transmission protocol. The transmission instruction is the first transmission protocol matched with the acquisition device and the transmission key.

[0093] The data acquisition device is used to send a transmission request to the first server after determining that the connection status is determined according to the received status query instruction. The transmission request includes a matching first transmission protocol and a transmission key. The data acquisition device is also used to send the acquired field data to the second server according to the time period, the data volume, and the data target.

[0094] The second server 33 is used to establish a transmission path with the acquisition device according to the first transmission protocol and the transmission key.

[0095] Furthermore, the second server 33 is also used to receive the field data uploaded by the acquisition device, classify the data type, data business object, and data sensitivity of the field data, and determine the storage type of the field data, including local storage, cache storage, and cloud storage;

[0096] When the storage type is determined to be local storage, the field data is subjected to storage clustering processing, and the clustered field data is sent to the data warehouse of the corresponding clustering type.

[0097] When the storage type is determined to be cache storage, the local cache space is parsed, and the field data is stored in the parsed local cache space according to the device model of the acquisition device;

[0098] When the storage type is determined to be cloud storage, the second transmission protocol of the cloud storage space is determined to transmit the field data to the cloud storage space.

[0099] Furthermore, the first server 31 is also used to obtain the amount of data stored by the second server according to different storage types, and to determine the data target based on the business object identifier;

[0100] Send a data transmission time compatibility request to a third server, wherein the third server is a server in a transmission system that has the same processing function as the first server;

[0101] After obtaining the time compatibility information fed back by the third server, the time period is determined by combining the data volume, the data target, and the time compatibility information.

[0102] Furthermore, the first server 31 is also configured to establish an Internet of Things network structure containing the device identifier of the acquisition device after receiving the transmission request;

[0103] After the acquisition device sends the acquired field data to the second server, the first server plots the data flow corresponding to different historical time nodes of the IoT network structure according to the transmission path and generates transmission monitoring information.

[0104] Furthermore, the acquisition device 32 is also used to acquire device running time, device acquisition efficiency, and device type, and to determine whether the time period, data volume, and data target corresponding to the device running time, device acquisition efficiency, and device type are in a connected state based on a preset device running state mapping relationship. The preset device running state mapping relationship includes the connected states of different device running times, different device acquisition efficiencies, and different device types corresponding to different time periods, different data volumes, and different data targets.

[0105] This invention provides an IoT-based field data transmission system. Compared with existing technologies, this embodiment sends a status query command to each data acquisition device via a first server. The status query command carries the expected data transmission time period, data volume, and data target. After the data acquisition device determines a connectivity status based on the time period, data volume, and data target, it sends a transmission request to the first server. The transmission request includes a matching first transmission protocol and a transmission key. When the first server receives the transmission request, it sends a transmission command to a second server via the first transmission protocol. The transmission command is the first transmission protocol matched to the data acquisition device and the transmission key. The second server establishes a transmission path with the data acquisition device according to the first transmission protocol and the transmission key. The data acquisition device then sends the collected field data to the second server according to the time period, data volume, and data target. By isolating the second server from the data acquisition device before determining the field data, the first server further ensures the security of data transmission based on the first transmission protocol and the transmission key. Furthermore, establishing a transmission path between the server and the data acquisition device only after determining a connectivity status based on the time period, data volume, and data target ensures the effectiveness of field data transmission.

[0106] It is obvious to those skilled in the art that the modules or steps of the present invention described above can be implemented using general-purpose computing systems. They can be centralized on a single computing system or distributed across a network of multiple computing systems. Optionally, they can be implemented using program code executable by a computing system, thereby storing them in a storage system for execution by the computing system. In some cases, the steps shown or described can be performed in a different order than those presented herein, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any particular combination of hardware and software.

[0107] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A field data transmission method based on the Internet of Things, characterized in that, include: The first server sends a status query instruction to each data acquisition device. The status query instruction carries the expected time period, data volume, and data target of the data to be transmitted. After the acquisition device determines that the connection is established based on the time period, data volume, and data target, it sends a transmission request to the first server. The transmission request includes a matching first transmission protocol and a transmission key. After the first server receives the transmission request, it sends a transmission instruction to the second server through the first transmission protocol. The transmission instruction is the first transmission protocol that matches the acquisition device and the transmission key. The second server establishes a transmission path with the acquisition device according to the first transmission protocol and the transmission key, and the acquisition device sends the acquired field data to the second server according to the time period, the data volume, and the data target.

2. The method according to claim 1, characterized in that, The method further includes: After receiving the field data uploaded by the acquisition device through the second server, the second server classifies the data type, data business object, and data sensitivity of the field data to determine the storage type of the field data. The storage type includes local storage, cache storage, and cloud storage. When the storage type is determined to be local storage, the second server performs storage clustering processing on the field data and sends the clustered field data to the data warehouse of the corresponding clustering type; When the storage type is determined to be cache storage, the second server parses the local cache space and stores the field data into the parsed local cache space according to the device model of the acquisition device; When the storage type is determined to be cloud storage, the second server determines the second transmission protocol of the cloud storage space to transmit the field data to the cloud storage space.

3. The method according to claim 1, characterized in that, The method further includes: The first server obtains the amount of data stored by the second server according to different storage types, and the data target is determined based on the business object identifier; The first server sends a data transmission time compatibility request to the third server, wherein the third server is a server in a transmission system that has the same processing function as the first server. After the first server receives the time compatibility information from the third server, it determines the time period by combining the data volume, the data target, and the time compatibility information.

4. The method according to claim 1, characterized in that, The method further includes: After the first server receives the transmission request, it establishes an Internet of Things (IoT) network structure containing the device identifier of the data acquisition device. After sending the collected field data to the second server, the first server plots the data flow corresponding to different historical time nodes of the IoT network structure according to the transmission path and generates transmission monitoring information.

5. The method according to claim 1, characterized in that, The method further includes: The acquisition device obtains the device running time, device acquisition efficiency, and device type, and determines whether the time period, data volume, and data target corresponding to the device running time, device acquisition efficiency, and device type are in a connected state based on the preset device running state mapping relationship. The preset device running state mapping relationship includes the connection state of different device running times, different device acquisition efficiencies, and different device types corresponding to different time periods, different data volumes, and different data targets.

6. A field data transmission system based on the Internet of Things, characterized in that, include: The system comprises a first server, several acquisition devices, and a second server. The first server is communicatively connected to each of the acquisition devices. The first server is also communicatively connected to the second server. The second server is communicatively connected to each of the acquisition devices based on a first transmission protocol and a transmission key. The first server is used to send a status query instruction to each acquisition device. The status query instruction carries the expected time period, data volume, and data target of the data to be transmitted. When a transmission request is received, the server sends a transmission instruction to the second server through the first transmission protocol. The transmission instruction is the first transmission protocol matched with the acquisition device and the transmission key. The acquisition device is used to send a transmission request to the first server after determining that the status is connected according to the received status query instruction. The transmission request includes a matching first transmission protocol and a transmission key. The data acquisition device sends the collected field data to the second server according to the time period, the data volume, and the data target. The second server is used to establish a transmission path with the acquisition device according to the first transmission protocol and the transmission key.

Images