Field data transmission method and system based on Internet of Things

Abstract

The invention discloses an on-site data transmission method and system based on the Internet of Things, relates to the technical field of communication, and mainly aims to solve the problem that on-site data transmission is low in effectiveness and safety. The method mainly comprises the following steps: sending a state query instruction to each acquisition device through a first server, wherein the state query instruction carries a time period, a data volume and a data target of expected transmission data; after the acquisition equipment is determined to be in a connected state based on the time period, the data volume and the data target, a transmission request is sent to a first server, and the transmission request comprises a matched first transmission protocol and a transmission key; after the first server receives the transmission request, a transmission instruction is sent to a second server through an instruction first transmission protocol; and transmitting the key through the second server according to the first transmission protocol to establish a transmission path with the acquisition equipment, and sending the acquired field data to the second server through the acquisition equipment according to the time period, the data volume and the data target. The method is mainly used for transmitting field data.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to an on-site data transmission method and system based on the Internet of Things. Background Art

[0002] With the advent of the big data era, in order to achieve authentic data collection, a large amount of field data needs to be transmitted to the processor for data processing so as to perform data monitoring and other operations according to the needs of different enterprises.

[0003] At present, when transmitting field data, the field data is usually directly loaded into a storage device and then exported from the storage device to a processor, or the data is directly uploaded through the Internet. However, when the Internet is interrupted, the effectiveness of field data transmission will be greatly affected. In addition, loading data through a storage device consumes a lot of hardware equipment resources, a lot of manpower and time, and cannot ensure data security. Therefore, a field data transmission method based on the Internet of Things is urgently needed to solve the above problems. Summary of the invention

[0004] In view of this, the present invention provides an on-site data transmission method and system based on the Internet of Things, the main purpose of which is to solve the problem of low effectiveness and security of existing on-site data transmission.

[0005] According to one aspect of the present invention, there is provided a field data transmission method based on the Internet of Things, comprising: Sending a status query instruction to each acquisition device through the first server, wherein the status query instruction carries the expected time period, data volume, and data target for data transmission; After the acquisition device determines that the connection state is established based on the time period, data volume, and data target, the acquisition device sends a transmission request to the first server, wherein the transmission request includes a matching first transmission protocol and a transmission key; After receiving the transmission request, the first server sends a transmission instruction to the second server by instructing the first transmission protocol, wherein the transmission instruction is the first transmission protocol matched with the acquisition device and the transmission key; A transmission path is established between the second server and the collection device in accordance with the first transmission protocol and the transmission key, and the collection device sends the collected field data to the second server in accordance with the time period, the data volume, and the data target.

[0006] Furthermore, the method further comprises: After receiving the field data uploaded by the acquisition device through the second server, the second server classifies the data type, data business object, and data sensitivity of the field data, and determines the storage type of the field data, which includes local storage, cache storage, and cloud storage; When it is determined that the storage type is local storage, the second server performs storage clustering processing on the field data, and sends the clustered field data to a data warehouse corresponding to the clustering type; When it is determined that the storage type is cache storage, the second server parses the local cache space and stores the field data in the parsed local cache space according to the device model of the acquisition device; When it is determined that the storage type is cloud storage, the second server determines a second transmission protocol of the cloud storage space to transmit the on-site data to the cloud storage space.

[0007] Furthermore, the method further comprises: Acquiring, through the first server, the amount of data stored by the second server according to different storage types, and determining a data target based on a business object identifier; Sending a data transmission time compatibility request to a third server through the first server, where the third server is a server in the transmission system having the same processing function as the first server; After the first server obtains the time compatibility information fed back by the third server, the first server determines the time period in combination with the data volume, the data target, and the time compatibility information.

[0008] Furthermore, the method further comprises: When the first server receives the transmission request, it establishes an Internet of Things network structure including the device identification of the acquisition device; After sending the collected field data to the second server, the data trends corresponding to different historical time nodes of the Internet of Things network structure are drawn in the first server according to the transmission path, and transmission monitoring information is generated.

[0009] Furthermore, the method further comprises: The device operating time, device acquisition efficiency, and device type are obtained through the acquisition device, and based on the preset device operating status mapping relationship, it is determined whether the time period, data volume, and data target corresponding to the device operating time, device acquisition efficiency, and device type are in a connected state. The preset device operating status mapping relationship includes different device operating times, different device acquisition efficiencies, and different device types corresponding to different time periods, different data volumes, and different data targets. Connectivity status.

[0010] According to another aspect of the present invention, there is provided a field data transmission system based on the Internet of Things, comprising: A first server, several collection devices and a second server, wherein the first server is respectively connected to the collection devices for communication, the first server is connected to the second server for communication, and the second server is connected to the collection devices for communication based on the first transmission protocol and the transmission key; The first server is used to send a status query instruction to each collection device, wherein the status query instruction carries the expected time period, data volume, and data target of the data to be transmitted; after receiving the transmission request, the first server sends a transmission instruction to the second server by instructing the first transmission protocol, wherein the transmission instruction is the first transmission protocol matched with the collection device and the transmission key; The collection device is used to send a transmission request to the first server after determining that the connection state is in accordance with the received status query instruction, wherein the transmission request includes a matching first transmission protocol and a transmission key; and send the collected field data to the second server through the collection device according to the time period, the data volume, and the data target; The second server is used to establish a transmission path with the collection device according to the first transmission protocol and the transmission key.

[0011] Furthermore, the second server is further configured to classify the data type, data business object, and data sensitivity of the field data after receiving the field data uploaded by the acquisition device, and determine the storage type of the field data, wherein the storage type includes local storage, cache storage, and cloud storage; When it is determined that the storage type is local storage, storage clustering processing is performed on the field data, and the clustered field data is sent to a data warehouse corresponding to the clustering type; When it is determined that the storage type is cache storage, the local cache space is parsed, and the field data is stored in the parsed local cache space according to the device model of the acquisition device; When it is determined that the storage type is cloud storage, a second transmission protocol of the cloud storage space is determined to transmit the on-site data to the cloud storage space.

[0012] Furthermore, the first server is further used to obtain the data volume of the second server storing data according to different storage types, and determine the data target based on the business object identifier; Sending a data transmission time compatibility request to a third server, where the third server is a server in the transmission system having the same processing function as the first server; After the time compatibility information fed back by the third server is obtained, the time period is determined in combination with the data volume, the data target, and the time compatibility information.

[0013] Furthermore, the first server is further configured to establish an Internet of Things network structure including a device identification of the acquisition device after receiving the transmission request; After the collection device sends the collected field data to the second server, the data trends corresponding to different historical time nodes of the Internet of Things network structure are drawn in the first server according to the transmission path, and transmission monitoring information is generated.

[0014] Furthermore, the collection device is also used to obtain the device operating time, device collection efficiency, and device type, and determine whether the time period, data volume, and data target corresponding to the device operating time, device collection efficiency, and device type are in a connected state based on a preset device operating status mapping relationship. The preset device operating status mapping relationship includes different device operating times, different device collection efficiencies, and different device types corresponding to different time periods, different data volumes, and different data targets. Connectivity status.

[0015] By means of the above technical solution, the technical solution provided by the embodiment of the present invention has at least the following advantages: The present invention provides a method and system for transmitting data on site based on the Internet of Things. Compared with the prior art, the embodiment of the present invention sends a status query instruction to each collection device through a first server, and the status query instruction carries the time period, data volume, and data target of the expected data transmission; after the collection device determines that it is in a connected state based on the time period, data volume, and data target, a transmission request is sent to the first server, and the transmission request contains a matching first transmission protocol and a transmission key; after the first server receives the transmission request, it sends a transmission instruction to the second server by instructing the first transmission protocol, and the transmission instruction is the first transmission protocol and the transmission key that match the collection device; the second server establishes a transmission path with the collection device according to the first transmission protocol and the transmission key, and the collection device sends the collected field data to the second server according to the time period, the data volume, and the data target, and the first server isolates the second server from the collection device before determining the field data, and during field data transmission, the security of data transmission is further ensured based on the first transmission protocol and the transmission key; at the same time, the transmission path between the server and the collection device is established only after the connection state is determined based on the time period, data volume, and data target, so as to ensure the validity of field data transmission.

[0016] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings: Figure 1 A flow chart of a field data transmission method based on the Internet of Things provided by an embodiment of the present invention is shown; Figure 2 A schematic diagram showing a connection relationship of a transmission system provided by an embodiment of the present invention is shown; Figure 3 A flow chart of another on-site data transmission method based on the Internet of Things provided by an embodiment of the present invention is shown; Figure 4 A schematic diagram showing a connection relationship between two transmission systems provided by an embodiment of the present invention is shown; FIG5 (a) shows a schematic diagram of an Internet of Things network structure provided by an embodiment of the present invention; FIG5( b ) shows another schematic diagram of the structure of an Internet of Things provided by an embodiment of the present invention; Figure 6 A block diagram of the composition of an on-site data transmission system based on the Internet of Things provided by an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0018] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0019] The embodiment of the present invention provides a field data transmission method based on the Internet of Things, such as Figure 1 As shown, the method includes: 101. Send a status query instruction to each acquisition device through the first server.

[0020] In the embodiment of the present invention, the transmission of field data is completed based on the first server, the second server and a plurality of acquisition devices, and the connection relationship between the three is as follows: Figure 2As shown. Among them, the first server is used as a control server to control the data transmission process between the collection device and the second server; the collection device is used to collect field data and send the field data to the second server; the second server is used to store the received field data. Before data transmission, the first server queries whether each collection device can perform data transmission under the expected data transmission conditions by sending a status query instruction through the collection device. The status query instruction carries the expected time period, data volume, and data target for data transmission. Among them, the time period is the specific time range for expected data transmission, for example, 1 o'clock to 2 o'clock, 23 o'clock to 24 o'clock, etc. The data volume is the data transmission volume that can be allowed by the expected transmission capacity and the storage capacity of the storage device. The data target includes the specific content of the data and / or the target storage space for transmission. For example, the specific content of the data is the pressure data of the gas pipeline, and the target storage space for transmission is the gas pipeline monitoring database. Among them, the collection device can be a sensing device, for example, a temperature sensor, a pressure sensor, etc., or a data monitoring component, such as a click volume monitoring component, a transaction monitoring component, etc.

[0021] It should be noted that the content carried by the status query instruction can be determined based on the system performance monitoring data of the data transmission and the pre-set data mapping relationship. For example, the data transmission volume in different time periods is calculated according to the system performance monitoring, and the time period with the largest data transmission volume is determined as the time period, and the data transmission volume is determined as the data volume. It can also be based on the user's settings, for example, obtaining the data target and time period input by the user through the data transmission interface. Of course, it is also possible to adopt a method that combines automatic determination by the system and user settings. For example, the data target is determined based on the user setting, and the event segment and data volume corresponding to the data target are determined based on the system performance monitoring data. The embodiments of the present invention do not make specific limitations.

[0022] 102. After the collection device determines that the state is connected based on the time period, data volume, and data target, it sends a transmission request to the first server.

[0023] In the embodiment of the present invention, each acquisition device stores its own data transmission attributes, such as the business object of data acquisition, the time allowed for data transmission, etc., and also includes the amount of data collected since the last data transmission, etc. After receiving the status query instruction, each acquisition device determines the data target corresponding to the data amount in the status query instruction according to the data transmission attributes of its own device, whether data transmission can be performed within the time period, and if so, it is determined to be a connected state, and if not, it is determined to be a non-connected state. After determining to be a connected state, the acquisition device sends a transmission request to the first server, and the transmission request includes a first transmission protocol and a transmission key that match the current acquisition device, so as to establish a connection with the data receiving server (second server) in the future.

[0024] It should be noted that by querying the status of the collection device, it is possible to ensure that the collection device is in a connected state, avoiding invalid data transmission in a disconnected state, thereby reducing the failure rate of data transmission and ensuring the effectiveness of data transmission. In addition, data transmission based on the first transmission protocol and transmission key sent by the collection device can further ensure the security of data transmission.

[0025] 103. After receiving the transmission request, the first server sends a transmission instruction to the second server by instructing the first transmission protocol.

[0026] In an embodiment of the present invention, the first server receives a transmission request from a collection device, indicating that the current collection device can perform data transmission within the expected transmission time period. Therefore, the first server generates a transmission instruction for issuing to the second server according to the transmission request, which is used to instruct the second server to establish a transmission path with the current collection device. The transmission instruction is the first transmission protocol and the transmission key that match the collection device. Among them, the first transmission protocol may include the transmission control protocol TCP (Transmission Control Protocol), the user datagram protocol UDP (User Datagram Protocol), the Internet protocol (IP), etc., which are not specifically limited in the embodiment of the present invention.

[0027] It should be noted that before data transmission, the connectivity status of the collection device is confirmed by the first server to identify the collection device that meets the expected data transmission time period, data volume and data target, filter out the collection device that cannot perform data transmission normally, and send the first transmission protocol and transmission key matching this collection device to the second server, which can effectively ensure the effectiveness and security of the transmission path established between the data storage server and the collection device, thereby ensuring the effectiveness of data transmission. In addition, through the two-way regulation between the collection device and the second server by the first server, the invalid connection between the collection device and the second server can be avoided during the non-data transmission time period, the isolation between the collection device and the second server can be achieved, and the resource consumption of the second server can be reduced, thereby reducing the resource consumption of the system operation while further improving the security of the system.

[0028] 104. Establish a transmission path with the collection device through the second server according to the first transmission protocol and the transmission key, and send the collected field data to the second server through the collection device according to the time period, the data volume, and the data target.

[0029] In the embodiment of the present invention, the transmission path established between the second server and each acquisition device can be one or more, that is, the acquisition device can send field data to the second server in a serial manner through one transmission path, or can send field data to the second server in a parallel manner through multiple transmission paths, which is not specifically limited in the embodiment of the present invention. The field data transmission of the acquisition device is carried out according to the time period, data volume, and data target, and the time period and data volume of the field data transmission can be controlled, and the content of the transmitted data can also be screened. The time period, data volume, and data target can be configured by the user through the interactive interface. Therefore, the optimal time period can be selected for data transmission through pre-configuration to balance the network transmission traffic; and only the field data that needs to be stored is transmitted to avoid unnecessary resource occupation and consumption, thereby reducing resource occupation and consumption while ensuring flexible configuration and accurate control of field data transmission.

[0030] It should be noted that the above-mentioned on-site data transmission method can be applied to any scenario that requires data collection and data transmission, which can be a data monitoring scenario of a physical device, such as a gas pipeline transportation data monitoring scenario, or a virtual data flow monitoring scenario, such as a platform sales volume data monitoring scenario. The embodiments of the present invention do not make specific limitations.

[0031] In an embodiment of the present invention, for further explanation and limitation, as Figure 3 As shown, the method also includes: 201. After receiving the field data uploaded by the acquisition device through the second server, the second server classifies the data type, data business object, and data sensitivity of the field data to determine the storage type of the field data.

[0032] 202. When it is determined that the storage type is local storage, the second server performs storage clustering processing on the field data, and sends the clustered field data to a data warehouse corresponding to the clustering type.

[0033] 203. When it is determined that the storage type is cache storage, the second server parses the local cache space, and stores the field data in the parsed local cache space according to the device model of the acquisition device.

[0034] 204. When it is determined that the storage type is cloud storage, the second server determines a second transmission protocol of the cloud storage space to transmit the on-site data to the cloud storage space.

[0035] In the embodiment of the present invention, after the second server receives the field data, the field data needs to be stored. In the process of data storage, the field data needs to be classified according to one or more of the data type, data business object, and data sensitivity, and then the storage type is determined according to the classification result. The storage type includes local storage, cache storage, and cloud storage. Among them, the data type includes digital type, text type, character type, Boolean type, etc., which are not specifically limited in the embodiment of the present invention. The data business object is used to characterize the data source or associated object of the field data. For example, the data business object of the gas pipeline pressure data is the gas pipeline pressure; the data business object of the short video click flow data business is the short video click flow. Data sensitivity is used to characterize the confidentiality and security requirements of the field data. It can be photographed according to the content of the specific field data. For example, for field data containing important information such as identity card information and payment bank card information, the data sensitivity can be configured to the highest 10, for field data containing important equipment monitoring data, the data sensitivity can be configured to 6, and for field data containing log data and general equipment monitoring data, the data sensitivity can be configured to 3.

[0036] When confirming the storage type based on one of the data type, data business object, and data sensitivity, it can be determined based on a pre-set mapping relationship. For example, a mapping relationship between a digital data type and local storage, and a mapping relationship between a text data type and cache storage are pre-established. When the classification identifies that the field data is digital, the storage type can be determined to be local storage. When confirming the storage type based on two or three of the data type, data business object, and data sensitivity, it can be determined based on a pre-configured many-to-one mapping relationship. For example, the field data is text data, and the data business object is a mapping relationship between the pipeline pressure state and cache storage, and the field data is digital data, and the data business object is a mapping relationship between pressure and temperature data and cloud storage. Then, only when the data type of the field data is digital and the data target matches the pressure and temperature, the storage type is cloud storage. It is also possible to use a trained storage type classification model to perform classification prediction based on the data type, data business object, and data sensitivity of the field data to determine the storage type. Among them, the storage type classification model is a neural network model, for example, a binary tree model, and this neural network model is trained based on historical field data samples marked with different storage types and corresponding to the same data types, data business objects and data sensitivities.

[0037] After determining the storage type, if the storage type is local storage. Since the amount of data stored locally is large, in order to further realize the refined storage and management of data, it is necessary to cluster the field data according to the preset clustering type, classify the field data into at least one clustering type of data, and store the data of different clustering types in the data warehouse of the corresponding clustering type. Among them, the clustering type can be divided according to the business object, or according to the type of acquisition equipment, or according to the time of data acquisition, which is not specifically limited in the embodiment of the present invention. Among them, the clustering method can be a K-means clustering method, or a density-based distance method, etc. Among them, the data warehouse can be a relational database, such as MySQL, Oracle, MariaDB, etc., or a non-relational database, such as BigTable MongoDB, etc., which can be customized according to the data type and storage requirements of the specific field data, which is not specifically limited in the embodiment of the present invention.

[0038] If the storage type is determined to be cache storage, the field data needs to be stored according to the device model of the acquisition device, that is, the local cache space is parsed, the cache space matching the device model of the acquisition device corresponding to the current field data is determined, and the current field data is stored in the space.

[0039] If the storage type is determined to be cloud storage, indicating that the on-site data needs to be uploaded to the cloud through the network, it is necessary to determine the second transmission protocol expected to be sent to the cloud storage space, so as to encrypt the on-site data to be sent based on this protocol and transmit the encrypted on-site data to the cloud storage space to ensure the security of the on-site data transmission process.

[0040] In an embodiment of the present invention, for further explanation and limitation, the method further includes: Acquiring, through the first server, the amount of data stored by the second server according to different storage types, and determining a data target based on a business object identifier; Sending a data transmission time compatibility request to a third server through the first server; After the first server obtains the time compatibility information fed back by the third server, the first server determines the time period in combination with the data volume, the data target, and the time compatibility information.

[0041] In an embodiment of the present invention, before sending a status query instruction to the acquisition device, the first server needs to query the second server for the amount of data that can be allowed by storage spaces of different storage types, for example, the remaining available storage capacity a of the cloud storage space, the remaining available storage capacity b of the local storage space, and the available storage capacity c of the local cache. The business object that is expected to transmit data is determined based on the business object identifier, and then the data target is determined based on the business object. Specifically, it can be determined based on the preset mapping relationship between the business object and the data target. For example, business object A corresponds to the temperature data and pressure data of the gas pipeline, and business object B corresponds to the device control instructions and device operation data. With the above mapping relationship, the user can configure and modify the data content and storage space through the interactive interface according to the real-time needs of the business, thereby realizing flexible configuration of the collected data content and the data storage address.

[0042] In the embodiment of the present invention, multiple transmission systems can coexist, and different transmission systems are used to transmit field data of different acquisition devices. For example, transmission system No. 1 is connected to acquisition devices No. 1-50, and transmission system No. 2 is connected to acquisition devices No. 51-100. Each transmission system includes a first server and a second server, and they share storage space. Taking two transmission systems as an example, the connection relationship is as follows: Figure 4 As shown. The third server is a server in another transmission system, which is equivalent to the function of the first server in the current system, that is, the third server is a server in the transmission system with the same processing function as the first server. At the same time, the system where the third server is located also includes a fourth server with the same function as the second server. The third server here is not limited to one, that is, the transmission system coexisting with the current execution system is not limited to one. The data transmission process of different transmission systems can be parallel or serial. For example, when sending data to a local storage warehouse, multiple systems can be used for parallel data transmission; but when sending data to a cloud storage space, considering the requirements of remote data transmission on the network, multiple transmission systems use a serial method with staggered transmission time periods to achieve data transmission.

[0043] In order to accurately determine the data transmission situation of other transmission systems, the first server obtains the time compatibility information of the transmission system where the third server is located by sending a data transmission time compatibility request to the third server. This time compatibility information includes at least one of the compatible time period in which the transmission system can perform parallel data transmission with other transmission systems and the incompatible time period in which parallel data transmission cannot be performed with other transmission systems. Based on this time compatibility information, the allowed time period in which the second server can perform data transmission, that is, the time period, can be determined. For example, the compatible time period obtained from the third server is multiple time periods such as 12:00 to 1:00, 15:00 to 17:00, 21:00 to 22:00, etc. The above time periods can be used as time periods, or the above time periods can be further screened according to data targets and data volumes to determine one or more time periods as the time periods. It should be noted that the description here is based on the transmission system where the first server and the second server are located as the execution subject. When other transmission systems are used as the execution subject, it is also necessary to obtain the time compatibility information of the transmission system where the first server is located from the first server to achieve the intercommunication of compatible information and ensure stable and efficient data transmission.

[0044] In an embodiment of the present invention, for further explanation and limitation, the method further includes: When the first server receives the transmission request, it establishes an Internet of Things network structure including the device identification of the acquisition device; After sending the collected field data to the second server, the data trends corresponding to different historical time nodes of the Internet of Things network structure are drawn in the first server according to the transmission path, and transmission monitoring information is generated.

[0045] In the embodiment of the present invention, since there are many acquisition devices that need to perform on-site data transmission, in order to be able to monitor the data transmission process more intuitively. Therefore, after the first server receives the transmission request sent by the acquisition device, it confirms that the current acquisition device is in a connected state, and after the transmission path can be established, the Internet of Things network structure is constructed based on the device identification of the acquisition device. In the Internet of Things network structure, only the acquisition devices in a connected state can be displayed, as shown in Figure 5 (a), or all acquisition devices can be displayed, and the acquisition devices in a connected state are connected to the second server, as shown in Figure 5 (b). After the acquisition device sends the on-site data to the second server, the first server draws the data trend in the constructed Internet of Things network structure according to the data transmission process at different historical time nodes, so as to generate transmission monitoring information for visually presenting the on-site data transmission process. Specifically, the transmission paths of different historical time nodes can be drawn with lines of different colors, and different layers or different transmission monitoring diagrams can be drawn for different historical time nodes. It can be customized according to specific application requirements, and the embodiment of the present invention does not make specific limitations.

[0046] It should be noted that by building an IoT network structure and drawing the data trend according to the data transmission path at different time nodes, the connection status between the acquisition device and the server, as well as the completion time and progress of data transmission can be intuitively displayed, which can assist monitoring personnel to capture the data transmission process more conveniently and efficiently, and discover data transmission problems in a timely manner, thereby improving the efficiency of data transmission monitoring.

[0047] In an embodiment of the present invention, for further explanation and limitation, the method further includes: obtaining the device operating time, device collection efficiency, and device type through the collection device, and determining whether the time period, data volume, and data target corresponding to the device operating time, device collection efficiency, and device type are in a connected state based on a preset device operating status mapping relationship.

[0048] In the embodiment of the present invention, each acquisition device is configured with a corresponding device operating time, device acquisition efficiency, and device type. Among them, the device operating time is the time period in which the acquisition device operates. For example, the monitoring objects corresponding to some acquisition devices only operate within a fixed time period, that is, valid data is only collected within a fixed time period; the data collection of some acquisition devices is staged, that is, a period of time is collected every interval. The device acquisition efficiency is equal to the ratio of the data collection amount of the acquisition device to the data collection time, that is, the data collection amount per unit time. Preferably, the device type is divided according to the content of the data collected by the acquisition device, that is, it is divided based on the corresponding business object. Of course, it can also be divided according to other attributes of the acquisition device, such as the data type of the collected data, the storage space corresponding to the acquisition device, etc., which can be customized according to the specific application scenario, and the embodiment of the present invention does not make specific limitations.

[0049] After receiving the data volume, time period and data target sent by the first server, it is necessary to determine whether it is in a connected state according to the preset device operation status mapping relationship. Among them, the preset device operation status mapping relationship includes different device operation times, different device collection efficiencies, and different device types corresponding to different time periods, different data volumes, and different data targets. If the device operation time, device collection efficiency, device type, and received data volume, time period and data target of the current collection device all match the same mapping relationship in the preset device operation status mapping relationship, then the collection device is determined to be in a connected state, otherwise, the collection device is determined to be in a non-connected state.

[0050] The present invention provides a field data transmission method based on the Internet of Things. Compared with the prior art, in an embodiment of the present invention, a first server sends a status query instruction to each collection device, wherein the status query instruction carries a time period, a data volume, and a data target of expected data transmission; after the collection device determines that the state is connected based on the time period, the data volume, and the data target, a transmission request is sent to the first server, wherein the transmission request contains a matching first transmission protocol and a transmission key; after the first server receives the transmission request, the first server sends a transmission instruction to a second server by instructing the first transmission protocol, wherein the transmission instruction is the first transmission protocol and the transmission key matched with the collection device; the second server establishes a transmission path with the collection device according to the first transmission protocol and the transmission key, and the collection device sends the collected field data to the second server according to the time period, the data volume, and the data target; the first server isolates the second server from the collection device before determining the field data, and during field data transmission, the security of data transmission is further ensured based on the first transmission protocol and the transmission key; at the same time, the transmission path between the server and the collection device is established only after the connection state is determined based on the time period, the data volume, and the data target, so as to ensure the validity of field data transmission.

[0051] Furthermore, as a response to the above Figure 1 The implementation of the method shown in the figure, the embodiment of the present invention provides a field data transmission system based on the Internet of Things, such as Figure 6 As shown, the system includes: A first server 31, several collection devices and a second server 32, wherein the first server is respectively connected to the collection devices for communication, the first server is connected to the second server 33 for communication, and the second server is connected to the collection devices for communication based on the first transmission protocol and the transmission key; The first server 31 is used to send a status query instruction to each acquisition device, wherein the status query instruction carries the expected time period, data volume, and data target of the data to be transmitted; after receiving the transmission request, the first server 31 sends a transmission instruction to the second server by instructing the first transmission protocol, wherein the transmission instruction is the first transmission protocol matched with the acquisition device and the transmission key; The collection device 32 is used to send a transmission request to the first server after determining that the connection state is in accordance with the received state query instruction, wherein the transmission request includes a matching first transmission protocol and a transmission key; and send the collected field data to the second server through the collection device according to the time period, the data volume, and the data target; The second server 33 is used to establish a transmission path with the collection device according to the first transmission protocol and the transmission key.

[0052] Furthermore, the second server 33 is also used to classify the data type, data business object, and data sensitivity of the field data after receiving the field data uploaded by the acquisition device, and determine the storage type of the field data, and the storage type includes local storage, cache storage, and cloud storage; When it is determined that the storage type is local storage, storage clustering processing is performed on the field data, and the clustered field data is sent to a data warehouse corresponding to the clustering type; When it is determined that the storage type is cache storage, the local cache space is parsed, and the field data is stored in the parsed local cache space according to the device model of the acquisition device; When it is determined that the storage type is cloud storage, a second transmission protocol of the cloud storage space is determined to transmit the on-site data to the cloud storage space.

[0053] Furthermore, the first server 31 is further used to obtain the data volume of the second server storing data according to different storage types, and determine the data target based on the business object identifier; Sending a data transmission time compatibility request to a third server, where the third server is a server in the transmission system having the same processing function as the first server; After the time compatibility information fed back by the third server is obtained, the time period is determined in combination with the data volume, the data target, and the time compatibility information.

[0054] Furthermore, the first server 31 is also used to establish an Internet of Things network structure including the device identification of the acquisition device after receiving the transmission request; After the collection device sends the collected field data to the second server, the data trends corresponding to different historical time nodes of the Internet of Things network structure are drawn in the first server according to the transmission path, and transmission monitoring information is generated.

[0055] Furthermore, the acquisition device 32 is also used to obtain the device operating time, device acquisition efficiency, and device type, and determine whether the time period, data volume, and data target corresponding to the device operating time, device acquisition efficiency, and device type are in a connected state based on a preset device operating status mapping relationship. The preset device operating status mapping relationship includes different device operating times, different device acquisition efficiencies, and different device types corresponding to different time periods, different data volumes, and different data targets. Connectivity status.

[0056] The present invention provides a field data transmission system based on the Internet of Things. Compared with the prior art, the embodiment of the present invention sends a status query instruction to each collection device through a first server, and the status query instruction carries the time period, data volume, and data target of the expected data transmission; after the collection device determines that it is in a connected state based on the time period, data volume, and data target, a transmission request is sent to the first server, and the transmission request contains a matching first transmission protocol and a transmission key; when the first server receives the transmission request, it sends a transmission instruction to the second server by instructing the first transmission protocol, and the transmission instruction is the first transmission protocol and the transmission key that match the collection device; the second server establishes a transmission path with the collection device according to the first transmission protocol and the transmission key, and the collection device sends the collected field data to the second server according to the time period, the data volume, and the data target, and the first server isolates the second server from the collection device before determining the field data, and when the field data is transmitted, the security of the data transmission is further ensured based on the first transmission protocol and the transmission key; at the same time, the transmission path between the server and the collection device is established only after the connection state is determined based on the time period, the data volume, and the data target, so as to ensure the validity of the field data transmission.

[0057] Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general computing system, they can be concentrated on a single computing system, or distributed on a network composed of multiple computing systems, and optionally, they can be implemented by a program code executable by a computing system, so that they can be stored in a storage system and executed by the computing system, and in some cases, the steps shown or described can be executed in a different order than here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0058] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A field data transmission method based on the Internet of Things, characterized in that: include: Sending a status query instruction to each acquisition device through the first server, wherein the status query instruction carries the expected time period, data volume, and data target for data transmission; After the acquisition device determines that the connection state is established based on the time period, data volume, and data target, the acquisition device sends a transmission request to the first server, wherein the transmission request includes a matching first transmission protocol and a transmission key; After receiving the transmission request, the first server sends a transmission instruction to the second server by instructing the first transmission protocol, wherein the transmission instruction is the first transmission protocol matched with the acquisition device and the transmission key; A transmission path is established between the second server and the collection device according to the transmission key of the first transmission protocol, and the collected field data is sent to the second server through the collection device according to the time period, the data volume and the data target.

2. The method according to claim 1, characterized in that The method further comprises: After receiving the field data uploaded by the acquisition device through the second server, the second server classifies the data type, data business object, and data sensitivity of the field data, and determines the storage type of the field data, which includes local storage, cache storage, and cloud storage; When it is determined that the storage type is local storage, the second server performs storage clustering processing on the field data, and sends the clustered field data to a data warehouse corresponding to the clustering type; When it is determined that the storage type is cache storage, the second server parses the local cache space and stores the field data in the parsed local cache space according to the device model of the acquisition device; When it is determined that the storage type is cloud storage, the second server determines a second transmission protocol of the cloud storage space to transmit the field protocol to the cloud storage space.

3. The method according to claim 1, characterized in that The method further comprises: Acquiring, through the first server, the amount of data stored by the second server according to different storage types, and determining a data target based on a business object identifier; Sending a data transmission time compatibility request to a third server through the first server, where the third server is a server in the transmission system having the same processing function as the first server; After the first server obtains the time compatibility information fed back by the third server, the first server determines the time period in combination with the data volume, the data target, and the time compatibility information.

4. The method according to claim 1, characterized in that: The method further comprises: When the first server receives the transmission request, it establishes an Internet of Things network structure including the device identification of the acquisition device; After sending the collected field data to the second server, the data trends corresponding to different historical time nodes of the Internet of Things network structure are drawn in the first server according to the transmission path, and transmission monitoring information is generated.

5. The method according to claim 1, characterized in that The method further comprises: The device operating time, device acquisition efficiency, and device type are obtained through the acquisition device, and based on the preset device operating status mapping relationship, it is determined whether the time period, data volume, and data target corresponding to the device operating time, device acquisition efficiency, and device type are in a connected state. The preset device operating status mapping relationship includes different device operating times, different device acquisition efficiencies, and different device types corresponding to different time periods, different data volumes, and different data targets. Connectivity status.

6. A field data transmission system based on the Internet of Things, characterized in that: include: A first server, several collection devices and a second server, wherein the first server is respectively connected to the collection devices for communication, the first server is connected to the second server for communication, and the second server is connected to the collection devices for communication based on the first transmission protocol and the transmission key; The first server is used to send a status query instruction to each collection device, wherein the status query instruction carries the expected time period, data volume, and data target of the data to be transmitted; after receiving the transmission request, the first server sends a transmission instruction to the second server by instructing the first transmission protocol, wherein the transmission instruction is the first transmission protocol matched with the collection device and the transmission key; The acquisition device is used to send a transmission request to the first server after determining that the state is connected according to the received state query instruction, wherein the transmission request includes a matching first transmission protocol and a transmission key; Sending the collected field data to the second server through the collection device according to the time period, the data volume, and the data target; The second server is used to establish a transmission path with the collection device according to the first transmission protocol and the transmission key.

7. A field data transmission system based on the Internet of Things, characterized in that: The second server is further configured to classify the data type, data business object, and data sensitivity of the field data after receiving the field data uploaded by the acquisition device, and determine the storage type of the field data, wherein the storage type includes local storage, cache storage, and cloud storage; When it is determined that the storage type is local storage, performing storage clustering processing on the field data, and sending the clustered field data to a data warehouse corresponding to the clustering type; When it is determined that the storage type is cache storage, the local cache space is parsed, and the field data is stored in the parsed local cache space according to the device model of the acquisition device; When it is determined that the storage type is cloud storage, a second transmission protocol of the cloud storage space is determined to transmit the on-site data to the cloud storage space.

8. A field data transmission system based on the Internet of Things, characterized in that: The first server is further used to obtain the data volume of the second server storing data according to different storage types, and determine the data target based on the business object identifier; Sending a data transmission time compatibility request to a third server, where the third server is a server in the transmission system having the same processing function as the first server; After the time compatibility information fed back by the third server is obtained, the time period is determined in combination with the data volume, the data target, and the time compatibility information.

9. A field data transmission system based on the Internet of Things, characterized in that: The first server is further configured to establish an Internet of Things network structure including a device identification of the acquisition device after receiving the transmission request; After the collection device sends the collected field data to the second server, the data trends corresponding to different historical time nodes of the Internet of Things network structure are drawn in the first server according to the transmission path, and transmission monitoring information is generated.

10. A field data transmission system based on the Internet of Things, characterized in that: The collection device is also used to obtain the device operating time, device collection efficiency, and device type, and determine whether the time period, data volume, and data target corresponding to the device operating time, device collection efficiency, and device type are in a connected state based on a preset device operating status mapping relationship. The preset device operating status mapping relationship includes different device operating times, different device collection efficiencies, and different device types corresponding to different time periods, different data volumes, and different data targets. Connectivity status.

Images