A data collection method, apparatus, device and medium

Abstract

The application provides a data collection method, device, equipment and medium, relates to the technical field of Internet of Things, and comprises the following steps: acquiring system data and communication protocols respectively related to at least one to-be-collected system; establishing on-site systems corresponding to the at least one to-be-collected system according to the system data and the communication protocols respectively related to the at least one to-be-collected system; and collecting data from the at least one to-be-collected system through the on-site systems corresponding to the at least one to-be-collected system. When data needs to be collected from multiple to-be-collected systems supporting different communication protocols, the on-site systems corresponding to the multiple to-be-collected systems can be established regardless of the communication protocols supported by the multiple to-be-collected systems, the data channel between the on-site systems and the multiple to-be-collected systems is opened, data can be collected from the multiple to-be-collected systems through the on-site systems, and the cost is reduced compared with the mode of collecting data through multiple data collection gateways.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of Internet of Things, and in particular to a data collection method and device, equipment and medium. BACKGROUND

[0002] With the rapid development of industry, the data generated in industrial sites is growing exponentially. How to collect industrial data faster, more accurately and more simply has become a hot topic.

[0003] Currently, data can be collected from programmable logic controllers (PLC) supporting specific communication protocols through a data collection gateway. However, different PLC systems may support different communication protocols, resulting in data generated by multiple PLC systems needing to be collected by multiple data collection gateways, which is costly. SUMMARY

[0004] Therefore, the present application provides a data collection method, device, equipment and medium to solve the problem of high collection cost in the prior art. The technical solution is as follows:

[0005] A data collection method comprises:

[0006] Obtaining system data and communication protocols related to at least one system to be collected, wherein the system data related to a system to be collected refers to data that uniquely describes the system to be collected, the communication protocol related to a system to be collected refers to an existing communication protocol and / or a custom communication protocol that the system to be collected can support, and the system to be collected refers to an edge programmable logic controller (PLC) system that can obtain data to be collected and / or an edge data collection and monitoring (SCADA) system that is communicatively connected to the edge PLC system;

[0007] According to the system data and communication protocols related to at least one system to be collected, establishing at least one local system corresponding to the system to be collected, wherein the local system corresponding to the system to be collected has a data collection channel with the system to be collected, and the data collection channel refers to a channel used when collecting data from the system to be collected;

[0008] Collecting data from at least one system to be collected through at least one local system corresponding to the system to be collected.

[0009] Optionally, collecting data from at least one system to be collected through at least one local system corresponding to the system to be collected comprises:

[0010] acquire at least one original data point file corresponding to each of the at least one to-be-sampled system, wherein the original data point file corresponding to a to-be-sampled system refers to a file describing attribute information of data in the to-be-sampled system;

[0011] determine a sampling mode corresponding to each of the at least one to-be-sampled system according to the original data point file corresponding to each of the at least one to-be-sampled system;

[0012] collect data from the at least one to-be-sampled system by using the in-situ system corresponding to each of the at least one to-be-sampled system and the sampling mode corresponding to each of the at least one to-be-sampled system.

[0013] Optionally, after collecting data from the at least one to-be-sampled system by using the in-situ system corresponding to each of the at least one to-be-sampled system, the method further comprises:

[0014] upload the collected data to a cloud system by using a message queue telemetry transport (MQTT) protocol;

[0015] and / or, pre-process the collected data and upload the pre-processed data to the cloud system by using the MQTT protocol, wherein the pre-processing is used to process the collected data into data meeting user requirements.

[0016] Optionally, after collecting data from the at least one to-be-sampled system by using the in-situ system corresponding to each of the at least one to-be-sampled system, the method further comprises:

[0017] save the collected data to a local database, wherein the local database is used to store data collected within a set time.

[0018] Optionally, the system data comprises one or more of the following data: an IP address and a port number.

[0019] Optionally, the method further comprises:

[0020] monitor a connection state of the in-situ system corresponding to each of the at least one to-be-sampled system and the corresponding to-be-sampled system;

[0021] if the monitored connection state is a disconnection, re-establish a connection with the corresponding to-be-sampled system.

[0022] A data collection device comprises an information acquisition module, a system establishment module and a data collection module.

[0023] An information obtaining module is configured to obtain system data and communication protocols respectively associated with at least one to-be-sampled system, wherein the system data associated with a to-be-sampled system refers to data uniquely describing the to-be-sampled system, the communication protocol associated with a to-be-sampled system refers to an existing communication protocol and / or a self-defined communication protocol that can be supported by the to-be-sampled system, and the to-be-sampled system refers to an edge-side programmable logic control (PLC) system capable of obtaining to-be-sampled data and / or an edge-side data acquisition and monitoring control (SCADA) system in communication connection with the edge-side PLC system;

[0024] A system establishing module is configured to establish, according to the system data and the communication protocols respectively associated with the at least one to-be-sampled system, at least one local system respectively corresponding to the at least one to-be-sampled system, wherein the local system corresponding to a to-be-sampled system has a data acquisition channel with the to-be-sampled system, and the data acquisition channel refers to a channel used when acquiring data from the to-be-sampled system;

[0025] A data acquisition module is configured to acquire data from the at least one to-be-sampled system through the at least one local system respectively corresponding to the at least one to-be-sampled system.

[0026] Optionally, the data acquisition module comprises an original data point file obtaining module, a sampling mode determining module and a sampling mode reference module.

[0027] The original data point file obtaining module is configured to obtain an original data point file respectively corresponding to the at least one to-be-sampled system, wherein the original data point file corresponding to a to-be-sampled system refers to a file describing attribute information of data generated by the to-be-sampled system.

[0028] The sampling mode determining module is configured to determine a sampling mode respectively corresponding to the at least one to-be-sampled system according to the original data point file respectively corresponding to the at least one to-be-sampled system.

[0029] The sampling mode reference module is configured to acquire data from the at least one to-be-sampled system through the at least one local system respectively corresponding to the at least one to-be-sampled system by using the sampling mode respectively corresponding to the at least one to-be-sampled system.

[0030] A data acquisition device comprises a memory and a processor.

[0031] The memory is configured to store a program.

[0032] The processor is configured to execute the program to implement each step of the data acquisition method according to any one of the above.

[0033] A readable storage medium has a computer program stored thereon, and the computer program, when executed by a processor, implements each step of the data acquisition method according to any one of the above.

[0034] According to the technical solution, the data acquisition method provided by the application first acquires system data and communication protocols respectively related to at least one to-be-acquired system, then establishes at least one corresponding on-site system for the at least one to-be-acquired system according to the system data and the communication protocols respectively related to the at least one to-be-acquired system, and finally acquires data from the at least one to-be-acquired system through the at least one corresponding on-site system. When data needs to be acquired from multiple to-be-acquired systems supporting different communication protocols, the application can establish multiple corresponding on-site systems for the multiple to-be-acquired systems, regardless of which communication protocol is supported by the multiple to-be-acquired systems, so as to open a data channel between the on-site systems and the multiple to-be-acquired systems, and enable the on-site systems to acquire data from the multiple to-be-acquired systems, thereby reducing the cost compared with the mode of acquiring data through multiple data acquisition gateways. BRIEF DESCRIPTION OF DRAWINGS

[0035] In order to more clearly illustrate the technical solutions in the embodiments of the application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description only constitute a part of the embodiments of the application, and for those skilled in the art, other drawings can be obtained without creative labor on the basis of the provided drawings.

[0036] Figure 1 The flowchart of the data acquisition method provided by the embodiment of the application;

[0037] Figure 2 The configuration interface of the on-site system provided by the embodiment of the application;

[0038] Figure 3 The related information of the data managed in the local database provided by the embodiment of the application;

[0039] Figure 4 The structural diagram of the data acquisition device provided by the embodiment of the application;

[0040] Figure 5 The hardware structure block diagram of the data acquisition device provided by the embodiment of the application. DETAILED DESCRIPTION

[0041] The technical solutions in the embodiments of the application will be described clearly and completely below with reference to the drawings in the embodiments of the application. Obviously, the described embodiments are only a part of the embodiments of the application, not all the embodiments. Based on the embodiments in the application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the application.

[0042] The application provides a data collection method, and the data collection method provided by the application is described in detail through the following embodiments.

[0043] Please refer to Figure 1 , a flowchart of a data collection method provided by an embodiment of the application is shown, and the data collection method can include:

[0044] In step S101, system data and communication protocols respectively related to at least one to-be-collected system are acquired.

[0045] The system data related to a to-be-collected system refers to data uniquely describing the to-be-collected system, the communication protocols related to a to-be-collected system refer to existing communication protocols and / or custom communication protocols that can be supported by the to-be-collected system, and the to-be-collected system refers to an edge programmable logic control (PLC) system that can obtain to-be-collected data and / or an edge data collection and monitoring control (SCADA) system that is in communication connection with the edge PLC system.

[0046] Specifically, when data needs to be collected from at least one to-be-collected system, the system data and the communication protocols respectively related to the at least one to-be-collected system can be determined first.

[0047] Here, the system data refers to data uniquely describing the to-be-collected system, and the system data related to each to-be-collected system can be used to distinguish each to-be-collected system, for example, the system data can include one or more of the following data: an IP address and a port number of the to-be-collected system.

[0048] Of course, the system data including the IP address and the port number is only an example and does not limit the application.

[0049] The communication protocols refer to communication protocols that can be supported by the to-be-collected system, and in this step, the communication protocols can be existing communication protocols, for example, Modbus-TCP protocols, OPC (OLE for Process Control) UA (Unified architecture) protocols, OPC DA (Data Access) protocols, simple network management protocols (SNMP), etc., or custom communication protocols defined by a user, that is, whether the communication protocols supported by the to-be-collected system are existing communication protocols or custom communication protocols, the embodiment can be successfully executed.

[0050] In step S102, at least one to-be-collected system respectively corresponding to an on-site system is established according to the system data and the communication protocols respectively related to the at least one to-be-collected system.

[0051] Among them, the local system corresponding to the data collection system has a data acquisition channel with the data collection system. The data acquisition channel refers to the channel used when collecting data from the data collection system.

[0052] Specifically, this step can establish a local system corresponding to each data collection system based on the system data and communication protocols related to each data collection system. At the same time as establishing the local system, a data acquisition channel will be established between the local system and the data collection system, so that the local system can collect data from the data collection system through the data acquisition channel.

[0053] This step enables the establishment of a data connection with the system to be collected by building a local system. Entity mappings of the system to be collected can be established under the built local system, achieving unified management of the system and its data points.

[0054] Optional, see Figure 2 This is a schematic diagram of the configuration interface for the local system. This embodiment can provide... Figure 2 The interface shown allows users to configure system data and communication protocols related to the data collection system to establish a corresponding local system. After the user configures the system data and communication protocols in at least one configuration interface, step S101 can obtain system data and communication protocols related to at least one data collection system. Then, at least one local system corresponding to each data collection system can be established through this step.

[0055] Step S103: Collect data from at least one data collection system through the local system corresponding to each data collection system.

[0056] After establishing local systems corresponding to at least one data collection system, this step can initiate the southbound data collection process to collect data from at least one data collection system. Here, the "southbound data collection process" refers to the process of collecting data from the data collection system.

[0057] Optionally, the data collected in this step can be data from smart buildings and / or microgrid distributed energy data and / or operational data of power distribution equipment. Data from smart buildings can include, for example, electricity consumption and temperature data, while microgrid distributed energy data can include, for example, electricity consumption and power data from generator sets, wind turbines, fuel cells, and electric vehicle charging stations.

[0058] The data acquisition method provided in the application first acquires system data and communication protocols respectively related to at least one to-be-acquired system, then establishes on-site systems respectively corresponding to the at least one to-be-acquired system according to the system data and the communication protocols respectively related to the at least one to-be-acquired system, and finally acquires data from the at least one to-be-acquired system through the on-site systems respectively corresponding to the at least one to-be-acquired system. When data needs to be acquired from multiple to-be-acquired systems supporting different communication protocols, the application can establish on-site systems respectively corresponding to the multiple to-be-acquired systems, regardless of which communication protocol is supported by the multiple to-be-acquired systems, so as to open a data channel between the on-site systems and the multiple to-be-acquired systems, and enable data to be acquired from the multiple to-be-acquired systems through the on-site systems, thereby reducing the cost compared with the mode of acquiring data through multiple data acquisition gateways.

[0059] In a possible implementation, the embodiments of the application can be applied to a server corresponding to an Internet of Things platform.

[0060] Optionally, the steps S101-S103 can be implemented through a virtual gateway deployed in advance on the server, that is, the application can acquire the system data and the communication protocols respectively related to the at least one to-be-acquired system through the pre-deployed virtual gateway, establish the on-site systems respectively corresponding to the at least one to-be-acquired system according to the system data and the communication protocols respectively related to the at least one to-be-acquired system, and acquire data from the at least one to-be-acquired system through the on-site systems respectively corresponding to the at least one to-be-acquired system.

[0061] In the process of deploying the virtual gateway on the server, the server initiates a gateway registration instruction request, the cloud system provides a downloadable virtual gateway installation package (also referred to as a southbound deployment program installation package) to the server after receiving the request, the server downloads and saves the virtual gateway installation package to the local, and installs and deploys the local program. An encrypted license corresponding to the current request is generated in the virtual gateway installation package, so as to perform security verification through the license in the deployment process. In the deployment process after the verification, the Mac address of the current server network card is bound and reported to the cloud system, so as to realize safe authorization control management and avoid the case of multiple server deployment.

[0062] Optionally, the virtual gateway can use a message queue to implement the interaction of commands and reported information between the cloud system and each to-be-acquired system.

[0063] The embodiment realizes the above process by designing a virtual gateway. In the deployment of the virtual gateway, the transmission security is realized by the binding of a license and a MAC (Media Access Control) address, ensuring the security of the virtual gateway in the process of collecting data from the to-be-collected system and reporting the collected data to the cloud system.

[0064] Meanwhile, the Internet of Things platform defines a communication protocol for data collection through the virtual gateway, realizing the access of multiple types of industrial equipment, the analysis of multiple industrial communication network protocols, and the conversion of multiple sources of industrial data formats.

[0065] In another optional embodiment, before step S103, it is difficult to determine which data collection mode should be used to collect data, because it is unknown what kind of data is in the at least one to-be-collected system.

[0066] Therefore, the embodiment is proposed to introduce the process of "step S103, collecting data from the at least one to-be-collected system through the on-site system corresponding to the at least one to-be-collected system respectively".

[0067] Specifically, the process of "step S103, collecting data from the at least one to-be-collected system through the on-site system corresponding to the at least one to-be-collected system respectively" includes:

[0068] Step S1031, obtaining an original data point file corresponding to each of the at least one to-be-collected system.

[0069] The original data point file corresponding to a to-be-collected system refers to a file describing the attribute information of the data in the to-be-collected system.

[0070] Step S1032, determining a data collection mode corresponding to each of the at least one to-be-collected system according to the original data point file corresponding to each of the at least one to-be-collected system.

[0071] Optionally, each to-be-collected system can include multiple types of data. In order to distinguish, each type of data can have a point position name. The data collection mode corresponding to a to-be-collected system can include the data collection mode of each type of data included in the to-be-collected system. For example, the data collection mode of a type of data can include information about whether the type of data is collected, the point position name of the type of data, and the collection frequency.

[0072] Step S1033, collecting data from the at least one to-be-collected system through the on-site system corresponding to the at least one to-be-collected system respectively by using the data collection mode corresponding to the at least one to-be-collected system respectively.

[0073] The step can enable each to-be-sensed system corresponding local system to perform sensing according to the corresponding sensing mode.

[0074] Compared with a mode of directly collecting all data in the system without determining the sensing mode, the mode of the embodiment can improve the sensing efficiency, and the collected data is more in line with the user demand.

[0075] In an embodiment of the present application, it is considered that in some scenarios, the collected data needs to be uploaded to a cloud system to support upper-layer business applications to perform data display, analysis and service functions, etc. However, in the prior art, the data reporting channel between the edge-side data collection gateway and the cloud system may not be connected, or the edge-side data collection gateway hardware needs to be deployed and the software needs to be configured to realize the reporting of the collected data to the cloud system.

[0076] However, in the case that the data reporting channel is not connected, the PLC data collected by multiple data collection gateways needs to be manually summarized and then uploaded to the cloud system, which wastes human resources. The deployment and configuration of software and hardware have high investment costs, and the data format reported by most edge-side data collection gateways to the Internet of Things platform cannot be modified. If the communication between the PLC and the edge-side data collection gateway fails, data collection will be missing, which cannot provide effective data support and stability guarantee for industrial applications.

[0077] To solve the above problems, in an optional embodiment, when the collected data needs to be uploaded to the cloud system, at least one local system corresponding to each to-be-sensed system can be automatically connected to the data reporting channel with the cloud system after being newly created in step S102, so that the collected data can be uploaded to the cloud system through the data reporting channel after being collected in step S103.

[0078] Optionally, the collected data can be uploaded to the cloud system by using the Message Queuing Telemetry Transport (MQTT) protocol.

[0079] Optionally, after the data is collected in step S103, the data may need to be preprocessed (for example, summation, averaging, difference, etc.) according to the user demand before being uploaded to the cloud.

[0080] Therefore, the collected data can be preprocessed and uploaded to the cloud system by using the MQTT protocol. Here, the preprocessing is used to process the collected data into data that meets the user demand.

[0081] The embodiment can upload the data collected in the south direction to the cloud system in real time. The embodiment realizes information interaction of edge cloud data collaboration through deployment of defined southward (referring to data collection from the PLC system) and northward (uploading the collected data to the cloud system) protocols, completes data collection of the industrial equipment, and provides more possibilities for data connection and collection.

[0082] In one embodiment below, considering that network abnormity may exist in the process of reporting data, in order to avoid the situation that the collected data cannot be timely reported to the cloud system, resulting in data loss, the embodiment also provides a local database to store the collected data within a set time period. Here, the set time period can be determined according to actual conditions, for example, the set time period can be 3 days or 7 days, etc.

[0083] Based on this, after "step S103, collecting data from at least one to-be-collected system through at least one on-site system corresponding to the to-be-collected system", the data collection method provided by the embodiment can further include: saving the collected data to a local database.

[0084] Referring to Figure 3 , a schematic diagram of related information of data managed in the local database is shown. As Figure 3 shown, the embodiment can manage and store the collected data (the data collected by the embodiment is actually a "data point", so Figure 3 described as "data point") in the local database according to point name, whether to collect, collection frequency, medium, unit, data type, and register start address (i.e., the start storage address of the corresponding data).

[0085] The embodiment can automatically cache the data collected during the abnormal period to the local database under the network abnormal condition, and then automatically upload the data of the abnormal period to the cloud system after the network recovers to normal, thereby ensuring the stability of data collection and avoiding data loss.

[0086] Optionally, the embodiment can start a job capable of traversing the data file storage directory of the southward drive production, and can provide three different modes of real-time data job, offline data transfer job, and offline uploading job. The data is reported to the cloud system through ack. The real-time data job provides real-time data collection, the offline data transfer job provides local data storage during interruption of uploading data to the cloud system, and the offline uploading job provides uploading of offline data cached during interruption to the cloud system.

[0087] In a possible implementation, in the case of abnormal disconnection of the on-site system and the to-be-sampled system, in order to avoid the case that the data cannot be collected, the embodiment can further monitor the connection state of each to-be-sampled system and the corresponding to-be-sampled system, and re-establish the connection with the corresponding to-be-sampled system when the connection state is disconnected.

[0088] Optionally, the embodiment can further monitor the connection state of the cloud system, and re-establish the connection with the cloud system when the connection state is abnormally disconnected.

[0089] Optionally, the above-mentioned information related to abnormal disconnection (for example, the reason for abnormal disconnection) can be recorded in the log, so as to facilitate subsequent viewing.

[0090] In summary of the above embodiments, the data collection method provided by the application has the following advantages:

[0091] Convenience: on-site rapid deployment, cloud simple debugging, and device batch import, compared with the traditional access scheme, the debugging efficiency is improved by at least 10 times.

[0092] Low cost and wide support: distributed deployment architecture, multi-standard protocol support, reduces the work of on-site construction wiring, avoids repeated cost investment, shortens the debugging period, and reduces the cost by 20% to 30%.

[0093] Collection capacity: support for international or industry mainstream standard protocol access, realize data collection of SCADA software or devices on the customer site.

[0094] The embodiment of the application further provides a data collection device, and the data collection device provided by the embodiment of the application is described below. The data collection device described below can be correspondingly referred to the data collection method described above.

[0095] Please refer to Figure 4 , which shows the structure diagram of the data collection device provided by the embodiment of the application. As shown in Figure 4 , the data collection device can include an information acquisition module 401, a system establishment module 402, and a data collection module 403.

[0096] The information acquisition module 401 is configured to acquire system data and communication protocols related to at least one to-be-sampled system respectively, wherein the system data related to a to-be-sampled system refers to data uniquely describing the to-be-sampled system, the communication protocol related to a to-be-sampled system refers to an existing communication protocol and / or a self-defined communication protocol that can be supported by the to-be-sampled system, and the to-be-sampled system refers to an edge programmable logic control (PLC) system that can obtain to-be-collected data and / or an edge data acquisition and monitoring control (SCADA) system that is in communication connection with the edge PLC system.

[0097] The system establishing module 402 is configured to establish at least one to-be-surveyed system respectively corresponding on-site systems according to system data and communication protocols respectively associated with the at least one to-be-surveyed system, wherein the on-site system corresponding to a to-be-surveyed system has a data acquisition channel with the to-be-surveyed system.

[0098] The data acquisition module 403 is configured to acquire data from the at least one to-be-surveyed system through the on-site systems respectively corresponding to the at least one to-be-surveyed system.

[0099] The data acquisition device provided by the present application first acquires system data and communication protocols respectively associated with at least one to-be-surveyed system, then establishes on-site systems respectively corresponding to the at least one to-be-surveyed system according to the system data and the communication protocols respectively associated with the at least one to-be-surveyed system, and finally acquires data from the at least one to-be-surveyed system through the on-site systems respectively corresponding to the at least one to-be-surveyed system. When it is necessary to acquire data from a plurality of to-be-surveyed systems supporting different communication protocols, the present application can establish on-site systems respectively corresponding to the plurality of to-be-surveyed systems regardless of which communication protocol is supported by the plurality of to-be-surveyed systems, thereby opening up data channels between the on-site systems and the plurality of to-be-surveyed systems and enabling data to be acquired from the plurality of to-be-surveyed systems through the on-site systems. Compared with the mode of acquiring data through a plurality of data acquisition gateways, the present application reduces the cost.

[0100] In a possible implementation, the data acquisition module 403 can include an original data point file acquisition module, a surveying mode determination module, and a surveying mode reference module.

[0101] The original data point file acquisition module is configured to acquire original data point files respectively corresponding to the at least one to-be-surveyed system, wherein the original data point file corresponding to a to-be-surveyed system is a file describing attribute information of data generated by the to-be-surveyed system.

[0102] The surveying mode determination module is configured to determine surveying modes respectively corresponding to the at least one to-be-surveyed system according to the original data point files respectively corresponding to the at least one to-be-surveyed system.

[0103] The surveying mode reference module is configured to acquire data from the at least one to-be-surveyed system through the on-site systems respectively corresponding to the at least one to-be-surveyed system by using the surveying modes respectively corresponding to the at least one to-be-surveyed system.

[0104] In a possible implementation, the data acquisition device provided by the embodiment of the present application can further include a first data transmission module and / or a second data transmission module.

[0105] The first data transmission module is configured to upload the collected data to a cloud system by using a Message Queue Telemetry Transport (MQTT) protocol.

[0106] The second data transmission module is configured to pre-process the collected data and upload the pre-processed data to the cloud system by using the MQTT protocol, wherein the pre-processing is configured to process the collected data into data meeting user requirements.

[0107] In a possible implementation, the data collection device provided by the embodiment of the application can further include a data saving module.

[0108] The data saving module is configured to save the collected data to a local database, wherein the local database is configured to store the collected data within a set time.

[0109] In a possible implementation, the system data includes one or more of the following data: an IP address and a port number.

[0110] In a possible implementation, the data collection device provided by the embodiment of the application can further include a state monitoring module and an abnormal reconnection module.

[0111] The state monitoring module is configured to monitor a connection state between each to-be-collected system and a corresponding on-site system.

[0112] The abnormal reconnection module is configured to re-establish a connection with the corresponding to-be-collected system if the monitored connection state is a disconnected state.

[0113] The embodiment of the application further provides a data collection device. Optionally, Figure 5 A hardware structure block diagram of the data collection device is shown, and the hardware structure of the data collection device can include at least one processor 501, at least one communication interface 502, at least one memory 503 and at least one communication bus 504. Figure 5

[0114] In the embodiment of the application, the number of the processor 501, the communication interface 502, the memory 503 and the communication bus 504 is at least one, and the processor 501, the communication interface 502 and the memory 503 complete mutual communication through the communication bus 504.

[0115] The processor 501 can be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the application.

[0116] ​The memory 503 can include a high-speed RAM memory, and can also include a non-volatile memory such as at least one disk memory;

[0117] The memory 503 stores a program, and the processor 501 can call the program stored in the memory 503, and the program is used for:

[0118] Obtaining system data and communication protocols respectively related to at least one to-be-collected system, wherein the system data related to a to-be-collected system refers to data uniquely describing the to-be-collected system, the communication protocol related to a to-be-collected system refers to an existing communication protocol and / or a self-defined communication protocol that can be supported by the to-be-collected system, and the to-be-collected system refers to an edge programmable logic control (PLC) system capable of obtaining to-be-collected data and / or an edge data acquisition and monitoring control (SCADA) system in communication connection with the edge PLC system;

[0119] According to the system data and the communication protocols respectively related to at least one to-be-collected system, at least one to-be-collected system respectively corresponding local system is established, wherein the local system corresponding to a to-be-collected system has a data acquisition channel with the to-be-collected system, and the data acquisition channel refers to a channel used when collecting data from the to-be-collected system;

[0120] Collecting data from at least one to-be-collected system through at least one local system respectively corresponding to the to-be-collected system.

[0121] Optionally, the detailed functions and the extended functions of the program can refer to the description above.

[0122] The embodiment of the application further provides a readable storage medium, and the readable storage medium stores a computer program, and the computer program is executed by a processor to realize the data collection method.

[0123] Optionally, the detailed functions and the extended functions of the program can refer to the description above.

[0124] Finally, it should be noted that, in the specification, relational terms such as first and second and the like can be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0125] The various embodiments in the specification are described with progression in this fashion. Embodiments described in this specification can be combined with other embodiments in this specification in any manner.

[0126] The above description of disclosed embodiments is intended to be illustrative, and not restrictive. Many embodiments will be apparent to those of skill in the art upon reviewing the above description. The scope of the application should, therefore, be determined not with reference to the above description, but instead with reference to the appended claims, along with their full scope of equivalents.

Claims

1. A data acquisition method, characterized by, The system comprises: obtaining system data and communication protocols related to at least one to-be-collected system through a pre-deployed virtual gateway, wherein the system data related to a to-be-collected system refers to data uniquely describing the to-be-collected system, the communication protocols related to a to-be-collected system refer to existing communication protocols and / or self-defined communication protocols that can be supported by the to-be-collected system, and the to-be-collected system refers to an edge programmable logic control (PLC) system capable of obtaining data to be collected and / or an edge data acquisition and monitoring control (SCADA) system in communication connection with the edge PLC system; establishing a corresponding on-site system for each to-be-collected system through the pre-deployed virtual gateway according to the system data and communication protocols related to the at least one to-be-collected system, wherein the corresponding on-site system of a to-be-collected system has a data acquisition channel with the to-be-collected system, and the data acquisition channel refers to a channel used when collecting data from the to-be-collected system; collecting data from the at least one to-be-collected system through the corresponding on-site system of each to-be-collected system, wherein the communication protocol for data collection is defined through the virtual gateway; wherein the collecting data from the at least one to-be-collected system through the corresponding on-site system of each to-be-collected system comprises: obtaining an original data point file corresponding to each to-be-collected system, wherein the original data point file corresponding to a to-be-collected system refers to a file describing attribute information of data in the to-be-collected system; determining a collection mode corresponding to each to-be-collected system according to the original data point file corresponding to the at least one to-be-collected system; collecting data from the at least one to-be-collected system through the corresponding on-site system of each to-be-collected system by using the collection mode corresponding to the at least one to-be-collected system.

2. The data collection method of claim 1, wherein, After the collecting data from the at least one to-be-collected system through the corresponding on-site system of each to-be-collected system, the system further comprises: uploading the collected data to a cloud system by using a message queue telemetry transport (MQTT) protocol; and / or, preprocessing the collected data and uploading the preprocessed data to the cloud system by using the MQTT protocol, wherein the preprocessing is used to process the collected data into data meeting user requirements.

3. The data collection method of claim 2, wherein, After the collecting data from the at least one to-be-collected system through the corresponding on-site system of each to-be-collected system, the system further comprises: saving the collected data to a local database, wherein the local database is used to store data collected within a set time.

4. The data collection method of claim 1, wherein, The system data comprises one or more of the following data: IP address and port number.

5. The data collection method of claim 1, wherein, The system further comprises: listening to the connection state of each corresponding on-site system of a to-be-collected system and the corresponding to-be-collected system; if the connection state is disconnected, re-establishing a connection with the corresponding to-be-collected system.

6. A data acquisition device, characterized by The system comprises: an information acquisition module, a system establishment module, and a data collection module. The information acquisition module is configured to acquire system data and communication protocols respectively related to at least one to-be-sampled system through a pre-deployed virtual gateway, wherein the system data related to a to-be-sampled system refers to data uniquely describing the to-be-sampled system, the communication protocol related to a to-be-sampled system refers to an existing communication protocol and / or a custom communication protocol that can be supported by the to-be-sampled system, and the to-be-sampled system refers to an edge-side programmable logic control (PLC) system capable of obtaining data to be collected and / or an edge-side supervisory control and data acquisition (SCADA) system in communication connection with the edge-side PLC system; The system establishment module is configured to establish a corresponding on-site system for each of the at least one to-be-sampled system according to the system data and the communication protocols respectively related to the at least one to-be-sampled system through the pre-deployed virtual gateway, wherein the on-site system corresponding to a to-be-sampled system has a data collection channel with the to-be-sampled system, and the data collection channel refers to a channel used when collecting data from the to-be-sampled system; The data collection module is configured to collect data from the at least one to-be-sampled system through the on-site system corresponding to each of the at least one to-be-sampled system, wherein a communication protocol for data collection is defined through the virtual gateway; The data collection module includes an original data point file acquisition module, a sampling method determination module, and a sampling method reference module. The original data point file acquisition module is configured to acquire an original data point file corresponding to each of the at least one to-be-sampled system, wherein the original data point file corresponding to a to-be-sampled system refers to a file describing attribute information of data generated by the to-be-sampled system; The sampling method determination module is configured to determine a sampling method corresponding to each of the at least one to-be-sampled system according to the original data point file corresponding to each of the at least one to-be-sampled system; The sampling method reference module is configured to collect data from the at least one to-be-sampled system through the on-site system corresponding to each of the at least one to-be-sampled system by using the sampling method corresponding to each of the at least one to-be-sampled system.

7. A data acquisition device, characterized by The computer program is executed by the processor to implement the steps of the data collection method according to any one of claims 1-5. The computer program is executed by the processor to implement the steps of the data collection method according to any one of claims 1-5. ​ 8. A readable storage medium, having stored thereon a computer program, characterized in that, ​

Images