Data processing method and device, cloud server and edge gateway

Abstract

The invention discloses a data processing method and device, a cloud server and an edge gateway. According to the embodiment, the method comprises the following steps: firstly, acquiring first data through an edge node, and transmitting the first data to an edge gateway; secondly, processing the first data through a first data processing method of the edge gateway to obtain processed second data, and transmitting the second data to a cloud server; processing the second data through the cloud server to obtain a second data processing method, and transmitting the second data processing method to the edge gateway; and finally, enabling the edge gateway to obtain the second data processing method, and updating the first data processing method into the second data processing method. The edge gateway and the cloud server are connected, the data obtained by the edge gateway is processed in the cloud server, the edge gateway data processing method is updated, self-learning and self-repairing of the edge gateway are achieved, reasonable data processing of the edge gateway is achieved, and stable operation of the edge gateway is guaranteed.

Description

Technical Field

[0001] The present invention relates to the field of network technology, and in particular to a data processing method, device, cloud server and edge gateway. Background Art

[0002] At present, the fifth generation of mobile communication technology is being popularized around the world, and the fifth generation of mobile communication technology has a huge driving effect on the development and practice of the Internet of Things, and the application of Internet of Things business is increasing. Large-scale Internet of Things applications face difficulties in business processing with high requirements such as real-time, large data volume, and security. The emergence of edge computing is to solve this problem. Edge computing puts part of the tasks on edge nodes (network edge side devices) and edge gateways for processing, thereby achieving faster service response; if it exceeds the processing capacity of edge nodes and edge gateways, it will be sent to the cloud for processing, and a large amount of data can also be stored in the cloud.

[0003] Therefore, when the edge gateway forwards or processes massive amounts of data, the performance of the edge gateway is particularly important. Therefore, how to achieve self-learning and self-repair of the edge gateway, and then ensure the stability, reliability and efficiency of the edge gateway is an urgent problem to be solved. Summary of the invention

[0004] The present invention provides a data processing method, device, cloud server and edge gateway, so as to update the data processing method of the edge gateway by connecting the edge gateway to the cloud server, thereby realizing self-learning and self-repair of the edge gateway.

[0005] According to one aspect of the present invention, a data processing method is provided, which is applied to a data processing system, wherein the data processing system includes an edge gateway, an edge node, and a cloud server; the edge gateway is connected to the edge node and the cloud server in sequence, and the data processing method includes:

[0006] Collecting first data through the edge node and transmitting the first data to the edge gateway, the first data including one or more different types of data;

[0007] Processing the first data by the first data processing method of the edge gateway to obtain processed second data, and transmitting the second data to the cloud server;

[0008] Processing the second data by the cloud server to obtain a second data processing method, and transmitting the second data processing method to the edge gateway;

[0009] The second data processing method is obtained through the edge gateway, and the first data processing method is updated to the second data processing method.

[0010] According to another aspect of the present invention, there is provided a data processing method, which is applied to a cloud server in a data processing system, and the method comprises:

[0011] Processing the second data to obtain a second data processing method;

[0012] The second data processing method is transmitted to the edge gateway.

[0013] According to another aspect of the present invention, there is provided a data processing method, which is applied to an edge gateway in a data processing system, and the method comprises:

[0014] Processing the first data by a first data processing method to obtain processed second data, and transmitting the second data to a cloud server in the data processing system;

[0015] Obtain a second data processing method determined by the cloud server based on the second data, and update the first data processing method to the second data processing method.

[0016] According to another aspect of the present invention, a cloud server is provided, the cloud server comprising:

[0017] at least one processor; and

[0018] a memory communicatively connected to the at least one processor; wherein,

[0019] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the data processing method applied to the cloud server described in any embodiment of the present invention.

[0020] According to another aspect of the present invention, an edge gateway is provided, the edge gateway comprising:

[0021] at least one processor; and

[0022] a memory communicatively connected to the at least one processor; wherein,

[0023] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the data processing method applied to the edge gateway described in any embodiment of the present invention.

[0024] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the data processing method described in any embodiment of the present invention when executed.

[0025] The technical solution of the embodiment of the present invention is applied to the data processing system. First, the first data is collected through the edge node, and the first data is transmitted to the edge gateway, and the first data includes one or more different types of data; secondly, the first data is processed by the first data processing method of the edge gateway to obtain the processed second data, and the second data is transmitted to the cloud server; then the second data is processed by the cloud server to obtain the second data processing method, and the second data processing method is transmitted to the edge gateway; finally, the edge gateway obtains the second data processing method, and updates the first data processing method to the second data processing method. The present invention connects the edge gateway and the cloud server, and updates the data processing method of the edge gateway by processing the data obtained by the edge gateway in the cloud server, realizes the self-learning and self-repair of the edge gateway, realizes the reasonable processing of data by the edge gateway, and ensures the stable operation of the edge gateway.

[0026] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0028] Figure 1A is a flow chart of a data processing method provided according to Embodiment 1 of the present invention;

[0029] Figure 1B is a schematic diagram of a data processing system provided according to Embodiment 1 of the present invention;

[0030] Figure 2 is a flow chart of a data processing method applied to a cloud server provided according to Embodiment 2 of the present invention;

[0031] Figure 3 is a flow chart of a data processing method applied to an edge gateway provided according to Embodiment 3 of the present invention;

[0032] Figure 4 is a structural diagram of a data processing device configured in a cloud server provided according to a fourth embodiment of the present invention;

[0033] Figure 5is a structural diagram of a data processing device configured in an edge gateway provided according to a fifth embodiment of the present invention;

[0034] Figure 6 This is a block diagram of a cloud processor or edge gateway provided according to Embodiment 6 of the present invention. DETAILED DESCRIPTION

[0035] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0036] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0037] Embodiment 1

[0038] Figure 1AIt is a flowchart of a data processing method provided according to the first embodiment of the present invention. This embodiment is applicable to the case of updating the data processing method. The method can be executed by a data processing device, and the data processing device can be implemented in the form of hardware and / or software. The data processing device can be configured in a data processing system, and the data processing system includes an edge gateway, an edge node and a cloud server. The edge gateway is connected to the edge node and the cloud server in sequence. The edge node is used to collect first data and transmit the first data to the edge gateway. The first data includes one or more different types of data; the edge gateway is used to process the first data by a first data processing method to obtain processed second data, and transmit the second data to the cloud server; the cloud server is used to process the second data to obtain a second data processing method, and transmit the second data processing method to the edge gateway; the edge gateway is also used to obtain the second data processing method, and update the first data processing method to the second data processing method. Figure 1A As shown, the method includes:

[0039] S110. Collect first data through the edge node and transmit the first data to the edge gateway, where the first data includes one or more different types of data.

[0040] In this embodiment, the edge node can be understood as a device placed on the edge of the network in edge computing, which has certain task processing capabilities, and can be a sensor or data acquisition device, etc. Edge computing is a computing model deployed on the edge of the network, close to the data source, including core capabilities such as network, computing, storage and / or applications, and providing processing operations. The edge gateway can forward or further process data from the perception layer or data processed by the edge node device. The first data can be data collected by the edge node. In a data processing system, there can be one or more edge nodes, each used to collect one or more different types of data.

[0041] Specifically, a data processing system is a system that can be used to collect, store, process and analyze data, and can be composed of multiple modules. A data processing system includes one or more edge nodes. One or more different types of data are collected by one or more edge nodes as first data. The first data collected by the edge node is transmitted to the edge gateway.

[0042] For example, Figure 1B Schematic diagram of a data processing system provided according to Embodiment 1 of the present invention. Figure 1BThe data processing system includes six edge nodes, namely, acquisition device 1 to acquisition device 6. The six acquisition devices respectively collect different types of data, use the collected data as first data, and transmit it to the edge gateway.

[0043] S120. Process the first data by using the first data processing method of the edge gateway to obtain processed second data, and transmit the second data to the cloud server.

[0044] In this embodiment, the first data processing method can be understood as a method for processing the first data collected by the edge node, which can be a classification process for the first data. The second data can be understood as data obtained by the first data after the first data processing method is applied in the edge gateway. A cloud server is a technology platform that provides computing resources, data storage, and analysis services through the Internet. A cloud server allows users to access and use these resources on demand without owning and maintaining physical infrastructure.

[0045] Specifically, the data processing system includes an edge gateway, which is a hardware system. The edge gateway can realize the connection with the cloud server and can transmit information to and from the cloud server. The first data processing method can be deployed on the edge gateway. The first data collected by the edge node can be processed by the first data processing method on the edge gateway to obtain the second data. The first data processing method can be to classify the first data. Finally, the determined second data is transmitted to the cloud server.

[0046] For example, Figure 1B , the first data collected by the six edge nodes are transmitted to the edge gateway, and the first data are classified and processed by the first data processing method deployed on the edge gateway to obtain the second data. The second data is transmitted to the cloud server, and a large amount of second data can be stored on the cloud server for use.

[0047] S130. Process the second data through the cloud server to obtain a second data processing method, and transmit the second data processing method to the edge gateway.

[0048] In this embodiment, the second data processing method can be understood as a data processing method determined by performing feature extraction on the second data in the cloud server, and the first data processing method can be updated according to the second data processing method.

[0049] Specifically, the data processing system also includes a cloud server, and the cloud server can realize information transmission between the edge gateway. The second data is transmitted to the cloud server through the edge gateway, and the second data can be feature extracted in the cloud server, and prediction is performed based on the extracted features to obtain the second data processing method. Finally, the second data processing method is transmitted back to the edge gateway.

[0050] For example, Figure 1B , the second data is transmitted to the cloud server, and the cloud server can extract features from the second data through the deep learning model, and then predict the extracted features. For example, a decision or prediction can be made on the extracted features to obtain a second data processing method, which is then transmitted back to the edge gateway.

[0051] S140. Obtain the second data processing method through the edge gateway, and update the first data processing method to the second data processing method.

[0052] Specifically, the second data processing method in the cloud server is transmitted back to the edge gateway, and the second data processing method is a data processing method determined according to the characteristics of the second data. The second data processing method can be considered as the updated first data processing method, which can be used to process the first data.

[0053] The technical solution of the embodiment of the present invention is applied to the data processing system. First, the first data is collected through the edge node, and the first data is transmitted to the edge gateway, and the first data includes one or more different types of data; secondly, the first data is processed by the first data processing method of the edge gateway to obtain the processed second data, and the second data is transmitted to the cloud server; then the second data is processed by the cloud server to obtain the second data processing method, and the second data processing method is transmitted to the edge gateway; finally, the edge gateway obtains the second data processing method, and updates the first data processing method to the second data processing method. The present invention connects the edge gateway and the cloud server, and updates the data processing method of the edge gateway by processing the data obtained by the edge gateway in the cloud server, realizes the self-learning and self-repair of the edge gateway, realizes the reasonable processing of data by the edge gateway, and ensures the stable operation of the edge gateway.

[0054] Based on the above embodiment, a variant embodiment of the above embodiment is proposed. It should be noted that in order to make the description concise, only the differences from the above embodiment are described in the variant embodiment.

[0055] In one embodiment, a management platform is configured in the edge gateway, and the management platform includes a data processing service module. The first data is processed by the first data processing method of the edge gateway to obtain the processed second data, including:

[0056] Classify and process the first data using the data processing method in the data processing service module to obtain classified data;

[0057] The classified data is determined as second data.

[0058] In this embodiment, the management platform can be an open source system for automatically deploying, scaling and managing containerized applications, and can be closely integrated with the cloud server. Mainstream management platforms include open source container orchestration platform Kubernetes, cluster management tools, distributed system kernels and Kubernetes management tools, among which Kubernetes is the most commonly used. The management platform is configured in the edge gateway, and can complete the execution of instructions obtained by the edge gateway, such as completing the specific execution of instructions such as prediction, decision-making or data processing methods issued by the edge gateway from the cloud platform. The management platform includes a data processing service module. The data processing service module can be used to process data according to the data processing method obtained by the edge gateway, and the data processing service module can realize functions such as data processing and policy execution.

[0059] Specifically, a management platform is configured in the edge gateway, and a data processing service module is deployed on the management platform. The data transmitted to the edge gateway can be processed in the data processing service module. The first data input to the edge gateway is classified and processed using the data processing method on the data processing service module. The data processing method at this time is the data processing method obtained based on the last batch of data input to the edge gateway. The classified data is forwarded to the cloud server as the second data.

[0060] For example, Figure 1B , configure a management platform in the edge gateway hardware, and there can be multiple data processing service modules on one management platform. The first data input to the edge gateway is classified and processed using the data processing method on the data processing service module to obtain second data. The edge gateway hardware can also include an operating system to achieve unified management of data. The management platform has a visual interface, through which the data processing method corresponding to the data processing service module can be displayed and configured in a visual manner.

[0061] In one embodiment, the processing of the second data by the cloud server to obtain a second data processing method includes:

[0062] A second data processing method is determined by the cloud server based on the second data and the updated model.

[0063] In this embodiment, the update model can be understood as a model for updating the data processing method in the cloud server. The update model can be a deep learning model composed of several neural network layers and hidden layers. Different learning models can be selected according to specific circumstances and needs, and the corresponding number of layers can be configured to train results that meet the needs. The basis of deep learning is a neural network, which is composed of a large number of nodes (or neurons). These nodes are closely connected between multiple layers. Each layer performs a specific transformation on the input data and passes the result to the next layer. The deep learning model extracts features from the data through multiple such hidden layers, and then automatically learns the characteristics of the data.

[0064] Specifically, an update model is deployed in the cloud server, and the second data transmitted from the edge gateway to the cloud server is input into the update model to extract features corresponding to the second data. The update model can be a deep learning model that can automatically extract features through a large amount of data training. Finally, the second data processing method is determined based on the extracted features, and the second data processing method is transmitted back to the edge gateway, so that the edge gateway can perform data processing according to the second data processing method.

[0065] In one embodiment, determining, by the cloud server, a second data processing method based on the second data and the update model includes:

[0066] Preprocessing the second data by the cloud server to obtain third data;

[0067] The features of the third data are extracted by the updated model, and the second data processing method is predicted based on the features by the updated model.

[0068] In this embodiment, the third data can be understood as data obtained by preprocessing the second data transmitted by the edge gateway in the cloud server, and can be used as input data for updating the model.

[0069] Specifically, in order to obtain input data for the updated model, the second data collected by the edge gateway needs to be preprocessed, such as cleaning and labeling the second data, to obtain third data, and the third data is used as input data for the updated model. The updated model is used to extract features from the third data, and the second data processing method is predicted based on the extracted features. The second data processing method can update the method for classifying the data.

[0070] In one embodiment, the number of the edge node is at least one, different types of edge nodes correspond to different data protocols, and collecting the first data through the edge node includes: collecting the first data of the type corresponding to the data protocol through the data protocol corresponding to the edge node.

[0071] In this embodiment, the data protocols may be different protocols configured for different edge nodes, and different types of data may be collected according to different protocols.

[0072] Specifically, in a data processing system, one or more edge nodes are included, and different data protocols are configured for each edge node, which can be used to collect one or more types of data. For an edge node, data corresponding to the data protocol can be collected according to the data protocol corresponding to the edge node, that is, the first data collected by the edge node can be obtained.

[0073] For example, Figure 1B The data processing system includes six edge nodes, namely, acquisition devices 1 to 6. By configuring different data protocols for acquisition devices 1 to 6, each acquisition device can acquire data according to the corresponding data protocol, and the acquired data of various types are used as the first data.

[0074] Embodiment 2

[0075] Figure 2 1 is a flow chart of a data processing method applied to a cloud server according to Embodiment 2 of the present invention. Figure 2 As shown, the method includes:

[0076] S210: Process the second data to obtain a second data processing method.

[0077] Specifically, the second data in the edge gateway is transmitted to the cloud server, and the update model is deployed in the cloud server. The second data is input into the update model, and features corresponding to the second data are extracted, and a second data processing method is determined according to the extracted features.

[0078] Exemplarily, the second data is transmitted to a cloud server, and the cloud server may extract features of the second data by updating a model, such as a deep learning model, and then predict the extracted features to obtain a second data processing method.

[0079] S220. Transmit the second data processing method to the edge gateway.

[0080] Specifically, the second data processing method is transmitted back to the edge gateway, so that the edge gateway can perform data processing according to the second data processing method.

[0081] The technical solution of the embodiment of the present invention provides a method for processing second data in a cloud server, in which a second data processing method is obtained by processing the second data in the cloud server, and the second data processing method is transmitted to an edge gateway. By learning a large amount of second data in the cloud server, the second data processing method is predicted, thereby improving the efficiency and accuracy of data processing. By dynamically sending the data processing method generated by the cloud server to the edge gateway, the reliability and stability of the edge gateway are guaranteed.

[0082] Embodiment 3

[0083] Figure 3 1 is a flow chart of a data processing method applied to an edge gateway according to Embodiment 3 of the present invention. Figure 3 As shown, the method includes:

[0084] S310: Process the first data using the first data processing method to obtain processed second data, and transmit the second data to the cloud server in the data processing system.

[0085] Specifically, a management platform is configured in the edge gateway, and the first data is processed according to the first data processing method in the data processing service module deployed on the management platform, and the first data can be classified and processed, and the processed data is used as the second data. In a data processing system, information transmission can be achieved between the edge gateway and the cloud server, and the second data can be transmitted to the cloud server for subsequent processing.

[0086] S320: Obtain a second data processing method determined by the cloud server based on the second data, and update the first data processing method to the second data processing method.

[0087] Specifically, the second data processing method obtained by the cloud server according to the second data is transmitted to the edge gateway, and the second data processing method is configured on the data processing service platform of the edge gateway, so as to update the original first data processing method on the data processing service platform to the second data processing method.

[0088] The technical solution of the embodiment of the present invention provides a data processing method applied to an edge gateway. On the one hand, the first data can be processed by the first data processing method in the edge gateway to obtain the processed second data, and the second data is transmitted to the cloud server in the data processing system. On the other hand, the edge gateway can obtain the second data processing method determined by the cloud server based on the second data, and update the first data processing method to the second data processing method. The edge gateway updates its own data processing method by executing the data processing method transmitted by the cloud server, thereby realizing self-learning of the edge gateway and ensuring the stability of the edge gateway.

[0089] Embodiment 4

[0090] Figure 4 1 is a schematic diagram of a data processing device configured in a cloud server according to Embodiment 4 of the present invention. Figure 4 As shown, the device comprises:

[0091] The cloud server processing module 410 is used to process the second data and obtain a second data processing method;

[0092] The transmission module 420 is used to transmit the second data processing method to the edge gateway.

[0093] The data processing device configured in the cloud server provided in the embodiment of the present invention obtains the second data processing method by processing the second data in the cloud server through the cloud server processing module, and transmits the second data processing method to the edge gateway through the transmission module. Through the cooperation between the modules, a large amount of second data is learned in the cloud server, and the second data processing method is predicted, thereby improving the efficiency and accuracy of data processing. By dynamically sending the data processing method generated by the cloud server to the edge gateway, the reliability and stability of the edge gateway are guaranteed.

[0094] In one embodiment, the cloud server processing module 410 includes:

[0095] A determination unit is used to determine a second data processing method based on the second data and the update model through the cloud server.

[0096] In one embodiment, the determining unit is specifically configured to:

[0097] Preprocessing the second data by the cloud server to obtain third data;

[0098] The features of the third data are extracted by the updated model, and the second data processing method is predicted based on the features by the updated model.

[0099] The data processing device configured in the cloud server provided in the embodiment of the present invention can execute the data processing method provided in the second embodiment of the present invention, completes the data processing through the mutual cooperation and collaboration between the modules, and has the functional modules and beneficial effects corresponding to the execution method.

[0100] Embodiment 5

[0101] Figure 5 1 is a schematic diagram of a data processing device configured in an edge gateway according to Embodiment 5 of the present invention. Figure 5 As shown, the device comprises:

[0102] The edge gateway processing module 510 is used to process the first data by using the first data processing method to obtain processed second data, and transmit the second data to the cloud server in the data processing system;

[0103] The updating module 520 is used to obtain the second data processing method determined by the cloud server based on the second data, and update the first data processing method to the second data processing method.

[0104] The data processing device configured in the edge gateway provided in the embodiment of the present invention, on the one hand, processes the first data in the edge gateway through the first data processing method through the edge gateway processing module to obtain the processed second data, and transmits the second data to the cloud server in the data processing system. On the other hand, the second data processing method determined by the cloud server based on the second data is obtained through the update module, and the first data processing method is updated to the second data processing method. Through the cooperation between the modules, the edge gateway executes the data processing method transmitted by the cloud server, updates the data processing method of the edge gateway itself, realizes the self-learning of the edge gateway, and ensures the stability of the edge gateway.

[0105] In one embodiment, a management platform is configured in the edge gateway, and the management platform includes a data processing service module and an edge gateway processing module 510, which is specifically used to:

[0106] Classify and process the first data using the data processing method in the data processing service module to obtain classified data;

[0107] The classified data is determined as second data.

[0108] In one embodiment, the number of the edge node is at least one, different types of edge nodes correspond to different data protocols, and collecting the first data through the edge node includes: collecting the first data of the type corresponding to the data protocol through the data protocol corresponding to the edge node.

[0109] The data processing device configured in the edge gateway provided in the embodiment of the present invention can execute the data processing method provided in the third embodiment of the present invention, completes the data processing through the mutual cooperation and collaboration between the modules, and has the functional modules and beneficial effects corresponding to the execution method.

[0110] Embodiment 6

[0111] According to an embodiment of the present invention, the present invention also provides a cloud server, an edge gateway, a computer-readable storage medium and a computer program product.

[0112] Figure 6 A schematic diagram of the structure of a cloud processor or edge gateway 10 that can be used to implement an embodiment of the present invention is shown. The cloud processor or edge gateway is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The cloud processor or edge gateway can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0113] like Figure 6 As shown, the cloud processor or edge gateway 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In RAM 13, various programs and data required for the operation of the cloud processor or edge gateway 10 can also be stored. The processor 11, ROM 12 and RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0114] Multiple components in the cloud processor or edge gateway 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the cloud processor or edge gateway 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0115] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as a data processing method.

[0116] In some embodiments, the data processing method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the cloud processor or edge gateway 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the data processing method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the data processing method in any other suitable manner (e.g., by means of firmware).

[0117] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0118] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0119] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0120] To provide interaction with a user, the systems and techniques described herein may be implemented on a cloud processor or edge gateway having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which a user can provide input to the cloud processor or edge gateway. Other types of devices may also be used to provide interaction with a user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0121] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0122] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0123] In some embodiments, the computer program product includes a computer program, and when the computer program is executed by a processor, it implements the data processing method provided by the embodiment of the present invention.

[0124] The technical solution of the embodiment of the present invention is applied to a data processing system through a data processing method, device, cloud server and edge gateway. First, the first data is collected through the edge node and transmitted to the edge gateway. The first data includes one or more different types of data; secondly, the first data is processed by the first data processing method of the edge gateway to obtain the processed second data, and the second data is transmitted to the cloud server; then the second data is processed by the cloud server to obtain the second data processing method, and the second data processing method is transmitted to the edge gateway; finally, the edge gateway obtains the second data processing method and updates the first data processing method to the second data processing method. The present invention connects the edge gateway and the cloud server, and updates the data processing method of the edge gateway by processing the data obtained by the edge gateway in the cloud server, realizing the self-learning and self-repair of the edge gateway, realizing the reasonable processing of data by the edge gateway, and ensuring the stable operation of the edge gateway.

[0125] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0126] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A data processing method, applied to a data processing system, wherein the data processing system includes an edge gateway, an edge node and a cloud server; The edge gateway is connected to the edge node and the cloud server in sequence, and the data processing method includes: Collecting first data through the edge node and transmitting the first data to the edge gateway, the first data including one or more different types of data; Processing the first data by the first data processing method of the edge gateway to obtain processed second data, and transmitting the second data to the cloud server; Processing the second data by the cloud server to obtain a second data processing method, and transmitting the second data processing method to the edge gateway; The second data processing method is obtained through the edge gateway, and the first data processing method is updated to the second data processing method.

2. The method according to claim 1, characterized in that The edge gateway is provided with a management platform, the management platform includes a data processing service module, and the first data is processed by the first data processing method of the edge gateway to obtain the processed second data, including: Classify and process the first data using the data processing method in the data processing service module to obtain classified data; The classified data is determined as second data.

3. The method according to claim 1, characterized in that The step of processing the second data by the cloud server to obtain a second data processing method includes: A second data processing method is determined by the cloud server based on the second data and the updated model.

4. The method according to claim 3, characterized in that The determining, by the cloud server, a second data processing method based on the second data and the update model includes: Preprocessing the second data by the cloud server to obtain third data; The features of the third data are extracted by the updated model, and the second data processing method is predicted based on the features by the updated model.

5. The method according to claim 1, characterized in that The number of the edge node is at least one, different types of edge nodes correspond to different data protocols, and collecting the first data through the edge node includes: collecting the first data of the type corresponding to the data protocol through the data protocol corresponding to the edge node.

6. A data processing method, characterized in that: A cloud server applied to a data processing system to which the data processing method according to any one of claims 1 to 5 is applied, the method comprising: Processing the second data to obtain a second data processing method; The second data processing method is transmitted to the edge gateway.

7. A data processing method, characterized in that: An edge gateway applied to a data processing system to which the data processing method according to any one of claims 1 to 5 is applied, the method comprising: Processing the first data by a first data processing method to obtain processed second data, and transmitting the second data to a cloud server in the data processing system; Obtain a second data processing method determined by the cloud server based on the second data, and update the first data processing method to the second data processing method.

8. A cloud server, characterized in that: The cloud server comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the data processing method described in claim 6.

9. An edge gateway, characterized in that: The edge gateway comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the data processing method described in claim 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the data processing method according to any one of claims 6 to 7 when executed.

Images