Data processing method and device, equipment, medium and program product

Abstract

The invention provides a data processing method and device, equipment, a medium and a program product. The method comprises the following steps: receiving message data sent by terminal equipment through at least one communication protocol; performing feature extraction on the message data to obtain at least one first feature; matching each first feature with a second feature in a preset feature library to obtain a second feature matched with each first feature; according to communication protocols corresponding to second features matched with the first features, application programs corresponding to the first features are determined, and different application programs are used for processing data transmitted through different types of communication protocols; and for each first feature, acquiring data content related to the first feature in the message data, and sending the data content to an application program corresponding to the first feature, so that the application program processes the data content. According to the edge gateway provided by the invention, the rapid processing of different protocol data can be realized, and the data processing efficiency of the edge gateway is improved.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a data processing method, device, equipment, medium and program product. Background Art

[0002] The edge gateway is a device that connects terminal devices and cloud servers, and plays a vital role in the IoT system. As the middle layer between terminal devices and cloud servers, it is responsible for collecting data from terminal devices, processing and storing it, and sending the processed and packaged data to the cloud server. By connecting to IoT devices, the edge gateway can achieve real-time control and monitoring of IoT devices, and analyze and make decisions on data. At the same time, the edge gateway can also coordinate the communication between terminal devices, thereby achieving effective management and control of the entire IoT environment.

[0003] The characteristics and difficulties of massive access resources for edge computing are mainly reflected in interconnection, interoperability, high reliability and security. For example, in the power sector, facing the actual situation of multiple communication protocols, multiple types of equipment, and high timeliness requirements for access to power grid equipment, edge gateway equipment must first solve the problem of interconnection and interoperability to meet the needs of different types of field equipment for convenient access and rapid cloud access. In related technologies, after receiving data from multiple different protocols, the edge gateway cannot quickly process the data from these different protocols, resulting in low efficiency in multi-protocol data processing. Summary of the invention

[0004] The present application provides a data processing method, device, equipment, medium and program product to solve the defect in the prior art that the edge gateway cannot quickly process different protocol data and improve the processing efficiency of multi-protocol data of the edge gateway.

[0005] The present application provides a data processing method, which is applied to an edge gateway, wherein the edge gateway is communicatively connected with a terminal device, and comprises the following steps: Receiving message data sent by the terminal device through at least one communication protocol; Performing feature extraction on the message data to obtain at least one first feature; Matching each of the first features with a second feature in a preset feature library to obtain a second feature that matches each of the first features, wherein the preset feature library includes a second feature set corresponding to each of a plurality of different types of communication protocols, and the second feature set includes at least one second feature; Determine, according to the communication protocol corresponding to the second feature matching each of the first features, an application corresponding to each of the first features, wherein different applications are used to process data transmitted through different types of communication protocols; For each of the first features, data content related to the first feature is obtained in the message data, and the data content is sent to an application corresponding to the first feature, so that the application processes the data content.

[0006] According to a data processing method provided by the present application, the first features include a target feature, and the target feature is any one of the first features; and determining the application corresponding to each of the first features according to the communication protocol corresponding to the second feature matching each of the first features includes: Determining a target communication protocol corresponding to a second feature matching the target feature, wherein the communication protocols in the preset feature library include the target communication protocol; An application used for processing data transmitted through the target communication protocol is determined as an application corresponding to the target feature.

[0007] According to a data processing method provided by the present application, the preset feature library is obtained in advance through the following steps: Determining all types of communication protocols supported by the edge gateway; Extracting features for each type of communication protocol to obtain a second feature set corresponding to each type of communication protocol; The preset feature library is generated according to all types of communication protocols and each of the second feature sets.

[0008] According to a data processing method provided by the present application, matching each of the first features with a second feature in a preset feature library to obtain a second feature matching each of the first features includes: Determining the similarity between the target feature and each of the second features in the preset feature library; The second feature with the highest similarity is determined as the second feature matching the target feature.

[0009] According to a data processing method provided by the present application, determining the similarity between the target feature and each of the second features in the preset feature library includes: Obtaining a vectorized feature corresponding to the target feature and a vectorized feature corresponding to each of the second features in the preset feature library; The similarity between the vectorized feature corresponding to the target feature and the vectorized features corresponding to each of the second features in the preset feature library is determined by a preset similarity algorithm, wherein the preset similarity algorithm includes any one of the following: cosine similarity, Euclidean distance, and Manhattan distance.

[0010] According to a data processing method provided by the present application, the edge gateway is also in communication connection with a target receiving device; after sending the data content to an application corresponding to the first feature, the method further includes: Obtaining data processed by each of the applications; The processed data is transmitted to the target receiving device according to the data transmission mode negotiated with the target receiving device.

[0011] The present application also provides a data processing device, which is applied to an edge gateway, wherein the edge gateway is communicatively connected with a terminal device, and the data processing device includes the following modules: A receiving module, used to receive message data sent by the terminal device through at least one communication protocol; An extraction module, used to extract features from the message data to obtain at least one first feature; a matching module, configured to match each of the first features with a second feature in a preset feature library to obtain a second feature that matches each of the first features, wherein the preset feature library includes a second feature set corresponding to each of a plurality of different types of communication protocols, and the second feature set includes at least one second feature; a determination module, configured to determine, according to the communication protocol corresponding to the second feature matching each of the first features, an application corresponding to each of the first features, wherein different applications are used to process data transmitted via different types of communication protocols; A sending module is used to obtain data content related to the first feature in the message data for each of the first features, and send the data content to an application corresponding to the first feature so that the application processes the data content.

[0012] The present application also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, a data processing method as described in any one of the above is implemented.

[0013] The present application also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, a data processing method as described in any one of the above is implemented.

[0014] The present application also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements a data processing method as described in any one of the above.

[0015] The present application provides a data processing method, device, equipment, medium and program product. In the implementation of the method of the present application, after receiving the message data sent by the terminal device through at least one communication protocol, the edge gateway first extracts the features of the message data to obtain at least one first feature; then, each of the first features is matched with the second feature in the preset feature library to obtain the second feature matching each of the first features; then, according to the communication protocol corresponding to the second feature matching each of the first features, the application corresponding to each of the first features is determined, and different applications are used to process data transmitted through different types of communication protocols; finally, for each of the first features, the data content related to the first feature is obtained in the message data, and the data content is sent to the application corresponding to the first feature, so that the application processes the data content. In the present application, the edge gateway realizes the automatic matching of different protocol data in the message data with the application for processing the corresponding protocol data by extracting the key features in the message data, and different applications can process the data at the same time after receiving the distributed data, so that the edge gateway of the present application can realize the rapid processing of different protocol data after receiving data of multiple different protocols, overcoming the problem of low efficiency of multi-protocol data processing in the related art. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the present application or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0017] Figure 1 is a flow chart of a data processing method shown in one embodiment of the present application; Figure 2 It is a schematic diagram of the structure of a preset feature library shown in an embodiment of the present application; Figure 3 is a structural block diagram of a data processing device shown in an embodiment of the present application; Figure 4 It is a schematic diagram of the physical structure of an electronic device shown in an embodiment of the present application. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in this application will be clearly and completely described below in conjunction with the drawings in this application. Obviously, the described embodiments are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0019] Combine the following Figure 1-Figure 2 A data processing method of the present application is described.

[0020] The data processing method provided by the present application is executed by an edge gateway or a data processing device. The data processing method of the present application will be described in detail below by taking the edge gateway as an example.

[0021] Figure 1 1 is a flow chart of a data processing method according to an embodiment of the present application. Figure 1 , the method of the present application comprises the following steps: Step 101: Receive message data sent by a terminal device via at least one communication protocol.

[0022] In this embodiment, the terminal device may be an IoT device or other types of devices. The number of terminal devices may be one or more. The terminal device may be located in a variety of different application scenarios, such as a power station, a substation, etc. in a power system.

[0023] An edge gateway is a gateway deployed at the edge of the network. It is a network middleware that connects IoT devices with cloud servers. It is mainly used in IoT systems such as smart cities, smart factories, and smart homes.

[0024] In this embodiment, the edge gateway obtains message data sent by various terminal devices through the internal communication interface layer.

[0025] Among them, the communication interface layer of the edge gateway includes a variety of communication technologies, including but not limited to Ethernet, RS-485 (Recommended Standard 485, a half-duplex, asynchronous, serial communication protocol), Wi-Fi (Wireless Fidelity, a wireless LAN technology based on the IEEE 802.11 standard), 4G (fourth-generation mobile communication technology), Bluetooth (a short-range wireless communication technology) and other communication technologies. Therefore, the edge gateway has the ability to communicate with different types of terminal devices and networks.

[0026] In step 101, the edge gateway can support a variety of different communication protocols, so that the terminal device can use any of these communication protocols to transmit message data to the edge gateway. These communication protocols include but are not limited to: substation communication network and system, power system automation communication standard protocol, Modbus Ethernet protocol and Modbus serial communication protocol.

[0027] Among them, the substation communication network and system (IEC-61850, also known as the International Electrotechnical Commission 61850 standard) is a set of global standards for power automation developed by the International Electrotechnical Commission, mainly for the communication network and system in the substation automation system. It is based on an object-oriented data model, aims to achieve seamless interoperability between various devices, and covers multiple aspects such as device model, communication model, service model, etc.

[0028] The power system automation communication standard protocol (IEC-104, also known as the International Electrotechnical Commission 104 protocol) is a standard protocol for power system automation communication. It is based on the TCP / IP network layer and is used for data exchange between telecontrol equipment and the control center. The protocol supports real-time data transmission and reliable communication.

[0029] Modbus TCP is a variant of Modbus protocol that uses TCP / IP protocol for data transmission. It enables Modbus protocol to run over Ethernet network, allowing devices to exchange data over IP network. Modbus TCP is commonly used in industrial environments to connect control systems and field devices.

[0030] Modbus RTU (Modbus Remote Terminal Unit) is an open communication protocol mainly based on serial links (such as RS232C or RS485). It supports use in TCP or UDP mode, with a simple, compact frame format and easy-to-understand communication rules. Modbus RTU is mainly used in the field of industrial automation and supports a variety of electrical interfaces and transmission media.

[0031] Of course, in actual implementation, different edge gateways can support different types of communication protocols. Therefore, the type of communication protocol supported by the edge gateway in this application can also be set according to actual needs.

[0032] Step 102: extract features from the message data to obtain at least one first feature.

[0033] In this embodiment, feature extraction is performed on the message data. For example, features such as the destination MAC, service port, frame header, APDU, ASDU, etc. of the message data can be extracted. All key features in the message data can also be extracted. One key feature is a first feature, and multiple first features are finally obtained.

[0034] Among them, the MAC (Media Access Control) address, also known as the physical address, hardware address or link address, is used to define the location of a network device. The destination MAC refers to the MAC address of the target device to which the message data is to be sent. By identifying the destination MAC address of the message data, the edge gateway can determine the target receiving device of the message data, thereby performing routing forwarding or processing.

[0035] The service port is a logical address in network communication, which is used to distinguish different network services or applications. The edge gateway can identify the protocol or service to which the message data belongs by analyzing the service port of the parsed message data, and then perform corresponding processing.

[0036] The frame header is the starting part of the data frame, which contains some key information of the data frame, such as frame length, frame type, source address and destination address, etc. The edge gateway can obtain the basic information of the data frame by analyzing the frame header of the parsed message data, so as to perform operations such as data frame identification, verification and routing forwarding.

[0037] APDU (Application Protocol Data Unit) is an application protocol data unit that encapsulates data and information at the application layer and is used for data transmission and exchange at the application layer. In industrial automation and remote monitoring systems, APDU is often used to encapsulate application layer information such as sensor data and control commands. By analyzing the APDU of the parsed message data, the edge gateway can obtain data and information at the application layer, thereby performing operations such as data processing and control decision-making.

[0038] ASDU (Application Service Data Unit) is an application service data unit that defines the data structure and format transmitted between different application services. ASDU is often used to encapsulate data of application services such as telemetry and remote control in industrial automation systems. The edge gateway can identify different application service types and data formats by analyzing the ASDU of the parsed message data, and then perform corresponding processing.

[0039] In this embodiment, the edge gateway can adopt different strategies for feature extraction, and the extracted feature types include but are not limited to the feature types in the above examples. The specific feature extraction strategy can be set according to actual needs, and this embodiment does not impose specific restrictions on this.

[0040] Step 103: Match each first feature with a second feature in a preset feature library to obtain a second feature that matches each first feature. The preset feature library includes a second feature set corresponding to each of multiple different types of communication protocols, and the second feature set includes at least one second feature.

[0041] In this embodiment, the preset feature library is a multi-protocol feature matrix library. In the multi-protocol feature matrix library, each row represents a feature set corresponding to a communication protocol, and each column represents the name of a feature.

[0042] In order to distinguish between the features extracted from the received message data and the features in the preset feature library, the present application refers to the features extracted in step 102 as first features, and the features stored in the preset feature library as second features.

[0043] In one embodiment, the preset feature library is obtained in advance through the following steps: Identify all types of communication protocols supported by the edge gateway; Extracting features for each type of communication protocol to obtain a second feature set corresponding to each type of communication protocol; A preset feature library is generated according to all types of communication protocols and various second feature sets.

[0044] Different edge gateways use different preset feature libraries.

[0045] Figure 2 Schematic diagram of a preset feature library shown in an embodiment of the present application. Figure 2, when obtaining the preset feature library corresponding to a certain edge gateway, first determine all types of communication protocols supported by the edge gateway, such as substation communication networks and systems, power system automation communication standard protocols, Modbus Ethernet protocols, and Modbus serial communication protocols. Then, analyze each type of communication protocol, extract all key features corresponding to each communication protocol, and generate a second feature set uniquely corresponding to each communication protocol based on these key features. Different communication protocols correspond to different second feature sets. For example, for communication protocol 1, if the extracted second feature includes feature 1-feature 10, then the generated second feature set includes feature 1-feature 10; for another example, for communication protocol 2, if the extracted second feature includes feature 1'-feature 10', then the generated second feature set includes feature 1'-feature 10'. Finally, each communication protocol and the corresponding second feature set are stored in correspondence to obtain the preset feature library.

[0046] Among them, the types of communication protocols supported by the edge gateway can be set according to actual needs, and the method of extracting all key features corresponding to each communication protocol can also be set according to actual needs. This embodiment does not impose specific restrictions on this.

[0047] When executing step 103, for each first feature, it is matched with all second features in the preset feature library to obtain a second feature matching each first feature. For example, when the first feature is feature 1-feature 4, feature 1' matching feature 1, feature 2' matching feature 2, feature 3' matching feature 3, and feature 4' matching feature 4 can be obtained through the preset feature library.

[0048] In actual implementation, a variety of methods may be used to determine the matching degree between different features, and this embodiment does not impose any specific limitation on this.

[0049] Step 104: Determine the application corresponding to each first feature according to the communication protocol corresponding to the second feature matching each first feature, and different applications are used to process data transmitted through different types of communication protocols.

[0050] In one embodiment, the first feature includes a target feature, and the target feature is any feature in the first feature. Accordingly, step 104 may include: Determine a target communication protocol corresponding to a second feature matching the target feature, wherein the communication protocols in the preset feature library include the target communication protocol; An application used to process data transmitted through a target communication protocol is determined as an application corresponding to the target feature.

[0051] Combination Figure 2If the first feature includes feature 1-feature 4, the second feature matching feature 1 is feature 11, the second feature matching feature 2 is feature 21, the second feature matching feature 3 is feature 31, and the second feature matching feature 4 is feature 41, then it is necessary to determine the application used to process data transmitted through communication protocol 1 as application 1 corresponding to feature 1, determine the application 2 used to process data transmitted through communication protocol 2 as the application corresponding to feature 2, determine the application 3 used to process data transmitted through communication protocol 3 as the application corresponding to feature 3, and determine the application 4 used to process data transmitted through communication protocol 4 as the application corresponding to feature 4.

[0052] Step 105: For each first feature, obtain data content related to the first feature in the message data, and send the data content to an application corresponding to the first feature so that the application processes the data content.

[0053] Continuing with the above embodiment, the portion of the content corresponding to feature 1 in the message data is sent to application 1, the portion of the content corresponding to feature 2 in the message data is sent to application 2, the portion of the content corresponding to feature 3 in the message data is sent to application 3, and the portion of the content corresponding to feature 4 in the message data is sent to application 4. In this embodiment, the edge gateway can automatically extract the data content corresponding to each feature from the message data.

[0054] After application 1 receives the distributed data content, it uses communication protocol 1 to parse and process the data content. After application 2 receives the distributed data content, it uses communication protocol 2 to parse and process the data content. After application 3 receives the distributed data content, it uses communication protocol 3 to parse and process the data content. After application 4 receives the distributed data content, it uses communication protocol 4 to parse and process the data content.

[0055] To implement the method of the present application, after receiving message data sent by a terminal device through at least one communication protocol, the edge gateway first extracts features from the message data to obtain at least one first feature; then, each first feature is matched with a second feature in a preset feature library to obtain a second feature that matches each first feature; then, based on the communication protocol corresponding to the second feature that matches each first feature, an application corresponding to each first feature is determined, and different applications are used to process data transmitted through different types of communication protocols; finally, for each first feature, data content related to the first feature is obtained in the message data, and the data content is sent to the application corresponding to the first feature, so that the application processes the data content.

[0056] In the present application, the edge gateway extracts key features from the message data to achieve automatic matching of different protocol data in the message data with the application that processes the corresponding protocol data. Different applications can process data simultaneously after receiving the distributed data. Therefore, after receiving message data of multiple different protocols, the edge gateway of the present application can achieve rapid processing of message data of different protocols, thereby overcoming the problem of low efficiency of multi-protocol data processing in related technologies.

[0057] In combination with the above embodiments, in one implementation, each first feature is matched with a second feature in a preset feature library to obtain a second feature that matches each first feature, including: Determine the similarity between the target feature and each second feature in the preset feature library; The second feature with the highest similarity is determined as the second feature matching the target feature.

[0058] In this embodiment, the second features that match each first step feature can be determined by calculating the similarity between different features. Specifically, for a first feature, after calculating the similarity between it and each second feature in the preset feature library, the second feature with the highest similarity can be used as the second feature that matches the first feature.

[0059] In one embodiment, determining the similarity between the target feature and each second feature in the preset feature library includes: Obtaining a vectorized feature corresponding to the target feature and a vectorized feature corresponding to each second feature in a preset feature library; The similarity between the vectorized feature corresponding to the target feature and the vectorized features corresponding to each second feature in the preset feature library is determined by a preset similarity algorithm, wherein the preset similarity algorithm includes any one of the following: cosine similarity, Euclidean distance, and Manhattan distance.

[0060] In this embodiment, the target feature is any one of the first features. When calculating the similarity between the target feature and each second feature, the target feature is first converted into a vector representation to obtain a vectorized feature corresponding to the target feature. Specifically, the vector conversion can be achieved through a hash function, an encoding method, or a specific algorithm to ensure that the target feature has a unique vector representation. Then, the similarity between the vectorized feature corresponding to the target feature and the vectorized feature corresponding to each second feature is calculated.

[0061] The similarity algorithm may be set according to actual needs. The similarity algorithm used in this embodiment includes but is not limited to: cosine similarity, Euclidean distance, and Manhattan distance.

[0062] Among them, cosine similarity is based on the vector space model and measures the similarity between two vectors by comparing the cosine value of the angle between them. The value range of cosine similarity is [-1, 1]. The closer the cosine similarity is to 1, the more similar the two vectors are; the closer it is to -1, the less similar the two vectors are; and the closer it is to 0, the less similar the two vectors are. Euclidean distance measures the absolute distance between points in multidimensional space. Manhattan distance, also known as city block distance or L1 distance, is a measurement method for calculating the distance between two points on a plane.

[0063] Through this embodiment, the similarity between each first feature and each second feature can be quickly and accurately determined, thereby achieving rapid matching of features, and providing technical support for achieving rapid subsequent data processing.

[0064] In combination with the above embodiments, in one implementation, the edge gateway is also connected to the target receiving device for communication; after sending the data content to the application corresponding to the first feature, the method of the present application may further include: Get the data processed by each application; The processed data is transmitted to the target receiving device according to the data transmission mode negotiated with the target receiving device.

[0065] In this embodiment, the application program may be an APP (Application), and APPs of different protocols may analyze, process, and transmit data transmitted through different protocols. APPs of different protocols parse and process according to preset rules, and store in the platform database or message bus using unified rules.

[0066] The number of target receiving devices may be one or more. The edge gateway can determine the target receiving device of the message data by identifying the destination MAC address of the message data.

[0067] The type of the target receiving device can be set according to actual needs, for example, it can be a cloud server.

[0068] In this embodiment, after parsing the received data, the APP obtains the data transmission method negotiated between the edge gateway and the target receiving device based on the parsed results, processes the parsed results accordingly according to the data transmission method, and finally sends the processed data to the target receiving device.

[0069] The data processing method of the present application will be fully described below with a specific embodiment, which includes the following steps: Step 1: Obtain all communication protocols supported by the edge gateway, including but not limited to IEC-61850, IEC -104, ModbusTCP, ModbusRTU and other different types of communication protocols; Step 2: According to the communication protocol obtained in step 1, analyze the key features of different types of communication protocols, such as destination MAC, service port, frame header, APDU, ASDU and other features, and obtain the key features corresponding to each communication protocol; Step 3: Based on the key features obtained in step 2, a multi-protocol feature matrix library is established. In the multi-protocol feature matrix library, each row corresponds to all key features of a communication protocol, and each column represents the name of the feature; Step 4: Based on the multi-protocol feature matrix library, realize automatic identification of different communication protocols. Extract the destination MAC, service port, frame header, APDU, ASDU and other features of the message data received by the communication interface, and match them with the features in the multi-protocol feature matrix library. According to the matching results, distribute the data content corresponding to each feature in the message data to the APP that supports the corresponding protocol, such as the APP that supports IEC-61850, the APP that supports IEC-104, the APP that supports ModbusTCP protocol, the APP that supports ModbusRTU protocol, etc. for data processing, which simplifies the message data reception and framing process of each APP.

[0070] Step 5: Apps that support different protocols are parsed and processed according to preset rules and stored in the platform database or message bus using unified rules.

[0071] In this application, based on the multi-protocol feature matrix library, the edge gateway has the ability to automatically identify and process message data of different communication protocols, so as to achieve the purpose of automatically adapting to multiple communication protocols for data processing, reduce the redundant configuration of various communication protocols, and realize the rapid processing of different protocol data, thus overcoming the problem of low efficiency of multi-protocol data processing in related technologies.

[0072] A data processing device provided by the present application is described below. The data processing device described below and the data processing method described above can be referenced to each other.

[0073] A data processing device provided in the present application is applied to an edge gateway, and the edge gateway is communicatively connected with a terminal device. Figure 3 1 is a structural block diagram of a data processing device according to an embodiment of the present application. Figure 3 The data processing device 300 of the present application includes the following modules: The receiving module 301 is used to receive message data sent by the terminal device through at least one communication protocol; An extraction module 302 is used to extract features from the message data to obtain at least one first feature; A matching module 303 is used to match each of the first features with a second feature in a preset feature library to obtain a second feature that matches each of the first features, wherein the preset feature library includes a second feature set corresponding to each of a plurality of different types of communication protocols, and the second feature set includes at least one second feature; A determination module 304, configured to determine an application corresponding to each of the first features according to a communication protocol corresponding to a second feature matching each of the first features, wherein different applications are used to process data transmitted via different types of communication protocols; The sending module 305 is used to obtain data content related to the first feature in the message data for each of the first features, and send the data content to the application corresponding to the first feature so that the application processes the data content.

[0074] According to a data processing device 300 provided by the present application, the first features include a target feature, and the target feature is any one of the first features; the determination module 304 includes: A first determination submodule is used to determine a target communication protocol corresponding to a second feature matching the target feature, wherein the communication protocols in the preset feature library include the target communication protocol; The second determination submodule is used to: determine the application used for processing data transmitted through the target communication protocol as the application corresponding to the target feature.

[0075] According to a data processing device 300 provided in the present application, the data processing device 300 also includes a generation module, which is used to determine all types of communication protocols supported by the edge gateway; perform feature extraction on each type of communication protocol to obtain a second feature set corresponding to each type of communication protocol; and generate the preset feature library based on all types of communication protocols and each of the second feature sets.

[0076] According to a data processing device 300 provided by the present application, the matching module 303 includes: A third determination submodule, used to determine the similarity between the target feature and each of the second features in the preset feature library; The fourth determining submodule is used to determine the second feature with the highest similarity as the second feature matching the target feature.

[0077] According to a data processing device 300 provided by the present application, the third determining submodule includes: An acquisition submodule, used to acquire the vectorized features corresponding to the target feature and the vectorized features corresponding to each of the second features in the preset feature library; The fifth determination submodule is used to determine the similarity between the vectorized features corresponding to the target feature and the vectorized features corresponding to each of the second features in the preset feature library through a preset similarity algorithm, and the preset similarity algorithm includes any one of the following: cosine similarity, Euclidean distance, and Manhattan distance.

[0078] According to a data processing device 300 provided by the present application, the edge gateway is also communicatively connected with a target receiving device; the data processing device 300 further includes: An acquisition module, used to acquire the data processed by each of the applications; The transmission module is used to transmit the processed data to the target receiving device according to the data transmission mode negotiated between the target receiving device and the target receiving device.

[0079] Figure 4 FIG. 1 is a schematic diagram of the physical structure of an electronic device shown in an embodiment of the present application. Figure 4 As shown, the electronic device may include: a processor 410, a communications interface 420, a memory 430 and a communication bus 440, wherein the processor 410, the communications interface 420 and the memory 430 communicate with each other through the communication bus 440. The processor 410 may call the logic instructions in the memory 430 to execute a data processing method, the method comprising: receiving message data sent by the terminal device through at least one communication protocol; Performing feature extraction on the message data to obtain at least one first feature; Matching each of the first features with a second feature in a preset feature library to obtain a second feature that matches each of the first features, wherein the preset feature library includes a second feature set corresponding to each of a plurality of different types of communication protocols, and the second feature set includes at least one second feature; Determining, according to the communication protocols corresponding to the second features matching the first features, the applications corresponding to the first features, wherein different applications are used to process data transmitted through different types of communication protocols; For each of the first features, data content related to the first feature is obtained in the message data, and the data content is sent to an application corresponding to the first feature, so that the application processes the data content.

[0080] In addition, the logic instructions in the above-mentioned memory 430 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0081] On the other hand, the present application also provides a computer program product, the computer program product includes a computer program, the computer program can be stored on a non-transitory computer-readable storage medium, when the computer program is executed by a processor, the computer can execute a data processing method provided by the above methods, the method comprising: receiving message data sent by the terminal device through at least one communication protocol; Performing feature extraction on the message data to obtain at least one first feature; Matching each of the first features with a second feature in a preset feature library to obtain a second feature that matches each of the first features, wherein the preset feature library includes a second feature set corresponding to each of a plurality of different types of communication protocols, and the second feature set includes at least one second feature; Determining, according to the communication protocols corresponding to the second features matching the first features, the applications corresponding to the first features, wherein different applications are used to process data transmitted through different types of communication protocols; For each of the first features, data content related to the first feature is obtained in the message data, and the data content is sent to an application corresponding to the first feature, so that the application processes the data content.

[0082] In another aspect, the present application further provides a non-transitory computer-readable storage medium having a computer program stored thereon, the computer program being implemented when executed by a processor to execute a data processing method provided by the above methods, the method comprising: receiving message data sent by the terminal device through at least one communication protocol; Performing feature extraction on the message data to obtain at least one first feature; Matching each of the first features with a second feature in a preset feature library to obtain a second feature that matches each of the first features, wherein the preset feature library includes a second feature set corresponding to each of a plurality of different types of communication protocols, and the second feature set includes at least one second feature; Determining, according to the communication protocols corresponding to the second features matching the first features, the applications corresponding to the first features, wherein different applications are used to process data transmitted through different types of communication protocols; For each of the first features, data content related to the first feature is obtained in the message data, and the data content is sent to an application corresponding to the first feature, so that the application processes the data content.

[0083] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative work.

[0084] Through the description of the above implementation modes, those skilled in the art can clearly understand that each implementation mode can be implemented by means of software plus a necessary general hardware platform, or of course by hardware. Based on such an understanding, the above technical solution can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0085] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements will not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A data processing method, characterized in that: Applied to an edge gateway, the method includes: Receiving message data sent by a terminal device via at least one communication protocol; Performing feature extraction on the message data to obtain at least one first feature; Matching each of the first features with a second feature in a preset feature library to obtain a second feature that matches each of the first features, wherein the preset feature library includes a second feature set corresponding to each of a plurality of different types of communication protocols, and the second feature set includes at least one second feature; Determine, according to the communication protocol corresponding to the second feature matching each of the first features, an application corresponding to each of the first features, wherein different applications are used to process data transmitted through different types of communication protocols; For each of the first features, data content related to the first feature is obtained in the message data, and the data content is sent to an application corresponding to the first feature, so that the application processes the data content.

2. The data processing method according to claim 1, characterized in that: The first features include a target feature, and the target feature is any one of the first features; The determining, according to the communication protocol corresponding to the second feature matching each of the first features, the application corresponding to each of the first features, includes: Determining a target communication protocol corresponding to a second feature matching the target feature, wherein the communication protocols in the preset feature library include the target communication protocol; An application used for processing data transmitted through the target communication protocol is determined as an application corresponding to the target feature.

3. The data processing method according to claim 1, characterized in that: The preset feature library is obtained in advance through the following steps: Determining all types of communication protocols supported by the edge gateway; Extracting features for each type of communication protocol to obtain a second feature set corresponding to each type of communication protocol; The preset feature library is generated according to all types of communication protocols and each of the second feature sets.

4. The data processing method according to claim 2, characterized in that: The matching of each of the first features with a second feature in a preset feature library to obtain a second feature matching each of the first features includes: Determining the similarity between the target feature and each of the second features in the preset feature library; The second feature with the highest similarity is determined as the second feature matching the target feature.

5. The data processing method according to claim 4, characterized in that: The determining the similarity between the target feature and each of the second features in the preset feature library includes: Obtaining a vectorized feature corresponding to the target feature and a vectorized feature corresponding to each of the second features in the preset feature library; The similarity between the vectorized feature corresponding to the target feature and the vectorized features corresponding to each of the second features in the preset feature library is determined by a preset similarity algorithm, wherein the preset similarity algorithm includes any one of the following: cosine similarity, Euclidean distance, and Manhattan distance.

6. The data processing method according to any one of claims 1 to 5, characterized in that: After sending the data content to the application corresponding to the first feature, the method further includes: Obtaining data processed by each of the applications; The processed data is transmitted to the target receiving device according to the data transmission mode negotiated with the target receiving device.

7. A data processing device, characterized in that: Applied to an edge gateway, the data processing device comprises: A receiving module, used to receive message data sent by a terminal device via at least one communication protocol; An extraction module, used to extract the message data feature to obtain at least one first feature; a matching module, configured to match each of the first features with a second feature in a preset feature library to obtain a second feature that matches each of the first features, wherein the preset feature library includes a second feature set corresponding to each of a plurality of different types of communication protocols, and the second feature set includes at least one second feature; a determination module, configured to determine, according to the communication protocol corresponding to the second feature matching each of the first features, an application corresponding to each of the first features, wherein different applications are used to process data transmitted via different types of communication protocols; A sending module is used to obtain data content related to the first feature in the message data for each of the first features, and send the data content to an application corresponding to the first feature so that the application processes the data content.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the computer program, the data processing method according to any one of claims 1 to 6 is implemented.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, a data processing method according to any one of claims 1 to 6 is implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, a data processing method according to any one of claims 1 to 6 is implemented.

Images