Task flow processing method and device based on edge computing
By introducing task flow orchestration and dynamic registration mechanisms into the edge computing architecture, the management and optimization problems of multimodal task execution in the existing technology are solved, and efficient task flow execution and data processing link dynamic adjustment is achieved.
Patent Information
- Application Number
- CN202411612578.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-12
- Publication Date
- 2025-04-01
AI Technical Summary
Existing edge computing architectures are difficult to effectively manage and optimize the execution of multimodal tasks, especially in complex, multi-task parallel execution scenarios.
Create task flows by providing visual pages on management nodes, generate tree structures to encapsulate dependency component lists and task flow information, send them to edge nodes to perform task flows, and support dynamic registration and configuration management of edge nodes.
It realizes unified management and optimized scheduling of multimodal data processing tasks, supports real-time and offline processing of tasks, can dynamically adjust the data processing link, and improves the information management and task issuance efficiency of edge nodes.
Smart Images

Figure CN119739495A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, and in particular to a task flow processing method based on edge computing, a task flow processing device based on edge computing, an electronic device and a computer-readable storage medium. Background Art
[0002] With the rapid development of the Internet of Things (IoT), artificial intelligence (AI) and 5G communication technologies, edge computing, as a distributed computing architecture that can process and analyze data near the data source, has become a key technology for processing massive multimodal data. Multimodal data usually contains data from multiple sensors, cameras, microphones and other devices, such as video, audio, text and sensor data.
[0003] In the existing edge computing architecture, most solutions focus on the issuance and execution of a single task, lacking the overall management and optimized scheduling of multi-modal tasks. In addition, the existing edge node management mechanism can usually only perform simple monitoring and management of a single device or task, and it is difficult to cope with complex, multi-task parallel execution scenarios. Summary of the invention
[0004] In view of the above problems, embodiments of the present invention are proposed to provide a task flow processing method based on edge computing, a task flow processing device based on edge computing, an electronic device and a computer-readable storage medium that overcome the above problems or at least partially solve the above problems.
[0005] The embodiment of the present invention discloses a task flow processing method based on edge computing, which is applied to a management node. The method includes:
[0006] In response to a task flow creation request, acquiring task flow information of the task flow, and displaying a visualization page for creating the task flow;
[0007] Generate a task flow based on at least one operator component added in the visualization page and the flow connection between the operator components;
[0008] Determine the dependency component list of each dependent component corresponding to each operator component;
[0009] The dependent component list and the task flow information are sent to an edge node, so that the edge node executes the task flow based on the dependent component list and the task flow information.
[0010] In one or more embodiments, further comprising:
[0011] Obtaining a request for obtaining a target dependent component sent by the edge node; the target dependent component is a dependent component that the edge node lacks among the dependent components;
[0012] The target dependent component is sent to the edge node.
[0013] In one or more embodiments, sending the dependent component list and the task flow information to the edge node includes:
[0014] Generating a tree structure for each of the operator components and each of the dependent components;
[0015] Encapsulating the dependent component list of each dependent component and the task flow information according to the tree structure to obtain a data packet;
[0016] The data packet is sent to the edge node.
[0017] In one or more embodiments, before obtaining the task flow information of the task flow in response to the task flow creation request, the method further includes:
[0018] Detect whether there are new edge nodes;
[0019] If yes, the new edge node is registered.
[0020] In one or more embodiments, registering the new edge node includes:
[0021] If the network segment to which the new edge node belongs has configuration information, sending the configuration information to the new edge node so that the new edge node installs the configuration information;
[0022] If an acquisition request of an edge node client sent by the new edge node is obtained, an installation package of the edge node client is sent to the new edge node, so that the new edge node obtains the installation package, and installs the installation package to obtain the edge node client, and, when the edge node client is started, sends heartbeat information;
[0023] Acquire the heartbeat information, and acquire the node identifier of the new edge node from the heartbeat information;
[0024] The node identifier is added to a preset node management list.
[0025] In one or more embodiments, further comprising:
[0026] If the heartbeat information is not received within a preset time period, it is determined that the new edge node is abnormal.
[0027] In one or more embodiments, further comprising:
[0028] An operator component update instruction is sent to the edge node, so that the edge node updates the operator component to be updated in response to the operator component update instruction to obtain an updated operator component.
[0029] The embodiment of the present invention discloses a task flow processing method based on edge computing, which is applied to an edge node and includes:
[0030] When the list of dependent components and task flow information are obtained, the edge node client is started;
[0031] Acquire corresponding dependent components based on the dependent component list;
[0032] The task flow is executed in the edge node client using each of the dependent components and the task flow information.
[0033] In one or more embodiments, acquiring corresponding dependent components based on the dependent component list includes:
[0034] Acquire corresponding dependent components from other edge nodes based on the dependent component list; the other edge nodes and the edge node belong to the same network segment;
[0035] If the target dependent component is not obtained, a first acquisition request for the target dependent component is generated; the target dependent component is a dependent component that the edge node lacks among the dependent components;
[0036] The first acquisition request is sent to a management node, so that the management node sends the target dependent component to the edge node based on the first acquisition request.
[0037] In one or more embodiments, before obtaining the dependent component list and the task flow information, the process further includes:
[0038] When the configuration information is obtained, installing the configuration information;
[0039] Obtaining the installation package of the edge node client from other edge nodes;
[0040] If the acquisition is successful, the installation package is installed to obtain the edge node client;
[0041] If the acquisition fails, generating a second acquisition request for the installation package;
[0042] Sending the second acquisition request to the management node, so that the management node sends the installation package to the edge node based on the second acquisition request;
[0043] When the installation package is obtained, the installation package is installed to obtain the edge node client.
[0044] In one or more embodiments, before starting the edge node client, the method further includes:
[0045] Testing the task flow based on the task flow information;
[0046] If the test passes, the edge node client is started.
[0047] In one or more embodiments, the step of executing the task flow in the edge node client using each of the dependent components and the task flow information includes:
[0048] Merging the dependent components according to the keys corresponding to the dependent components to obtain at least one operator component corresponding to the task flow;
[0049] The task flow is executed in the edge node client using each of the operator components.
[0050] In one or more embodiments, further comprising:
[0051] When an operator component update instruction is obtained, the input of the operator component to be updated is blocked;
[0052] Using a preset update file to update the operator component to be updated;
[0053] When the update is completed, the updated operator component is obtained and the blocking is released.
[0054] In one or more embodiments, further comprising:
[0055] Recording the execution result of the task flow and sending the execution result to the management node;
[0056] If the number of execution failures in the execution result exceeds a number threshold, the execution of the task flow is terminated.
[0057] Accordingly, an embodiment of the present invention discloses a task flow processing device based on edge computing, which is applied to a management node. The device includes:
[0058] A first acquisition module, configured to acquire task flow information of the task flow in response to a task flow creation request;
[0059] A display module, used to display a visualization page used to create the task flow;
[0060] A generation module, used to generate a task flow based on at least one operator component added in the visualization page and the flow connection between each operator component;
[0061] A first determination module is used to determine a dependency component list of each dependency component corresponding to each operator component;
[0062] The first sending module is used to send the dependent component list and the task flow information to the edge node, so that the edge node executes the task flow based on the dependent component list and the task flow information.
[0063] In one or more embodiments, the first acquisition module is further used to acquire an acquisition request for a target dependent component sent by the edge node; the target dependent component is a dependent component that the edge node lacks among the dependent components;
[0064] The first sending module is further configured to send the target dependent component to the edge node.
[0065] In one or more embodiments, the first sending module is specifically configured to:
[0066] Generating a tree structure for each of the operator components and each of the dependent components;
[0067] Encapsulating the dependent component list of each dependent component and the task flow information according to the tree structure to obtain a data packet;
[0068] The data packet is sent to the edge node.
[0069] In one or more embodiments, further comprising:
[0070] A detection module, used for detecting whether there is a new edge node before obtaining the task flow information of the task flow in response to the task flow creation request;
[0071] A registration module is used to register the new edge node if yes.
[0072] In one or more embodiments, the registration module is specifically used to:
[0073] If the network segment to which the new edge node belongs has configuration information, sending the configuration information to the new edge node so that the new edge node installs the configuration information;
[0074] If an acquisition request of an edge node client sent by the new edge node is obtained, an installation package of the edge node client is sent to the new edge node, so that the new edge node obtains the installation package, and installs the installation package to obtain the edge node client, and, when the edge node client is started, sends heartbeat information;
[0075] Acquire the heartbeat information, and acquire the node identifier of the new edge node from the heartbeat information;
[0076] The node identifier is added to a preset node management list.
[0077] In one or more embodiments, further comprising:
[0078] The second determination module is configured to determine that an abnormality exists in the new edge node if the heartbeat information is not received within a preset time period.
[0079] In one or more embodiments, the first sending module is further used to send an operator component update instruction to the edge node, so that the edge node updates the operator component to be updated in response to the operator component update instruction to obtain an updated operator component.
[0080] Accordingly, an embodiment of the present invention discloses a task flow processing device based on edge computing, which is applied to an edge node, including:
[0081] The startup module is used to start the edge node client when the dependent component list and task flow information are obtained;
[0082] A second acquisition module, used for acquiring corresponding dependent components based on the dependent component list;
[0083] An execution module is used to execute the task flow in the edge node client by using each of the dependent components and the task flow information.
[0084] In one or more embodiments, the second acquisition module is specifically configured to:
[0085] Acquire corresponding dependent components from other edge nodes based on the dependent component list; the other edge nodes and the edge node belong to the same network segment;
[0086] If the target dependent component is not obtained, a first acquisition request for the target dependent component is generated; the target dependent component is a dependent component that the edge node lacks among the dependent components;
[0087] The first acquisition request is sent to a management node, so that the management node sends the target dependent component to the edge node based on the first acquisition request.
[0088] In one or more embodiments, further comprising:
[0089] An installation module is used to install the configuration information when the configuration information is obtained before the dependent component list and the task flow information are obtained;
[0090] The second acquisition module is further used to obtain the installation package of the edge node client from other edge nodes;
[0091] The installation module is further configured to install the installation package to obtain the edge node client if the acquisition is successful;
[0092] A generating module, configured to generate a second acquisition request for the installation package if the acquisition fails;
[0093] a second sending module, configured to send the second acquisition request to the management node, so that the management node sends the installation package to the edge node based on the second acquisition request;
[0094] The installation module is further configured to install the installation package to obtain the edge node client when the installation package is acquired.
[0095] In one or more embodiments, further comprising:
[0096] A testing module, used for testing the task flow based on the task flow information before starting the edge node client;
[0097] The startup module is further configured to start the edge node client if the test passes.
[0098] In one or more embodiments, the execution module is specifically used to:
[0099] Merging the dependent components according to the keys corresponding to the dependent components to obtain at least one operator component corresponding to the task flow;
[0100] The task flow is executed in the edge node client using each of the operator components.
[0101] In one or more embodiments, further comprising:
[0102] The blocking module is used to block the input of the operator component to be updated when the operator component update instruction is obtained;
[0103] An updating module, used to update the operator component to be updated using a preset update file;
[0104] The release module is used to obtain the updated operator component and release the blockage when the update is completed.
[0105] In one or more embodiments, further comprising:
[0106] A recording module, used to record the execution result of the task flow;
[0107] A second sending module, used to send the execution result to the management node;
[0108] The termination module is used to terminate the execution of the task flow if the number of execution failures in the execution result exceeds a number threshold.
[0109] Correspondingly, an embodiment of the present invention discloses an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, the various steps of the above-mentioned embodiment of the task flow processing method based on edge computing are implemented.
[0110] Correspondingly, an embodiment of the present invention discloses a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various steps of the above-mentioned embodiment of the task flow processing method based on edge computing are implemented.
[0111] The embodiments of the present invention include the following advantages:
[0112] The management node responds to the task flow creation request, obtains the task flow information of the task flow, and displays the visualization page for creating the task flow; generates the task flow based on at least one operator component added in the visualization page, and the flow connection between each operator component; determines the dependency component list of each dependency component corresponding to each operator component; sends the dependency component list and the task flow information to the edge node, so that the edge node executes the task flow based on the dependency component list and the task flow information. Through the above-mentioned task flow arrangement method, the task flow of multimodal data processing tasks can be realized, which can not only uniformly manage the information of edge nodes, but also uniformly send various arranged multimodal data processing flows. Since the task flow has been arranged, the embodiment of the present invention can not only support real-time processing of tasks, but also support offline processing of tasks. Moreover, through this arrangement mechanism, users can flexibly define task flows, support operator components for multi-modal data processing to run on edge nodes, thereby realizing dynamic adjustment of data processing links. BRIEF DESCRIPTION OF THE DRAWINGS
[0113] Figure 1 This is a step flow chart of a first embodiment of a task flow processing method based on edge computing of the present invention;
[0114] Figure 2 It is a schematic diagram of the architecture of the management node and the edge node of the present invention;
[0115] Figure 3 It is a logical schematic diagram of the creation task flow of the present invention;
[0116] Figure 4is a schematic diagram of the tree structure of operator components and dependent components of the present invention;
[0117] Figure 5 This is a flowchart of the steps of Embodiment 2 of a task flow processing method based on edge computing of the present invention;
[0118] Figure 6 This is a flowchart of the steps of Embodiment 3 of a task flow processing method based on edge computing of the present invention;
[0119] Figure 7 It is a logical schematic diagram of the merging of dependent components of the present invention;
[0120] Figure 8 is a logical schematic diagram of the update operator component of the present invention;
[0121] Fig. 9 It is a structural block diagram of a first embodiment of a task flow processing device based on edge computing of the present invention;
[0122] Fig.10 It is a structural block diagram of a second embodiment of a task flow processing device based on edge computing of the present invention. DETAILED DESCRIPTION
[0123] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.
[0124] One of the core concepts of the embodiment of the present invention is that, through the task flow arrangement method, the task flow of multimodal data processing tasks can be realized, which can not only uniformly manage the information of edge nodes, but also uniformly issue various arranged multimodal data processing flows. Since the task flow has been arranged, the embodiment of the present invention can not only support the real-time processing of tasks, but also support the offline processing of tasks. Moreover, through this arrangement mechanism, users can flexibly define task flows and support the operation of operator components for multi-modal data processing on edge nodes, thereby realizing dynamic adjustment of data processing links.
[0125] Reference Figure 1 , shows a step flow chart of a task flow processing method based on edge computing of the present invention, applied to the management node, referring to Figure 2, showing a schematic diagram of the architecture of the management node and the edge node. Among them, the management node can be deployed in the management center, and the number of management nodes can be one or more. In practical applications, the number of management nodes can be adjusted according to actual needs, and the embodiment of the present invention does not limit this. The management node is responsible for the global control and management of the system, including the discovery, registration, monitoring, task issuance, upgrade management, etc. of edge nodes. Multiple management nodes can be highly available to each other. In a cloud environment, it can also be deployed on a cloud server.
[0126] Furthermore, a gateway is deployed in the management center, and each management node is connected to the gateway. At the same time, multiple gateways are deployed in the edge node network segment, and each gateway can connect to multiple edge nodes, that is, multiple edge nodes connected to the same gateway are in the same network segment. The edge node represents an independent computing unit, responsible for accepting and executing the task flow issued by the management center, reporting node status indicators, updating actual tasks, etc.
[0127] The gateway in the management center is connected to each gateway in the edge node network segment. In this way, each management node can communicate with each edge node through the gateway in the management center and each gateway in the edge node network segment. In practical applications, the number of gateways in the edge node network segment and the number of edge nodes in each network segment can be set according to actual needs, and the embodiment of the present invention does not limit this.
[0128] The method may specifically include the following steps:
[0129] Step 101 : in response to a task flow creation request, obtaining task flow information of the task flow, and displaying a visualization page for creating the task flow.
[0130] Specifically, the user can access the management node and send a creation request for creating a task flow to the management node. After obtaining the creation request, the management node can provide an interface for obtaining the task flow information of the task flow, and the user can input the task flow information through the interface. Among them, the task flow information may include: task tags, version information, task templates, abstract parameters, whether to bind to a certain network segment to facilitate automatic task distribution, and task effective time. Of course, in addition to this, the task flow information may also include other information. In actual applications, the specific information included in the task flow information can be set according to actual needs, and the embodiment of the present invention does not limit this.
[0131] Furthermore, the management node can also display a visualization interface to the user, and the user can create a task flow in the visualization interface. The task flow can include multiple subtasks, and each subtask is processed in sequence to form a task flow. The data processed by the task flow can be multimodal data.
[0132] It should be noted that the visualization interface can be displayed before or after the task flow information is obtained. That is to say, the order of displaying the visualization interface and obtaining the task flow information can be adjusted according to actual needs, and the embodiment of the present invention does not limit this.
[0133] Step 102: Generate a task flow based on at least one operator component added in the visualization page and the flow connection between each operator component.
[0134] The displayed visualization interface may include an interface and a canvas of an operator component library, wherein the operator component library may include multiple operator components that have been set up. In this way, the user can add at least one operator component for executing a task flow to the canvas through the interface, and then the user can make input and output flow connections for each operator component on the canvas and configure the relevant parameters of each operator, thereby obtaining a task flow consisting of each operator and flow connection.
[0135] Reference Figure 3 , showing a logical diagram of creating a task flow. The types of operator components in the operator plug-in library may include decision operators, text operators, video operators, and audio operators.
[0136] The decision operator component is used to trigger the next operator component based on the data, and to trigger NeverBreakException to interrupt the task flow when an infinite loop occurs, thereby jumping out of the infinite loop.
[0137] Text operators are used to process text data.
[0138] Video operators are used to process video data.
[0139] Audio operators are used to process audio data.
[0140] Decision operator components may include value judgment filtering operator components, enumeration judgment operator components, aggregation operator components, splitting operator components, etc.; text operator components may include feature deduplication operator components, text conversion operator components, sensitive information processing operator components, encryption and decryption operator components, etc.; video operator components may include video noise reduction operator components, dynamic enhancement operator components, format conversion operator components, frame extraction transformation operator components, etc.; audio operator components may include format conversion operator components, audio noise reduction operator components, human voice splitting operator components, damage filtering operator components, etc.
[0141] Of course, the operator component library may also include other types of operator components, and each type of operator component may also include other operator components. In practical applications, the specific type of operator component can be set according to actual needs, and the embodiment of the present invention does not limit this.
[0142] Furthermore, the user can add the operator component in the operator component library to the canvas through the interface. The operator component can be added to the canvas by dragging, pulling, or other methods. In actual applications, the specific adding method can be set according to actual needs, and the embodiment of the present invention does not limit this.
[0143] After adding the operator component to the canvas, you can set the input and output of the multimodal data flow, and then the user can connect the input and output flows of each operator component.
[0144] Since each operator component has standard input and output, when the user connects any two operator components, if the output of the upstream operator component does not meet the input requirements of the downstream operator component, the two operator components cannot be connected in a flow direction. At the same time, an error message can be displayed to the user to prompt the user that the two operator components cannot be connected in a flow direction. It should be noted that the input of the decision operator component is arbitrary data, and the output inherits the input.
[0145] Furthermore, the operator component library also provides an extension interface, through which users can customize operator components to develop new operator components. The developed new operator components can be stored in the operator component library, so that they can be reused when creating task flows later.
[0146] Step 103: Determine a dependency component list of each dependency component corresponding to each operator component.
[0147] Since each operator component has a corresponding version number and at least one dependent component, after the user adds each operator component to the canvas, the dependent component corresponding to each operator component can be determined to obtain a list of dependent components.
[0148] Step 104: Send the dependent component list and the task flow information to an edge node, so that the edge node executes the task flow based on the dependent component list and the task flow information.
[0149] After determining the dependent component list, the dependent component list and task flow information can be sent to the edge node that needs to execute the task flow. After obtaining the dependent component list and task flow information, the edge node can execute the task flow according to the dependent component list and task flow information.
[0150] In the embodiment of the present invention, the sending the dependent component list and the task flow information to the edge node includes:
[0151] Generating a tree structure for each of the operator components and each of the dependent components;
[0152] Encapsulating the dependent component list of each dependent component and the task flow information according to the tree structure to obtain a data packet;
[0153] The data packet is sent to the edge node.
[0154] Specifically, after determining each dependent component, the operator component and the dependent component can be generated into a tree structure. Since multiple operator components may have the same dependent component, duplicate dependent components can be removed by generating a tree structure, and only one identical dependent component is required.
[0155] Reference Figure 4 , which shows a schematic diagram of the tree structure of operator components and dependent components. Among them, operator component A includes dependent component A, dependent component B, dependent component C and dependent component D, and operator component B includes dependent component D and dependent component E. If the tree structure is not generated, then two dependent components D need to be retained. However, after the tree structure is generated, only one dependent component D needs to be retained.
[0156] After the tree structure is generated, the dependent component list and task flow information can be encapsulated according to the tree structure to obtain a data packet, and then the data packet can be sent to the edge node.
[0157] It should be noted that at this time, the management node does not need to send the dependent components to the edge node, but only needs to send the dependent component list to the edge node. The edge node can first obtain the dependent components from other edge nodes in the same network segment according to the dependent component list. If there are still missing dependent components, the missing dependent components can be obtained from the management node. In this way, the efficiency of edge nodes in obtaining dependent components can be improved.
[0158] In an embodiment of the present invention, the management node responds to the task flow creation request, obtains the task flow information of the task flow, and displays the visualization page for creating the task flow; generates the task flow based on at least one operator component added in the visualization page, and the flow connection between each operator component; determines the dependency component list of each dependency component corresponding to each operator component; sends the dependency component list and the task flow information to the edge node, so that the edge node executes the task flow based on the dependency component list and the task flow information. Through the above-mentioned task flow arrangement method, the task flow of multimodal data processing tasks can be realized, which can not only uniformly manage the information of edge nodes, but also uniformly send various arranged multimodal data processing flows. Since the task flow has been arranged, the embodiment of the present invention can not only support real-time processing of tasks, but also support offline processing of tasks. Moreover, through this arrangement mechanism, users can flexibly define task flows, support operator components of multimodal data processing to run on edge nodes, thereby realizing dynamic adjustment of data processing links.
[0159] Reference Figure 5 , shows a flowchart of the steps of a second embodiment of a task flow processing method based on edge computing of the present invention, which is applied to a management node and may specifically include the following steps:
[0160] Step 501: Detect whether there is a new edge node.
[0161] Before receiving a task flow creation request, the management node can detect whether a new edge node is connected. During the detection, the detection can be actively performed by probing the network segment. For example, the management node scans each monitored network segment, sends a communication instruction to each network segment, and broadcasts it within the network segment to detect whether a new edge node is connected.
[0162] Step 502: If yes, register the new edge node.
[0163] If a new edge node is detected, the new edge node can be registered so that the management node can manage the new edge node. If no new edge node is detected, step 503 can be performed.
[0164] In the embodiment of the present invention, the registering of the new edge node includes:
[0165] If the network segment to which the new edge node belongs has configuration information, sending the configuration information to the new edge node so that the new edge node installs the configuration information;
[0166] If an acquisition request of an edge node client sent by the new edge node is obtained, an installation package of the edge node client is sent to the new edge node, so that the new edge node obtains the installation package, and installs the installation package to obtain the edge node client, and, when the edge node client is started, sends heartbeat information;
[0167] Acquire the heartbeat information, and acquire the node identifier of the new edge node from the heartbeat information;
[0168] The node identifier is added to a preset node management list.
[0169] Specifically, when the network segment to which the new edge node belongs has configuration information of the edge node, the network segment can actively send the configuration information to the new edge node, and the new edge node can be initialized after obtaining the configuration information.
[0170] After the new edge node is initialized, it can send a request to the management node to obtain the edge node client. After obtaining the request, the management node can send the installation package of the edge node client to the new edge node. When sending the installation package, it can be sent through a TLS (Transport Layer Security) channel or other methods. In actual applications, the specific method of sending the installation package can be set according to actual needs, and the embodiment of the present invention does not limit this.
[0171] After obtaining the installation package, the new edge node can install the installation package to obtain the edge node client, then start the edge node client, and communicate and register with the management node with local information, confirm its own identity information, obtain configuration parameters for secondary startup, and after the secondary startup, send heartbeat information to the management node.
[0172] After obtaining the heartbeat information, the management node can parse the UDP-NetBIOS-NS query packet in the heartbeat information to obtain the node identifier of the new edge node, such as NetBIOS Names information. After obtaining the node identifier, the node identifier can be added to the preset node management list to manage the new edge node.
[0173] Furthermore, when detecting whether a new edge node is connected, in addition to scanning all network segments, it is also possible to scan according to the whitelist of network segments. In practical applications, whether to set the whitelist of network segments can be set according to actual needs, and the embodiment of the present invention does not limit this. In this way, the edge node is automatically registered by detecting the activity of the network segment, and the corresponding configuration information is issued, so that the dynamic joining and exit of the edge node can be effectively handled, and it is suitable for large-scale edge computing environments.
[0174] In the embodiment of the present invention, if the management node does not receive the heartbeat information of any edge node within a preset time period, it can be determined that the edge node is abnormal.
[0175] Step 503: In response to the task flow creation request, task flow information of the task flow is acquired, and a visualization page for creating the task flow is displayed.
[0176] Step 504: Generate a task flow based on at least one operator component added in the visualization page and the flow connection between each operator component.
[0177] Step 505: Determine a dependent component list of each dependent component corresponding to each operator component.
[0178] Step 506: Send the dependent component list and the task flow information to an edge node, so that the edge node executes the task flow based on the dependent component list and the task flow information.
[0179] Among them, steps 503 to 506 are substantially the same as steps 101 to 104, and will not be described here for avoiding repetition.
[0180] It should be noted that the new edge node detected in steps 501 to 502 may be the same as or different from the edge node executing the task flow in steps 503 to 506. In other words, whether a new edge node is needed to execute the task flow can be set according to actual needs, and the embodiment of the present invention does not limit this.
[0181] Step 507: Obtain a request for obtaining a target dependent component sent by the edge node; the target dependent component is a dependent component that the edge node lacks among the dependent components.
[0182] Step 508: Send the target dependent component to the edge node.
[0183] Specifically, the management node may obtain a request for obtaining a target dependent component sent by the edge node to be executed, wherein the target dependent component is a dependent component that is missing from all dependent components required by the edge node to be executed.
[0184] When the management node receives the acquisition request, it can package the target dependency components and then send the packaged target dependency components to the edge node.
[0185] Step 509: Send an operator component update instruction to the edge node, so that the edge node updates the operator component to be updated in response to the operator component update instruction to obtain an updated operator component.
[0186] Specifically, when it is necessary to update the operator component in the edge node, the management node can send an operator component update instruction to the edge node. After obtaining the operator component update instruction, the edge node can update the operator component to be updated, thereby obtaining the updated operator component.
[0187] It should be noted that step 509 can be executed after step 506 or after step 508. The embodiment of the present invention is described as step 509 being executed after step 508. In actual applications, the execution order of step 509 can be set according to actual needs, and the embodiment of the present invention does not limit this.
[0188] Reference Figure 6 , shows a flowchart of the steps of a third embodiment of a task flow processing method based on edge computing of the present invention, which is applied to edge nodes and may specifically include the following steps:
[0189] Step 601: When the dependent component list and task flow information are obtained, the edge node client is started.
[0190] When the edge node obtains the dependent component list and task flow information, it can start the edge node client for subsequent execution of the task flow.
[0191] In the embodiment of the present invention, before obtaining the dependent component list and the task flow information, the following is also included:
[0192] When the configuration information is obtained, installing the configuration information;
[0193] Obtaining the installation package of the edge node client from other edge nodes;
[0194] If the acquisition is successful, the installation package is installed to obtain the edge node client;
[0195] If the acquisition fails, generating a second acquisition request for the installation package;
[0196] Sending the second acquisition request to the management node, so that the management node sends the installation package to the edge node based on the second acquisition request;
[0197] When the installation package is obtained, the installation package is installed to obtain the edge node client.
[0198] Specifically, when the edge node obtains the configuration information, it can install the configuration information and initialize. After the edge node is initialized, it can preferentially obtain the installation package of the edge node client from other edge nodes in the same network segment. If the acquisition is successful, the installation package can be installed to obtain the edge node client; if the acquisition fails, an acquisition request for obtaining the installation package (recorded as a "second acquisition request") can be generated, and then the second acquisition request can be sent to the management node. After obtaining the second acquisition request, the management node can send the installation package to the edge node. After the edge node obtains the installation package, it can install the installation package to obtain the edge node client.
[0199] It should be noted that the edge nodes that obtain configuration information are mainly newly connected edge nodes.
[0200] Step 602: Obtain corresponding dependent components based on the dependent component list.
[0201] After obtaining the list of dependent components, the edge node can obtain each dependent component for executing the task flow according to the list of dependent components.
[0202] In the embodiment of the present invention, the acquiring corresponding dependent components based on the dependent component list includes:
[0203] Acquire corresponding dependent components from other edge nodes based on the dependent component list; the other edge nodes and the edge node belong to the same network segment;
[0204] If the target dependent component is not obtained, a first acquisition request for the target dependent component is generated; the target dependent component is a dependent component that the edge node lacks among the dependent components;
[0205] The first acquisition request is sent to a management node, so that the management node sends the target dependent component to the edge node based on the first acquisition request.
[0206] Specifically, the edge node can obtain the corresponding dependent components from other edge nodes according to the dependent component list, wherein the other edge nodes belong to the same network segment as the edge node. If some dependent components (referred to as "target dependent components") are not obtained from other edge nodes, then a request for obtaining the target dependent components (referred to as "first acquisition request") can be generated, and then the first acquisition request can be sent to the management node. When the management node obtains the acquisition request, the target dependent components can be packaged, and then the packaged target dependent components can be sent to the edge node.
[0207] Among them, the edge node can obtain the processes of other edge nodes in the same network segment through STUN (Session Traversal Utilities for NAT, NAT session traversal), and mutually authenticate through the cluster key (each management center and each edge node form a cluster) and the public key of each edge node when connecting. If the edge nodes belong to the same cluster, then each edge node in each cluster has the same cluster key and the private key obtained from the cluster when registering to the cluster. The edge node can obtain the salt operation of the cluster at the current time node through the private key, and can decode the public keys of other edge nodes through the salt operation, so that mutual trust is successful. After mutual trust is successful, the required dependent components can be obtained nearby.
[0208] Step 603: Execute the task flow in the edge node client using each of the dependent components and the task flow information.
[0209] After obtaining the dependent components required to execute the task flow, the task flow can be executed in the edge node client using the dependent components and the task flow information.
[0210] In the embodiment of the present invention, the step of using each of the dependent components and the task flow information to execute the task flow in the edge node client includes:
[0211] Merging the dependent components according to the keys corresponding to the dependent components to obtain at least one operator component corresponding to the task flow;
[0212] The task flow is executed in the edge node client using each of the operator components.
[0213] Specifically, each operator component has a corresponding key (KEY), for example, "multimodal-operator name-version number-MD5" is used as the key of the operator component. At the same time, each dependent component also has a corresponding key (KEY), for example, "dependent component-dependent component name-version number-MD5" is used as the key of the dependent component. Each key represents a minimum unit. Based on this, after obtaining each dependent component, the edge node can merge each dependent component according to the key of the operator component and the key of the dependent component to obtain each operator component. The merged dependent components can also be merged according to the tree structure.
[0214] Reference Figure 7, shows a logical diagram of dependent component merging. Dependent components A, B, C, and D are merged to obtain operator component A, dependent components D and E are merged to obtain operator component B, and dependent components F and G are merged to obtain operator component C. Operator component A and operator component B are used to execute task A, operator component B and operator component C are used to execute task B, and task A and task B constitute a task flow.
[0215] In the embodiment of the present invention, before starting the edge node client, the method further includes:
[0216] Testing the task flow based on the task flow information;
[0217] If the test passes, the edge node client is started.
[0218] Specifically, after obtaining the task flow information, the edge node can test the task flow based on the task flow information, including but not limited to integrity testing and executable testing. If the test passes, the edge node client can be started. If the test fails, the process can be restarted.
[0219] It should be noted that, in addition to the above tests, the test may also include other tests. In practical applications, specific test items may be set according to actual needs, and the embodiment of the present invention does not limit this.
[0220] In the embodiment of the present invention, after step 603, the following steps may also be included:
[0221] When an operator component update instruction is obtained, the input of the operator component to be updated is blocked;
[0222] Using a preset update file to update the operator component to be updated;
[0223] When the update is completed, the updated operator component is obtained and the blocking is released.
[0224] Specifically, when the edge node obtains the operator component update instruction, it can block the input of the operator component to be updated, so that the resource usage of the operator component to be updated can be cleared, but the information of the operator component runtime will be retained. Then the preset update file is used to update the operator component to be updated. When the update is completed, the updated operator component can be obtained, and at the same time, the input block of the updated operator component is released, so as to resume the operation of the operator component.
[0225] Reference Figure 8, shows a logical diagram of the update operator component. Since the multimodal data processing flow is a cyclic graph composed of multiple operator components, and each operator component is independent, the operator components can be logically connected through internal tunnels. Among them, the smallest processing unit of multimodal data processing can be called Flowfile, which may be composed of multiple Records or a single Record, and Record is the smallest data unit.
[0226] The Video frame conversion operator component converts the video stream input into images for output and puts them into a logical tunnel. The tunnel may temporarily store multiple Flowfiles waiting for the downstream Image license plate detection operator component to process.
[0227] The blocking command can suspend the output of all tunnels and stop all operator components from running subsequent Flowfile tasks. In this way, the processing flow of all operator components can be indirectly suspended. Of course, you can also block only a certain operator component to stop it from running.
[0228] The update implementation of the operator component is based on this mechanism. When you want to upgrade the Image license plate detection operator component from V1.0.0 to V1.0.1, you can execute the blocking of the front tunnel to block the input of the Image license plate detection operator component. When the Image license plate detection operator component has no input, the operator component is stopped and released. This implementation will clear the resource usage of the operator component, but will retain the information of the operator component during operation. Then hot load the new version number V1.0.1 version component to execute the operator component initialization implementation, load the running information of V1.0.0, and start it. At this time, the front tunnel releases the blockage after the new version is ready, and multimodal data begins to flow. The entire hot update process will not block other operator components on the same canvas, and the operator component of the version that needs to be loaded can be blocked.
[0229] Through the above-mentioned isolation of operator components, logical connection of tunnels, and independent loading of operator components, an update and upgrade of the multimodal data processing flow is completed. This operation can not only specify a certain edge node for update, but also update the edge node group at the same time. Therefore, it can not only realize grayscale upgrade, but also realize unified management of the edge node group processing flow.
[0230] In the embodiment of the present invention, after step 603, the following steps may also be included:
[0231] Recording the execution result of the task flow and sending the execution result to the management node;
[0232] If the number of execution failures in the execution result exceeds a number threshold, the execution of the task flow is terminated.
[0233] Specifically, when executing a task flow, the edge node can record the execution results of the task flow, capture possible errors or abnormal conditions, and report the execution results to the management node.
[0234] The edge node can also judge the execution results. If the number of execution failures in the execution results exceeds the quantity threshold, the execution of the task flow can be terminated.
[0235] When the edge node reports the execution result to the management node, it can use heartbeat information to report or other methods to report. In actual applications, the specific method of sending the execution result can be set according to actual needs, and the embodiment of the present invention does not limit this.
[0236] Furthermore, after obtaining the heartbeat information, the management node can generate feedback information for the heartbeat information, and then send the feedback information to the edge node. If the edge node does not receive the feedback information within a preset time period, the corresponding fault tolerance processing can be automatically performed.
[0237] In the embodiment of the present invention, when the edge node obtains the dependent component list and the task flow information, the edge node client is started; based on the dependent component list, the corresponding dependent components are obtained; and the task flow is executed in the edge node client using the dependent components and the task flow information. Among them, since the link between the edge node and the management node is long, when obtaining dependent components, it can be obtained from other edge nodes in the same network segment first, thereby reducing the network transmission of the link.
[0238] Furthermore, a logical isolation tunnel is set between operator components. This logical isolation makes the upstream and downstream operators have a certain degree of independence, and realizes hot update of a single operator component or operator component group without affecting other operator components, thereby realizing not only the grayscale upgrade of edge nodes, but also the unified upgrade of edge node groups.
[0239] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.
[0240] Reference Fig. 9 , shows a structural block diagram of a first embodiment of a task flow processing device based on edge computing of the present invention, which is applied to a management node and may specifically include the following modules:
[0241] A first acquisition module 901 is used to acquire task flow information of the task flow in response to a task flow creation request;
[0242] A display module 902, used to display a visualization page used to create the task flow;
[0243] A generating module 903, configured to generate a task flow based on at least one operator component added in the visualization page and the flow connection between the operator components;
[0244] A first determining module 904 is used to determine a dependent component list of each dependent component corresponding to each operator component;
[0245] The first sending module 905 is used to send the dependent component list and the task flow information to the edge node, so that the edge node executes the task flow based on the dependent component list and the task flow information.
[0246] In the embodiment of the present invention, the first acquisition module is further used to acquire an acquisition request of a target dependent component sent by the edge node; the target dependent component is a dependent component that the edge node lacks among the dependent components;
[0247] The first sending module is further configured to send the target dependent component to the edge node.
[0248] In the embodiment of the present invention, the first sending module is specifically used to:
[0249] Generating a tree structure for each of the operator components and each of the dependent components;
[0250] Encapsulating the dependent component list of each dependent component and the task flow information according to the tree structure to obtain a data packet;
[0251] The data packet is sent to the edge node.
[0252] In an embodiment of the present invention, it also includes:
[0253] A detection module, used for detecting whether there is a new edge node before obtaining the task flow information of the task flow in response to the task flow creation request;
[0254] A registration module is used to register the new edge node if yes.
[0255] In the embodiment of the present invention, the registration module is specifically used for:
[0256] If the network segment to which the new edge node belongs has configuration information, sending the configuration information to the new edge node so that the new edge node installs the configuration information;
[0257] If an acquisition request of an edge node client sent by the new edge node is obtained, an installation package of the edge node client is sent to the new edge node, so that the new edge node obtains the installation package, and installs the installation package to obtain the edge node client, and, when the edge node client is started, sends heartbeat information;
[0258] Acquire the heartbeat information, and acquire the node identifier of the new edge node from the heartbeat information;
[0259] The node identifier is added to a preset node management list.
[0260] In an embodiment of the present invention, it also includes:
[0261] The second determination module is configured to determine that an abnormality exists in the new edge node if the heartbeat information is not received within a preset time period.
[0262] In the embodiment of the present invention, the first sending module is further used to send an operator component update instruction to the edge node, so that the edge node updates the operator component to be updated in response to the operator component update instruction to obtain an updated operator component.
[0263] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0264] Reference Fig.10 , shows a structural block diagram of a second embodiment of a task flow processing device based on edge computing of the present invention, which is applied to edge nodes and may specifically include the following modules:
[0265] The startup module 1001 is used to start the edge node client when the dependent component list and task flow information are obtained;
[0266] A second acquisition module 1002, configured to acquire corresponding dependent components based on the dependent component list;
[0267] The execution module 1003 is used to execute the task flow in the edge node client by using each of the dependent components and the task flow information.
[0268] In the embodiment of the present invention, the second acquisition module is specifically used to:
[0269] Acquire corresponding dependent components from other edge nodes based on the dependent component list; the other edge nodes and the edge node belong to the same network segment;
[0270] If the target dependent component is not obtained, a first acquisition request for the target dependent component is generated; the target dependent component is a dependent component that the edge node lacks among the dependent components;
[0271] The first acquisition request is sent to a management node, so that the management node sends the target dependent component to the edge node based on the first acquisition request.
[0272] In an embodiment of the present invention, it also includes:
[0273] An installation module is used to install the configuration information when the configuration information is obtained before the dependent component list and the task flow information are obtained;
[0274] The second acquisition module is further used to obtain the installation package of the edge node client from other edge nodes;
[0275] The installation module is further configured to install the installation package to obtain the edge node client if the acquisition is successful;
[0276] A generating module, configured to generate a second acquisition request for the installation package if the acquisition fails;
[0277] a second sending module, configured to send the second acquisition request to the management node, so that the management node sends the installation package to the edge node based on the second acquisition request;
[0278] The installation module is further configured to install the installation package to obtain the edge node client when the installation package is acquired.
[0279] In an embodiment of the present invention, it also includes:
[0280] A testing module, used for testing the task flow based on the task flow information before starting the edge node client;
[0281] The startup module is further configured to start the edge node client if the test passes.
[0282] In the embodiment of the present invention, the execution module is specifically used to:
[0283] Merging the dependent components according to the keys corresponding to the dependent components to obtain at least one operator component corresponding to the task flow;
[0284] The task flow is executed in the edge node client using each of the operator components.
[0285] In an embodiment of the present invention, it also includes:
[0286] The blocking module is used to block the input of the operator component to be updated when the operator component update instruction is obtained;
[0287] An updating module, used to update the operator component to be updated using a preset update file;
[0288] The release module is used to obtain the updated operator component and release the blockage when the update is completed.
[0289] In an embodiment of the present invention, it also includes:
[0290] A recording module, used to record the execution result of the task flow;
[0291] A second sending module, used to send the execution result to the management node;
[0292] The termination module is used to terminate the execution of the task flow if the number of execution failures in the execution result exceeds a number threshold.
[0293] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0294] An embodiment of the present invention further provides an electronic device, including:
[0295] It includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, the various processes of the above-mentioned edge computing-based task flow processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0296] An embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned edge computing-based task flow processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0297] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0298] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0299] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0300] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0301] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0302] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.
[0303] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.
[0304] The above is a detailed introduction to a task flow processing method based on edge computing and a task flow processing device based on edge computing provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, according to the idea of the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.
Claims
1. A task flow processing method based on edge computing, characterized in that: Applied to a management node, the method comprises: In response to a task flow creation request, acquiring task flow information of the task flow, and displaying a visualization page for creating the task flow; Generate a task flow based on at least one operator component added in the visualization page and the flow connection between the operator components; Determine the dependency component list of each dependent component corresponding to each operator component; The dependent component list and the task flow information are sent to an edge node, so that the edge node executes the task flow based on the dependent component list and the task flow information.
2. The task flow processing method based on edge computing according to claim 1 is characterized in that: Also includes: Obtaining a request for obtaining a target dependent component sent by the edge node; The target dependent component is a dependent component that the edge node lacks among the dependent components; The target dependent component is sent to the edge node.
3. The task flow processing method based on edge computing according to claim 1 is characterized in that: The sending the dependent component list and the task flow information to the edge node includes: Generating a tree structure for each of the operator components and each of the dependent components; Encapsulating the dependent component list of each dependent component and the task flow information according to the tree structure to obtain a data packet; The data packet is sent to the edge node.
4. The task flow processing method based on edge computing according to claim 1 is characterized in that: Before obtaining the task flow information of the task flow in response to the task flow creation request, the method further includes: Detect whether there are new edge nodes; If yes, the new edge node is registered.
5. The task flow processing method based on edge computing according to claim 4 is characterized in that: The registering the new edge node includes: If the network segment to which the new edge node belongs has configuration information, sending the configuration information to the new edge node so that the new edge node installs the configuration information; If an acquisition request of an edge node client sent by the new edge node is obtained, an installation package of the edge node client is sent to the new edge node, so that the new edge node obtains the installation package, and installs the installation package to obtain the edge node client, and, when the edge node client is started, sends heartbeat information; Acquire the heartbeat information, and acquire the node identifier of the new edge node from the heartbeat information; The node identifier is added to a preset node management list.
6. The task flow processing method based on edge computing according to claim 5 is characterized in that: Also includes: If the heartbeat information is not received within a preset time period, it is determined that the new edge node is abnormal.
7. The task flow processing method based on edge computing according to claim 1 is characterized in that: Also includes: An operator component update instruction is sent to the edge node, so that the edge node updates the operator component to be updated in response to the operator component update instruction to obtain an updated operator component.
8. A task flow processing method based on edge computing, characterized in that: Applied to edge nodes, including: When the list of dependent components and task flow information are obtained, the edge node client is started; Acquire corresponding dependent components based on the dependent component list; The task flow is executed in the edge node client using each of the dependent components and the task flow information.
9. The task flow processing method based on edge computing according to claim 8 is characterized in that: The acquiring corresponding dependent components based on the dependent component list includes: Acquire corresponding dependent components from other edge nodes based on the dependent component list; the other edge nodes and the edge node belong to the same network segment; If the target dependent component is not obtained, a first acquisition request for the target dependent component is generated; the target dependent component is a dependent component that the edge node lacks among the dependent components; The first acquisition request is sent to a management node, so that the management node sends the target dependent component to the edge node based on the first acquisition request.
10. The task flow processing method based on edge computing according to claim 8, characterized in that: Before obtaining the list of dependent components and task flow information, it also includes: When the configuration information is obtained, installing the configuration information; Obtaining the installation package of the edge node client from other edge nodes; If the acquisition is successful, the installation package is installed to obtain the edge node client; If the acquisition fails, generating a second acquisition request for the installation package; Sending the second acquisition request to the management node, so that the management node sends the installation package to the edge node based on the second acquisition request; When the installation package is obtained, the installation package is installed to obtain the edge node client.
11. The task flow processing method based on edge computing according to claim 8, characterized in that: Before starting the edge node client, the method further includes: Testing the task flow based on the task flow information; If the test passes, the edge node client is started.
12. The task flow processing method based on edge computing according to claim 8, characterized in that: The step of using each of the dependent components and the task flow information to execute the task flow in the edge node client includes: Merging the dependent components according to the keys corresponding to the dependent components to obtain at least one operator component corresponding to the task flow; The task flow is executed in the edge node client using each of the operator components.
13. The task flow processing method based on edge computing according to claim 8, characterized in that: Also includes: When an operator component update instruction is obtained, the input of the operator component to be updated is blocked; Using a preset update file to update the operator component to be updated; When the update is completed, the updated operator component is obtained and the blocking is released.
14. The task flow processing method based on edge computing according to claim 8, characterized in that: Also includes: Recording the execution result of the task flow and sending the execution result to the management node; If the number of execution failures in the execution result exceeds a number threshold, the execution of the task flow is terminated.
15. A task flow processing device based on edge computing, characterized in that: Applied to a management node, the device comprises: A first acquisition module, configured to acquire task flow information of the task flow in response to a task flow creation request; A display module, used for displaying a visualization page used to create the task flow; A generation module, used to generate a task flow based on at least one operator component added in the visualization page and the flow connection between each operator component; A first determination module is used to determine a dependency component list of each dependency component corresponding to each operator component; The first sending module is used to send the dependent component list and the task flow information to the edge node, so that the edge node executes the task flow based on the dependent component list and the task flow information.
16. A task flow processing device based on edge computing, characterized in that: Applied to edge nodes, including: The startup module is used to start the edge node client when the dependent component list and task flow information are obtained; A second acquisition module, used for acquiring corresponding dependent components based on the dependent component list; An execution module is used to execute the task flow in the edge node client by using each of the dependent components and the task flow information.
17. An electronic device, characterized in that: include: A processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the steps of the task flow processing method based on edge computing as described in any one of claims 1 to 7 or 8 to 14 are implemented.
18. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, the steps of the task flow processing method based on edge computing as described in any one of claims 1 to 7 or 8 to 14 are implemented.
Citation Information
Cited By
Task flow processing method and apparatus based on edge computing
WO2026103310A1