Multi-target analysis method for industrial edge scene heterogeneous convolutional neural network

Abstract

The invention discloses a multi-target analysis method for an industrial edge scene heterogeneous convolutional neural network. The method comprises the steps that a plurality of target tasks are acquired, and different target tasks are processed by adopting different convolutional neural network models; and when each target task is unloaded from the terminal device to the edge server, different convolutional neural network models are processed through packet layer granularity division and optimizer search, so that the number of divisible layers of the different convolutional neural network models is equal, and each target task corresponds to one terminal device and one edge server. According to the method and the device, the technical problems of waste of computing resources and loss of correlation between models due to the fact that the dynamic relationship between a search space and a segmentation layer is coped with through frequent initialization when an optimal unloading scheme is found by analyzing a heterogeneous CNN reasoning task in the prior art are solved.

Description

Technical Field

[0001] The present invention relates to the technical fields of Industrial Internet of Things, Convolutional Neural Network Analysis, and Multi-Objective Optimization, and in particular to a multi-objective analysis method of heterogeneous convolutional neural networks for industrial edge scenarios. Background Art

[0002] As one of the important technologies in the field of artificial intelligence, convolutional neural networks are used in quality inspection, equipment maintenance, product classification, etc. in industrial environments. The characteristics of the industrial Internet are high response speed, low cost and high efficiency, diversified task processing, and operation in complex environments. The performance of CNN is closely related to the complexity of the network structure. The more complex the CNN, the better the performance. However, the high performance requirements of complex CNNs limit their deployment in industrial environments. Especially in edge environments, low-performance terminal devices cannot efficiently perform all CNN reasoning tasks, which greatly limits the deployment of CNN-based applications.

[0003] To address this issue, algorithms and network architectures optimized for edge device performance must be designed and implemented to fully realize the potential of CNN in industrial environments. To alleviate the performance limitations of terminal devices, solutions such as cloud computing, fog computing, and edge computing have emerged, which offload all or part of the reasoning tasks to higher-performance servers through analysis. For example, studies have shown that completely offloading CNN-based tasks to servers can significantly increase speed and reduce resource consumption. At the same time, some studies have explored partial offloading strategies, which further speeds up model reasoning and optimizes the allocation of computing resources. Relatively speaking, partial offloading has gradually become a mainstream method with its flexibility, stability, and robustness.

[0004] In order to better exert the performance of the parsing strategy, different practical scenarios for deploying CNNs must be considered. These scenarios can be roughly divided into two categories: scenarios with multiple terminal devices and scenarios with multiple servers. In scenarios with multiple terminal devices, it is crucial to consider the logical relationships and constraints between tasks. In contrast, multi-server scenarios involve multiple central nodes, such as edge servers or cloud servers, which brings challenges in task allocation. To address these challenges, improving system performance through effective task allocation has become a new research focus. The study takes various factors into consideration and proposes corresponding solution strategies to achieve effective task scheduling.

[0005] The diverse needs of industrial environments often lead to different applications being deployed on each terminal device and using various heterogeneous CNNs. For example, AlexNet and VGG are widely used for image classification tasks. AlexNet is suitable for deployment in devices with low resource requirements and high real-time requirements, while VGG is more suitable for processing large data sets. GoogLeNet with the Inception structure excels at high-precision tasks. Meanwhile, ResNet has a deeper structure and is more suitable for industrial scenarios that require detailed recognition but have lower real-time processing requirements. These heterogeneous models play different roles in industrial scenarios according to their different characteristics.

[0006] However, there are still limited inventions on parsing continuous heterogeneous CNNs reasoning tasks. Although many methods have verified the effectiveness of their strategies and achieved remarkable results, these methods usually only parse one type of CNNs reasoning tasks at a time and rarely involve the parsing problem of mixed heterogeneous CNNs reasoning tasks. When parsing heterogeneous CNN reasoning tasks to find the best offloading solution, great challenges may be faced due to the dynamic search space and the relationship between the segmentation layers. Existing parsing strategies usually require frequent reinitialization to cope with these challenges, resulting in insufficient flexibility and waste of computational resources. In addition, tailoring the parsing strategy for each model will result in a waste of computational resources and loss of correlation between models. Therefore, how to parse these continuously generated heterogeneous CNNs reasoning tasks without reinitializing the strategy is an urgent problem to be solved. Summary of the invention

[0007] An embodiment of the present invention provides a multi-objective parsing method for heterogeneous convolutional neural networks in industrial edge scenarios, which at least solves the technical problems that when existing technologies parse heterogeneous CNN inference tasks to find the best offloading solution, they frequently initialize to cope with the dynamic relationship between the search space and the segmentation layer, and tailor-make the parsing strategy for each model, which will cause waste of computing resources and loss of correlation between models.

[0008] According to one aspect of an embodiment of the present invention, a multi-objective parsing method for heterogeneous convolutional neural networks for industrial edge scenarios is provided. The method may include: obtaining multiple target tasks, wherein different target tasks are processed using different convolutional neural network models; when each target task is unloaded from a terminal device to an edge server, different convolutional neural network models are processed by grouping layer granularity division and optimizer search to make the number of divisible layers of different convolutional neural network models equal, wherein each target task corresponds to a terminal device and an edge server; when each target task is processed by the convolutional neural network model corresponding to each target task, an initial population of dimensions corresponding to the number of layers of the convolutional neural network model corresponding to each target task is created according to the number of layers of the convolutional neural network model corresponding to each target task, wherein the initial population includes n individuals, and the dimension of each individual is the number of layers of the convolutional neural network model corresponding to each target task plus a dimension representing a server identifier; a differential evolution algorithm is used to perform a multi-objective parsing on each target task. Iteratively update the initial population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to the target task to obtain the target population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task; convert the target population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task through the sigmoid function to obtain the 0 / 1 coding population of each target task; obtain multiple candidate solutions for each target task through the number of zeros of each individual in the 0 / 1 coding population of each target task, wherein each candidate solution is the number of zeros of each individual plus the server identifier; based on the multiple candidate solutions for each target task, determine the target segmentation number of each target task; based on the target segmentation number of each target task, determine the total delay and total energy of each target task; based on the total delay and total energy of each target task, obtain the total delay and total energy of multiple target tasks.

[0009] Optionally, based on multiple candidate solutions for each target task, the target number of segmentation layers for each target task is determined, including: substituting the information of the number of segmentation layers shown by each candidate solution into the initial delay calculation formula to obtain multiple initial total delays; and determining the candidate solution corresponding to the minimum value of the multiple initial total delays as the target number of segmentation layers for each target task.

[0010] Optionally, the initial delay calculation formula is:

[0011] in, is the initial delay, Inferring latency for end devices, The transmission delay of the terminal device from the output data of the terminal device to the edge server, After the terminal device transmits the output data of the terminal device to the edge server, the waiting delay when the output data of the terminal device enters the queue for waiting, Server inference latency for predictive model output.

[0012] Optionally, based on the target segmentation layer number of each target task, the total delay and total energy of each target task are determined, including: substituting the target segmentation layer number of each target task into the target delay calculation formula and the target energy calculation formula to obtain the total delay and total energy of each target task.

[0013] Optionally, the target delay is calculated as:

[0014] in, For the target delay, Inferring latency for end devices, The transmission delay of the terminal device from the output data of the terminal device to the edge server, After the terminal device transmits the output data of the terminal device to the edge server, the waiting delay when the output data of the terminal device enters the queue for waiting, Reasoning about latency for the server.

[0015] Optionally, the target energy calculation formula is:

[0016] in, is the target energy, Reasoning about energy consumption for end devices, It is the transmission energy consumption of the terminal device to transmit the output data of the terminal device to the edge server.

[0017] Beneficial effects of the present invention: The present invention proposes a multi-objective parsing method for heterogeneous convolutional neural networks in industrial edge scenarios. First, a delay and energy consumption model is proposed to parse heterogeneous CNN reasoning tasks in the Internet with multiple terminal devices and edge servers; secondly, a differential multi-objective optimization method is proposed to simultaneously solve the system delay and energy consumption problems, and a lightweight server computing delay prediction model established using historical data reduces the communication frequency between the terminal device and the edge server, thereby reducing the communication burden associated with finding the optimal segmentation layer; finally, a packet layer granularity segmentation method is proposed to manage the dynamic search space when determining the optimal segmentation layer; rigorous theoretical proofs and experimental analysis are provided to ensure that the present invention can effectively reduce system delay and energy consumption in heterogeneous model reasoning tasks, and meet the low latency and low energy consumption requirements in industrial Internet scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings: Figure 1 is a flowchart of a multi-objective parsing method for heterogeneous convolutional neural networks in industrial edge scenarios according to an embodiment of the present invention; Figure 2 is a schematic diagram of a multi-objective parsing method for a heterogeneous convolutional neural network for industrial edge scenarios according to an embodiment of the present invention; Figure 3 is a schematic diagram of multi-objective differential evolution coding according to an embodiment of the present invention. DETAILED DESCRIPTION

[0019] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only embodiments of a part of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0020] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0021] Example 1 According to an embodiment of the present invention, a multi-objective parsing method for heterogeneous convolutional neural networks for industrial edge scenarios is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system comprising at least one set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in an order different from that shown here.

[0022] Figure 1 is a flowchart of a multi-objective parsing method for heterogeneous convolutional neural networks in industrial edge scenarios according to an embodiment of the present invention. Figure 1 As shown, the method may include the following steps: Step S101, obtaining multiple target tasks, wherein different target tasks are processed using different convolutional neural network models.

[0023] In the technical solution provided in the above step S101 of the present invention, multiple target tasks are obtained. The target tasks may be image classification, image segmentation, etc., which are not specifically limited here, and are only used as examples. The convolutional neural network model used for each task is different. For example, the convolutional neural network model is AlexNet, GoogLeNet, ResNet, etc., among which AlexNet is a chain structure, GoogLeNet is an Inception structure, and ResNet is a residual structure.

[0024] The Inception structure is a key component of the GoogLeNet architecture, which can effectively solve the problem of efficiently capturing multi-scale features. It works by applying multiple convolutional filters of different sizes (1×1, 3×3, and 5×5) and a 3×3 maximum pooling operation in parallel, and then connecting their outputs. The Inception structure provides CNN with more flexible convolution options and improves the performance of the model. The present invention treats the Inception structure as a whole, ignoring the complex details inside each Inception module, and only focusing on unloading the model at the backbone node. This approach not only narrows the search space, but also greatly reduces the amount of data transmission required for parallel reasoning, thereby reducing transmission latency.

[0025] The ResNet architecture introduces the bottleneck block to solve the gradient vanishing problem and improve the training efficiency of the convolutional neural network. Each bottleneck block consists of multiple convolutional layers, and a skip connection (residual connection) is added from the input to the output of the block. This architecture allows the network to learn more complex functions while maintaining a controllable computational cost. The present invention treats the bottleneck block as a whole, treats it as a segmentation unit, and ignores its internal structure, thereby simplifying the task.

[0026] Step S102, when each target task is unloaded from the terminal device to the edge server, different convolutional neural network models are processed through grouping layer granularity division and optimizer search to make the number of divisible layers of different convolutional neural network models equal, wherein each target task corresponds to one terminal device and one edge server.

[0027] In the technical solution provided in the above step S102 of the present invention, Figure 2 is a schematic diagram of a multi-objective parsing method for a heterogeneous convolutional neural network for industrial edge scenarios according to an embodiment of the present invention, such as Figure 2 As shown, Figure 2 The leftmost two columns in ,the granularity division of the grouping layers of the heterogeneous models,,the optimizer searches to make the number of splittable layers of different,convolutional neural network models equal, e.g. Figure 2 In the third column, the number of separable layers of different convolutional neural network models is 4.

[0028] like Figure 2 As shown in the figure, firstly, models with different structures are regarded as a unified chain structure; then, they are grouped according to different layers of the model. This grouping strategy allows the optimizer to search for the optimal solution in a stable space; based on the decision information of the optimal solution, the split layer and server for executing subsequent tasks will be determined; then, the output data of the split layer will be sent to the specified server; finally, the subsequent tasks will enter the waiting queue of the server and wait for continued execution.

[0029] The heterogeneity of CNNs is not only reflected in different architectures, but also in different lengths. Different lengths lead to different search spaces for parsing the best offloading decision. When dealing with different search spaces, the parsing strategy must adapt to the frequent changes in the decision dimension, and often requires resetting the search algorithm to maintain optimal performance. To address the challenges brought by different model lengths, the strategy uses a layer grouping method to ensure stability.

[0030] When encountering heterogeneous CNNs inference tasks generated by multiple terminal devices, the strategy first determines the search space based on the shortest model length among the models. For example, when deploying AlexNet, GoogLeNet, and VGG-16, the length of the shortest model (AlexNet with a length of 13) is used as the standard. For longer models, such as VGG-16 with a length of 31, the present invention uses random grouping to reduce the search dimension to the standard length. The VGG-16 layers are randomly grouped, and each group is treated as a whole. Therefore, the search for the best split layer is only performed between these groups, thereby stabilizing the search space at a standard value of 13.

[0031] Step S103, when each target task is processed by the convolutional neural network model corresponding to each target task, an initial population with a dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task is created according to the number of layers of the convolutional neural network model corresponding to each target task, wherein the initial population includes n individuals, and the dimension of each individual is the number of layers of the convolutional neural network model corresponding to each target task plus a dimension representing the server identifier.

[0032] In the technical solution provided in the above step S103 of the present invention, Figure 3is a schematic diagram of multi-objective differential evolution coding according to an embodiment of the present invention. The CNN parsing process is essentially a process of solving discrete problems. Most current strategies use binary identifiers (0 and 1) to represent parsing decisions. In the population encoding process, normalized continuous values ​​in the range of [-1, 1] are used to initialize the population. The dimension of each individual in the population corresponds to the number of layers of the model. In an edge computing environment with multiple terminal devices and multiple servers, choosing which server to send the second half of the task to greatly affect the task waiting time. Therefore, choosing the right server is a key consideration when making parsing decisions. To solve this problem, in the population encoding process, each individual has an additional dimension to represent the server identifier. This means that each candidate solution must specify not only the parsing decision for each layer, but also the server that executes the second half of the task. Therefore, the dimension of each individual in the population is always twice the number of layers in the model.

[0033] According to the encoding rules, the new generation population is represented by standardized values. The sigmoid function is used to convert each dimension of the individual to 0 or 1 as a parsing identifier. The number of zeros in each individual is counted to determine the index of the segmentation layer, such as Figure 3 As shown, the X1, X2....X n For each individual in the initial population, each individual includes , is the number of layers of the convolutional neural network model corresponding to each target task, A dimension that identifies the server.

[0034] Step S104, iteratively update the initial population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task through the differential evolution algorithm, and obtain the target population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task.

[0035] In the technical solution provided in the above step S104 of the present invention, the initial population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task is iteratively updated by the differential evolution algorithm to obtain the target population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task.

[0036] Initialization: Create a population with the corresponding dimensions according to the number of layers of the model, and the population contains n individuals. For example, Figure 3 As shown, when the number of layers of the CNN model is 6, the present invention creates a population consisting of n individuals. These individuals are X1, X2...X n Composition, each individual has 6+1 dimensions.

[0037] Evolution: The differential evolution algorithm is used as an optimizer to generate new populations through iteration; the iteration process continues until the termination condition is met; the algorithm outputs a Pareto optimal solution set S1 based on the multi-objective optimization characteristics; finally, a solution is selected from the solution set S1 as the optimal solution X best .

[0038] Step S105, converting the target population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task through a sigmoid function to obtain a 0 / 1 coding population for each target task.

[0039] In the technical solution provided in step S105 of the present invention, if Figure 3 As shown, the target population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task is converted through the sigmoid function to obtain the 0 / 1 coding population for each target task.

[0040] Step S106, obtaining multiple candidate solutions for each target task by the number of zeros of each individual in the 0 / 1 coding population of each target task, wherein each candidate solution is the number of zeros of each individual plus a server identifier.

[0041] In the technical solution provided in the above step S106 of the present invention, for example, Figure 3 X1 in contains 3 zeros, so the candidate solution of X1 is , and so on for other candidate solutions.

[0042] Step S107, based on multiple candidate solutions for each target task, determine the target segmentation level for each target task.

[0043] In the technical solution provided in the above step S107 of the present invention, the target segmentation layer number of each target task is obtained according to multiple candidate solutions of each target task.

[0044] Step S108, determining the total delay and total energy of each target task based on the target segmentation level of each target task.

[0045] In the technical solution provided in the above step S108 of the present invention, the total delay and total energy of each target task are determined according to the target segmentation layer number of each target task.

[0046] Step S109, based on the total delay and total energy of each target task, the total delay and total energy of multiple target tasks are obtained.

[0047] In the technical solution provided in the above step S109 of the present invention, the total delay of each target task is accumulated and summed to obtain the total delay of multiple target tasks, and the total energy of each target task is accumulated and summed to obtain the total energy of multiple target tasks.

[0048] The above method of this embodiment is further introduced below.

[0049] As an optional implementation method, step S107, based on multiple candidate solutions for each target task, determines the target number of segmentation layers for each target task, including: substituting the information of the number of segmentation layers shown by each candidate solution into the initial delay calculation formula to obtain multiple initial total delays; and determining the candidate solution corresponding to the minimum value of the multiple initial total delays as the target number of segmentation layers for each target task.

[0050] As an optional implementation manner, the initial delay calculation formula is:

[0051] in, is the initial delay, Inferring latency for end devices, The transmission delay of the terminal device from the output data of the terminal device to the edge server, After the terminal device transmits the output data of the terminal device to the edge server, the waiting delay when the output data of the terminal device enters the queue for waiting, Server inference latency for predictive model output.

[0052] In this embodiment, in the process of finding the best split layer, each candidate solution must be evaluated to select the best solution. Evaluating each candidate solution requires prior knowledge of the inference latency on the subtask-specified server, which is referred to as L server . Frequently send requests to obtain from the server L server This will cause huge communication overhead and prolong the optimization process. To solve this problem, the present invention uses a lightweight radial basis function network (RBFN) to predict the inference delay on the specified server after segmentation. L server The prediction model uses historical data for incremental training. During task execution, the present invention collects the inference delay on the terminal device. L endModel information, server identification information, and corresponding server inference delay. Based on this information, the present invention constructs a three-layer lightweight neural network. The model captures the implicit relationship between terminal inference delay, model type, server identification information, and specified server inference delay. For the parsing decision of the current candidate solution, the input of the prediction proxy model includes the inference delay of the first part of the current task on the terminal device Input L , CNN information for generating tasks Input M And the server information for the second part of the task Input S The output of the prediction surrogate model is the inference latency of the second part of the task on the specified server The expression is as follows:

[0053] As an optional implementation method, step S108, based on the target segmentation layer number of each target task, determines the total delay and total energy of each target task, including: substituting the target segmentation layer number of each target task into the target delay calculation formula and the target energy calculation formula to obtain the total delay and total energy of each target task.

[0054] As an optional implementation method, the target delay calculation formula is:

[0055] in, For the target delay, Inferring latency for end devices, The transmission delay of the terminal device from the output data of the terminal device to the edge server, After the terminal device transmits the output data of the terminal device to the edge server, the waiting delay when the output data of the terminal device enters the queue for waiting, Reasoning about latency for the server.

[0056] In this embodiment, the terminal device infers the delay: For any terminal device, the present invention uses d i Indicates that n In the convolutional neural network model of layer i The floating point computation amount of the layer, where i ∈[1, n]. j Layer as a split layer, j ∈[1,n]. The reasoning from layer 1 to layer j is performed locally, while the reasoning from layer j The reasoning process from layer +1 to layer n will be performed on the edge server. f1 represents the floating point computing capability of the terminal device. The delay formula for executing layer 1 to layer j on the terminal device is as follows. Terminal device inference delay L end The calculation formula is as follows:

[0057] The transmission delay of the terminal device transmitting the output data of the terminal device to the edge server: j Layer is the segmentation layer that needs to send output data to the edge server (what does it mean). m j represents the size of the output data of the jth layer. According to Shannon's law, the data transmission rate is ,in, B is the channel bandwidth, Q is the transmission power of the terminal equipment, G is the channel gain between the terminal device and the edge server, is the noise power. Transmission delay L trans The calculation method is as follows:

[0058] After the terminal device transmits the output data of the terminal device to the edge server, the waiting delay when the output data of the terminal device enters the queue for waiting: the intermediate data of the task is transmitted to the designated server k After that, the task will enter the queue and wait for execution. The waiting time is related to the number of tasks before this task in the queue. q And each task on the edge server k The calculation formula is as follows:

[0059] Server inference delay: Due to the j The layer is a segmentation layer, and the edge server needs to execute j +1 layer to n-th layer reasoning tasks. f 3 represents the floating point computing capability of the edge server. j The latency from layer +1 to layer n is expressed as follows: Edge server inference latency L server The calculation formula is as follows:

[0060] in, f 3 represents the floating point computing capability of the edge server.

[0061] As an optional embodiment, the target energy calculation formula is:

[0062] in, is the target energy, Reasoning about energy consumption for end devices, It is the transmission energy consumption of the terminal device to transmit the output data of the terminal device to the edge server.

[0063] In this embodiment, the terminal device infers energy consumption: E end The calculation formula is as follows:

[0064] in, p end is the inference energy consumption rate of the terminal device, L end is the terminal device inference latency for the current task.

[0065] The transmission energy consumption of the terminal device to transmit the output data of the terminal device to the edge server: E trans The calculation formula is as follows:

[0066] in, p trans Transmits energy consumption rate for terminal equipment, L trans The terminal device transmission delay for the current task.

[0067] In an embodiment of the present invention, a plurality of target tasks are obtained, wherein different target tasks are processed by different convolutional neural network models; when each target task is unloaded from a terminal device to an edge server, different convolutional neural network models are processed by grouping layer granularity division and optimizer search to make the number of divisible layers of different convolutional neural network models equal, wherein each target task corresponds to a terminal device and an edge server; when each target task is processed by the convolutional neural network model corresponding to each target task, an initial population of dimensions corresponding to the number of layers of the convolutional neural network model corresponding to each target task is created according to the number of layers of the convolutional neural network model corresponding to each target task, wherein the initial population includes n individuals, and the dimension of each individual is the number of layers of the convolutional neural network model corresponding to each target task plus a dimension representing a server identifier; the initial population of dimensions corresponding to the number of layers of the convolutional neural network model corresponding to each target task is iteratively updated by a differential evolution algorithm to obtain a target population of dimensions corresponding to the number of layers of the convolutional neural network model corresponding to each target task; The target population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to the task is converted through the sigmoid function to obtain a 0 / 1 coding population for each target task; multiple candidate solutions for each target task are obtained through the number of zeros of each individual in the 0 / 1 coding population of each target task, wherein each candidate solution is the number of zeros of each individual plus a server identifier; based on the multiple candidate solutions for each target task, the target number of segmentation layers for each target task is determined; based on the target number of segmentation layers for each target task, the total delay and total energy of each target task are determined; based on the total delay and total energy of each target task, the total delay and total energy of multiple target tasks are obtained, which solves the technical problem that when the existing technology parses heterogeneous CNN inference tasks to find the best offloading solution, it responds to the dynamic relationship between the search space and the segmentation layer through frequent initialization, and the technical problem that tailoring the parsing strategy for each model will cause waste of computing resources and loss of correlation between models, and achieves the technical effect of effectively reducing system delay and energy consumption in heterogeneous model inference tasks and meeting the low latency and low energy consumption requirements in industrial Internet scenarios.

[0068] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0069] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0070] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0071] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed over multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0072] In addition, each functional unit in each embodiment of the present invention may be integrated into a first processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0073] The above are only preferred embodiments of the present invention. It should be pointed out that, for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A multi-objective analysis method for heterogeneous convolutional neural networks in industrial edge scenarios, characterized by: include: Obtain multiple target tasks, where different target tasks are processed using different convolutional neural network models; When each target task is offloaded from the terminal device to the edge server, different convolutional neural network models are processed through grouping layer granularity division and optimizer search to make the number of splittable layers of different convolutional neural network models equal, wherein each target task corresponds to one terminal device and one edge server; When each target task is processed by the convolutional neural network model corresponding to each target task, an initial population with a dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task is created according to the number of layers of the convolutional neural network model corresponding to each target task, wherein the initial population includes n individuals, and the dimension of each individual is the number of layers of the convolutional neural network model corresponding to each target task plus a dimension representing a server identifier; The initial population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task is iteratively updated by a differential evolution algorithm to obtain a target population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task; The target population of the dimension corresponding to the number of layers of the convolutional neural network model corresponding to each target task is converted through the sigmoid function to obtain the 0 / 1 coding population of each target task; By encoding the number of zeros of each individual in the 0 / 1 encoding population of each target task, multiple candidate solutions for each target task are obtained, wherein each candidate solution is the number of zeros of each individual plus the server identifier; Based on multiple candidate solutions for each target task, determine the target segmentation layer number for each target task; Determine the total latency and total energy of each target task based on the target segmentation layer number of each target task; Based on the total delay and total energy of each target task, the total delay and total energy of multiple target tasks are obtained.

2. The method according to claim 1, characterized in that The step of determining the target segmentation number of each target task based on multiple candidate solutions for each target task includes: Substituting the information of the number of segmentation layers indicated by each candidate solution into the initial delay calculation formula to obtain multiple initial total delays; The candidate solution corresponding to the minimum value of multiple initial total delays is determined as the target segmentation layer number for each target task.

3. The method according to claim 2, characterized in that The initial delay calculation formula is: in, is the initial delay, Inferring latency for end devices, The transmission delay of the terminal device from the output data of the terminal device to the edge server, After the terminal device transmits the output data of the terminal device to the edge server, the waiting delay when the output data of the terminal device enters the queue for waiting, Server inference latency for predictive model output.

4. The method according to claim 1, characterized in that The determining of the total delay and total energy of each target task based on the target segmentation layer number of each target task includes: Substitute the target segmentation layer number of each target task into the target delay calculation formula and the target energy calculation formula to obtain the total delay and total energy of each target task.

5. The method according to claim 1, characterized in that The target delay calculation formula is: in, For the target delay, Inferring latency for end devices, The transmission delay of the terminal device from the output data of the terminal device to the edge server, After the terminal device transmits the output data of the terminal device to the edge server, the waiting delay when the output data of the terminal device enters the queue for waiting, Reasoning about latency for the server.

6. The method according to claim 1, characterized in that The target energy calculation formula is: in, is the target energy, Reasoning about energy consumption for end devices, It is the transmission energy consumption of the terminal device to transmit the output data of the terminal device to the edge server.

7. A computer system, characterized in that include: One or more processors, and a computer-readable storage medium for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors are enabled to implement the method of claim 1.

8. A computer-readable storage medium, characterized in that Computer executable instructions are stored, and when the instructions are executed, they are used to implement the method of claim 1.

9. A computer program product, characterized in that The invention comprises computer executable instructions, which are used to implement the method of claim 1 when being executed.

Images