Cloud-edge collaborative target detection method based on dynamic hypernetwork
By constructing a dynamic segmentation hypernetwork and determining the optimal segmentation point in real time, the problem of decreased reasoning efficiency and accuracy in cloud-edge collaborative target detection is solved, and efficient target detection is achieved in resource-constrained environments.
Patent Information
- Application Number
- CN202411411154.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-10
- Publication Date
- 2025-10-21
- Estimated Expiration
- 2044-10-10
AI Technical Summary
In the existing technology, the cloud-edge collaborative target detection method based on deep neural networks uses a static method to determine the optimal segmentation point in scenarios where the bandwidth changes dynamically, resulting in reduced reasoning efficiency and decreased accuracy.
A dynamic segmentation super-network is built based on a single-branch YOLOv5s network. By adding fine-grained compensation F-Com blocks and Identity blocks at each segmentation point and coarse-grained compensation C-Com blocks at the end, a neural network architecture search is performed in real time, the optimal segmentation point is dynamically determined, and a target detection model is built. Edge devices and the cloud collaborate to perform target detection.
It achieves dynamic estimation of the optimal segmentation point in resource-constrained scenarios, improves reasoning efficiency and accuracy, and adapts to dynamically changing application scenarios.
Smart Images

Figure CN119540549B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of target detection technology, and in particular to a cloud-edge collaborative target detection method based on a dynamic hypernetwork. Background Art
[0002] In diverse application scenarios such as drone inspections, disaster relief, and augmented reality, lightweight edge devices can continue to operate normally even under poor network conditions or limited bandwidth resources, highlighting the importance of edge computing in such situations. However, due to the limited computing power, energy consumption, and bandwidth resources of edge devices, it is difficult to meet the low-latency and high-precision perception requirements when running intelligent models with many parameters and large computational workloads. In recent years, cloud-edge collaborative reasoning based on deep neural networks has attracted widespread attention. The key to collaborative reasoning is to find the optimal segmentation point of the neural network. Currently, existing technologies use a static method to determine the optimal segmentation point, and the segmentation point is fixed. Due to the limited computing power of the device, the reasoning efficiency and accuracy are reduced in scenarios where the bandwidth changes dynamically. Summary of the Invention
[0003] The present invention provides a cloud-edge collaborative target detection method based on a dynamic hypernetwork, which is used to solve the defects of the prior art in that the optimal segmentation point is determined in a static manner, the segmentation point is fixed, and it is difficult to adapt to the dynamically changing bandwidth, resulting in reduced reasoning efficiency and decreased accuracy.
[0004] In a first aspect, the present invention provides a cloud-edge collaborative target detection method based on a dynamic hypernetwork, comprising:
[0005] A dynamic segmentation super-network is constructed based on a YOLOv5s single-branch network. The dynamic segmentation super-network includes multiple convolutional layers and corresponding multiple segmentation points. A fine-grained compensation F-Com block and an Identity block are added to each segmentation point. A coarse-grained compensation C-Com block is added at the end of the dynamic segmentation super-network.
[0006] Based on the sample image, the dynamic segmentation super network is trained to obtain a trained super network;
[0007] Based on the trained hypernetwork, an inference model is constructed, and the inference model is deployed on edge devices and the cloud. Based on the inference model, a neural network architecture search is performed in real time to determine the optimal segmentation point. Based on the optimal segmentation point, the optimal subnetwork is determined to obtain an object detection model.
[0008] The edge device and the cloud collaboratively use the target detection model to perform target detection on the image to be detected, and obtain a target detection result of the image to be detected.
[0009] In some embodiments, performing a neural network architecture search in real time based on the inference model to determine an optimal segmentation point includes:
[0010] Constructing an objective function with the goal of minimizing the total inference delay of the inference model, where the total inference delay includes the computation delay of the edge device, the data transmission delay, and the computation delay of the cloud;
[0011] An adaptive segmentation point selection algorithm is used to solve the objective function and determine an optimal segmentation point from the multiple segmentation points.
[0012] In some embodiments, the objective function is calculated as follows:
[0013] ;
[0014] ;
[0015] in, represents the total inference latency, Indicates that the edge device adopts the inference model The computational delay of data processing at the layer, represents the data transmission delay from the edge device to the cloud, Indicates that the cloud uses the inference model The computational delay of data processing at the layer, is the current bandwidth of the communication channel between the edge device and the cloud, is the current signal-to-noise ratio of the communication channel, The inference model The amount of feature data output by the layer represents the amount of feature data transmitted by the edge device to the cloud. The first layer, The first layer, , Indicates the total number of convolutional layers of the inference model.
[0016] In some embodiments, the training of the dynamic segmentation hypernetwork based on the sample image to obtain the trained hypernetwork includes:
[0017] Setting binary vector groups corresponding to the fine-grained compensation F-Com blocks and Identity blocks of the multiple segmentation points, so that the target segmentation point selects the corresponding fine-grained compensation F-Com block for feature compression and fine-grained feature compensation, and the common segmentation point selects the corresponding Identity block for direct feature transfer;
[0018] Dynamically adjusting the binary vector group, adopting a uniform sampling strategy, simultaneously training sub-networks corresponding to different target segmentation points based on the sample image, and calculating the cumulative gradient of each sub-network;
[0019] Based on the accumulated gradient of each sub-network, the parameters of each sub-network are optimized to obtain a trained super-network.
[0020] In some embodiments, the object detection model includes a feature encoding module, a feature decoding module, and an object detection module;
[0021] The edge device and the cloud collaboratively use the target detection model to perform target detection on the image to be detected, and obtain a target detection result of the image to be detected, including:
[0022] The edge device acquires the image to be detected, uses the feature encoding module to perform feature extraction on the image to be detected to obtain an original feature map of the image to be detected, and compresses and quantizes the original feature map to obtain a compressed feature map;
[0023] The edge device sends the compressed feature map to the cloud;
[0024] The cloud receives the compressed feature map sent by the edge device, decodes the compressed feature map using the feature decoding module to obtain a decoded feature map, and adopts a coarse-fine granularity collaborative compensation strategy to perform feature processing on the decoded feature map to obtain a multi-scale feature map of the image to be detected;
[0025] The cloud uses the target detection module to perform target detection on the multi-scale feature map of the image to be detected to obtain a target detection result of the image to be detected.
[0026] In some embodiments, the coarse-grained and fine-grained collaborative compensation strategy is used to perform feature processing on the decoded feature map to obtain a multi-scale feature map of the image to be detected, including:
[0027] Extracting statistical information of the original feature map, the statistical information including a channel-level mean and variance of the original feature map;
[0028] Adaptively adjusting the channel-level mean and variance of the decoded feature map based on the statistical information of the original feature map, and performing fine-grained compensation on the decoded feature map to obtain a fine-grained compensated feature map;
[0029] Based on the fine-grained compensated feature map, coarse-grained compensation is performed to obtain the multi-scale feature map.
[0030] In a second aspect, the present invention further provides a cloud-edge collaborative target detection device based on a dynamic hypernetwork, comprising:
[0031] A construction unit is used to construct a dynamic segmentation super network based on a YOLOv5s single-branch network, wherein the dynamic segmentation super network includes multiple convolutional layers and corresponding multiple segmentation points, adds a fine-grained compensation F-Com block and an Identity block at each segmentation point, and adds a coarse-grained compensation C-Com block at the end of the dynamic segmentation super network;
[0032] A training unit, configured to train the dynamic segmentation supernetwork based on sample images to obtain a trained supernetwork;
[0033] An optimization unit is configured to construct an inference model based on the trained supernetwork, deploy the inference model on edge devices and in the cloud, perform a real-time neural network architecture search based on the inference model, determine an optimal segmentation point, and determine an optimal subnetwork based on the optimal segmentation point to obtain an object detection model;
[0034] The target detection unit is used for the edge device and the cloud to collaboratively use the target detection model to perform target detection on the image to be detected, and obtain the target detection result of the image to be detected.
[0035] The cloud-edge collaborative target detection method based on dynamic hypernetwork provided by the present invention constructs a dynamic segmentation hypernetwork based on a YOLOv5s single-branch network, trains the dynamic segmentation hypernetwork based on sample images to obtain a trained hypernetwork, constructs an inference model based on the trained hypernetwork, deploys the inference model on edge devices and the cloud, performs a neural network architecture search in real time based on the inference model, determines the optimal segmentation point, and obtains a target detection model. The edge device and the cloud collaboratively use the target detection model to perform target detection on the image to be detected to obtain a target detection result. This can realize dynamic estimation of the optimal segmentation point of the hypernetwork and improve reasoning efficiency and accuracy in resource-constrained scenarios. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction is given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0037] Figure 1 It is a statistical chart of the output data volume and computational complexity of each layer of YOLOv5s network provided by existing technology;
[0038] Figure 2Schematic diagram of the structure of a cloud-edge collaborative target detection system based on a dynamic hypernetwork provided by an embodiment of the present invention;
[0039] Figure 3 1 is a flow chart of a cloud-edge collaborative target detection method based on a dynamic hypernetwork provided by an embodiment of the present invention;
[0040] Figure 4 1 is a flow chart of a training process of a dynamic segmentation hypernetwork provided by an embodiment of the present invention;
[0041] Figure 5 is a schematic structural diagram of a coarse-grained and fine-grained compensation module provided by an embodiment of the present invention;
[0042] Figure 6 Schematic diagram of the structure of a cloud-edge collaborative target detection device based on a dynamic hypernetwork provided by an embodiment of the present invention;
[0043] Figure 7 It is a structural diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0044] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.
[0045] Figure 1 The statistical graph of the output data volume and computational complexity of each layer of YOLOv5s network provided by the existing technology. Figure 1 As shown in Figure 1, as a deep neural network runs, the amount of output data decreases layer by layer, while the amount of computation increases. Therefore, a common approach is to find an optimal split point for the deep neural network (DNN) and then segment the model. The edge device is responsible for reasoning in the first half, transmitting the intermediate output features to the cloud, which then completes the second half of the reasoning. However, model segmentation is susceptible to bandwidth fluctuations and device computing power. Because the multiple branches of the network significantly increase the number of transmitted features, existing segmentation algorithms have difficulty finding the optimal split point for convolutional neural networks in dynamic environments.
[0046] Existing research compresses models and intermediate features to reduce computational and communication latency. Intermediate feature compression methods include the use of JPEG and PNG encoders, Huffman coding, autoencoders, and quantization. Some research also uses lightweight methods such as pruning, knowledge distillation, and Neural Architecture Search (NAS) to reduce the computational complexity of edge models. However, most compression methods rely on fixed split points to keep intermediate feature quantities constant, which can increase transmission latency when bandwidth fluctuates. Furthermore, applying feature compression to different split points in the network can result in the loss of critical information, leading to reduced model accuracy.
[0047] To this end, the present invention provides a cloud-edge collaborative target detection method based on a dynamic hypernetwork. By constructing a dynamic segmentation hypernetwork based on a YOLOv5s single-branch network, the dynamic segmentation hypernetwork is trained based on sample images to obtain a trained hypernetwork. Based on the trained hypernetwork, an inference model is constructed. The inference model is deployed on edge devices and the cloud. Based on the inference model, a neural network architecture search is performed in real time to determine the optimal segmentation point and obtain a target detection model. The edge device and the cloud collaboratively use the target detection model to perform target detection on the image to be detected to obtain a target detection result. The present invention can realize dynamic estimation of the optimal segmentation point of the hypernetwork, and can improve inference efficiency and accuracy in resource-constrained scenarios.
[0048] Figure 2 This is a schematic diagram of the structure of the cloud-edge collaborative target detection system based on dynamic hypernetwork provided by an embodiment of the present invention. Figure 2 As shown, a cloud-edge collaborative target detection system based on a dynamic hypernetwork is provided. The system includes an edge device end and a cloud server end. The edge device end and the cloud server end are used to collaboratively utilize the dynamic segmentation hypernetwork to perform target detection on the image to be detected. The edge device end is also used to realize adaptive segmentation point selection and select different optimal segmentation points according to different application scenarios.
[0049] Figure 3 The flowchart of the cloud-edge collaborative target detection method based on dynamic hypernetwork provided by the embodiment of the present invention is as follows. Figure 3 As shown, a cloud-edge collaborative target detection method based on a dynamic hypernetwork is provided, comprising the following steps: step 310, step 320, step 330, and step 340. The steps of the method flow are merely a possible implementation of the present invention.
[0050] Step 310: Build a dynamic segmentation super-network based on the YOLOv5s single-branch network. The dynamic segmentation super-network includes multiple convolutional layers and corresponding multiple segmentation points. Add a fine-grained compensation F-Com block and an Identity block to each segmentation point, and add a coarse-grained compensation C-Com block at the end of the dynamic segmentation super-network.
[0051] Among them, YOLOv5s is the smallest model in the YOLOv5 series, with fewer parameters and less computational complexity, making it suitable for use in resource-constrained environments; YOLOv5 is an efficient target detection model and the fifth version of the YOLO (You Only Look Once) series.
[0052] It should be noted that the dynamic segmentation network includes multiple sub-networks corresponding to multiple segmentation points. Each sub-network includes a segmentation point, and the segmentation point is located between two adjacent convolutional layers.
[0053] Among them, the hypernetwork is a neural network architecture that provides a new perspective for the design of neural network architecture. By dynamically generating network parameters, it can achieve more flexible and efficient model design, which is suitable for processing a variety of complex tasks.
[0054] Among them, the F-Com (Feature Communication) block enhances feature expression capabilities through cross-layer feature communication, enabling the effective combination of shallow detail features and deep semantic features; the Identity block directly transmits input to output through skip connections, facilitating information transmission in the network; and the C-Com (Class Communication) block optimizes classification performance through information exchange between categories.
[0055] It should be noted that the F-Com block operates at the optimal split point to highly compress the output feature map for more efficient transmission between edge devices and cloud servers.
[0056] Step 320: Based on the sample image, train the dynamic segmentation hypernetwork to obtain a trained hypernetwork.
[0057] Optionally, multiple sample images are acquired, and a multi-scale feature label of each sample image is determined.
[0058] Optionally, each sample image is input into a dynamic segmentation hypernetwork to obtain a prediction result of the multi-scale features of each sample image output by the dynamic segmentation hypernetwork.
[0059] Optionally, a loss function value is calculated based on the prediction result of the multi-scale feature of each sample image and the multi-scale feature label of each sample image.
[0060] Based on the loss function value, the parameters of the dynamic segmentation hypernetwork are iteratively optimized.
[0061] Step 330: Based on the trained super network, build an inference model, deploy the inference model on edge devices and the cloud, and perform a real-time neural network architecture search based on the inference model to determine the optimal segmentation point. Based on the optimal segmentation point, determine the optimal subnetwork to obtain the target detection model.
[0062] Optionally, obtain the current bandwidth and current signal-to-noise ratio of the communication channel from the edge device to the cloud.
[0063] Optionally, based on the current bandwidth and the current signal-to-noise ratio, a neural network architecture search is performed in real time to determine the optimal split point.
[0064] Optionally, the optimal sub-network is combined with the detection head to obtain an object detection model.
[0065] It should be noted that thanks to the hypernetwork design, the same inference model can be deployed on edge devices and the cloud, saving the storage overhead of split point switching and multiple models; the edge device selects the optimal split point based on its computing power and communication rate, and shares the optimal split point information with the cloud to synchronously switch to the same subnet architecture.
[0066] It can be understood that performing a neural network architecture search in real time to determine the optimal segmentation point can achieve dynamic estimation of the optimal segmentation point, which has strong real-time and flexibility and can adapt to dynamically changing application scenarios.
[0067] In step 340 , the edge device and the cloud collaboratively use the target detection model to perform target detection on the image to be detected, and obtain a target detection result for the image to be detected.
[0068] Optionally, the edge device uses the target detection model to extract, compress and quantize features of the image to be detected, obtains a compressed feature map, and transmits the compressed feature map to the cloud.
[0069] Optionally, the cloud uses a target detection model to decode, perform fine-grained compensation, and coarse-grained compensation on the compressed feature map to obtain multi-scale features, and obtain target detection results based on the multi-scale features.
[0070] In an embodiment of the present invention, a dynamic segmentation supernetwork is constructed based on a YOLOv5s single-branch network, and the dynamic segmentation supernetwork is trained based on a sample image to obtain a trained supernetwork. An inference model is constructed based on the trained supernetwork, and the inference model is deployed on edge devices and the cloud. Based on the inference model, a neural network architecture search is performed in real time to determine the optimal segmentation point and obtain a target detection model. The edge device and the cloud collaboratively use the target detection model to perform target detection on the image to be detected to obtain a target detection result. This can realize dynamic estimation of the optimal position of the cutting point and improve the inference efficiency and accuracy in resource-constrained scenarios.
[0071] In some embodiments, a neural network architecture search is performed based on the inference model to determine the optimal split point, including:
[0072] The objective function is constructed with the goal of minimizing the total inference latency of the inference model. The total inference latency includes the computational latency of the edge device, the data transmission latency, and the computational latency in the cloud.
[0073] An adaptive segmentation point selection algorithm is used to solve the objective function and determine the optimal segmentation point from multiple segmentation points.
[0074] Optionally, the current bandwidth and the current signal-to-noise ratio are obtained, and based on the current bandwidth and the current signal-to-noise ratio, the Shannon formula is used to calculate the communication transmission rate from the edge device to the cloud.
[0075] Optionally, the data transmission delay is calculated based on the communication transmission rate.
[0076] Optionally, an adaptive segmentation point selection algorithm is used to determine the optimal segmentation point, including:
[0077] S1, input: edge computing delay set, cloud computing delay set, communication bandwidth B, signal-to-noise ratio SNR, segmentation point set N;
[0078] S2, output: optimal segmentation subnet ;
[0079] S3. Initialization: segmentation point selection vector ;
[0080] S4、fori in ;
[0081] S5. Edge computing latency of computing network layer 0-i , and the (i+1)-N layer cloud computing latency , get the feature quantity of the output of the i-th layer ;
[0082] S6, ;
[0083] S7, ;
[0084] S8, ;
[0085] S9, end for;
[0086] S10, ;
[0087] S11, .
[0088] Optionally, set a set of binary vectors Used to indicate the selection of the F-Com block. Each split point can choose to enable the F-Com block or the Identity block.
[0089] F-Com block: When the i-th layer is selected as the optimal split point, set the i-th F-Com block At this split point, the output features are channel compressed and quantized on the edge device side to reduce the amount of data transmission; in the cloud, fine-grained compensation is used to restore the compressed feature information.
[0090] Identity block: If the i-th layer is not the optimal split point, set , the features are passed directly to the next layer of the network through the Identity block.
[0091] Optionally, after determining the optimal split point p, set the pth F-Com block , the optimal segmentation sub-network is obtained at the segmentation point p between the edge device and the cloud.
[0092] In some embodiments, the objective function is calculated as follows:
[0093] ;
[0094] ;
[0095] in, represents the total inference latency, Indicates that edge devices use inference models The computational delay of data processing at the layer, Indicates the data transmission delay from edge devices to the cloud. Indicates that the cloud uses an inference model The computational delay of data processing at the layer, is the current bandwidth of the communication channel between the edge device and the cloud, is the current signal-to-noise ratio of the communication channel, The inference model The amount of feature data output by the layer represents the amount of feature data transmitted from the edge device to the cloud. Represents the inference model layer, Represents the inference model layer, , Indicates the total number of convolutional layers of the inference model.
[0096] It should be noted that according to Shannon’s theorem, the bandwidth 𝐵 and the signal-to-noise ratio 𝑆𝑁𝑅 determine the maximum transmission rate of the communication channel.
[0097] Figure 4 Schematic diagram of the training process of the dynamic segmentation super network provided by the embodiment of the present invention. Figure 4 As shown, in some embodiments, a dynamic segmentation super-network is trained based on sample images to obtain a trained super-network, including:
[0098] Step 410: Set binary vector groups corresponding to the fine-grained compensation F-Com blocks and Identity blocks of multiple segmentation points, so that the target segmentation point selects the corresponding fine-grained compensation F-Com block for feature compression and fine-grained feature compensation, and the common segmentation point selects the corresponding Identity block for direct feature transfer;
[0099] Step 420: Dynamically adjust the binary vector group, adopt a uniform sampling strategy, simultaneously train sub-networks corresponding to different target segmentation points based on the sample image, and calculate the cumulative gradient of each sub-network;
[0100] Step 430: Based on the accumulated gradient of each sub-network, optimize the parameters of each sub-network to obtain a trained super-network.
[0101] It should be noted that during the training of the hypernetwork, the maintenance vector group , in order to train sub-networks with different segmentation points at the same time. Since each sub-network has only one segmentation point, only one F-Com block of the segmentation point network is selected at the same time. The vector group It is limited to a one-hot vector; a uniform sampling strategy is used to sample the sub-networks and the accumulated gradients of the sub-networks are used to optimize the super-network, which can effectively ensure that all sub-networks are fully trained.
[0102] In some embodiments, the object detection model includes a feature encoding module, a feature decoding module, and an object detection module;
[0103] The edge device and the cloud collaborate to use the target detection model to perform target detection on the image to be detected, and obtain the target detection results of the image to be detected, including:
[0104] The edge device obtains the image to be detected, uses the feature encoding module to extract features of the image to be detected, obtains the original feature map of the image to be detected, and compresses and quantizes the original feature map to obtain a compressed feature map;
[0105] The edge device sends the compressed feature map to the cloud;
[0106] The cloud receives the compressed feature map sent by the edge device, uses the feature decoding module to decode the compressed feature map to obtain the decoded feature map, adopts the coarse-fine granularity collaborative compensation strategy to perform feature processing on the decoded feature map to obtain the multi-scale feature map of the image to be detected;
[0107] The cloud uses the target detection module to perform target detection on the multi-scale feature map of the image to be detected and obtain the target detection result of the image to be detected.
[0108] It can be understood that by collaboratively utilizing the target detection model based on the dynamic segmentation hypernetwork through edge devices and the cloud, the detected image can be processed in real time, which improves the reasoning efficiency, has strong real-time performance and flexibility, and is suitable for complex application scenarios with dynamic changes and limited resources. By adopting a coarse-grained and fine-grained collaborative compensation strategy to compensate for the restored features, the coarse-grained compensation restores the multi-level feature information in the network, while the fine-grained compensation restores the single-layer compressed feature information at the segmentation point, thereby improving the accuracy of reasoning and the accuracy of target detection.
[0109] Figure 5 This is a schematic diagram of the structure of the coarse and fine granularity compensation module provided by the embodiment of the present invention. Figure 5 As shown in the figure, the fine-grained compensation F-Com block is inserted at each segmentation point of the dynamic segmentation super network to compress the features output at the segmentation point and perform fine-grained compensation based on the statistical information of the original features; the coarse-grained compensation C-Com block is placed at the end of the dynamic segmentation super network to restore multiple high-level features through a single layer of low-level features for coarse-grained compensation.
[0110] In some embodiments, a coarse-grained and fine-grained collaborative compensation strategy is adopted to perform feature processing on the decoded feature map to obtain a multi-scale feature map of the image to be detected, including:
[0111] Extract statistical information of the original feature map, including the channel-level mean and variance of the original feature map;
[0112] Based on the statistical information of the original feature map, the channel-level mean and variance of the decoded feature map are adaptively adjusted, and the decoded feature map is fine-grained compensated to obtain a fine-grained compensated feature map;
[0113] Based on the feature map after fine-grained compensation, coarse-grained compensation is performed to obtain a multi-scale feature map.
[0114] Optionally, the fine-grained compensation F-Com block compresses and quantizes the original feature map as follows:
[0115] ;
[0116] ;
[0117] in, represents the original feature map, Represents compressed feature map, ConvReduce represents feature compression, and Sign is the feature quantization function; are the statistical information of the original feature map, which respectively represent the channel-level mean and variance of the original feature map.
[0118] Optionally, the compressed feature map is decoded as follows:
[0119] ;
[0120] in, Represents the decoded feature map, and ConvRecover represents the feature recovery process.
[0121] Optionally, the mean and variance of the decoded feature map are matched with the mean and variance of the original feature map, as expressed as follows:
[0122] ;
[0123] in, represents the feature map after fine-grained compensation, They represent the channel-level mean and variance of the decoded feature map respectively.
[0124] It should be noted that the C-Com block is used to recover multiple low-level features from a single high-level feature and pass them to the feature pyramid of the neck. Through the compensation mechanism, the edge device no longer needs to transmit multi-branch features, but only needs to transmit the features of the current layer, reducing the amount of multi-branch feature transmission; in addition, the C-Com block can also perform coarse-grained reconstruction of quantized features through the deconvolution network, thereby improving the feature expression capability.
[0125] It can be understood that by performing feature compensation using fine-grained compensation and coarse-grained compensation, the recovered features can be made closer to the original features, which helps to reduce the impact of quantization and improve the accuracy of the recovered features.
[0126] Example:
[0127] 1) Dataset Description:
[0128] In this embodiment of the present invention, a dynamic segmentation hypernetwork was trained and tested on the COCO 2017 dataset. The COCO dataset contains over 200,000 high-resolution images, covering 80 categories of objects in natural scenes. The dataset includes a training set, a validation set, and a test set. The training set contains approximately 118,000 images, and the validation set contains approximately 5,000 images. The objects in the dataset vary in size, ranging from small to large objects. During training, input images were scaled to 640 × 640 for all experiments, and performance was reported on the validation dataset.
[0129] 2) The experimental setup is as follows:
[0130] This embodiment of the present invention uses the NVIDIA Jetson TX2 as an edge device and the NVIDIA A100 as a cloud server. The model is based on the PyTorch framework and trained in the cloud. During training, the Stochastic Gradient Descent (SGD) optimizer is used, with an initial learning rate of 1e-2, which decays to 2e-3 during training. The total number of training epochs is 400, and the batch size is 32. Due to the presence of non-differentiable binarization operations during model training, a straight-through estimator (STE) strategy is adopted, directly propagating the gradient of the last layer of the quantization module back to the previous layer. When training the hypernetwork model, a weight-sharing strategy is used to train the four-branch sub-network simultaneously in each epoch. Mean Average Precision (mAP) is used as the evaluation metric for model accuracy.
[0131] 3) Ablation analysis:
[0132] Table 1 shows the ablation experiment results provided by an embodiment of the present invention. The original YOLOv5 model is used as the baseline without modification. The feature size is several thousand KB at each segmentation point, and the accuracy is 0.567. After adding C-Com, the amount of features transmitted by multiple branches of the network is significantly reduced, while the accuracy decreases by no more than 0.4%. Through channel compression and 1-bit quantization, the features are reduced by 128 times, but the accuracy is reduced, especially at segmentation points 3 and 10, which lose 2.1% and 3.4% of the accuracy compared to the baseline. Through the compensation strategy, the accuracy of segmentation points 3 and 10 is improved by 1.2% and 1.4% respectively, while the feature inclusion statistical information only increases by 1KB and 3KB, and the accuracy loses 1.7% and 2% compared to the baseline. These results show that DS-Net not only effectively reduces the amount of transmitted features, but also effectively alleviates the accuracy loss caused by feature compression.
[0133] Table 1 Ablation experiment results provided by the embodiment of the present invention
[0134]
[0135] 4) Adaptive analysis of segmentation points:
[0136] To evaluate the adaptive inference performance of the cloud-edge collaborative object detection method based on a dynamic hypernetwork, proposed in this embodiment of the present invention, under different bandwidth conditions, WonderShaper was used to control the upload bandwidth, and three simulations were conducted: 8 Mbps, 16 Mbps, and 56 Mbps. Comparative experiments were conducted using three settings: cloud-only, edge-only, and the proposed method. The inference latency, accuracy, and other parameters of these methods were compared under different bandwidths.
[0137] Table 2 shows the adaptability analysis results under different bandwidths provided by the embodiment of the present invention. When edge-only computing is performed, the inference latency is 70.2 ms and the accuracy is 0.567. This shows that edge-only device processing provides low latency while maintaining accuracy, but it lacks the collaborative capabilities of the cloud, which puts a huge burden on the edge device. For the cloud-only method, the inference latency is severely affected by the bandwidth. At 8 Mbps, the longer transmission time results in a total inference latency of 423.5 ms. Even if the bandwidth is increased to 56 Mbps, the total latency is only reduced to 116.8 ms. This shows that the transmission bottleneck in edge computing under low bandwidth conditions can significantly affect the inference efficiency.
[0138] In comparison, the method proposed in this embodiment demonstrates significant advantages under varying bandwidth conditions. At 8 Mbps, the proposed method segments the hypernetwork at the 10th layer and effectively compresses the feature data to 6 KB, achieving a total latency of 68.5 ms. Due to limited network bandwidth, the proposed method selects a later segmentation point, reducing transmission latency by transmitting fewer features. At 16 Mbps, the proposed method segments at the 5th layer and compresses the feature data to 15 KB, resulting in a total inference latency of 61.0 ms, 76% lower than the cloud-only approach with only a 1.1% loss in accuracy. When the bandwidth is increased to 56 Mbps, the proposed method segments at the 3rd layer and compresses the feature data to 26 KB, further reducing the total latency to 53.6 ms. Given the abundant network transmission resources and already low transmission latency, the proposed method selects an earlier segmentation point to minimize computational latency. These results demonstrate that the proposed method, through flexible segmentation point switching and efficient coarse-grained and fine-grained compensation techniques, maintains low inference latency while ensuring accuracy across varying bandwidths.
[0139] Table 2 Adaptability analysis results under different bandwidths provided by the embodiment of the present invention
[0140]
[0141] 5) Comparison with other methods:
[0142] Table 3 shows the comparative analysis results between the proposed method and other existing methods. All methods are based on YOLOv5 as a baseline, with a bandwidth of 16 Mbps. Compared to other methods, the proposed method exhibits superior performance. The 1-bit quantization method offers moderate latency and feature size, resulting in a 40% decrease in network accuracy and a 46% increase in latency compared to the proposed method. In contrast, int8 quantization achieves a higher mAP (0.560), but at the expense of higher latency and a larger feature size, with latency increasing by almost tenfold compared to the proposed method. The JPEG compressor performs well in terms of latency, but the lossy compression of arbitrary information results in lower accuracy, with accuracy decreasing by 49.7% and 26.4%, respectively, compared to the proposed method. BottleNet++ uses a traditional encoder and decoder architecture and accounts for channel noise, which indicates that it is inefficient in terms of speed and memory. DeepAdaln-Net achieves a good balance between latency (63.3 ms), feature size (26 KB), and mAP (0.552), but performance improvements are still limited by the fixed split point. Compared with DeepAdaln-Net, the proposed method reduces the feature size by 42% and improves the accuracy by 0.4%, showing the best performance of dynamic segmentation and compensation technology under bandwidth changes.
[0143] Table 3 Comparative analysis results between the method proposed in the embodiment of the present invention and other existing methods
[0144]
[0145] The following describes a cloud-edge collaborative target detection device based on a dynamic hypernetwork provided by an embodiment of the present invention. The cloud-edge collaborative target detection device based on a dynamic hypernetwork described below and the cloud-edge collaborative target detection method based on a dynamic hypernetwork described above can refer to each other.
[0146] Figure 6 A schematic diagram of the structure of a cloud-edge collaborative target detection device based on a dynamic hypernetwork provided by an embodiment of the present invention is shown in FIG. Figure 6 As shown, the cloud-edge collaborative target detection device 600 based on dynamic hypernetwork includes:
[0147] A construction unit 610 is configured to construct a dynamic segmentation super-network based on a YOLOv5s single-branch network, wherein the dynamic segmentation super-network includes multiple convolutional layers and corresponding multiple segmentation points, adds a fine-grained compensation F-Com block and an Identity block at each segmentation point, and adds a coarse-grained compensation C-Com block at the end of the dynamic segmentation super-network;
[0148] A training unit 620 is configured to train the dynamic segmentation supernetwork based on the sample image to obtain a trained supernetwork;
[0149] An optimization unit 630 is configured to construct an inference model based on the trained supernetwork, deploy the inference model on edge devices and in the cloud, perform a real-time neural network architecture search based on the inference model, determine the optimal split point, and based on the optimal split point, determine the optimal subnetwork to obtain an object detection model.
[0150] The target detection unit 640 is used for the edge device and the cloud to collaboratively use the target detection model to perform target detection on the image to be detected, and obtain the target detection result of the image to be detected.
[0151] Optionally, based on the inference model, a neural network architecture search is performed to determine the optimal split point, including:
[0152] The objective function is constructed with the goal of minimizing the total inference latency of the inference model. The total inference latency includes the computational latency of the edge device, the data transmission latency, and the computational latency in the cloud.
[0153] An adaptive segmentation point selection algorithm is used to solve the objective function and determine the optimal segmentation point from multiple segmentation points.
[0154] Optionally, the objective function is calculated as follows:
[0155] ;
[0156] ;
[0157] in, represents the total inference latency, Indicates that edge devices use inference models The computational delay of data processing at the layer, Indicates the data transmission delay from edge devices to the cloud. Indicates that the cloud uses an inference model The computational delay of data processing at the layer, is the current bandwidth of the communication channel between the edge device and the cloud, is the current signal-to-noise ratio of the communication channel, The first The amount of feature data output by the layer represents the amount of feature data transmitted from the edge device to the cloud. Represents the inference model layer, Represents the inference model layer, , Indicates the total number of convolutional layers of the inference model.
[0158] Optionally, based on the sample image, the dynamic segmentation hypernetwork is trained to obtain a trained hypernetwork, including:
[0159] Set the binary vector groups corresponding to the fine-grained compensation F-Com blocks and Identity blocks of multiple segmentation points, so that the target segmentation point selects the corresponding fine-grained compensation F-Com block for feature compression and fine-grained feature compensation, and the common segmentation point selects the corresponding Identity block for direct feature transfer;
[0160] Dynamically adjust the binary vector group, adopt a uniform sampling strategy, and simultaneously train sub-networks corresponding to different target segmentation points based on sample images, and calculate the cumulative gradient of each sub-network;
[0161] Based on the accumulated gradient of each sub-network, the parameters of each sub-network are optimized to obtain the trained super-network.
[0162] Optionally, the target detection model includes a feature encoding module, a feature decoding module and a target detection module;
[0163] Use the target detection model to perform target detection on the image to be detected, and obtain the target detection results of the image to be detected, including:
[0164] The edge device obtains the image to be detected, uses the feature encoding module to extract features of the image to be detected, obtains the original feature map of the image to be detected, and compresses and quantizes the original feature map to obtain a compressed feature map;
[0165] The edge device sends the compressed feature map to the cloud;
[0166] The cloud receives the compressed feature map sent by the edge device, uses the feature decoding module to decode the compressed feature map to obtain the decoded feature map, adopts the coarse-fine granularity collaborative compensation strategy to perform feature processing on the decoded feature map to obtain the multi-scale feature map of the image to be detected;
[0167] The cloud uses the target detection module to perform target detection on the multi-scale feature map of the image to be detected and obtain the target detection result of the image to be detected.
[0168] Optionally, a coarse-fine granularity collaborative compensation strategy is adopted to perform feature processing on the decoded feature map to obtain a multi-scale feature map of the image to be detected, including:
[0169] Extract statistical information of the original feature map, including the channel-level mean and variance of the original feature map;
[0170] Based on the statistical information of the original feature map, the channel-level mean and variance of the decoded feature map are adaptively adjusted, and the decoded feature map is fine-grained compensated to obtain a fine-grained compensated feature map;
[0171] Based on the feature map after fine-grained compensation, coarse-grained compensation is performed to obtain a multi-scale feature map.
[0172] It should be noted here that the cloud-edge collaborative target detection device based on dynamic hypernetwork provided by an embodiment of the present invention can implement all the method steps implemented by the above-mentioned cloud-edge collaborative target detection method embodiment based on dynamic hypernetwork, and can achieve the same technical effect. The parts and beneficial effects of this embodiment that are the same as those of the method embodiment will not be described in detail here.
[0173] Figure 7 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention, such as Figure 7 As shown, the electronic device may include: a processor (processor) 710 , a communication interface (Communications Interface) 720 , a memory (memory) 730 and a communication bus 740 , wherein the processor 710 , the communication interface 720 and the memory 730 communicate with each other via the communication bus 740 . The processor 710 can call the logic instructions in the memory 730 to execute a cloud-edge collaborative target detection method based on a dynamic supernetwork, the method including: constructing a dynamic segmentation supernetwork based on the YOLOv5s single-branch network, the dynamic segmentation supernetwork including multiple convolutional layers and corresponding multiple segmentation points, adding fine-grained compensation F-Com blocks and Identity blocks at each segmentation point, and adding coarse-grained compensation C-Com blocks at the end of the dynamic segmentation supernetwork; based on the sample image, the dynamic segmentation supernetwork is trained to obtain a trained supernetwork; based on the trained supernetwork, an inference model is constructed, and the inference model is deployed on the edge device and the cloud; based on the inference model, a neural network architecture search is performed in real time to determine the optimal segmentation point, and based on the optimal segmentation point, the optimal subnetwork is determined to obtain a target detection model; using the target detection model to perform target detection on the image to be detected, and obtain the target detection result of the image to be detected.
[0174] Furthermore, the logic instructions in the aforementioned memory 730 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product, stored in a storage medium, includes instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, a mobile hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0175] On the other hand, the present invention also provides a computer program product, which includes a computer program, which can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the cloud-edge collaborative target detection method based on the dynamic supernetwork provided by the above methods, the method including: constructing a dynamic segmentation supernetwork based on the YOLOv5s single-branch network, the dynamic segmentation supernetwork including multiple convolutional layers and corresponding multiple segmentation points, adding fine-grained compensation F-Com blocks and Identity blocks at each segmentation point, and adding coarse-grained compensation C-Com blocks at the end of the dynamic segmentation supernetwork; based on the sample image, the dynamic segmentation supernetwork is trained to obtain a trained supernetwork; based on the trained supernetwork, an inference model is constructed, and the inference model is deployed on the edge device and the cloud; based on the inference model, a neural network architecture search is performed in real time to determine the optimal segmentation point, and based on the optimal segmentation point, the optimal subnetwork is determined to obtain a target detection model; using the target detection model to perform target detection on the image to be detected, and obtain the target detection result of the image to be detected.
[0176] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the cloud-edge collaborative target detection method based on the dynamic supernetwork provided by the above methods, the method comprising: constructing a dynamic segmentation supernetwork based on a YOLOv5s single-branch network, the dynamic segmentation supernetwork comprising multiple convolutional layers and corresponding multiple segmentation points, adding a fine-grained compensation F-Com block and an Identity block at each segmentation point, and adding a coarse-grained compensation C-Com block at the end of the dynamic segmentation supernetwork; training the dynamic segmentation supernetwork based on a sample image to obtain a trained supernetwork; constructing an inference model based on the trained supernetwork, deploying the inference model on edge devices and the cloud, and performing a real-time neural network architecture search based on the inference model to determine the optimal segmentation point, and determining the optimal subnetwork based on the optimal segmentation point to obtain a target detection model; performing target detection on the image to be detected using the target detection model to obtain a target detection result of the image to be detected.
[0177] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.
[0178] Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented using software plus a necessary general-purpose hardware platform, or of course, hardware. Based on this understanding, the essence of the above technical solution, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, or an optical disk, and includes a number of instructions for causing a computer device (such as a personal computer, server, or network device) to execute the methods described in each embodiment or certain portions of the embodiments.
[0179] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.
Claims
1. A cloud-edge collaborative target detection method based on dynamic hypernetwork, characterized in that: include: A dynamic segmentation super-network is constructed based on a YOLOv5s single-branch network. The dynamic segmentation super-network includes multiple convolutional layers and corresponding multiple segmentation points. A fine-grained compensation F-Com block and an Identity block are added to each segmentation point. A coarse-grained compensation C-Com block is added at the end of the dynamic segmentation super-network. Based on the sample image, the dynamic segmentation super network is trained to obtain a trained super network; Based on the trained hypernetwork, an inference model is constructed, and the inference model is deployed on edge devices and the cloud. Based on the inference model, a neural network architecture search is performed in real time to determine the optimal segmentation point. Based on the optimal segmentation point, the optimal subnetwork is determined to obtain an object detection model. The edge device and the cloud collaboratively use the target detection model to perform target detection on the image to be detected, and obtain a target detection result of the image to be detected; The method of training the dynamic segmentation super-network based on the sample image to obtain the trained super-network includes: Setting binary vector groups corresponding to the fine-grained compensation F-Com blocks and Identity blocks of the multiple segmentation points, so that the target segmentation point selects the corresponding fine-grained compensation F-Com block for feature compression and fine-grained feature compensation, and the common segmentation point selects the corresponding Identity block for direct feature transfer; Dynamically adjusting the binary vector group, adopting a uniform sampling strategy, simultaneously training sub-networks corresponding to different target segmentation points based on the sample image, and calculating the cumulative gradient of each sub-network; Optimizing the parameters of each sub-network based on the accumulated gradient of each sub-network to obtain a trained super-network; The expression for compressing and quantizing the original feature map by the fine-grained compensation F-Com block is as follows: ; ; in, represents the original feature map, Represents compressed feature map, ConvReduce represents feature compression, and Sign is the feature quantization function; is the statistical information of the original feature map, which respectively represents the channel-level mean and variance of the original feature map; Decode the compressed feature map, the expression is as follows: ; in, Represents the decoded feature map, and ConvRecover represents the feature recovery process; Match the mean and variance of the decoded feature map with the mean and variance of the original feature map. The expressions are as follows: ; in, represents the feature map after fine-grained compensation, Represent the channel-level mean and variance of the decoded feature map respectively; The C-Com block performs coarse-grained reconstruction of quantized features through a deconvolution network.
2. The cloud-edge collaborative target detection method based on dynamic hypernetwork according to claim 1 is characterized in that: The method of performing a neural network architecture search in real time based on the inference model to determine the optimal segmentation point includes: Constructing an objective function with the goal of minimizing the total inference delay of the inference model, where the total inference delay includes the computation delay of the edge device, the data transmission delay, and the computation delay of the cloud; An adaptive segmentation point selection algorithm is used to solve the objective function and determine an optimal segmentation point from the multiple segmentation points.
3. The cloud-edge collaborative target detection method based on dynamic hypernetwork according to claim 2 is characterized in that: The calculation formula of the objective function is as follows: ; ; in, represents the total inference latency, Indicates that the edge device adopts the inference model The computational delay of data processing at the layer, represents the data transmission delay from the edge device to the cloud, Indicates that the cloud uses the inference model The computational delay of data processing at the layer, is the current bandwidth of the communication channel between the edge device and the cloud, is the current signal-to-noise ratio of the communication channel, The inference model The amount of feature data output by the layer represents the amount of feature data transmitted by the edge device to the cloud. The first layer, The first layer, , Indicates the total number of convolutional layers of the inference model.
4. The cloud-edge collaborative target detection method based on dynamic hypernetwork according to claim 1 is characterized in that: The target detection model includes a feature encoding module, a feature decoding module and a target detection module; The edge device and the cloud collaboratively use the target detection model to perform target detection on the image to be detected, and obtain a target detection result of the image to be detected, including: The edge device acquires the image to be detected, uses the feature encoding module to perform feature extraction on the image to be detected to obtain an original feature map of the image to be detected, and compresses and quantizes the original feature map to obtain a compressed feature map; The edge device sends the compressed feature map to the cloud; The cloud receives the compressed feature map sent by the edge device, decodes the compressed feature map using the feature decoding module to obtain a decoded feature map, and adopts a coarse-fine granularity collaborative compensation strategy to perform feature processing on the decoded feature map to obtain a multi-scale feature map of the image to be detected; The cloud uses the target detection module to perform target detection on the multi-scale feature map of the image to be detected to obtain a target detection result of the image to be detected.
5. The cloud-edge collaborative target detection method based on dynamic hypernetwork according to claim 4 is characterized in that: The method adopts a coarse-fine granularity collaborative compensation strategy to perform feature processing on the decoded feature map to obtain a multi-scale feature map of the image to be detected, including: Extracting statistical information of the original feature map, the statistical information including a channel-level mean and variance of the original feature map; Adaptively adjusting the channel-level mean and variance of the decoded feature map based on the statistical information of the original feature map, and performing fine-grained compensation on the decoded feature map to obtain a fine-grained compensated feature map; Based on the fine-grained compensated feature map, coarse-grained compensation is performed to obtain the multi-scale feature map.
6. A cloud-edge collaborative target detection device based on dynamic hypernetwork, characterized in that: include: A construction unit is used to construct a dynamic segmentation super network based on a YOLOv5s single-branch network, wherein the dynamic segmentation super network includes multiple convolutional layers and corresponding multiple segmentation points, adds a fine-grained compensation F-Com block and an Identity block at each segmentation point, and adds a coarse-grained compensation C-Com block at the end of the dynamic segmentation super network; A training unit, configured to train the dynamic segmentation supernetwork based on sample images to obtain a trained supernetwork; An optimization unit is configured to construct an inference model based on the trained supernetwork, deploy the inference model on edge devices and in the cloud, perform a real-time neural network architecture search based on the inference model, determine an optimal segmentation point, and determine an optimal subnetwork based on the optimal segmentation point to obtain an object detection model; A target detection unit, configured for the edge device and the cloud to collaboratively use the target detection model to perform target detection on the image to be detected, and obtain a target detection result of the image to be detected; The method of training the dynamic segmentation super-network based on the sample image to obtain the trained super-network includes: Setting binary vector groups corresponding to the fine-grained compensation F-Com blocks and Identity blocks of the multiple segmentation points, so that the target segmentation point selects the corresponding fine-grained compensation F-Com block for feature compression and fine-grained feature compensation, and the common segmentation point selects the corresponding Identity block for direct feature transfer; Dynamically adjusting the binary vector group, adopting a uniform sampling strategy, simultaneously training sub-networks corresponding to different target segmentation points based on the sample image, and calculating the cumulative gradient of each sub-network; Optimizing the parameters of each sub-network based on the accumulated gradient of each sub-network to obtain a trained super-network; The expression for compressing and quantizing the original feature map by the fine-grained compensation F-Com block is as follows: ; ; in, represents the original feature map, Represents compressed feature map, ConvReduce represents feature compression, and Sign is the feature quantization function; is the statistical information of the original feature map, which respectively represents the channel-level mean and variance of the original feature map; Decode the compressed feature map, the expression is as follows: ; in, Represents the decoded feature map, and ConvRecover represents the feature recovery process; Match the mean and variance of the decoded feature map with the mean and variance of the original feature map. The expressions are as follows: ; in, represents the feature map after fine-grained compensation, Represent the channel-level mean and variance of the decoded feature map respectively; The C-Com block performs coarse-grained reconstruction of quantized features through a deconvolution network.
7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, it implements the cloud-edge collaborative target detection method based on dynamic hypernetwork as described in any one of claims 1 to 5.
8. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the cloud-edge collaborative target detection method based on a dynamic hypernetwork is implemented as described in any one of claims 1 to 5.
9. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the cloud-edge collaborative target detection method based on a dynamic hypernetwork is implemented as described in any one of claims 1 to 5.
Citation Information
Patent Citations
Edge cloud collaborative optimization method based on deep reinforcement learning
CN113067873A
Neural network edge-cloud cooperative computing segmentation deployment method
CN114528987A