Remote sensing monitoring method and system based on edge calculation

Abstract

The invention discloses a remote sensing monitoring method and system based on edge calculation, and relates to the technical field of remote sensing monitoring, and the method comprises the steps: collecting historical remote sensing monitoring data, carrying out the task division, and calculating a total task complexity total value and an edge node calculation capability value according to a division result; clustering is carried out in combination with task complexity, a clustering result is output, after the final clustering result serves as an individual, a population is initialized for overall and local optimization, and a final solution is obtained; according to the method, the task scheduling precision is improved, the genetic algorithm and the ant algorithm are combined, so that reasonable scheduling can be performed according to the actual capability of the nodes, high-complexity tasks can be preferentially allocated to the nodes with relatively high capability, more efficient and balanced resource allocation can be realized, and the task scheduling efficiency is improved. Therefore, the response speed and the load balancing capability of the method in the remote sensing monitoring process are obviously improved.

Description

Technical Field

[0001] The present invention relates to the field of remote sensing monitoring technology, and in particular to a remote sensing monitoring method and system based on edge computing. Background Art

[0002] With the continuous development of information technology, remote sensing technology has been widely used in many fields such as earth science, environmental monitoring, and agricultural management. In order to improve the processing efficiency and real-time performance of remote sensing data, edge computing technology has emerged. As a distributed computing architecture, edge computing deploys computing resources at the edge of the network, allowing data storage and processing at or near the data source, significantly reducing dependence on cloud computing resources. Especially in remote areas or when the network connection is unstable, it can effectively realize local processing and intelligent decision-making.

[0003] Traditional remote sensing monitoring methods based on edge computing mostly focus on global optimization, ignoring the characteristics of individual tasks and nodes. As a result, when allocating complex tasks, it is impossible to perform fine scheduling based on actual computing power. In addition, the heterogeneity of edge computing nodes and the complexity of tasks are not fully considered, resulting in unbalanced loads, task delays, and waste of computing resources during task allocation. Summary of the invention

[0004] In view of the above existing problems, the present invention is proposed.

[0005] Therefore, the present invention provides a remote sensing monitoring method and system based on edge computing to solve the problems that traditional remote sensing monitoring methods based on edge computing mostly focus on global optimization and ignore the characteristics of individual tasks and nodes, resulting in the inability to perform fine scheduling according to actual computing power when allocating complex tasks, and the heterogeneity of edge computing nodes and the complexity of tasks are not fully considered, resulting in unbalanced load, task delays and waste of computing resources in the task allocation process.

[0006] In order to solve the above technical problems, the present invention provides the following technical solutions: In a first aspect, the present invention provides a remote sensing monitoring method based on edge computing, which comprises: Collect historical remote sensing monitoring data to divide tasks, and calculate the total task complexity and edge node computing capacity based on the division results; The historical remote sensing monitoring data includes historical monitoring tasks, execution time of historical tasks and edge node data; Based on the complexity of the task, clustering is performed and the clustering results are output. After the final clustering results are used as individuals, the population is initialized for overall and local optimization to obtain the final solution. The clustering results include strong and weak cluster clustering results; According to the final solution, the load value is calculated and tested, and the maximum and minimum total complexity values ​​are selected according to the test results as the fish individuals in the artificial fish school algorithm. After that, the simulated annealing algorithm is combined for iteration and random perturbation to obtain the load balancing solution; The load balancing solutions refer to strong and weak load balancing solutions; Based on the load balancing solution, the load value is recalculated for secondary detection, and the detection results are displayed through a visual interface and stored in a database.

[0007] As a preferred solution of the remote sensing monitoring method based on edge computing described in the present invention, wherein: the combination of task complexity, clustering, and outputting clustering results, taking the final clustering results as individuals, initializing the population for overall and local optimization, and obtaining the final solution includes the following steps: Integrate all complexity totals and use Excel to draw a box plot based on the integrated totals; Based on the box plot, label the low-complexity tasks and high-complexity tasks; Integrate the capability values ​​of all edge nodes and arrange them in ascending order; When the median of the permutation result is an odd number or an even number, the average of the middle or middle edge node capability values ​​is taken as the classification threshold; Compare the capability value of each edge node with the classification threshold to obtain strong and weak nodes; All tasks and corresponding nodes are integrated to obtain the first and second sets, and the total number of tasks and nodes in the first and second sets are counted respectively; The ratio between the total number of tasks and the total number of strong nodes is used as the cluster number of each strong node; After initializing each strong node as a strong cluster, the distance from each task to all nodes in the high-complexity task is calculated using the Manhattan distance formula; After integrating the distances from each task to all nodes, arrange them in ascending order, and assign each task to the corresponding strong cluster according to the minimum distance, obtain the clustering results of all strong clusters, and record the strong cluster labels; Similarly, the ratio between the total number of tasks and the total number of weak nodes is used as the clustering number of each weak node, and the same operation is performed to obtain the clustering results of all weak clusters and record the weak cluster labels; Use hot encoding technique to convert strong cluster labels into binary values; After taking each strong cluster in the strong cluster clustering result as a column and the task as a row, a strong assignment matrix is ​​constructed; After taking the strong assignment matrix as an individual, a population is randomly generated, and the binary values ​​and the population are initialized. The objective function is defined to combine the binary values ​​to minimize the total execution time of the overall task; Calculate the objective function value of each individual, use roulette to select the individual with the smallest objective function value as the optimal individual, select individuals for task exchange through crossover and mutation operations, and generate new individuals. During the iteration process, when the number of iterations reaches the maximum, stop the iteration and output the strong basic matrix; Similarly, the same operation is performed according to each weak cluster label to obtain the weak basic matrix; According to the strong basic matrix, each strong cluster is initialized as each ant individual in the ant algorithm, and the ratio between the node capability value and the total complexity value is used as the path matching value; After randomly setting the adjustment values ​​of all paths using a random number generator, the probability of assigning ants to tasks is calculated based on the path matching values. Define the objective function to minimize the total task execution time of individual ants; The ant algorithm is used to select the path according to the distribution probability. According to the path selection result, the objective function value of the ant individual is calculated, and the minimum objective function value is selected to update the path. During the iteration process, when the number of iterations reaches the maximum number, the iteration is stopped and the final solution of the strong cluster is output; Similarly, each weak cluster in the weak basic matrix is ​​treated as each ant individual in the ant algorithm and the same operation is performed to obtain the final solution of the weak cluster; The strong and weak clusters are ultimately resolved to the minimum total task execution time of each cluster.

[0008] As a preferred solution of the remote sensing monitoring method based on edge computing described in the present invention, the following steps are included: the load value is calculated according to the final solution and then detected, and the maximum and minimum total complexity values ​​are selected according to the detection results, and the fish individuals in the artificial fish school algorithm are combined with the simulated annealing algorithm for iteration and random perturbation to obtain the load balancing solution: According to the strong and weak final solutions, after extracting all clusters in the strong and weak final solutions, the mean of the total execution time of all tasks in the cluster is calculated, and the standard deviation of the cluster is taken as the first load value to obtain the first load values ​​of the strong and weak clusters respectively; Set the judgment threshold to and , the first load values ​​of the strong and weak clusters are compared with the corresponding thresholds and By comparison, we can obtain clusters with strong and weak load imbalance respectively; The maximum complexity total value is selected from the unbalanced clusters using the maximum operation, and the maximum complexity total value of the strong and weak clusters is obtained respectively; Further, according to the strong and weak final solutions, the minimum total complexity value is selected from the clusters of the strong and weak final solutions by minimization operation, and the maximum and minimum total complexity values ​​are used as fish individuals in the artificial fish swarm algorithm, and the fish population is randomly generated and initialized; The fish individuals and populations include new strong and weak fish individuals and populations respectively; The standard deviation of the total execution time of all clusters is used as the objective function value of the individual fish; Calculate the objective function value of each individual fish, and use the artificial fish swarm algorithm to simulate the behavior of the fish swarm to update the individual fish state. After finding the minimum objective function value through the foraging, clustering, and tail-chasing behaviors of the individual fish, set the initial temperature and cooling parameters of the simulated annealing algorithm. The exponential decay method is combined with the cooling parameters to gradually reduce the initial temperature. After the temperature is updated, the fish school is disturbed by random perturbation operations to generate new fish schools. When the number of iterations reaches the maximum number, the iteration and random perturbation operations are stopped, and the load balancing solution is output.

[0009] As a preferred solution of the remote sensing monitoring method based on edge computing described in the present invention, wherein: the recalculation of the load value for secondary detection based on the load balancing solution refers to recalculating the mean of all total execution times of all strong and weak clusters respectively according to the load balancing solution, and taking the standard deviation as the second load value, setting the number of comparisons, and comparing the second load value with the corresponding threshold value. and Compare again, when the second load value of the strong and weak clusters is less than or equal to the corresponding threshold and If the comparison times reach the maximum, the final result is taken as the load balancing result.

[0010] As a preferred solution of the remote sensing monitoring method based on edge computing described in the present invention, wherein: the display of the detection results through a visual interface refers to using the Matplotlib tool to draw a bar chart and a stacked chart, using a bar chart to display the total execution time mean and standard deviation of strong and weak nodes, and using a stacked chart to display the changes before and after load optimization.

[0011] As a preferred solution of the remote sensing monitoring method based on edge computing described in the present invention, wherein: the storage using a database refers to storing the bar chart and the stacked chart through the MySQL library, and converting the comparison result of the first load value and the second load value into XML format and encrypting it using a symmetric encryption algorithm, and storing the encrypted file in the MySQL library.

[0012] As a preferred solution of the remote sensing monitoring method based on edge computing described in the present invention, wherein: the collection of historical remote sensing monitoring data for task division, and the calculation of the total task complexity value and the edge node computing capacity value according to the division result include the following steps: Obtain historical monitoring tasks, historical task execution times, and edge node data from remote sensing probes through IoT technology; The historical monitoring task data includes image data and image detection data collected in different time periods; Preprocessing of collected data, including denoising, cropping and smoothing of image data in history, image detection data including feature extraction and classification of preprocessed data in history; The execution time of the historical tasks refers to the execution time of each task in the historical monitoring tasks; The edge node data refers to the performance data of the node, including node type, CPU performance and memory performance; Taking preprocessing as the total task and the execution time of historical tasks as the operation complexity value of each task, we sum the operation complexity values ​​of the tasks to obtain the total complexity values ​​of the total tasks in different historical time periods. Using edge node data, use the HiBench tool to obtain the computing power value of each edge node; Normalize all the total complexity values ​​and the computing power values ​​of the edge nodes.

[0013] In a second aspect, the present invention provides a remote sensing monitoring system based on edge computing, comprising: The acquisition and calculation module is used to collect remote sensing monitoring data for task division and calculate the total task complexity and edge node computing capacity value; The clustering and allocation module is used to combine the task complexity, perform clustering and global and local optimization to obtain the final solution; The detection and load balancing module is used to calculate the load value according to the final solution, perform detection, and perform iteration and random perturbation to obtain the load balancing solution and secondary detection; The display and storage module is used to display the test results through a visual interface and then store them in a database.

[0014] In a third aspect, the present invention provides a computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: when the computer program is executed by the processor, any step of the remote sensing monitoring method based on edge computing as described in the first aspect of the present invention is implemented.

[0015] In a fourth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein: when the computer program is executed by a processor, it implements any step of the remote sensing monitoring method based on edge computing as described in the first aspect of the present invention.

[0016] The beneficial effects of the present invention are as follows: the present invention greatly improves the accuracy of task scheduling by dividing task complexity into low-complexity tasks and high-complexity tasks, and dividing nodes into strong nodes and weak nodes. The combination of the genetic algorithm and the ant algorithm enables the present invention to perform reasonable scheduling according to the actual capabilities of the nodes, and ensures that high-complexity tasks can be preferentially allocated to nodes with stronger capabilities, avoiding the waste of computing resources and task delays caused by node heterogeneity and task complexity in traditional methods. Moreover, the combination of the artificial fish swarm algorithm and the simulated annealing algorithm enables the present invention to achieve more efficient and balanced resource allocation when processing large-scale tasks, so that the response speed and load balancing capability of the present invention in the remote sensing monitoring process are significantly improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0018] Figure 1 This is a flow chart of the remote sensing monitoring method based on edge computing in Example 1.

[0019] Figure 2 This is a structural diagram of the remote sensing monitoring system based on edge computing in Example 1.

[0020] Figure 3 This is a flowchart of task clustering in Example 1.

[0021] Figure 4 This is a flow chart of the ant colony algorithm path selection and optimization in Example 1. DETAILED DESCRIPTION

[0022] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the accompanying drawings.

[0023] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0024] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The term "in one embodiment" that appears in different places in this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive with other embodiments.

[0025] Example 1, reference Figures 1 to 4 , which is the first embodiment of the present invention, and provides a remote sensing monitoring method based on edge computing, comprising the following steps: S1. Collect historical remote sensing monitoring data to divide tasks, and calculate the total task complexity and edge node computing capacity value based on the division results; Historical remote sensing monitoring data includes historical monitoring tasks, execution time of historical tasks and edge node data; Specifically, collecting historical remote sensing monitoring data to divide tasks, and calculating the total task complexity value and edge node computing capacity value according to the division results include the following steps: Obtain historical monitoring tasks, historical task execution times, and edge node data from remote sensing probes through IoT technology; The historical monitoring task data includes image data and image detection data collected in different time periods; Preprocessing of collected data, including denoising, cropping and smoothing of image data in history, image detection data including feature extraction and classification of preprocessed data in history; The execution time of the historical tasks refers to the execution time of each task in the historical monitoring tasks; The edge node data refers to the performance data of the node, including node type, CPU performance and memory performance; The preprocessing is taken as the total task, and the execution time of the historical tasks is taken as the operation complexity value of each task; Sum up the operational complexity values ​​of the tasks to obtain the total complexity values ​​of the total tasks in different historical time periods; Using edge node data, use the HiBench tool to obtain the computing power value of each edge node; Normalize all the total complexity values ​​and the computing power values ​​of the edge nodes.

[0026] The data quality can be improved by adopting image preprocessing technology, and the computing power of edge nodes can be obtained by using HiBench tool, and the task complexity and node capability data can be made comparable through normalization operation, which enables the present invention to make reasonable allocation according to the computing power of the node, thereby avoiding resource waste and task delay.

[0027] S2. Clustering is performed based on the complexity of the task, and the clustering results are output. The final clustering results are used as individuals, and the population is initialized for overall and local optimization to obtain the final solution. The clustering results include strong and weak cluster clustering results; Specifically, clustering is performed based on the complexity of the task, and the clustering results are output. After the final clustering results are used as individuals, the population is initialized for overall and local optimization. The final solution includes the following steps: After integrating all the total complexity values, the Excel tool was used to plot the integrated total complexity values ​​as a box plot; According to the box plot, all the complexity total values ​​between the lower quartile and the median in the box plot are integrated and marked as low-complexity tasks, and all the complexity total values ​​between the median and the upper quartile and the complexity total values ​​above the upper quartile are integrated and marked as high-complexity tasks; Integrate the capability values ​​of all edge nodes and arrange them in ascending order; When the median in the permutation result is an odd number, the middle edge node capability value is taken as the classification threshold; When the median in the permutation result is an even number, the average value of the ability values ​​of the middle edge nodes is taken as the classification threshold; Compare the capability value of each edge node with the classification threshold. If the capability value of the edge node is greater than or equal to the classification threshold, the edge node is classified as a strong node, otherwise it is classified as a weak node. All high-complexity tasks and strong nodes are grouped into the first set, and all low-complexity tasks and weak nodes are grouped into the second set; Count the total number of high-complexity tasks and the total number of strong nodes in the first set; The ratio between the total number of tasks and the total number of strong nodes is used as the cluster number of each strong node; If there is no remainder in the ratio, the current number of clusters is used as the basis, otherwise the number of clusters of all strong nodes is increased until there is no remainder; Initialize each strong node as a strong cluster, and get A strong cluster; according to A strong cluster is formed. The distance from each task to all nodes in the high-complexity task is calculated using the Manhattan distance formula. After integrating the distances from each task to all nodes, arrange them in ascending order, and assign each task to the corresponding strong cluster according to the minimum distance, obtain the clustering results of all strong clusters, and record the strong cluster labels; Similarly, count the total number of low-complexity tasks and the total number of weak nodes in the second set, and perform the same operation to obtain the clustering results of all weak clusters, and record the weak cluster labels; Based on each strong cluster label, the strong cluster label is converted into a binary value using hot encoding technique; Further, according to the strong cluster clustering results, each strong cluster in the clustering results is taken as a column and the task as a row to construct a strong assignment matrix; After taking the strong assignment matrix as individuals, the population is randomly generated and the binary values ​​and population are initialized; Define the objective function to combine binary values ​​to minimize the total execution time of the overall task:

[0028] In the formula, represents the objective function value of the individual, Indicates the total number of tasks, represents the total number of clusters, Representation task Assign to cluster The binary value in Representation task The total complexity of Representation Cluster Node capability value; Calculate the objective function value of each individual, use roulette to select the individual with the smallest objective function value as the optimal individual, select individuals for task exchange through crossover and mutation operations, and generate new individuals. During the iteration process, when the number of iterations reaches the maximum, stop the iteration and output the strong basic matrix; Similarly, according to each weak cluster label, the hot encoding technique is used to convert the weak cluster label into a binary value; Further, according to the weak cluster clustering results, each weak cluster in the clustering results is taken as a column and the task as a row. After constructing the weak assignment matrix, the same operation is performed to obtain the weak basic matrix; According to the strong basic matrix, each strong cluster is initialized as each ant individual in the ant algorithm; According to the individual ants, the ratio between the node capability value and the total complexity value is taken as the path matching value; Use a random number generator to randomly set the adjustment values ​​of all paths; Combine the path matching value and the adjustment value to calculate the allocation probability between ant individuals and tasks:

[0029]

[0030] In the formula, Representation task With individual ants The probability of distribution between Representation task With individual ants The adjustment value of With individual ants The matching value of Indicates the total number of tasks; Define the objective function to minimize the total task execution time of individual ants:

[0031] In the formula, represents the objective function value of the ant individual, represents the total number of ant individuals, Indicates the task The total complexity of Represents an ant individual Node capability value; The ant algorithm is used to select the path according to the distribution probability. According to the path selection result, the objective function value of the ant individual is calculated, and the minimum objective function value is selected to update the path. During the iteration process, when the number of iterations reaches the maximum number, the iteration is stopped and the final solution of the strong cluster is output; Similarly, each weak cluster in the weak basic matrix is ​​initialized as each ant individual in the ant algorithm, and the same operation is performed to obtain the final solution of the weak cluster; The strong and weak clusters are ultimately resolved to the minimum total task execution time of each cluster.

[0032] The task complexity is analyzed through box plots, and the tasks are divided into two categories: low complexity and high complexity. The tasks are classified in combination with the computing power values ​​of edge nodes, and strong nodes are reasonably assigned to high complexity tasks, and weak nodes are reasonably assigned to low complexity tasks. The use of Manhattan distance further refines the matching degree between tasks and nodes by quantifying the distance between tasks and nodes. The strong and weak cluster labels are converted into binary values ​​through unique encoding technology, which effectively simplifies the subsequent optimization algorithm operations. Subsequently, the genetic algorithm generates an initial solution through global optimization search, providing a set of potential path or task allocation schemes, and on this basis, the ant algorithm can further optimize path selection and task allocation, and refine the quality of the solution in the search space by simulating the process of ant foraging, thereby improving the efficiency of task execution. Therefore, the genetic algorithm provides a global search framework, and the ant algorithm improves the path selection accuracy through local optimization. Through the linkage between these algorithms, the adaptability and optimization effect of the present invention in complex environments are significantly improved.

[0033] S3. According to the final solution, the load value is calculated and then tested. According to the test results, the maximum and minimum total complexity values ​​are selected as the fish individuals in the artificial fish school algorithm, and then combined with the simulated annealing algorithm for iteration and random perturbation to obtain a load balancing solution. Load balancing solutions refer to strong and weak load balancing solutions; Specifically, according to the final solution, the load value is calculated and then tested, and the maximum and minimum total complexity values ​​are selected according to the test results as the fish individuals in the artificial fish school algorithm, and then combined with the simulated annealing algorithm for iteration and random perturbation to obtain the load balancing solution, which includes the following steps: According to the strong and weak final solutions, all clusters in the strong and weak final solutions are extracted; After calculating the mean total execution time of all tasks in the cluster using the mean formula, the standard deviation of the cluster is taken as the first load value to obtain the first load values ​​of the strong and weak clusters respectively; The judgment threshold is set according to the accuracy requirements and personal experience. and , the first load values ​​of the strong and weak clusters are compared with the corresponding thresholds and For comparison, when the first load value of the strong cluster is greater than the threshold When , it indicates that the load of the strong cluster is unbalanced. Similarly, when the first load value of the weak cluster is greater than the threshold When , it means that the load of the weak cluster is unbalanced; According to the unbalanced clusters, the maximum total complexity value is selected from the clusters using the maximum operation to obtain the maximum total complexity value of the strong and weak clusters respectively; Further, according to the strong and weak final solutions, the minimum total complexity value is selected from the clusters of the strong and weak final solutions respectively by using the minimization operation; The maximum complexity total value and the minimum complexity total value are used as fish individuals in the artificial fish swarm algorithm, and the fish population is randomly generated and initialized; The fish individuals and populations include new strong and weak fish individuals and populations respectively; The standard deviation of the total execution time of all clusters is used as the objective function value of the individual fish; Calculate the objective function value of each individual fish, and use the artificial fish school algorithm to simulate the behavior of the fish school to update the status of the individual fish. Find the minimum objective function value through the foraging, grouping, and chasing behaviors of the individual fish. The initial temperature and cooling parameters of the simulated annealing algorithm are set through experience and prior knowledge; The exponential decay method is combined with the cooling parameters to gradually reduce the initial temperature. After the temperature is updated, the fish school is disturbed by random perturbation operations to generate new fish schools. When the number of iterations reaches the maximum number, the iteration and random perturbation operations are stopped, and the load balancing solution is output.

[0034] By calculating the standard deviation of the task execution time in the strong and weak clusters respectively, combined with the complexity of the task and the capacity of the node, the clusters with uneven loads can be accurately identified, which enables the present invention to achieve efficient resource utilization by dynamically adjusting task allocation, and when the load is uneven, the present invention can be adjusted according to the maximum and minimum values ​​of the complexity, and flexibly respond to different load conditions, thereby improving the stability and response speed of the present invention, and the present invention uses the artificial fish school algorithm for local search in the solution space, simulating the foraging behavior of the fish school to find a better solution, while the simulated annealing algorithm performs a global search for the solution through temperature control to prevent the trap of the local optimal solution and help the algorithm jump out of the local optimal solution, which makes the local exploration of the artificial fish school algorithm provide a more accurate search direction for the simulated annealing, and the simulated annealing algorithm optimizes the solution space of the artificial fish school algorithm through global exploration, so that the two achieve a higher balance in the quality of the solution, which not only increases the diversity of the search and prevents the dilemma of the local optimal solution, but also accelerates the optimization process and avoids the optimization bottleneck that may be caused by a single algorithm.

[0035] S4. Based on the load balancing solution, recalculate the load value for secondary detection, display the detection results through a visual interface, and store them in a database; Specifically, based on the load balancing solution, recalculating the load value for secondary detection means recalculating the mean of all total execution times of all strong and weak clusters respectively according to the load balancing solution, taking the standard deviation as the second load value, setting the number of comparisons, and comparing the second load value with the corresponding threshold value. and Compare again, when the second load value of the strong and weak clusters is less than or equal to the corresponding threshold and If the comparison times reach the maximum, the final result is taken as the load balancing result.

[0036] Through secondary detection, the load balancing situation can be accurately evaluated, and when the load exceeds the threshold, the optimization process is started to ensure load balancing. The setting of the maximum number of comparisons effectively avoids over-optimization and ensures the efficiency and stability of the process.

[0037] Furthermore, displaying the detection results through a visual interface refers to using the Matplotlib tool to draw a bar chart and a stacked chart, using the bar chart to display the total execution time mean and standard deviation of the strong and weak nodes, and using the stacked chart to display the changes before and after the load optimization.

[0038] By using the Matplotlib tool to draw bar charts and stacked charts, the execution time of strong and weak nodes and the load optimization effect are intuitively displayed. The bar chart shows the mean and standard deviation of the node execution time, which helps analyze the execution efficiency and stability between nodes. The stacked chart intuitively shows the changes before and after load optimization, which helps to evaluate the effectiveness of the optimization strategy.

[0039] Furthermore, using a database for storage refers to storing the bar chart and the stacked chart through a MySQL library, converting the comparison result of the first load value and the second load value into an XML format, encrypting it using a symmetric encryption algorithm, and storing the encrypted file in the MySQL library.

[0040] By using the MySQL database to store bar charts, stacked charts, and load value data, combined with symmetric encryption algorithms and XML format storage, the security and scalability of data management are effectively improved.

[0041] This embodiment also provides a remote sensing monitoring system based on edge computing, including: The acquisition and calculation module is used to collect remote sensing monitoring data for task division and calculate the total task complexity and edge node computing capacity value; The clustering and allocation module is used to combine the task complexity, perform clustering and global and local optimization to obtain the final solution; The detection and load balancing module is used to calculate the load value according to the final solution, perform detection, and perform iteration and random perturbation to obtain the load balancing solution and secondary detection; The display and storage module is used to display the test results through a visual interface and then store them in a database.

[0042] This embodiment also provides a computer device, which is suitable for the remote sensing monitoring method based on edge computing, including: a memory and a processor; the memory is used to store computer executable instructions, and the processor is used to execute computer executable instructions to implement the remote sensing monitoring method based on edge computing proposed in the above embodiment.

[0043] The computer device may be a terminal, and the computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, an operator network, NFC (near field communication) or other technologies. The display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covered on the display screen, or a key, trackball or touchpad provided on the housing of the computer device, or an external keyboard, touchpad or mouse, etc.

[0044] This embodiment also provides a storage medium on which a computer program is stored. When the program is executed by a processor, the remote sensing monitoring method based on edge computing proposed in the above embodiment is implemented; the storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, referred to as SRAM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, referred to as EEPROM), erasable programmable read-only memory (Erasable Programmable Read Only Memory, referred to as EPROM), programmable read-only memory (Programmable Red-Only Memory, referred to as PROM), read-only memory (Read-Only Memory, referred to as ROM), magnetic storage, flash memory, disk or optical disk.

[0045] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A remote sensing monitoring method based on edge computing, characterized in that: include, Collect historical remote sensing monitoring data to divide tasks, and calculate the total task complexity and edge node computing capacity based on the division results; The historical remote sensing monitoring data includes historical monitoring tasks, execution time of historical tasks and edge node data; Based on the complexity of the task, clustering is performed and the clustering results are output. After the final clustering results are used as individuals, the population is initialized for overall and local optimization to obtain the final solution. The clustering results include strong and weak cluster clustering results; According to the final solution, the load value is calculated and tested, and the maximum and minimum total complexity values ​​are selected according to the test results as the fish individuals in the artificial fish school algorithm. After that, the simulated annealing algorithm is combined for iteration and random perturbation to obtain the load balancing solution; The load balancing solutions refer to strong and weak load balancing solutions; Based on the load balancing solution, the load value is recalculated for secondary detection, and the detection results are displayed through a visual interface and stored in a database.

2. The remote sensing monitoring method based on edge computing according to claim 1, characterized in that: The method combines the task complexity, performs clustering, and outputs the clustering results. After taking the final clustering results as individuals, the population is initialized for overall and local optimization to obtain the final solution, which includes the following steps: Integrate all complexity totals and use Excel to draw a box plot based on the integrated totals; Based on the box plot, label the low-complexity tasks and high-complexity tasks; Integrate the capability values ​​of all edge nodes and arrange them in ascending order; When the median of the permutation result is an odd number or an even number, the average of the middle or middle edge node capability values ​​is taken as the classification threshold; Compare the capability value of each edge node with the classification threshold to obtain strong and weak nodes; All tasks and corresponding nodes are integrated to obtain the first and second sets, and the total number of tasks and nodes in the first and second sets are counted respectively; The ratio between the total number of tasks and the total number of strong nodes is used as the cluster number of each strong node; After initializing each strong node as a strong cluster, the distance from each task to all nodes in the high-complexity task is calculated using the Manhattan distance formula; After integrating the distances from each task to all nodes, arrange them in ascending order, and assign each task to the corresponding strong cluster according to the minimum distance, obtain the clustering results of all strong clusters, and record the strong cluster labels; Similarly, the ratio between the total number of tasks and the total number of weak nodes is used as the clustering number of each weak node, and the same operation is performed to obtain the clustering results of all weak clusters and record the weak cluster labels; Use hot encoding technique to convert strong cluster labels into binary values; After taking each strong cluster in the strong cluster clustering result as a column and the task as a row, a strong assignment matrix is ​​constructed; After taking the strong assignment matrix as an individual, a population is randomly generated, and the binary values ​​and the population are initialized. The objective function is defined to combine the binary values ​​to minimize the total execution time of the overall task; Calculate the objective function value of each individual, use roulette to select the individual with the smallest objective function value as the optimal individual, select individuals for task exchange through crossover and mutation operations, and generate new individuals. During the iteration process, when the number of iterations reaches the maximum, stop the iteration and output the strong basic matrix; Similarly, the same operation is performed according to each weak cluster label to obtain the weak basic matrix; According to the strong basic matrix, each strong cluster is initialized as each ant individual in the ant algorithm, and the ratio between the node capability value and the total complexity value is used as the path matching value; After randomly setting the adjustment values ​​of all paths using a random number generator, the probability of assigning ants to tasks is calculated based on the path matching values. Define the objective function to minimize the total task execution time of individual ants; The ant algorithm is used to select the path according to the distribution probability. According to the path selection result, the objective function value of the ant individual is calculated, and the minimum objective function value is selected to update the path. During the iteration process, when the number of iterations reaches the maximum number, the iteration is stopped and the final solution of the strong cluster is output; Similarly, each weak cluster in the weak basic matrix is ​​treated as each ant individual in the ant algorithm and the same operation is performed to obtain the final solution of the weak cluster; The strong and weak clusters are ultimately resolved to the minimum total task execution time of each cluster.

3. The remote sensing monitoring method based on edge computing according to claim 2, characterized in that: The method of calculating the load value according to the final solution and then performing detection, and selecting the maximum and minimum total complexity values ​​according to the detection results as the fish individuals in the artificial fish school algorithm, and then performing iteration and random perturbation in combination with the simulated annealing algorithm to obtain a load balancing solution includes the following steps: According to the strong and weak final solutions, after extracting all clusters in the strong and weak final solutions, the mean of the total execution time of all tasks in the cluster is calculated, and the standard deviation of the cluster is taken as the first load value to obtain the first load values ​​of the strong and weak clusters respectively; Set the judgment threshold to and , the first load values ​​of the strong and weak clusters are compared with the corresponding thresholds and By comparison, we can obtain clusters with strong and weak load imbalance respectively; The maximum complexity total value is selected from the unbalanced clusters using the maximum operation, and the maximum complexity total value of the strong and weak clusters is obtained respectively; Further, according to the strong and weak final solutions, the minimum total complexity value is selected from the clusters of the strong and weak final solutions by minimization operation, and the maximum and minimum total complexity values ​​are used as fish individuals in the artificial fish swarm algorithm, and the fish population is randomly generated and initialized; The fish individuals and populations include new strong and weak fish individuals and populations respectively; The standard deviation of the total execution time of all clusters is used as the objective function value of the individual fish; Calculate the objective function value of each individual fish, and use the artificial fish swarm algorithm to simulate the behavior of the fish swarm to update the individual fish state. After finding the minimum objective function value through the foraging, clustering, and tail-chasing behaviors of the individual fish, set the initial temperature and cooling parameters of the simulated annealing algorithm. The exponential decay method is combined with the cooling parameters to gradually reduce the initial temperature. After the temperature is updated, the fish school is disturbed by random perturbation operations to generate new fish schools. When the number of iterations reaches the maximum number, the iteration and random perturbation operations are stopped, and the load balancing solution is output.

4. The remote sensing monitoring method based on edge computing according to claim 3, characterized in that: The recalculation of the load value for secondary detection based on the load balancing solution refers to recalculating the mean of all the total execution time of all the strong and weak clusters respectively according to the load balancing solution, taking the standard deviation as the second load value, setting the number of comparisons, and comparing the second load value with the corresponding threshold value. and Compare again, when the second load value of the strong and weak clusters is less than or equal to the corresponding threshold and If the comparison times reach the maximum, the final result is taken as the load balancing result.

5. The remote sensing monitoring method based on edge computing according to claim 4, characterized in that: The display of the detection results through a visual interface refers to drawing a bar chart and a stacked chart using the Matplotlib tool, displaying the total execution time mean and standard deviation of strong and weak nodes through the bar chart, and displaying the changes before and after the load optimization using the stacked chart.

6. The remote sensing monitoring method based on edge computing according to claim 5, characterized in that: The storage using a database refers to storing the bar chart and the stacked chart through a MySQL library, converting the comparison result of the first load value and the second load value into an XML format, encrypting it using a symmetric encryption algorithm, and storing the encrypted file in the MySQL library.

7. The remote sensing monitoring method based on edge computing according to claim 6, characterized in that: The collecting of historical remote sensing monitoring data to divide tasks, and calculating the total task complexity value and the edge node computing capacity value according to the division results include the following steps: Obtain historical monitoring tasks, historical task execution times, and edge node data from remote sensing probes through IoT technology; The historical monitoring task data includes image data and image detection data collected in different time periods; Preprocessing of collected data, including denoising, cropping and smoothing of image data in history, image detection data including feature extraction and classification of preprocessed data in history; The execution time of the historical tasks refers to the execution time of each task in the historical monitoring tasks; The edge node data refers to the performance data of the node, including node type, CPU performance and memory performance; Taking preprocessing as the total task and the execution time of historical tasks as the operation complexity value of each task, we sum the operation complexity values ​​of the tasks to obtain the total complexity values ​​of the total tasks in different historical time periods. Using edge node data, use the HiBench tool to obtain the computing power value of each edge node; Normalize all the total complexity values ​​and the computing power values ​​of the edge nodes.

8. A remote sensing monitoring system based on edge computing, based on the remote sensing monitoring method based on edge computing according to any one of claims 1 to 7, characterized in that: include, The acquisition and calculation module is used to collect remote sensing monitoring data for task division and calculate the total task complexity and edge node computing capacity value; The clustering and allocation module is used to combine the task complexity, perform clustering and global and local optimization to obtain the final solution; The detection and load balancing module is used to calculate the load value according to the final solution, perform detection, and perform iteration and random perturbation to obtain the load balancing solution and secondary detection; The display and storage module is used to display the test results through a visual interface and then store them in a database.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the edge computing-based remote sensing monitoring method described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the edge computing-based remote sensing monitoring method described in any one of claims 1 to 7 are implemented.

Images