A lightweight edge control method and system based on cloud-edge collaboration
By improving the collaborative communication protocol and adaptive control algorithm, the problem of low efficiency in data collaborative processing in edge node environments was solved, achieving efficient resource regulation and data processing, and improving the system's stability and response speed.
Patent Information
- Application Number
- CN202411216135.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-02
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2044-09-02
AI Technical Summary
Existing technologies suffer from low efficiency in data collaboration and unreasonable resource allocation, especially in heterogeneous and dynamically changing edge node environments. This leads to low efficiency in data synchronization and collaboration, affecting system stability and resource utilization efficiency.
Improve collaborative communication protocols, collect performance and environmental data of edge nodes, identify network bottlenecks and resource limitations through data analysis, automatically adjust transmission parameters, build an adaptive control model to optimize resource regulation, introduce data collaboration weights and priorities, and use machine learning algorithms to optimize model training to achieve adaptive regulation at the edge and in the cloud.
It improved the timeliness and accuracy of data processing, optimized resource allocation, enhanced system stability and response speed, reduced connection problems and data transmission errors, and achieved more efficient resource utilization and more refined service control.
Smart Images

Figure CN118740938B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of cloud computing and edge computing, and in particular to a lightweight edge control method and system based on cloud-edge collaboration. Background Art
[0002] In recent years, with the rapid development of the Internet of Things (IoT), big data, and cloud computing technologies, edge computing has received widespread attention as an emerging computing paradigm. Edge computing aims to transfer data processing tasks from the cloud to the edge of the network to reduce latency, save bandwidth, and improve data processing speed and security. Against this background, cloud-edge collaborative technology has emerged. By effectively combining the powerful computing power of cloud computing with the real-time response capability of edge computing, it can optimize the data processing and resource allocation of the entire network. Despite this, current cloud-edge collaborative technology still faces many challenges. For example, the heterogeneous and dynamically changing edge node environment increases the complexity of the system, and existing collaborative communication protocols often cannot effectively adapt to such changes, resulting in low data synchronization and collaboration efficiency.
[0003] Existing technologies have obvious shortcomings in the management and collaborative operation of edge nodes. For example, in a heterogeneous network environment, different types of edge devices and protocol standards make collaborative data processing difficult, which not only affects processing efficiency but also may cause data security issues. In addition, existing solutions usually ignore the need to dynamically adjust control strategies according to edge node performance, and cannot effectively optimize the configuration of edge computing resources, resulting in resource waste and insufficient response speed. These technical defects limit the widespread deployment of cloud-edge collaborative systems in high-demand application scenarios, such as real-time big data processing and urban intelligent transportation systems.
[0004] In response to the above problems, the present invention proposes a lightweight edge control method based on cloud-edge collaboration, which improves the collaborative communication protocol for the heterogeneous and dynamically changing edge node environment, so that it can maintain efficient and stable communication under different network conditions and device performance; through this improved collaborative communication protocol, data collaboration tasks can be more effectively collected and processed on the edge side and the cloud; the concept of data collaboration weights is introduced, and these tasks are pre-processed to optimize data flow and processing strategies; an edge control model is constructed through an adaptive control algorithm, and deployed on the cloud to achieve intelligent regulation of edge computing resources, significantly improving the overall performance of the system and resource utilization efficiency. Summary of the invention
[0005] The purpose of this section is to summarize some aspects of the embodiments of the present invention and briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section and the abstract of the specification and the title of the invention of this application to avoid blurring the purpose of this section, the abstract of the specification and the title of the invention, and such simplifications or omissions cannot be used to limit the scope of the present invention.
[0006] In view of the above existing problems, the present invention is proposed.
[0007] Therefore, the technical problem solved by the present invention is: the problem of low efficiency of data collaborative processing and unreasonable resource allocation in the prior art.
[0008] In order to solve the above technical problems, the present invention provides the following technical solutions:
[0009] Improve cooperative communication protocols based on heterogeneous and dynamically changing edge node environments;
[0010] Deploy data collaboration tasks on the edge side and the cloud side respectively using the improved collaborative communication protocol;
[0011] Execute the data collaboration task and obtain the data collaboration priority;
[0012] A control model is constructed by an adaptive control algorithm, and the data coordination priority is input for learning and training. After the training is completed, an edge control model is obtained;
[0013] The edge control model is installed in the cloud server in the form of a data packet to run the program, and adaptively regulates the data collaboration tasks performed on the edge side and the cloud side respectively.
[0014] As a preferred solution of the lightweight edge control method based on cloud-edge collaboration described in the present invention, improving the collaborative communication protocol includes:
[0015] Collect performance and environmental data from all edge nodes;
[0016] Apply data analysis techniques to analyze and process the collected data to identify network bottlenecks, resource constraints, and potential failure modes;
[0017] Based on the analysis results, the communication protocol is adjusted and implemented on the edge nodes, automatically adjusting the transmission parameters to optimize performance.
[0018] As a preferred solution of the lightweight edge control method based on cloud-edge collaboration described in the present invention, the performance data and environmental data collected from all edge nodes include but are not limited to real-time network quality, device status and location information.
[0019] As a preferred solution of the lightweight edge control method based on cloud-edge collaboration described in the present invention, the deployed data collaboration task is used to collect, process and synchronize data on the edge side and the cloud to support real-time updates of decision-making and control strategies.
[0020] As a preferred solution of the lightweight edge control method based on cloud-edge collaboration described in the present invention, the data collaboration tasks include but are not limited to performance monitoring data, environmental data, event logs and user interaction data.
[0021] As a preferred solution of the lightweight edge control method based on cloud-edge collaboration described in the present invention, the data collaboration priority can be obtained by the following mathematical formula:
[0022]
[0023] Among them, E is the score of data coordination priority, p is the data priority factor, which is adjusted according to the importance and real-time nature of the data, c is the data compression rate, which improves transmission efficiency by reducing the data size, f is the fault tolerance, and s is the security strength. It is a small constant for numerical stability, used to prevent the denominator from being zero, and its value is usually 0.01.
[0024] As a preferred solution of the lightweight edge control method based on cloud-edge collaboration described in the present invention, the data collaboration priority is obtained by the numerical value of the score E of the data collaboration priority, and then the weight is calculated using the machine learning algorithm. The weight is used to control the training optimization of the model.
[0025] As a preferred solution of the lightweight edge control method based on cloud-edge collaboration described in the present invention, the edge control model can be expressed by the following formula:
[0026]
[0027] in, Represents the output of the model, which is used to regulate resource usage. represents the ith data collaborative weight, represents the adjustment parameter for the i-th weight in the adaptive control algorithm, represents the exponential adjustment parameter of the i-th weight, affecting its nonlinear performance in the model, Represents the bias term, which is used to adjust the threshold of the overall output of the model.
[0028] As a preferred solution of the lightweight edge control method based on cloud-edge collaboration described in the present invention, the output range of the edge control model is [0,1], which is used to indicate the degree of resource allocation, where:
[0029] When the output value approaches 0, it means that there is no resource allocation;
[0030] When the output value approaches 1, it indicates full resource allocation.
[0031] As a preferred solution of the lightweight edge control system based on cloud-edge collaboration described in the present invention, it includes:
[0032] one or more processors;
[0033] A memory stores operable instructions, which, when executed by the one or more processors, cause the one or more processors to perform operations, including the process of the aforementioned lightweight edge control method based on cloud-edge collaboration.
[0034] Beneficial effects of the present invention:
[0035] 1. The present invention takes into account the characteristics of different edge devices and network conditions, adopts dynamic adaptation technology, and automatically adjusts communication parameters to optimize communication efficiency. This improvement not only enhances the stability of the system, but also reduces connection problems and data transmission errors caused by environmental changes, thereby significantly improving the reliability and response speed of the overall network;
[0036] 2. The present invention not only improves the timeliness and accuracy of data processing, but also optimizes resource allocation, reduces the load on cloud servers, and enables the system to operate more economically and efficiently; at the same time, it enhances the flexibility and accuracy of data processing, helps to better understand data flows and user needs, and thus achieve more refined services and controls. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor. Among them:
[0038] Figure 1 This is a flow chart of the lightweight edge control method based on cloud-edge collaboration shown in the present invention. DETAILED DESCRIPTION
[0039] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings. It is obvious that the described embodiments are only part of the embodiments of the present invention, but not all of the embodiments.
[0040] Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in the art without making any creative work should fall within the scope of protection of the present invention.
[0041] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.
[0042] According to an embodiment of the present invention, Figure 1 The flowchart shown is a lightweight edge control method based on cloud-edge collaboration, which specifically includes the following steps:
[0043] S1. Improve the collaborative communication protocol based on the heterogeneous and dynamically changing edge node environment. It should be noted that the improved collaborative communication protocol includes:
[0044] Collect performance and environmental data from all edge nodes;
[0045] Apply data analysis techniques to analyze and process the collected data to identify network bottlenecks, resource constraints, and potential failure modes;
[0046] Based on the analysis results, the communication protocol is adjusted and implemented on the edge nodes, automatically adjusting the transmission parameters to optimize performance.
[0047] As an example, for nodes with high network latency, a data transmission protocol that is more suitable for a high latency environment may be selected.
[0048] As an example, performance data and environmental data from all edge nodes are collected, including but not limited to real-time network quality, device status, and location information.
[0049] It should be noted that heterogeneity refers to the diversity of different hardware platforms, operating systems, communication protocols, and network technologies involved in the edge computing environment. For example, the edge node may be a high-performance server or a resource-constrained IOT device.
[0050] Dynamic changes mean that the network connection status, available computing resources, and workload of edge nodes may change frequently. These changes may be due to the physical movement of the device, changes in network conditions, or dynamic changes in application requirements.
[0051] Preferably, this step achieves more efficient data transmission and processing capabilities by improving the collaborative communication protocol, and is particularly suitable for heterogeneous and constantly changing edge node environments.
[0052] Preferably, the method of the present invention takes into account the characteristics of different edge devices and network conditions, adopts dynamic adaptation technology, and automatically adjusts communication parameters to optimize communication efficiency. This improvement not only enhances the stability of the system, but also reduces connection problems and data transmission errors caused by environmental changes, thereby significantly improving the reliability and response speed of the overall network.
[0053] S2. Use the improved collaborative communication protocol to deploy data collaboration tasks on the edge and cloud sides respectively.
[0054] In an optional implementation, the deployed data collaboration tasks are used to collect, process and synchronize data on the edge side and the cloud to support real-time updates of decision-making and control strategies.
[0055] As examples, data collaboration tasks include, but are not limited to, performance monitoring data, environmental data, event logs, and user interaction data.
[0056] As an example, performance monitoring data includes but is not limited to CPU usage, memory usage, and network latency.
[0057] As an example, the environmental data includes, but is not limited to, geographic location, ambient temperature, and network connection status.
[0058] As an example, the event log includes but is not limited to error reports and system warnings, which are used to record various events that occur during the operation of the device.
[0059] As an example, user interaction data includes, but is not limited to, all operation records from the end user to the device.
[0060] It should be noted that this step optimizes the data collection efficiency on the edge and cloud through the improved communication protocol, making data collection more accurate and timely, helping to quickly respond to real-time data needs on the edge, and effectively upload data to the cloud for more in-depth analysis and storage.
[0061] Preferably, the method of the present invention not only improves the timeliness and accuracy of data processing, but also optimizes resource allocation, reduces the load on the cloud server, and enables the system to operate more economically and efficiently.
[0062] S3, execute the data collaboration task and obtain the data collaboration priority. It should be noted that the step of obtaining the data collaboration priority can be expressed by the following mathematical formula:
[0063]
[0064] Among them, E is the score of data coordination priority, p is the data priority factor, which is adjusted according to the importance and real-time nature of the data, c is the data compression rate, which improves transmission efficiency by reducing the data size, f is the fault tolerance, and s is the security strength. It is a small constant for numerical stability, used to prevent the denominator from being zero, and its value is usually 0.01.
[0065] It should be noted that the data collaboration priority can be known from the numerical value of the data collaboration priority score E, and then the weight can be calculated using the machine learning algorithm. The weight is used to control the training optimization of the model.
[0066] The introduction of data collaborative weights provides an important basis for subsequent data processing and decision-making, making data analysis more targeted and effective. This process enhances the flexibility and accuracy of data processing, helps to better understand data flows and user needs, and thus achieve more refined services and control.
[0067] The above-mentioned method for calculating the weight can be implemented by means or techniques in the prior art, and will not be described in detail in this example.
[0068] S4, construct a control model through an adaptive control algorithm, input data and coordinate priorities for learning and training, and after the training, obtain an edge control model. It should be noted that the edge control model can be expressed by the following formula:
[0069]
[0070] in, Represents the output of the model, which is used to regulate resource usage. represents the ith data collaborative weight, represents the adjustment parameter for the i-th weight in the adaptive control algorithm, represents the exponential adjustment parameter of the i-th weight, affecting its nonlinear performance in the model, Represents the bias term, which is used to adjust the threshold of the overall output of the model.
[0071] S5. The edge control model is installed in the cloud server in the form of a data packet and runs the program to adaptively control the data collaboration tasks performed by the edge side and the cloud. It should be noted that the output range of the edge control model is [0,1], which is used to indicate the degree of resource allocation, where:
[0072] When the output value approaches 0, it means that there is no resource allocation;
[0073] When the output value approaches 1, it indicates full resource allocation.
[0074] The aforementioned learning and training of the model can be achieved using means or technologies in the prior art, and will not be described in detail in this example.
[0075] Furthermore, other aspects disclosed in the embodiments of the present invention also propose a lightweight edge control system based on cloud-edge collaboration, including: one or more processors and a memory.
[0076] The memory is used to store operable instructions, which, when executed by the one or more processors, cause the one or more processors to perform operations, including the process of the lightweight edge control method based on cloud-edge collaboration of the aforementioned embodiment, especially Figure 1 The process of the method shown.
[0077] The control system also includes a computer-readable medium storing software, the software including instructions executable by one or more computers, the instructions causing one or more computers to perform operations through such execution, the operations including the process of the lightweight edge control method based on cloud-edge collaboration of the aforementioned embodiment, especially Figure 1 The process of the method shown.
[0078] It should be appreciated that embodiments of the present invention can be implemented or carried out by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer-readable memory.
[0079] The method may be implemented in a computer program using standard programming techniques, including a non-transitory computer-readable storage medium configured with a computer program, wherein the storage medium so configured causes a computer to operate in a specific and predefined manner.
[0080] Each program can be implemented in a high-level procedural or object-oriented programming language to communicate with a computer system, however, the program can be implemented in assembly or machine language if desired.
[0081] In any case, the language may be a compiled or interpreted language.
[0082] Furthermore, the program can be run on an application specific integrated circuit programmed for this purpose.
[0083] The processes described herein (or variations and / or combinations thereof) may be performed under the control of one or more computer systems configured with executable instructions, and may be implemented as code (e.g., executable instructions, one or more computer programs, or one or more applications) that is executed collectively on one or more processors, by hardware, or a combination thereof. The computer program includes a plurality of instructions that can be executed by one or more processors.
[0084] Further, the method may be implemented in any type of computing platform operably connected to a suitable computer, including but not limited to a personal computer, a minicomputer, a mainframe, a workstation, a network or distributed computing environment, a separate or integrated computer platform, or in communication with a charged particle tool or other imaging device.
[0085] Various aspects of the present invention may be implemented in machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, optical read and / or write storage media, RAM, ROM, etc., so that it can be read by a programmable computer, which, when the storage medium or device is read by the computer, can be used to configure and operate the computer to perform the processes described herein.
[0086] Additionally, the machine-readable code, or portions thereof, can be transmitted over a wired or wireless network.
[0087] The invention described herein includes these and other various types of non-transitory computer-readable storage media when such media include instructions or programs that implement the steps described above in conjunction with a microprocessor or other data processor.
[0088] In order to better verify and illustrate the technical effects adopted in the method of the present invention, this embodiment chooses to conduct comparative tests with the existing TCP / IP protocol communication technology and the method of the present invention, and compares the test results by means of scientific demonstration to verify the real effect of the method of the present invention.
[0089] The existing TCP / IP protocol communication technology is not optimized for edge computing environments, resulting in high data transmission delays, high data packet loss rates, and ineffective resource allocation in high-load and highly dynamic network environments.
[0090] In order to verify that the method of the present invention has higher data processing speed and smaller network burden than the prior art, this embodiment selects a cloud server with advanced computing capabilities and multiple edge devices, and the devices are connected through an improved collaborative communication protocol.
[0091] Among them, the cloud server is configured as Dell EMC PowerEdge R740, the edge device is Raspberry pi4Model B, and the operating system is Ubuntu 20.04 LTS, ensuring the uniformity of the system and the convenience of operation.
[0092] The existing TCP / IP protocol communication technology is used to perform data transmission and task processing between the same five edge devices and the cloud server, and the data transmission rate, CPU and memory utilization, data packet loss rate and task completion rate under high network load are recorded. At the same time, the same experiment is performed again using the method provided in an embodiment of the present invention, and the recorded data are directly compared, as shown in Tables 1 and 2.
[0093] Table 1: Data record table of existing TCP / IP protocol communication technology
[0094]
[0095] Table 2: Data record table of the method of the present invention
[0096]
[0097] With reference to Table 1 and Table 2, it can be seen intuitively that compared with the prior art, the method of the present invention significantly improves the delay and packet loss rate of data transmission, while optimizing the utilization of resources, especially in a highly dynamic edge computing environment. By introducing an improved collaborative communication protocol and an adaptive control algorithm, not only the task completion rate is improved, but also the efficient operation of the system is ensured while ensuring low resource consumption.
[0098] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.
Claims
1. A lightweight edge control method based on cloud-edge collaboration, characterized in that: include: Improved collaborative communication protocols based on heterogeneous and dynamically changing edge node environments; including: Collect performance and environmental data from all edge nodes; Apply data analysis techniques to analyze and process the collected data to identify network bottlenecks, resource constraints, and potential failure modes; According to the analysis results, the communication protocol is adjusted and implemented on the edge nodes, automatically adjusting the transmission parameters to optimize performance; Deploy data collaboration tasks on the edge side and the cloud side respectively using the improved collaborative communication protocol; Execute the data collaboration task and obtain the data collaboration priority; A control model is constructed by an adaptive control algorithm, and the data coordination priority is input for learning and training. After the training is completed, an edge control model is obtained; The edge control model is installed in the cloud server in the form of a data packet to run the program, and adaptively regulates the data collaboration tasks performed on the edge side and the cloud side respectively.
2. The lightweight edge control method based on cloud-edge collaboration according to claim 1 is characterized in that: The performance data and environmental data collected from all edge nodes include but are not limited to real-time network quality, device status and location information.
3. The lightweight edge control method based on cloud-edge collaboration according to claim 1 is characterized in that: The deployed data collaboration tasks are used to collect, process and synchronize data on the edge side and the cloud to support real-time updates of decision-making and control strategies.
4. The lightweight edge control method based on cloud-edge collaboration according to claim 1 or 3 is characterized in that: The data collaboration tasks include but are not limited to performance monitoring data, environmental data, event logs and user interaction data.
5. The lightweight edge control method based on cloud-edge collaboration according to claim 1 is characterized in that: The data coordination priority is obtained and represented by the following mathematical formula: ; Among them, E is the score of data coordination priority, p is the data priority factor, which is adjusted according to the importance and real-time nature of the data, c is the data compression rate, which improves transmission efficiency by reducing the data size, f is the fault tolerance, and s is the security strength. is a small constant for numerical stability, used to prevent the denominator from being zero, and its value is 0.
01.
6. The lightweight edge control method based on cloud-edge collaboration according to claim 5 is characterized in that: The data collaboration priority is obtained from the numerical value of the score E of the data collaboration priority, and then the weight is calculated using the machine learning algorithm. The weight is used to control the training optimization of the model.
7. The lightweight edge control method based on cloud-edge collaboration according to claim 1 is characterized in that: The edge control model is expressed by the following formula: ; in, Represents the output of the model, which is used to regulate resource usage. represents the ith data collaborative weight, represents the adjustment parameter for the i-th weight in the adaptive control algorithm, represents the exponential adjustment parameter of the i-th weight, affecting its nonlinear performance in the model, Represents the bias term, which is used to adjust the threshold of the overall output of the model.
8. The lightweight edge control method based on cloud-edge collaboration according to claim 7 is characterized in that: The output range of the edge control model is [0,1], which is used to indicate the degree of resource allocation, where: When the output value approaches 0, it means that there is no resource allocation; When the output value approaches 1, it indicates full resource allocation.
9. A lightweight edge control system based on cloud-edge collaboration, characterized in that: include: one or more processors; A memory storing operable instructions, wherein when the instructions are executed by the one or more processors, the one or more processors perform operations, wherein the operations include the process of the lightweight edge control method based on cloud-edge collaboration as described in any one of claims 1 to 8.
