Method and system for improving node connectivity rate of edge distributed storage system

Through public key infrastructure, dynamic node discovery protocol, machine learning algorithm and decentralized network protocol, the problems of inter-node heterogeneity and network instability in edge distributed storage systems are solved, and efficient and reliable data transmission is achieved and security, optimize system performance and resource utilization.

CN119030889AInactive Publication Date: 2024-11-26SHENZHEN YIHANG NETWORK INFORMATION TECH CO LTD
View PDF 0 Cites 5 Cited by

Patent Information

Application Number
CN202411347412.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-26
Publication Date
2024-11-26
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The heterogeneity, network instability and trust security problems among nodes in edge distributed storage systems lead to low data transmission efficiency, high latency, poor reliability, and load imbalance affects overall performance.

Method used

Public key infrastructure is used to authenticate nodes, use dynamic node discovery protocols and machine learning algorithms to optimize connection paths, design multi-path transmission and automatic fault detection mechanisms, and introduce decentralized network protocols and edge computing intelligent collaboration mechanisms.

Benefits of technology

It improves the connectivity rate between nodes and the redundancy and reliability of data transmission, ensures the continuity and security of data transmission, and optimizes network performance and resource utilization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119030889A_ABST
    Figure CN119030889A_ABST
Patent Text Reader

Abstract

The invention discloses a method for improving the node connectivity rate of an edge distributed storage system, and the method comprises the steps: carrying out node identity verification through employing a public key infrastructure, and monitoring the state and position of a node in a network in real time through employing a dynamic node discovery protocol; a machine learning algorithm is used to predict node performance, a connection path between nodes is optimized, a multi-path transmission mechanism is realized, and a plurality of paths are selected during data transmission to increase the redundancy and reliability of the network; an automatic fault detection and repair mechanism is designed, and when a node or a path has a fault, the system can automatically find and repair the fault; a decentralized network protocol is adopted, and an edge computing intelligent cooperation mechanism is introduced, so that edge nodes autonomously decide and cooperatively work. By introducing the dynamic node discovery protocol and monitoring and adapting to the network topology change in real time, the system can quickly identify and connect new edge nodes, optimize the connection path between the nodes, select the optimal path for data transmission, and reduce the transmission delay and data loss.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of Internet technology, and in particular to a method and system for improving the connectivity rate of nodes in an edge distributed storage system. Background Art

[0002] Edge nodes include mobile devices such as smartphones and vehicles. These devices move frequently, causing frequent changes in node locations and network connections. Edge nodes can suddenly lose connection or go offline due to hardware failure, software errors, or battery exhaustion. The instability of the wireless network environment, signal interference, network congestion, and other factors can also affect node connectivity. Nodes in edge computing environments are usually heterogeneous, meaning that different nodes have significantly different hardware capabilities, network bandwidth, and storage capacity. This heterogeneity brings the following challenges: The difference in processing power and storage capacity between high-performance nodes and low-performance nodes will affect the efficiency of data storage and transmission. The inconsistency of network bandwidth between nodes will lead to data transmission bottlenecks, affecting the connectivity and performance of the overall network.

[0003] In edge distributed storage systems, data transmission reliability and latency are two key factors: Data loss: Data loss may occur during data transmission due to network instability or node failure, affecting data integrity and reliability. Communication latency between edge nodes may be high, especially when the network topology changes frequently or the nodes are far apart. This affects real-time data processing and application response speed.

[0004] Since edge nodes may be owned by different organizations or individuals, trust and security issues between nodes are particularly important. A reliable authentication mechanism is needed to ensure that only trusted nodes can participate in the network and exchange data. Encryption and access control mechanisms are needed to protect the privacy and security of data and prevent unauthorized access and data leakage. Load balancing and resource management are the key to improving system connectivity: load imbalance between nodes will cause some nodes to be overloaded, while other node resources will be idle, affecting the overall system performance. Summary of the invention

[0005] The purpose of this section is to summarize some aspects of embodiments of the present invention and briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section and the specification abstract and the invention title of this application to avoid blurring the purpose of this section, the specification abstract and the invention title, and such simplifications or omissions cannot be used to limit the scope of the present invention.

[0006] In view of the above or existing problems of data storage methods and systems based on distributed architecture, the present invention is proposed.

[0007] In order to solve the above technical problems, the present invention provides the following technical solutions: In the first aspect, an embodiment of the present invention provides a method for improving the node connectivity rate of an edge distributed storage system, including: using a public key infrastructure to perform node identity authentication, and using a dynamic node discovery protocol to monitor the node status and location in the network in real time; using a machine learning algorithm to predict node performance, optimize the connection paths between nodes, and implement a multi-path transmission mechanism, and select multiple paths during data transmission to increase the redundancy and reliability of the network; designing an automatic fault detection and repair mechanism, so that when a node or path fails, the system can automatically discover and repair it; adopting a decentralized network protocol and introducing an edge computing intelligent collaboration mechanism to allow edge nodes to make autonomous decisions and work collaboratively.

[0008] As a preferred solution of the method for improving the node connectivity rate of the edge distributed storage system described in the present invention, the method includes: the node generates a public key and a private key pair, and sends the public key and identity information to the RA, the RA verifies the identity of the node, the RA sends the node's public key and identity information to the CA, and requests the issuance of a digital certificate. The CA uses its own private key to sign the node's public key and identity information, generates a digital certificate, and returns it to the RA. The RA distributes the digital certificate to the node, and the node saves the certificate for subsequent use; the node uses the digital certificate for identity authentication when communicating with other nodes, the communicating parties exchange their respective digital certificates, the node uses the CA's public key to verify the validity of the other party's digital certificate, and checks whether the certificate is revoked or expired. After the verification is passed, the two parties use their respective private keys and the other party's public key to negotiate a session key for encrypted communication.

[0009] As a preferred solution of the method for improving the node connectivity rate of the edge distributed storage system described in the present invention, the method comprises: using a dynamic node discovery protocol to monitor the node status and position in the network in real time, including: a new node broadcasts a message of joining the network, the neighboring nodes receiving the message respond, and exchange their respective status information; the node periodically randomly selects a number of neighboring nodes, exchanges their respective status information, and the node updates the local network topology map according to the received status information. Through multiple rounds of status exchange, the node status information in the entire network is gradually propagated and updated; the node periodically sends a health check message, and if no response is received, it is marked as a fault. After the node finds the fault, it broadcasts the fault information to the neighboring nodes. The neighboring nodes adjust the network connection according to the fault information and select a new path for data transmission; the node's geographic location information is used to optimize node discovery and connection. The node periodically broadcasts its own geographic location information. The node selects a node that is closer to connect according to the received geographic location information, thereby optimizing network performance.

[0010] As a preferred solution of the method for improving the node connectivity rate of the edge distributed storage system described in the present invention, the method uses a machine learning algorithm to predict node performance and optimize the connection path between nodes, including: monitoring the CPU utilization rate, memory utilization rate, network bandwidth, delay and node failure rate indicators of the nodes, storing the collected data in a distributed database, extracting features from the performance data, using the collected performance data and features, selecting a neural network training data set, inputting the node performance data monitored in real time into the model, the model outputs the performance prediction results of the nodes, storing the prediction results in a distributed database, and calculating the optimal connection path based on the node performance prediction results, considering the delay, bandwidth and node load, and dynamically adjusting the connection path between nodes according to the real-time prediction results.

[0011] As a preferred solution of the method for improving the node connectivity rate of the edge distributed storage system described in the present invention, wherein: the multi-path transmission mechanism is implemented, and multiple paths are selected during data transmission to increase the redundancy and reliability of the network, including: using a dynamic node discovery protocol, collecting multiple available path information between nodes, selecting several optimal paths for data transmission according to the delay, bandwidth and reliability of the paths, dividing the data to be transmitted into multiple fragments according to certain rules, each fragment contains a unique sequence number, assigning each data fragment to a different transmission path, transmitting the data fragments simultaneously through multiple paths, reorganizing and verifying the received data fragments at the target node, the target node reorganizing the received data fragments into complete data according to the fragment sequence number, using a verification algorithm to verify the integrity and correctness of the data, and detecting errors or losses during the transmission process.

[0012] As a preferred solution of the method for improving the node connectivity rate of the edge distributed storage system described in the present invention, the automatic fault detection and repair mechanism is designed, and when a node or path fails, the system can automatically discover and repair it, including: the node regularly sends Ping messages to neighboring nodes to detect their response time and reachability, monitor the node's CPU usage, memory usage, disk IO and network bandwidth indicators, and analyze the node's system log in real time to identify potential fault signs. When an abnormality is detected, the system issues an alarm to notify the relevant nodes and administrators, and defines multi-level alarms according to the severity and impact range of the fault; the nodes regularly exchange health status information, gradually propagate fault information, and quickly locate the faulty node. The Raft algorithm is used to ensure that the fault information is consistent in the network, and the operations and states before and after the fault are traced back through the system log to find the cause of the abnormality, build a dependency graph of nodes and services, analyze the impact range of the fault on other nodes and services, compare historical data, find the commonalities and laws of similar faults, guide fault location and repair, and after the fault is detected, the system automatically isolates the faulty node or path; a neural network model is used to predict potential faults, and the system configuration is adjusted in advance according to the prediction results.

[0013] As a preferred solution of the method for improving the node connectivity rate of the edge distributed storage system described in the present invention, wherein: the decentralized network protocol is adopted, and the edge computing intelligent collaboration mechanism is introduced to allow the edge nodes to make autonomous decisions and work collaboratively, including: using Kademlia for node management and data storage, and recording transactions and state changes between nodes through blockchain technology; deploying decision trees in edge nodes for real-time data analysis and prediction, using edge computing capabilities, real-time processing and analysis of local data, reducing data transmission delays and bandwidth consumption, and edge nodes making decisions autonomously based on local data analysis results; designing collaborative protocols between edge nodes, such as task allocation, data sharing and load balancing, using P2P communication protocols to achieve real-time communication and information exchange between edge nodes, dynamically allocating tasks based on node performance and load conditions, coordinating work between nodes, and ensuring optimal utilization of resources.

[0014] In the second aspect, an embodiment of the present invention provides a system for improving the node connectivity rate of an edge distributed storage system, which includes a monitoring and verification module for using a public key infrastructure to perform node identity authentication and using a dynamic node discovery protocol to monitor the node status and location in the network in real time; a node optimization module for using a machine learning algorithm to predict node performance, optimize the connection paths between nodes, and implement a multi-path transmission mechanism, and select multiple paths during data transmission to increase the redundancy and reliability of the network; a detection and repair module for designing an automatic fault detection and repair mechanism, so that when a node or path fails, the system can automatically discover and repair it; a node collaboration module for adopting a decentralized network protocol and introducing an edge computing intelligent collaboration mechanism to allow edge nodes to make autonomous decisions and work collaboratively.

[0015] In a third aspect, an embodiment of the present invention provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, wherein: when the processor executes the computer program, it implements any step of the above-mentioned method for improving the connectivity rate of nodes in an edge distributed storage system.

[0016] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein: when the computer program is executed by a processor, any step of the above-mentioned method for improving the connectivity rate of nodes in an edge distributed storage system is implemented.

[0017] The beneficial effects of the present invention are as follows: the present invention introduces a dynamic node discovery protocol to monitor and adapt to network topology changes in real time, so that the system can quickly identify and connect new edge nodes, avoid connectivity degradation caused by frequent joining and leaving of nodes, implement a multi-path transmission mechanism, select multiple paths for data transmission, increase transmission redundancy and reliability, and even if some paths or nodes fail, data can still be transmitted smoothly. Machine learning algorithms are used to predict node performance, optimize connection paths between nodes, select the optimal path for data transmission, reduce transmission delays and data loss, and design an automatic fault detection and repair mechanism. Edge nodes can autonomously discover and repair faults to ensure the continuity and reliability of data transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor. Among them: Figure 1 A flowchart of a method for improving the node connectivity rate of an edge distributed storage system provided by an embodiment of the present invention.

[0019] Figure 2 A schematic diagram of the structure of a system for improving the node connectivity rate of an edge distributed storage system provided by an embodiment of the present invention.

[0020] Figure 3 An internal structural diagram of a computer device for improving the node connectivity rate of an edge distributed storage system provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0021] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the accompanying drawings.

[0022] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0023] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The term "in one embodiment" that appears in different places in this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive with other embodiments.

[0024] Example 1 Reference Figure 1 , is an embodiment of the present invention, which provides a method for improving the node connectivity rate of an edge distributed storage system, including: S1: Use public key infrastructure for node authentication and utilize dynamic node discovery protocol to monitor the node status and location in the network in real time.

[0025] Preferably, the node generates a public key and private key pair, and sends the public key and identity information to RA, RA verifies the identity of the node, RA sends the node's public key and identity information to CA, and requests the issuance of a digital certificate, CA uses its own private key to sign the node's public key and identity information, generates a digital certificate, and returns it to RA, RA distributes the digital certificate to the node, and the node saves the certificate for subsequent use; the node uses the digital certificate for identity authentication when communicating with other nodes, the communicating parties exchange their respective digital certificates, the node uses the CA's public key to verify the validity of the other party's digital certificate, and checks whether the certificate is revoked or expired. After the verification is passed, the two parties use their respective private keys and the other party's public key to negotiate a session key for encrypted communication.

[0026] Preferably, a new node broadcasts a message of joining the network, and neighboring nodes that receive the message respond and exchange their respective status information. The node periodically randomly selects a number of neighboring nodes and exchanges their respective status information. The node updates the local network topology map based on the received status information. Through multiple rounds of status exchange, the node status information in the entire network is gradually propagated and updated; the node periodically sends health check messages, and if no response is received, it is marked as a fault. After the node discovers the fault, it broadcasts the fault information to neighboring nodes. The neighboring nodes adjust the network connection based on the fault information and select a new path for data transmission; the node's geographic location information is used to optimize node discovery and connection. The node periodically broadcasts its own geographic location information. The node selects a node that is closer to connect based on the received geographic location information, thereby optimizing network performance.

[0027] Furthermore, suppose there are three nodes A, B, and C: Node A: ID=A, Location=(12.34, 56.78), Load=20%, Connection Status=Normal Node B: ID = B, Location = (12.35, 56.79), Load = 30%, Connection Status = Normal Node C: ID = C, Location = (12.36, 56.80), Load = 40%, Connection Status = Normal A broadcasts a joining message, B and C respond and exchange status information, record the status of B and C, A selects B and C to exchange status information, merges new status each time, and updates the local topology map; A checks B and C regularly, if B does not respond, A marks B as faulty and broadcasts fault information, C receives the fault information, removes B, and adjusts the transmission path, A broadcasts its location regularly, B and C select the optimal connection path based on distance to ensure efficient data transmission.

[0028] S2: Use machine learning algorithms to predict node performance, optimize the connection paths between nodes, implement a multi-path transmission mechanism, and select multiple paths during data transmission to increase the redundancy and reliability of the network.

[0029] Preferably, the CPU usage, memory usage, network bandwidth, latency and node failure rate indicators of the monitoring nodes are stored, the collected data is stored in a distributed database, features are extracted from the performance data, the collected performance data and features are used to select a neural network training data set, the node performance data monitored in real time is input into the model, the model outputs the performance prediction results of the node, the prediction results are stored in a distributed database, the optimal connection path is calculated based on the node performance prediction results, the latency, bandwidth and node load are taken into consideration, and the connection path between nodes is dynamically adjusted according to the real-time prediction results.

[0030] Preferably, a dynamic node discovery protocol is used to collect information on multiple available paths between nodes, and several optimal paths are selected for data transmission based on the delay, bandwidth and reliability of the paths. The data to be transmitted is divided into multiple fragments according to certain rules, and each fragment contains a unique sequence number. Each data fragment is assigned to a different transmission path, and the data fragments are transmitted simultaneously through multiple paths. The received data fragments are reassembled and verified at the target node. The target node reassembles the received data fragments into complete data based on the fragment sequence number, and uses a verification algorithm to verify the integrity and correctness of the data, and detects errors or losses during the transmission process.

[0031] Furthermore, assuming that the data to be transmitted is a "large file", it is divided into 6 data fragments and transmitted through 3 optimal paths: Data fragments: fragment 1 (sequence number 0), fragment 2 (sequence number 1), fragment 3 (sequence number 2), fragment 4 (sequence number 3), fragment 5 (sequence number 4), fragment 6 (sequence number 5), path A (delay = 20ms, bandwidth = 10Mbps, reliability = 99%), path B (delay = 30ms, bandwidth = 8Mbps, reliability = 98%), Path C (latency = 25ms, bandwidth = 9Mbps, reliability = 99.5%), Path A has the highest score, followed by Path C and Path B. Paths A, B, and C are selected as the optimal paths. The data "big file" is divided into 6 fragments, each of which is attached with a sequence number. Fragments 1 and 4 are transmitted through path A, fragments 2 and 5 are transmitted through path B, and fragments 3 and 6 are transmitted through path C. Fragments 1, 2, and 3 start to be transmitted at the same time, followed by fragments 4, 5, and 6. After the destination node receives all the fragments, it reassembles the data according to the sequence number and uses the verification algorithm to verify the reassembled data to ensure integrity and correctness.

[0032] S3: Design an automatic fault detection and repair mechanism so that when a node or path fails, the system can automatically detect and repair it.

[0033] Preferably, the node periodically sends Ping messages to neighboring nodes to detect their response time and reachability, monitor the node's CPU usage, memory usage, disk IO, and network bandwidth indicators, analyze the node's system log in real time, identify potential signs of failure, and when an abnormality is detected, the system sends an alarm to notify the relevant nodes and administrators, and defines multi-level alarms based on the severity and impact of the fault; nodes regularly exchange health status information, gradually propagate fault information, quickly locate the faulty node, and use the Raft algorithm to ensure that fault information is consistent in the network. Through system logs, the operations and states before and after the fault occur are traced back to find the cause of the abnormality, build a dependency graph of nodes and services, analyze the impact of the fault on other nodes and services, compare historical data, find the commonalities and rules of similar faults, guide fault location and repair, and after detecting a fault, the system automatically isolates the faulty node or path; use a neural network model to predict potential faults, and adjust the system configuration in advance based on the prediction results.

[0034] Furthermore, suppose there are three nodes A, B, and C. A sends a Ping message to B and C. B replies with RTT=30ms and C replies with RTT=50ms. If B does not reply, A marks B as unreachable. A collects CPU usage of 80%, memory usage of 70%, disk IO100MB / s, and network bandwidth of 50Mbps. A detects that the memory usage continues to rise and reaches 90%, generates a serious alarm, and sends an alarm to notify the administrator and neighboring nodes B and C. A regularly sends health status information to B and C. B and C receive and merge A's health status information and update local monitoring data. A detects a memory leak fault, traces back the log, and finds frequent memory allocation operations before the fault. It builds a dependency graph and analyzes the impact of memory leaks on other services. A detects a memory leak, automatically isolates the faulty service, releases memory resources, restarts related services, records repair operations and results, trains a neural network model, predicts possible memory leak faults in A, adjusts A's memory configuration in advance, increases memory limits, and prevents memory leaks.

[0035] S4: Adopt decentralized network protocols and introduce edge computing intelligent collaboration mechanisms to allow edge nodes to make autonomous decisions and work collaboratively.

[0036] Preferably, Kademlia is used for node management and data storage, and blockchain technology is used to record transactions and state changes between nodes; decision trees are deployed in edge nodes for real-time data analysis and prediction, and edge computing capabilities are used to process and analyze local data in real time to reduce data transmission delays and bandwidth consumption. Edge nodes make decisions autonomously based on local data analysis results; collaborative protocols between edge nodes are designed, such as task allocation, data sharing, and load balancing. P2P communication protocols are used to achieve real-time communication and information exchange between edge nodes. Tasks are dynamically allocated based on node performance and load conditions, and work between nodes is coordinated to ensure optimal utilization of resources.

[0037] Furthermore, node A joins the network, selects node ID A1, searches for the nearest node B, exchanges routing tables, and receives real-time data streams at edge node A. It uses the locally deployed decision tree model to analyze the data. The model predicts that A's load will exceed 80%, and A decides to assign some tasks to node B. A and B exchange current load information through the P2P protocol. A finds that B's load is lower, and dynamically assigns some tasks to B. A and B establish a P2P connection and regularly exchange status information. A detects fluctuations in network bandwidth and decides to broadcast the information through the P2P protocol to notify B and C to make adjustments.

[0038] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A method for improving the node connectivity rate of an edge distributed storage system, characterized in that: include: Use public key infrastructure for node authentication and dynamic node discovery protocol to monitor the status and location of nodes in the network in real time; Use machine learning algorithms to predict node performance, optimize the connection paths between nodes, implement multi-path transmission mechanisms, and select multiple paths during data transmission to increase network redundancy and reliability; Design an automatic fault detection and repair mechanism so that when a node or path fails, the system can automatically detect and repair it; It adopts a decentralized network protocol and introduces an edge computing intelligent collaboration mechanism to allow edge nodes to make autonomous decisions and work collaboratively.

2. The method for improving the node connectivity rate of the edge distributed storage system according to claim 1, characterized in that: The use of public key infrastructure for node authentication includes: The node generates a public key and private key pair, and sends the public key and identity information to RA. RA verifies the identity of the node. RA sends the node's public key and identity information to CA, requesting the issuance of a digital certificate. CA uses its own private key to sign the node's public key and identity information, generates a digital certificate, and returns it to RA. RA distributes the digital certificate to the node, and the node saves the certificate for subsequent use. When communicating with other nodes, the node uses a digital certificate for identity authentication. The communicating parties exchange their respective digital certificates. The node uses the CA's public key to verify the validity of the other party's digital certificate and check whether the certificate is revoked or expired. After the verification is passed, the two parties use their respective private keys and the other party's public key to negotiate a session key for encrypted communication.

3. The method for improving the node connectivity rate of the edge distributed storage system according to claim 1, characterized in that: The use of a dynamic node discovery protocol to monitor the node status and location in the network in real time includes: A new node broadcasts a message of joining the network, and the neighboring nodes that receive the message respond and exchange their respective status information. The node periodically randomly selects several neighboring nodes and exchanges their respective status information. The node updates the local network topology based on the received status information. Through multiple rounds of status exchange, the node status information in the entire network is gradually propagated and updated. The node periodically sends health check messages. If no response is received, it is marked as a fault. After the node discovers the fault, it broadcasts the fault information to the neighboring nodes. The neighboring nodes adjust the network connection based on the fault information and select a new path for data transmission. The node's geographic location information is used to optimize node discovery and connection. The node periodically broadcasts its own geographic location information. The node selects a node that is closer to connect based on the received geographic location information to optimize network performance.

4. The method for improving the node connectivity rate of the edge distributed storage system according to claim 1, characterized in that: The method of using a machine learning algorithm to predict node performance and optimize the connection paths between nodes includes: Monitor the CPU usage, memory usage, network bandwidth, latency, and node failure rate indicators of the nodes, store the collected data in a distributed database, extract features from the performance data, use the collected performance data and features, select the neural network training data set, input the real-time monitored node performance data into the model, the model outputs the node performance prediction results, and stores the prediction results in a distributed database. Based on the node performance prediction results, calculate the optimal connection path, consider latency, bandwidth, and node load, and dynamically adjust the connection path between nodes according to the real-time prediction results.

5. The method for improving the node connectivity rate of the edge distributed storage system according to claim 1, characterized in that: The implementation of the multi-path transmission mechanism selects multiple paths during data transmission to increase the redundancy and reliability of the network, including: Use a dynamic node discovery protocol to collect information on multiple available paths between nodes, select several optimal paths for data transmission based on the path's delay, bandwidth, and reliability, divide the data to be transmitted into multiple fragments according to certain rules, each fragment contains a unique sequence number, assign each data fragment to a different transmission path, transmit the data fragments simultaneously through multiple paths, reassemble and verify the received data fragments at the target node, and the target node reassembles the received data fragments into complete data based on the fragment sequence number, uses a verification algorithm to verify the integrity and correctness of the data, and detects errors or losses during the transmission process.

6. The method for improving the node connectivity rate of the edge distributed storage system according to claim 1, characterized in that: The automatic fault detection and repair mechanism is designed. When a node or path fails, the system can automatically detect and repair it, including: Nodes regularly send Ping messages to neighboring nodes to detect their response time and reachability, monitor the node's CPU usage, memory usage, disk IO, and network bandwidth indicators, analyze the node's system log in real time, and identify potential signs of failure. When an abnormality is detected, the system sends an alarm to notify the relevant nodes and administrators. According to the severity and impact of the fault, multi-level alarms are defined; nodes regularly exchange health status information, gradually propagate fault information, and quickly locate the faulty node. The Raft algorithm is used to ensure that fault information is consistent in the network. Through the system log, the operations and status before and after the fault occur can be traced back to find the cause of the abnormality, and a dependency graph of nodes and services can be constructed. The impact of the fault on other nodes and services is analyzed, and historical data can be compared to find the commonalities and patterns of similar faults, and guide fault location and repair. After detecting a fault, the system automatically isolates the faulty node or path; uses a neural network model to predict potential faults and adjusts the system configuration in advance based on the prediction results.

7. The method for improving the node connectivity rate of the edge distributed storage system according to claim 1, characterized in that: The decentralized network protocol is adopted and the edge computing intelligent collaboration mechanism is introduced to allow edge nodes to make autonomous decisions and work together, including: Use Kademlia for node management and data storage, and use blockchain technology to record transactions and status changes between nodes; deploy decision trees in edge nodes for real-time data analysis and prediction, use edge computing capabilities to process and analyze local data in real time, reduce data transmission delays and bandwidth consumption, and make decisions autonomously based on local data analysis results; design collaborative protocols between edge nodes, such as task allocation, data sharing, and load balancing, use P2P communication protocols to achieve real-time communication and information exchange between edge nodes, dynamically allocate tasks based on node performance and load conditions, coordinate work between nodes, and ensure optimal use of resources.

8. A system for improving the node connectivity rate of an edge distributed storage system, characterized in that: include: A monitoring and verification module is used to perform node identity authentication using a public key infrastructure and utilize a dynamic node discovery protocol to monitor the node status and location in the network in real time; The node optimization module is used to predict node performance using machine learning algorithms, optimize the connection paths between nodes, implement a multi-path transmission mechanism, and select multiple paths during data transmission to increase network redundancy and reliability; The detection and repair module is used to design an automatic fault detection and repair mechanism. When a node or path fails, the system can automatically detect and repair it. The node collaboration module is used to adopt a decentralized network protocol and introduce an edge computing intelligent collaboration mechanism, allowing edge nodes to make autonomous decisions and work collaboratively.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method for improving the node connectivity rate of the edge distributed storage system described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method for improving the node connectivity rate of an edge distributed storage system as described in any one of claims 1 to 7 are implemented.

Citation Information

Cited By

  • Data exchange method based on P2P

    CN119728704A

  • Optical fiber distributed network transmission system

    CN120110514A

  • Cloud-edge collaborative intelligent storage node dynamic deployment method and system

    CN120614249A

  • Public Key Infrastructure (PKI) Monitoring Systems and Methods

    US20250112787A1

  • Method for processing devices on basis of decentralization, and device and system

    WO2026199642A1