Communication method and device and electronic equipment

Abstract

The embodiment of the invention provides a communication method and device and electronic equipment, the method is applied to first client equipment, and the method comprises the following steps: receiving a first message sent by second client equipment; verifying the first message; under the condition that the verification of the first message is not passed, a second message is generated according to the first message, and the second message is used for indicating that error verification exists in the first message; sending a second message to a second client device or a cluster monitoring device; the second message is used for indicating to disconnect the communication link between the first client device and the second client device and establish the communication link between the first client device and the third client device. According to the embodiment of the invention, the communication efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the field of communications, and in particular to a communication method, device and electronic equipment. Background Art

[0002] With the development of communication technology, message transmission needs to be verified to ensure its reliability and correctness. When the network module verifies the received message, if a verification error occurs, the link will be repeatedly retried and continue to report errors, causing the link to be frequently disconnected and reconnected, forming a loop and blocking the entire business.

[0003] Currently, the only way to recover is to manually restart the process. The distributed system cannot automatically repair this error, which affects the normal operation of the business. Communication resources are occupied by error messages, reducing communication efficiency. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present invention provides a communication method, device and electronic equipment.

[0005] In a first aspect, the present invention provides a communication method, the method comprising:

[0006] receiving a first message sent by a second client device;

[0007] verifying the first message;

[0008] If the first message fails verification, generating a second message according to the first message, wherein the second message is used to indicate that there is an error in the first message verification;

[0009] The second message is sent to the second client device or the cluster monitoring device; the second message is used to instruct to disconnect the communication link between the first client device and the second client device, and to establish a communication link between the first client device and a third client device; the third client device is a client device in the cluster other than the first client device and the second client device.

[0010] Optionally, when the first message fails verification, generating a second message according to the first message includes:

[0011] If the first message fails verification, determining a location of an error verification based on the verification result;

[0012] Marking the position of the error check to obtain a target mark;

[0013] The target tag is added to the first message to obtain a second message.

[0014] Optionally, the method further comprises:

[0015] Receive a service message sent by the third client device; the service message is used to execute the service corresponding to the first message.

[0016] Optionally, when the first message fails verification, generating a second message according to the first message includes:

[0017] Extracting data from the first message to obtain metadata, control data, and payload data corresponding to the first message;

[0018] Determine a generating polynomial according to an error checking algorithm;

[0019] For each byte of each data in the first message, perform an XOR operation with the low byte of the error check register to obtain an XOR result, and shift the XOR result left by one bit;

[0020] When the highest bit corresponding to each byte is 1, an XOR operation is performed with the generator polynomial;

[0021] After all bytes are calculated, a first error check code is obtained;

[0022] Adding the first error check code to the first message to determine first check information;

[0023] Determining a second error checking code according to the first checking information and the error checking algorithm;

[0024] Determining a verification result according to the first error checking code and the second error checking code;

[0025] When the first error check code and the second error check code are the same, it is determined that the first message passes the check and there is no data anomaly in the first message;

[0026] When the first error check code and the second error check code are different, it is determined that the first message fails verification, error check information is added to the first message, and a second message is generated.

[0027] Optionally, applied to a second client device, the method includes:

[0028] Sending a first message to a first client device;

[0029] receiving a first target message; the first target message is used to indicate that an error check exists in the first message;

[0030] Based on the first target message, the communication link between the first client device and the second client device is disconnected, and a communication link between the first client device and a third client device is established; the third client device is a client device in the cluster other than the first client device and the second client device.

[0031] Optionally, the second client device comprises a client device; the first target message comprises a second message from the first client device;

[0032] The method of disconnecting the communication link between the first client device and the second client device and establishing a communication link between the first client device and a third client device based on the first target message includes:

[0033] A third message is sent to the cluster monitoring device; the third message is used to instruct to clean and reset the second client device and to create a communication link between the third client device and the first client device; the third client device is a client device in the cluster except the first client device and the second client device.

[0034] Optionally, sending the third message to the cluster monitoring device includes:

[0035] Upon receiving a second message from the first client device, determining whether the second message carries a target tag; the target tag is used to indicate that an error check exists in the first message;

[0036] In the case where the target tag is carried in the second message, a third message is sent to the cluster monitoring device; the cluster monitoring device includes a client service device.

[0037] Optionally, the second client device includes an object storage device; the first target message includes an isolation message from a cluster monitoring device;

[0038] The method of disconnecting the communication link between the first client device and the second client device and establishing a communication link between the first client device and a third client device based on the first target message includes:

[0039] The link resources are cleaned up and a network module is re-established; the network module is used to process read and write services.

[0040] Optionally, applied to a cluster monitoring device, the method includes:

[0041] receiving a second target message; the second target message includes a second message from the first client device, or a third message from the second client device;

[0042] In the case where the second target message is the second message, an isolation message is sent to the second client device; the isolation message is used to instruct the second client device to clean up the link resources and re-establish the network module; the network module is used to process the read and write services;

[0043] In the case where the second target message is the third message, the second client device is cleaned and reset, and a communication link is created between the third client device and the first client device; the third client device is a client device in the cluster other than the first client device and the second client device.

[0044] Optionally, when the second target message is the second message, sending the isolation message to the second client device includes:

[0045] receiving a second message sent by the first client device; the second message is used to indicate that an error check exists in the first message;

[0046] Generate an isolation message according to the device information carried in the second message; the isolation message is used to instruct the second client device to clean up the link resources and re-establish the network module; the network module is used to process the read and write services;

[0047] The quarantine message is sent to the second client device.

[0048] In a second aspect, the present invention provides a communication method, which is applied to a distributed file system, wherein the distributed file system includes a first client device, a second client device, and a cluster monitoring device; the method includes:

[0049] The first client device is used to receive a first message sent by a second client device; verify the first message; if the first message fails to be verified, generate a second message according to the first message, the second message being used to indicate that there is an error in the first message; send the second message to the second client device or the cluster monitoring device; the second message is used to indicate to disconnect the communication link between the first client device and the second client device, and establish a communication link between the first client device and a third client device;

[0050] The second client device is used to send a first message to the first client device; receive a first target message; the first target message is used to indicate that there is an error check in the first message; based on the first target message, disconnect the communication link between the first client device and the second client device, and establish a communication link between the first client device and a third client device;

[0051] The cluster monitoring device is used to receive a second target message; the second target message includes a second message from a first client device, or a third message from a second client device; when the second target message is the second message, an isolation message is sent to the second client device; the isolation message is used to instruct the second client device to clean up link resources and re-establish a network module; the network module is used to process read and write services; when the second target message is the third message, the second client device is cleaned and reset, and a communication link is created between the third client device and the first client device; the third client device is a client device in the cluster other than the first client device and the second client device.

[0052] In a third aspect, the present invention provides a server, wherein the server comprises the communication method as described in any one of the first aspects.

[0053] In a fourth aspect, the present invention provides an electronic device, the electronic device comprising:

[0054] A processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the communication method as described in the second aspect when executing the program.

[0055] In a fifth aspect, the present invention provides a readable storage medium, which, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to execute the communication method described in the second aspect.

[0056] In a sixth aspect, the present invention provides a computer program product, comprising a computer program / instruction, which, when executed by a processor, implements the communication method described in the second aspect.

[0057] The communication method provided by the embodiment of the present invention is applied to a first client device, the first client device receives a first message sent by a second client device; and verifies the first message; when the first message verification fails, the first client device will first generate a second message based on the first message, wherein the second message is used to indicate that there is an error in the first message verification; finally, the first client device will send the second message to the second client device or the cluster monitoring device; the second message is used to indicate the disconnection of the communication link between the first client device and the second client device, that is, when the sent message verification fails, the first client device will send the verification error information to the second client device or the cluster monitoring device, thereby disconnecting the connection between the first client device and the second client device, and establishing a communication link between the first client device and the third client device, thereby solving the problem of communication congestion and improving communication efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0059] Figure 1 This is a step flow of a communication method provided by an embodiment of the present invention. Figure 1 ;

[0060] Figure 2 This is a step flow of a communication method provided by an embodiment of the present invention. Figure 2 ;

[0061] Figure 3 This is a step flow of a communication method provided by an embodiment of the present invention. Figure 3 ;

[0062] Figure 4 It is a schematic diagram of the architecture of a distributed file system provided by an embodiment of the present invention;

[0063] Figure 5 is a schematic diagram of a communication device provided by an embodiment of the present invention;

[0064] Figure 6 is a schematic diagram of another communication device provided by an embodiment of the present invention;

[0065] Figure 7 is a schematic diagram of another communication device provided by an embodiment of the present invention;

[0066] Figure 8An electronic device is provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0067] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0068] Method Embodiment

[0069] The communication method provided in the embodiment of the present invention can be applied to the first client device as described above, referring to Figure 1 , showing the steps of a communication method provided by an embodiment of the present invention Figure 1 , the method may include steps S101 to S104:

[0070] Step S101: Receive a first message sent by a second client device.

[0071] In the embodiment of the present invention, during the communication process of the distributed file system, the first client device first receives the first message sent by the second client device.

[0072] Exemplarily, the first client device may be an Async module of an object storage service (OSS). The Async module of OSS generally refers to a function or tool related to asynchronous processing, which allows a user to continue to perform other tasks without having to wait for the task to be completed when processing the task.

[0073] For example, the Async module provides a series of practical functions for simplifying asynchronous flow control in JavaScript.

[0074] For example, asynchronous processing (x-oss-async-process) means that when a program executes a task, it can continue to execute other tasks without waiting for the task to complete. This processing method is particularly suitable for scenarios with long processing time, such as document conversion, video transcoding, video splicing, etc.

[0075] Document conversion and processing: The Async module of OSS also supports document conversion, such as converting one document format to another.

[0076] Efficient use of resources: Asynchronous processing requests do not return processing results when they are returned. The "Save As" function is required to persist the processing results in object storage. By using the message notification function, users can obtain the processing results of asynchronous tasks, thereby managing tasks more efficiently.

[0077] Exemplarily, the advantages of the Async module include: Asynchronous processing allows users to perform multiple tasks at the same time, thereby improving overall processing efficiency. Users do not need to wait for a single task to complete before continuing to perform other tasks, thus saving time. Asynchronous processing is suitable for various scenarios with long processing times, providing users with more flexibility.

[0078] It should be noted that before using the Async module, users need to ensure that they have provided the correct credentials for accessing OSS, including the access key account AccessKeyId, the access key secret AccessKeySecret, and the endpoint Endpoint. Users need to understand and correctly set the processing parameters to ensure that the task can be executed correctly. Users can monitor the processing status of asynchronous tasks through the message notification function and handle any potential problems in a timely manner.

[0079] The second client device may be an object storage client management object Objecter or OSS, which is not specifically limited in the embodiment of the present invention.

[0080] It should be noted that the object storage client is a tool for managing object storage services, which can help users more conveniently upload, download, delete, copy and other operations on objects in buckets (also called containers or storage pools). The "object" here is the basic data unit in object storage, which includes the data itself, related metadata and a unique identifier.

[0081] Object storage clients usually provide the following functions to manage objects: Clients can upload local files to a specified bucket in the object storage service. This usually supports the upload of single files and folders, and sometimes also supports functions such as batch upload and breakpoint resume. Users can download files from the bucket to their local computer through the client, or specify to download to a certain folder. This is very useful for data backup, recovery, or access to data across devices. The client allows users to delete single or multiple files in a bucket, and even supports deleting the entire bucket (subject to compliance with permissions and security policies). Users can copy files within or across buckets, which helps with data migration, backup, or distribution. The client can also provide basic information viewing functions for buckets and files, including name, size, upload time, MD5 checksum, etc. This information is very important for data management and auditing.

[0082] The implementation principle of object storage clients is usually based on the application programming interface (API) of the object storage service. Developers use client tools to indirectly access the API interface of the object storage service to implement operations on buckets and objects. These API interfaces provide rich functions, allowing clients to flexibly manage data in object storage.

[0083] The object storage client is an important part of the object storage service. It provides a user-friendly interface and rich functions to manage objects in buckets. By using the object storage client, users can store and manage large amounts of unstructured data more efficiently and securely.

[0084] Exemplarily, in the embodiments of the present invention, OSS refers to an object storage service, which is a cloud computing-based storage method that provides a high-reliability, high-scalability, and low-cost data storage solution by storing data objects on physical storage devices in the cloud. The object storage service processes data as objects, each of which includes the data itself, metadata, and a globally unique identifier.

[0085] Exemplarily, the first message may be a read-write message, which is a data structure used to transmit information related to read-write operations in a program. It is usually composed of multiple fields, each of which contains specific information related to the read-write operation. These structures are usually used in scenarios such as network communication, file operations, and database access to transmit and process read-write requests between different program components or systems.

[0086] Exemplarily, the specific composition of the read-write message structure depends on its application scenario and the programming language used.

[0087] Exemplarily, the operation type can be used to indicate whether the current operation is a read operation or a write operation; the target address indicates the target location of the read or write operation, such as a file path, a database table name, a target address in network communication, etc.; the data buffer is used to store the data to be written or the data to be read from the target; the data length indicates the length of the data in the data buffer; the status code / error code is used to indicate the result status of the read or write operation, such as success, failure, timeout, etc., as well as possible causes of the error. Other parameters may also include other parameters related to the read and write operation, such as timeout, number of retries, etc., depending on the specific application scenario.

[0088] Exemplarily, the first message may be a service request message or a read / write request message; or, the first message may be a service message transmitted during the current service execution process, for example, a message for transmitting intermediate data. When the first message is a service request message, it means that a verification error has been determined before the service is executed, and the communication method of the embodiment of the present invention is adopted; when the first message is a service message during the service execution process, if there is a verification problem in the service message, the communication method of the embodiment of the present invention is adopted.

[0089] Exemplarily, before the message is transmitted, a business message has been transmitted.

[0090] Step S102: verify the first message.

[0091] In the embodiment of the present invention, after receiving the first message sent by the second client device, the first client device verifies the first message.

[0092] The verification process may use a cyclic redundancy check (CRC), which is the most commonly used error checking code in the field of data communication.

[0093] For example, CRC checksum is a checksum technology based on polynomial division. During data transmission or storage, the sender will calculate a checksum (CRC code) based on the data to be transmitted using a pre-agreed generator polynomial, and append it to the original data before sending it to the receiver. After receiving the data, the receiver will use the same generator polynomial to check the received data, and by comparing the calculated checksum with the checksum appended by the sender, it can determine whether the data is wrong during transmission.

[0094] Step S103: When the first message fails verification, a second message is generated according to the first message, where the second message is used to indicate that there is an error in the verification of the first message.

[0095] In the embodiment of the present invention, after the first message is verified, if the first message fails the verification, a second message is generated according to the first message, and the second message is used to indicate that there is an error in the verification of the first message.

[0096] The second message may be generated according to the first message, and the second message may indicate that there is an error check in the first message.

[0097] Exemplarily, information including error checking is added to the first message, thereby obtaining the second message.

[0098] Exemplarily, the error check may be performed after checking the first message, and if the check fails, it is considered an error check.

[0099] Furthermore, in an embodiment of the present invention, when the first message fails verification, a second message is generated based on the first message, and the first client device can determine the location of the error check based on the verification result; mark the location of the error check to obtain a target mark; and add the target mark to the first message to obtain the second message.

[0100] Exemplarily, the verification result may include verification passed, verification failed, and no verification result, which is not limited in the embodiments of the present application.

[0101] Exemplarily, since the lengths of the information field and the check field of the CRC check can be arbitrarily selected, the position of the error check can be any position in the message.

[0102] Exemplarily, the target mark may be obtained after the error check mark.

[0103] Step S104: Send a second message to the second client device or the cluster monitoring device; the second message is used to instruct to disconnect the communication link between the first client device and the second client device, and to establish a communication link between the first client device and the third client device.

[0104] In an embodiment of the present invention, if the first message fails verification, after generating a second message based on the first message, the first client device will send the second message to the second client device or the cluster monitoring device; the second message is used to indicate disconnection of the communication link between the first client device and the second client device, and to establish a communication link between the first client device and the third client device.

[0105] It should be noted that the cluster monitoring device may be China's Communication Service (CCS), which is not limited in the embodiment of the present invention.

[0106] For example, in an embodiment of the present invention, in a distributed system or cluster environment, the CCS service refers to a daemon process running in the CCSitor cluster environment, which is responsible for monitoring the status and performance of the cluster to ensure the healthy operation of the cluster. This daemon process may collect data from each node in the cluster, provide a visual interface or alarm mechanism, and take measures to solve the problem when necessary.

[0107] The third client device may be a new objecter, that is, after disconnecting the communication connection between the first client device and the second client device, the first client device will establish a communication connection with the new client device to achieve information transmission.

[0108] Further, in an embodiment of the present invention, the first client device may receive a service message sent by the third client device; the service message is used to execute the service corresponding to the first message.

[0109] Exemplarily, the service message may include a read service and a write service. The read and write services in the distributed file system mainly involve the client performing read and write operations on files stored on multiple computer nodes.

[0110] It should be noted that a distributed file system (DFS) is a file system that can store files on multiple computer nodes. It implements distributed storage of files on multiple hosts through the network, improving data reliability and availability. In a distributed file system, the client obtains the location information of the file by communicating with the metadata server (or master node), and directly performs data read and write operations with the storage node (or slave node).

[0111] Further, in an embodiment of the present invention, when the first message fails to be verified and the second message is generated according to the first message, the first client device can extract data from the first message to obtain metadata, control data, and payload data corresponding to the first message; determine a generating polynomial according to an error checking algorithm; for each byte of each data in the first message, perform an XOR operation with the low byte of the error checking register to obtain an XOR result, and shift the XOR result left by one bit; when the highest bit corresponding to each byte is 1, perform an XOR operation with the generating polynomial; after all bytes are calculated, obtain a first error check code; add the first error check code to the first message to determine the first check information; determine the second error check code according to the first check information and the error checking algorithm; determine the check result according to the first error check code and the second error check code; when the first error check code and the second error check code are the same, determine that the first message passes the check and there is no data anomaly in the first message; when the first error check code and the second error check code are different, determine that the first message fails the check, add the error check information to the first message, and generate the second message.

[0112] Exemplarily, the metadata may represent a header of the first message, including message length and message type, etc., which is not limited in the embodiments of the present invention.

[0113] Exemplarily, the control data may represent the middle part of the first message, and may also include additional data, etc., which is not limited in the embodiments of the present invention.

[0114] Exemplarily, the payload data may represent the actual data payload of the first message, which is not limited in the embodiments of the present invention.

[0115] Exemplarily, the low byte may be a low-order byte in the first message, which is not limited in the embodiment of the present invention.

[0116] Exemplarily, the low byte generally refers to a byte with a smaller value or a byte located at a lower address (or lower bit order) in a multi-byte data representation, which is not limited in the embodiments of the present invention.

[0117] Exemplarily, during the verification process, the metadata, control data, and payload data corresponding to the first message may be verified respectively.

[0118] Exemplarily, the verification process also includes initializing a CRC register, that is, initializing the CRC register to a predefined initial value.

[0119] Exemplarily, after all bytes in the metadata are processed, the content of the CRC register is the CRC check code corresponding to the metadata.

[0120] Exemplarily, after all bytes in the control data are processed, the content of the CRC register is the CRC check code corresponding to the control data.

[0121] Exemplarily, after all bytes in the payload data are processed, the content of the CRC register is the CRC check code corresponding to the payload data.

[0122] Exemplarily, the metadata, control data, and CRC check codes corresponding to the payload data are appended to the end of the message or other designated locations for verification by the receiver.

[0123] The communication method provided in the embodiment of the present invention can be applied to the second client device as described above, referring to Figure 2 , showing the steps of a communication method provided by an embodiment of the present invention Figure 2 , the method may include steps S201 to S203:

[0124] Step S201: Send a first message to a first client device.

[0125] In the embodiment of the present invention, during the communication process, the second client device sends the first information to the first client device.

[0126] The first message is a message that has not been verified yet.

[0127] Step S202, receiving a first target message; the first target message is used to indicate that an error check exists in the first message.

[0128] In an embodiment of the present invention, after sending a first message to a first client device, a second client device may receive a first target message, wherein the first target message is used to indicate that an error check exists in the first message.

[0129] It should be noted that, in the embodiment of the present application, the first target message refers to a message containing an error check.

[0130] Step S203: based on the first target message, disconnect the communication link between the first client device and the second client device, and establish a communication link between the first client device and the third client device.

[0131] In the embodiment of the present invention, after receiving the first target message, the second client device may disconnect the communication link between the first client device and the second client device based on the first target message, and establish a communication link between the first client device and the third client device.

[0132] It should be noted that in the embodiments of the present application, in a distributed file system, a communication link refers to a network connection established between a client, a metadata server (or a master server) and a storage node (or a slave node, a data server) to implement functions such as reading and writing file data, updating status, and verifying permissions. This connection is the cornerstone of the normal operation of a distributed file system, which allows different components to exchange information and work together.

[0133] Specifically, the communication links in a distributed file system may include: the connection between the client and the metadata server, that is, when the client accesses the distributed file system, it will first establish a connection with the metadata server to obtain the file's location information, metadata, etc.; the metadata server is responsible for maintaining the namespace of the entire file system, the mapping relationship between files and storage nodes, and other key information, and provides this information to the client through this connection.

[0134] The connection between the client and the storage node, that is, after the client obtains the location information of the file, it will establish a connection with the corresponding storage node to perform data read and write operations. The storage node is responsible for storing and managing the data blocks of the file, and transmits the data blocks to the client or receives the data blocks from the client through this connection.

[0135] The connection between the metadata server and the storage node, that is, the metadata server not only needs to communicate with the client, but also needs to interact with the storage node to update the metadata of the file, monitor the status of the storage node, etc. This connection is crucial to maintaining the overall consistency and reliability of the distributed file system.

[0136] Connections between storage nodes (in some architectures), that is, in some distributed file system architectures, connections may also need to be established between storage nodes to achieve functions such as data replication and load balancing.

[0137] Further, in an embodiment of the present invention, the second client device includes a client device; the first target message includes a second message from the first client device; when the communication link between the first client device and the second client device is disconnected and the communication link between the first client device and the third client device is established based on the first target message, the client device can send a third message to the cluster monitoring device; the third message is used to instruct the second client device to be cleaned and reset, and to create a communication link between the third client device and the first client device; the third client device is a client device in the cluster other than the second client device.

[0138] It should be noted that in the embodiments of the present application, the client device can perform a series of operations on the objects stored in the object storage system through the object storage client tool. Object storage is an object-centric storage method that stores data as objects rather than files. Each object has a unique identifier and metadata that can be accessed through an API. The object storage client tool is a tool for managing these objects, which provides operations such as upload, download, delete, copy, and view.

[0139] It should be noted that, in the embodiment of the present application, the first target message includes the second message from the first client device, that is, the first target message includes error checking information.

[0140] It should be noted that, in the embodiment of the present application, the third message may be used to instruct to clean and reset the second client device.

[0141] It should be noted that, in the embodiment of the present application, the cleaning and resetting of the second client device may include object attribute reset, data cleaning, configuration reset, state reset, security cleaning, etc.

[0142] Furthermore, in an embodiment of the present application, the second client device includes an object storage device; the first target message includes an isolation message from a cluster monitoring device; when the communication link between the first client device and the second client device is disconnected and a communication link between the first client device and the third client device is established based on the first target message, the second client device can clean up the link resources and re-establish the network module; the network module is used to process read and write services.

[0143] It should be noted that in the embodiments of the present application, object storage devices can be used to store and manage large amounts of unstructured data. Unlike traditional block storage and file storage, object storage stores data as objects, each of which contains the data itself, metadata (property information describing the data), and a unique identifier.

[0144] It should be noted that, in the embodiment of the present application, the isolation message can be used to instruct the second client device to perform cleaning and resetting.

[0145] It should be noted that in the embodiments of the present application, the cluster monitoring device can monitor various types of devices and systems, including but not limited to: servers, monitoring the server's CPU usage, memory usage, disk I / O and other performance indicators; network devices, monitoring switches, routers and other network devices' bandwidth utilization, connection status, etc.; storage systems, monitoring the storage device's capacity usage, read and write speeds, etc.; in addition, cluster monitoring can also be divided into different levels, such as cluster layer monitoring, node layer monitoring and application layer monitoring, in order to understand each aspect of the cluster in more detail.

[0146] It should be noted that, in the embodiments of the present application, a link resource generally refers to a logical connection or reference, which allows a user or system to conveniently access and share files or data resources distributed on a network.

[0147] It should be noted that in the embodiments of the present application, in the communication between OSSs, an asynchronous communication mechanism may be used to improve the response speed and throughput of the system. This mechanism allows the system to continue to execute other tasks without waiting for the response of the other party, thereby improving the concurrent processing capability of the system. At this level, the Async module can be understood as a technical means or framework for implementing asynchronous communication, which supports non-blocking, event-driven interaction between OSS systems.

[0148] Further, in an embodiment of the present application, when the second client device sends a third message to the cluster monitoring device, upon receiving the second message from the first client device, it determines whether the second message carries a target tag; the target tag is used to indicate that there is an error check in the first message; when the second message carries the target tag, the third message is sent to the cluster monitoring device; the cluster monitoring device includes a client service device.

[0149] Exemplarily, the target mark may be a mark of error checking.

[0150] Exemplarily, the client service device may be samb or rdb, which is not limited in the embodiments of the present application.

[0151] Specifically, in the embodiments of the present application, the client service device can obtain various information from the server, such as news, emails, files, etc., and display them to the user; the client service can also interact with the server for data, such as submitting forms, uploading files, downloading data, etc.; the client service can also execute various application programs, such as games, office software, image processing software, etc.; in some cases, the client service can also be used to manage local devices, such as printers, cameras, etc.

[0152] The communication method provided in the embodiment of the present invention can be applied to the cluster monitoring device as described above, referring to Figure 3 , showing the steps of a communication method provided by an embodiment of the present invention Figure 3 , the method may include steps S301 to S303:

[0153] S301. Receive a second target message; the second target message includes a second message from a first client device, or a third message from a second client device.

[0154] In the embodiment of the present invention, the second target message may include a second message from the first client device, or a third message from the second client device.

[0155] The second message is used to indicate that there is an error check in the first message; the third message is used to indicate to clean and reset the second client device and to create a communication link between the third client device and the first client device.

[0156] S302. When the second target message is the second message, an isolation message is sent to the second client device; the isolation message is used to instruct the second client device to clean up the link resources and re-establish the network module; the network module is used to process the read and write services.

[0157] In an embodiment of the present invention, after receiving a second target message, wherein the second target message includes a second message from a first client device, or a third message from a second client device, the cluster monitoring device may send an isolation message to the second client device if the second target message is the second message; the isolation message is used to instruct the second client device to clean up link resources and re-establish a network module; the network module is used to process read and write services.

[0158] Furthermore, in an embodiment of the present invention, the second target message is the second message. When sending an isolation message to a second client device, the cluster monitoring device can receive the second message sent by the first client device; the second message is used to indicate that there is an error check in the first message; an isolation message is generated based on the device information carried in the second message; the isolation message is used to instruct the second client device to clean up the link resources and re-establish the network module; the network module is used to process read and write services; and an isolation message is sent to the second client device.

[0159] It should be noted that the device information may be device information corresponding to the second client device.

[0160] It should be noted that the isolation information is generated based on the device information carried in the second message.

[0161] S303: When the second target message is the third message, clean and reset the second client device, and create a communication link between the third client device and the first client device; the third client device is a client device in the cluster except the second client device.

[0162] In the embodiment of the present invention, the third client device is a client device in the cluster except the first client device and the second client device.

[0163] In summary, the communication method provided by the embodiment of the present invention is applied to a first client device, and the method includes: receiving a first message sent by a second client device; verifying the first message; if the first message fails to be verified, generating a second message according to the first message, the second message is used to indicate that there is an error in the first message; sending the second message to the second client device or the cluster monitoring device; the second message is used to indicate to disconnect the communication link between the first client device and the second client device, and to establish a communication link between the first client device and the third client device. The embodiment of the present invention improves communication efficiency.

[0164] It can be seen that, when the first message verification fails, the first client device will first generate the second information based on the first information, and then send the second message to the second client device or the cluster monitoring device, and then disconnect the communication link with the second client device according to the second message, and establish a new link with the third client device, thereby improving communication efficiency.

[0165] In some embodiments, after the link between services is successfully established, error checking that occurs during data interaction is performed. The service types are different according to different service roles. The services that need to be notified and the processing methods are different, so the overall processing flow is also different. It is generally divided into two parts. One is the data processing flow between OSS services and OSS services, and the other is the data processing flow between OSS services and Objecter services.

[0166] Exemplarily, the first client device includes an object storage service; when receiving a first message sent by a second client device, the first client device can receive the first message sent by the client device; when generating a second message based on the first message, if the first message verification fails, the first client device can perform a cyclic redundancy check on the first message; when the first message verification fails, the first client device can add error verification information to the first message to generate a first target message; when sending a second message to a second client device or a cluster monitoring device, the first client device can send the first target message to the client device or the cluster monitoring device; disconnect the communication link with the client device, and establish a communication link with a third client device; the third client device is a client device in the cluster other than the second client device; wherein the first message includes any one of the following: a business request message; a read / write request message.

[0167] Exemplarily, it is assumed that the first client device is the Async module of OSS.B, the second client device is OSS.A, and the cluster monitoring device is the CCS service.

[0168] When the Async module of OSS.B receives the message sent from OSS.A, if BADCRC appears in the message, it will pass the BADCRC tag and OSS.A information to OSS.B; after OSS.B receives the BADCRC tag transmitted by the async module, it constructs a BADCRC message containing the OSS.A information that sends the BADCRC message and sends it to the CCS service; after receiving the BADCRC message, the CCS service reads the OSS.A information from the BADCRC message and sends an isolation message to OSS.A; after OSS.A is isolated, the master OSS will switch to other members. Objecter will send read and write service requests to the new master OSS. For example, if the new master OSS is OSS.C, it will send read and write service requests to OSS.C; after OSS.A receives the isolation message from CCS, it will clean up the link resources, re-establish the Async module, and rejoin. Then it can receive commands for reading and writing again, and there will be no more blocking reading and writing.

[0169] Exemplarily, the first client device is the Async module of OSS, the second client device is Objecter, and the cluster monitoring device is the client service.

[0170] When the Async module of OSS receives the message sent from Objecter, if BADCRC is found in the message, it will transmit the BADCRC mark information to OSS.

[0171] After receiving the BADCRC mark from the async module, the OSS adds the BADCRC mark to the READY message of the connection establishment when the Objecter reconnects next time.

[0172] When receiving the link establishment READY message from OSS, Objecter checks whether there is a BADCRC flag. If there is a BADCRC flag, Objecter reports to the client that a BAD CRC problem has occurred.

[0173] After receiving the BADCRC message reported by the Objecter module, client services such as samb rdb clean up and reset the Objecter, then recreate the read and write requirements, reassemble the read and write information, and send it to the OSS.

[0174] The above-mentioned method for dynamically handling memory data anomalies in a distributed file system optimizes the problem that the overall reading and writing are stuck due to the inability to handle the BAD CRC problem. By dynamically handling the memory data anomaly, the service can automatically clean up the faulty memory information, reapply for memory, and then resend the data, avoiding a large number of blockages to the reading and writing business when the BAD CRC problem occurs, and improving the robustness and flexibility of business processing. For customers, the user experience is improved, and the business will not be blocked or affect the normal business operation of customers. The fault will no longer be exposed to customers, waiting for customers to handle it manually.

[0175] Specifically, the distributed file system can dynamically handle memory data anomalies, allowing the service to repair BAD CRC problems without leaving a trace, dynamically isolate abnormal OSS, automatically clean up memory data anomalies, and rebuild the Async module. Read and write services are not blocked; in the event of memory data anomalies, the objecter module can be used to notify the client service, automatically rebuild the objecter module, release abnormal memory, and resend data. Read and write services are not blocked.

[0176] Reference Figure 4 , shows a schematic diagram of the architecture of a distributed file system provided by an embodiment of the present invention, such as Figure 4 As shown, the distributed file system 600 includes a first client device 601 , a second client device 602 , and a cluster monitoring device 603 .

[0177] The first client device is used to receive a first message sent by a second client device; verify the first message; if the first message fails to be verified, generate a second message according to the first message, the second message being used to indicate that there is an error in the first message; send the second message to the second client device or the cluster monitoring device; the second message is used to indicate to disconnect the communication link between the first client device and the second client device, and establish a communication link between the first client device and a third client device;

[0178] Optionally, the first client device is further configured to perform the following steps:

[0179] If the first message fails verification, determining a location of an error verification based on the verification result;

[0180] Marking the position of the error check to obtain a target mark;

[0181] The target tag is added to the first message to obtain a second message.

[0182] Optionally, the first client device is further configured to perform the following steps:

[0183] Receive a service message sent by the third client device; the service message is used to execute the service corresponding to the first message.

[0184] The second client device is used to send a first message to the first client device; receive a first target message; the first target message is used to indicate that there is an error check in the first message; based on the first target message, disconnect the communication link between the first client device and the second client device, and establish a communication link between the first client device and a third client device;

[0185] Optionally, the second client device is further configured to perform the following steps:

[0186] A third message is sent to the cluster monitoring device; the third message is used to instruct to clean and reset the second client device and to create a communication link between the third client device and the first client device; the third client device is a client device in the cluster except the first client device and the second client device.

[0187] Optionally, the second client device is further configured to perform the following steps:

[0188] Upon receiving a second message from the first client device, determining whether the second message carries a target tag; the target tag is used to indicate that an error check exists in the first message;

[0189] In the case where the target tag is carried in the second message, a third message is sent to the cluster monitoring device; the cluster monitoring device includes a client service device.

[0190] Optionally, the second client device is further configured to perform the following steps:

[0191] The link resources are cleaned up and a network module is re-established; the network module is used to process read and write services.

[0192] The cluster monitoring device is used to receive a second target message; the second target message includes a second message from a first client device, or a third message from a second client device; when the second target message is the second message, an isolation message is sent to the second client device; the isolation message is used to instruct the second client device to clean up link resources and re-establish a network module; the network module is used to process read and write services; when the second target message is the third message, the second client device is cleaned and reset, and a communication link is created between the third client device and the first client device; the third client device is a client device in the cluster other than the first client device and the second client device.

[0193] Optionally, the cluster monitoring device is further configured to perform the following steps:

[0194] receiving a second message sent by the first client device; the second message is used to indicate that an error check exists in the first message;

[0195] Generate an isolation message according to the device information carried in the second message; the isolation message is used to instruct the second client device to clean up the link resources and re-establish the network module; the network module is used to process the read and write services;

[0196] The quarantine message is sent to the second client device.

[0197] In some embodiments, the method may include:

[0198] The second client device sends a first message to the first client device.

[0199] In the embodiment of the present invention, during the communication process, the second client device sends the first information to the first client device.

[0200] The first message is a message that has not been verified yet.

[0201] The first client device receives a first message sent by the second client device.

[0202] In the embodiment of the present invention, during the communication process of the distributed file system, the first client device first receives the first message sent by the second client device.

[0203] The first client device verifies the first message; if the first message fails the verification, a second message is generated according to the first message, and the second message is used to indicate that there is an error in the verification of the first message.

[0204] In an embodiment of the present invention, after receiving a first message sent by a second client device, the first client device verifies the first message. If the first message fails the verification, a second message is generated based on the first message, and the second message is used to indicate that there is an error in the verification of the first message.

[0205] The first client device sends a second message to the second client device or the cluster monitoring device; the second message is used to instruct to disconnect the communication link between the first client device and the second client device, and to establish a communication link between the first client device and the third client device.

[0206] In an embodiment of the present invention, if the first message fails verification, after generating a second message based on the first message, the first client device will send the second message to the second client device or the cluster monitoring device; the second message is used to indicate disconnection of the communication link between the first client device and the second client device, and to establish a communication link between the first client device and the third client device.

[0207] It should be noted that the cluster monitoring device may be a CCS service, which is not limited in the embodiment of the present invention.

[0208] For example, in an embodiment of the present invention, in a distributed system or cluster environment, the CCS service refers to a daemon process running in the CCSitor cluster environment, which is responsible for monitoring the status and performance of the cluster to ensure the healthy operation of the cluster. This daemon process may collect data from each node in the cluster, provide a visual interface or alarm mechanism, and take measures to solve the problem when necessary.

[0209] The third client device may be a new objecter, that is, after disconnecting the communication connection between the first client device and the second client device, the first client device will establish a communication connection with the new client device to achieve information transmission.

[0210] The second client device receives the first target message; the first target message is used to indicate that there is an error check in the first message; the first target message includes the second message from the first client device, or the first target message includes an isolation message from the cluster monitoring device.

[0211] In an embodiment of the present invention, after sending a first message to a first client device, a second client device may receive a first target message, wherein the first target message is used to indicate that an error check exists in the first message.

[0212] It should be noted that, in the embodiment of the present application, the first target message refers to a message containing an error check.

[0213] The second client device disconnects the communication link between the first client device and the second client device based on the first target message, and establishes a communication link between the first client device and the third client device.

[0214] In the embodiment of the present invention, after receiving the first target message, the second client device may disconnect the communication link between the first client device and the second client device based on the first target message, and establish a communication link between the first client device and the third client device.

[0215] It should be noted that in the embodiments of the present application, in a distributed file system, a communication link refers to a network connection established between a client, a metadata server (or a master server) and a storage node (or a slave node, a data server) to implement functions such as reading and writing file data, updating status, and verifying permissions. This connection is the cornerstone of the normal operation of a distributed file system, which allows different components to exchange information and work together.

[0216] Specifically, the communication links in a distributed file system may include: the connection between the client and the metadata server, that is, when the client accesses the distributed file system, it will first establish a connection with the metadata server to obtain the file's location information, metadata, etc.; the metadata server is responsible for maintaining the namespace of the entire file system, the mapping relationship between files and storage nodes, and other key information, and provides this information to the client through this connection.

[0217] The cluster monitoring device receives a second target message; the second target message includes a second message from the first client device, or a third message from the second client device.

[0218] In the embodiment of the present invention, the second target message may include a second message from the first client device, or a third message from the second client device.

[0219] The second message is used to indicate that there is an error check in the first message; the third message is used to indicate to clean and reset the second client device and to create a communication link between the third client device and the first client device.

[0220] When the second target message is the second message, an isolation message is sent to the second client device; the isolation message is used to instruct the second client device to clean up the link resources and re-establish the network module; the network module is used to process the read and write services.

[0221] In an embodiment of the present invention, after receiving a second target message, wherein the second target message includes a second message from a first client device, or a third message from a second client device, the cluster monitoring device may send an isolation message to the second client device if the second target message is the second message; the isolation message is used to instruct the second client device to clean up link resources and re-establish a network module; the network module is used to process read and write services.

[0222] It should be noted that the device information may be device information corresponding to the second client device.

[0223] It should be noted that the isolation information is generated based on the device information carried in the second message.

[0224] In the case where the second target message is the third message, the second client device is cleaned and reset, and a communication link is created between the third client device and the first client device; the third client device is a client device in the cluster except the second client device.

[0225] In the embodiment of the present invention, the third client device is a client device in the cluster except the first client device and the second client device.

[0226] Reference Figure 5 , shows a schematic diagram of a communication device provided by an embodiment of the present invention, the communication device 800 includes:

[0227] A first receiving unit 801 is configured to receive a first message sent by a second client device;

[0228] A verification unit 802, configured to verify the first message;

[0229] A generating unit 803 is used to generate a second message according to the first message when the first message fails to pass the check, and the second message is used to indicate that there is an error check in the first message;

[0230] The first sending unit 804 is used to send a second message to the second client device or the cluster monitoring device; the second message is used to instruct to disconnect the communication link between the first client device and the second client device, and to establish a communication link between the first client device and the third client device.

[0231] Optionally, when the first message fails verification, the position of the error check is determined based on the verification result; the position of the error check is marked to obtain a target mark; and the target mark is added to the first message to obtain a second message.

[0232] Optionally, a service message sent by a third client device is received; the service message is used to execute the service corresponding to the first message.

[0233] Reference Figure 6 , shows a schematic diagram of another communication device provided by an embodiment of the present invention, the communication device 800 includes:

[0234] A second sending unit 805 is configured to send a first message to a first client device;

[0235] The second receiving unit 806 is used to receive a first target message; the first target message is used to indicate that there is an error check in the first message;

[0236] The disconnection unit 807 is configured to disconnect the communication link between the first client device and the second client device based on the first target message, and to establish a communication link between the first client device and the third client device.

[0237] Optionally, a third message is sent to the cluster monitoring device; the third message is used to instruct to clean and reset the second client device and create a communication link between the third client device and the first client device; the third client device is a client device in the cluster except the second client device.

[0238] Optionally, when a second message is received from a first client device, it is determined whether the second message carries a target tag; the target tag is used to indicate that there is an error check in the first message; when the second message carries the target tag, a third message is sent to the cluster monitoring device; the cluster monitoring device includes a client service device.

[0239] Optionally, the link resources are cleaned up and a network module is re-established; the network module is used to process read and write services.

[0240] Reference Figure 7 , shows a schematic diagram of another communication device provided by an embodiment of the present invention, the communication device 800 includes:

[0241] The third receiving unit 808 is used to receive a second target message; the second target message includes a second message from the first client device, or a third message from the second client device;

[0242] The fourth sending unit 809 is used to send an isolation message to the second client device when the second target message is the second message; the isolation message is used to instruct the second client device to clean up the link resources and re-establish the network module; the network module is used to process the read and write services;

[0243] The cleaning unit 810 is used to clean and reset the second client device and create a communication link between the third client device and the first client device when the second target message is the third message; the third client device is a client device in the cluster except the second client device.

[0244] Optionally, a second message sent by a first client device is received; the second message is used to indicate that there is an error check in the first message; an isolation message is generated based on the device information carried in the second message; the isolation message is used to instruct the second client device to clean up the link resources and re-establish the network module; the network module is used to process read and write services; and an isolation message is sent to the second client device.

[0245] The present invention also provides a computer program product, comprising a computer program / instruction, wherein the computer program / instruction implements the communication method of the aforementioned embodiment when executed by a processor.

[0246] The present invention also provides an electronic device 100, see Figure 8 , including: a processor 901, a memory 902, and a computer program 9021 stored in the memory and executable on the processor, wherein the processor implements the communication method of the aforementioned embodiment when executing the program.

[0247] The present invention also provides a readable storage medium, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can execute the communication method of the aforementioned embodiment.

[0248] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0249] The algorithm and display provided herein are not inherently related to any particular computer, virtual system or other device. Various general purpose systems can also be used together with the teachings based on this. According to the above description, it is obvious that the structure required for constructing such systems. In addition, the present invention is not directed to any specific programming language either. It should be understood that various programming languages ​​can be utilized to realize the content of the present invention described herein, and the description of the above specific languages ​​is for disclosing the best mode of the present invention.

Claims

1. A communication method, characterized in that: Applied to a first client device, the method comprises: receiving a first message sent by a second client device; verifying the first message; If the first message fails to pass the check, generating a second message according to the first message; the second message is used to indicate that there is an error check on the first message; The second message is sent to the second client device or the cluster monitoring device; the second message is used to instruct to disconnect the communication link between the first client device and the second client device, and to establish a communication link between the first client device and a third client device; the third client device is a client device in the cluster other than the first client device and the second client device.

2. The communication method according to claim 1, characterized in that: The step of generating a second message according to the first message when the first message fails verification includes: If the first message fails verification, determining a location of an error verification based on a verification result; Marking the position of the error check to obtain a target mark; The target tag is added to the first message to obtain a second message.

3. The method according to claim 1, characterized in that The method further comprises: Receive a service message sent by the third client device; the service message is used to execute the service corresponding to the first message.

4. The method according to claim 1, characterized in that: The step of generating a second message according to the first message when the first message fails verification includes: Extracting data from the first message to obtain metadata, control data, and payload data corresponding to the first message; Determine a generating polynomial according to an error checking algorithm; For each byte of each data in the first message, perform an XOR operation with the low byte of the error check register to obtain an XOR result, and shift the XOR result left by one bit; When the highest bit corresponding to each byte is 1, an XOR operation is performed with the generator polynomial; After all bytes are calculated, a first error check code is obtained; Adding the first error check code to the first message to determine first check information; Determining a second error checking code according to the first checking information and the error checking algorithm; Determining a verification result according to the first error checking code and the second error checking code; When the first error check code and the second error check code are the same, it is determined that the first message passes the check and there is no data anomaly in the first message; When the first error check code and the second error check code are different, it is determined that the first message fails verification, error check information is added to the first message, and a second message is generated.

5. A communication method, characterized in that: Applied to a second client device, the method comprises: Sending a first message to a first client device; receiving a first target message; the first target message is used to indicate that an error check exists in the first message; Based on the first target message, the communication link between the first client device and the second client device is disconnected, and a communication link between the first client device and a third client device is established; the third client device is a client device in the cluster other than the first client device and the second client device.

6. The method according to claim 5, characterized in that the second client device comprises a client device; the first target message comprises a second message from the first client device; The method of disconnecting the communication link between the first client device and the second client device and establishing a communication link between the first client device and a third client device based on the first target message includes: A third message is sent to the cluster monitoring device; the third message is used to instruct to clean and reset the second client device and to create a communication link between the third client device and the first client device; the third client device is a client device in the cluster other than the first client device and the second client device.

7. The method according to claim 6, characterized in that The sending of the third message to the cluster monitoring device includes: Upon receiving a second message from the first client device, determining whether the second message carries a target tag; the target tag is used to indicate that an error check exists in the first message; In the case where the target tag is carried in the second message, a third message is sent to the cluster monitoring device; the cluster monitoring device includes a client service device.

8. The method according to claim 5, characterized in that The second client device includes an object storage device; the first target message includes an isolation message from a cluster monitoring device; The method of disconnecting the communication link between the first client device and the second client device and establishing a communication link between the first client device and a third client device based on the first target message includes: The link resources are cleaned up and a network module is re-established; the network module is used to process read and write services.

9. A communication method, characterized in that: Applied to cluster monitoring equipment, the method includes: receiving a second target message; the second target message includes a second message from the first client device, or a third message from the second client device; In the case where the second target message is the second message, an isolation message is sent to the second client device; the isolation message is used to instruct the second client device to clean up the link resources and re-establish the network module; the network module is used to process the read and write services; In the case where the second target message is the third message, the second client device is cleaned and reset, and a communication link is created between the third client device and the first client device; the third client device is a client device in the cluster other than the first client device and the second client device.

10. The method according to claim 9, characterized in that The sending of the isolation message to the second client device when the second target message is the second message includes: receiving a second message sent by the first client device; the second message is used to indicate that an error check exists in the first message; Generate an isolation message according to the device information carried in the second message; the isolation message is used to instruct the second client device to clean up the link resources and re-establish the network module; the network module is used to process the read and write services; The quarantine message is sent to the second client device.

11. A communication method, characterized in that: Applied to a distributed file system, the distributed file system includes a first client device, a second client device and a cluster monitoring device, the method includes: The second client device sends a first message to the first client device; The first client device receives a first message sent by a second client device; verifies the first message; if the first message fails to be verified, generates a second message according to the first message, the second message being used to indicate that there is an error in the first message verification; sends the second message to the second client device or the cluster monitoring device; the second message is used to indicate to disconnect the communication link between the first client device and the second client device, and to establish a communication link between the first client device and a third client device; The second client device receives a first target message; the first target message is used to indicate that there is an error check in the first message; the first target message includes a second message from the first client device, or the first target message includes an isolation message from the cluster monitoring device; The second client device disconnects the communication link between the first client device and the second client device based on the first target message, and establishes a communication link between the first client device and a third client device; The cluster monitoring device is used to receive a second target message; the second target message includes a second message from a first client device, or a third message from a second client device; when the second target message is the second message, an isolation message is sent to the second client device; the isolation message is used to instruct the second client device to clean up link resources and re-establish a network module; the network module is used to process read and write services; when the second target message is the third message, the second client device is cleaned and reset, and a communication link is created between the third client device and the first client device; the third client device is a client device in the cluster other than the first client device and the second client device.

Images