Calculation network system based on network file sharing

By introducing first-level and second-level file sharing disks into the computing network system, efficient sharing and caching of files is achieved, stability and efficiency problems caused by frequent file transfers are solved, and the overall performance of the system is improved.

CN119088777AActive Publication Date: 2024-12-06HUBEI SILANG WANWEI COMPUTING EQUIPMENT MANUFACTURING CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202411153412.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-21
Publication Date
2024-12-06
Estimated Expiration
2044-08-21

AI Technical Summary

Technical Problem

The frequent file transfers of existing computing network systems in the computing task process lead to low stability and reliability, low computing efficiency, and high data storage pressure.

Method used

Adopt a computing network system based on network file sharing, and through the coordinated work of control nodes, proxy nodes, computing nodes, first-level file sharing disks and second-level file sharing disks, efficient file sharing and cache, reduce disk drop operations, and improve computing efficiency.

Benefits of technology

It improves the stability, reliability and computing efficiency of the computing network system, reduces data storage pressure, and enhances the overall performance of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119088777A_ABST
    Figure CN119088777A_ABST
Patent Text Reader

Abstract

The invention discloses a computing network system based on network file sharing, and the system comprises a control node which is used for generating a control command and transmitting the control command to each agent node; the proxy node is used for generating a proxy command and sending the proxy command to the computing node in network connection with the proxy node; the computing node is used for generating a file acquisition instruction matched with the proxy command and sending the file acquisition instruction to a secondary file sharing disk; the secondary file sharing disk is used for extracting a target computing power file matched with the file acquisition instruction and sending the target computing power file to a computing node matched with the file acquisition instruction; and the computing node is also used for caching the target computing power file to the memory, performing computing operation on the target computing power file according to the proxy command, obtaining a computing result and emptying the memory. Through the technical scheme of the invention, the stability, reliability and calculation efficiency of the computing network system are improved, and the data storage pressure of the computing network system is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computing networks, and in particular to a computing network system based on network file sharing. Background Art

[0002] In today's computing network system field, there is a typical computing network framework structure. This computing network framework is composed of several hardware nodes, among which the control node mainly bears the important responsibility of obtaining user instructions and assigning computing tasks to the proxy nodes below. Each proxy node is responsible for subdividing the computing tasks and sending them to several computing nodes corresponding to itself. For example, if there is a specific computing network containing 8 proxy nodes, and each proxy node has 8 computing nodes, there are a total of 64 computing nodes in the entire computing network. This means that the computing tasks obtained from the control node need to be divided into 64 small computing tasks, which are distributed to the corresponding computing nodes by the 8 proxy nodes. After the computing node completes its own computing task, it will pass the calculation results to the proxy node, and finally the proxy node will feed back to the control node. After a round of calculation, 64 files generated after calculation will be generated. Only by integrating these files can the complete calculation results of a computing task be obtained.

[0003] In such a complete computing task flow, there are numerous file transfer processes, including the control node sending computing tasks and the computing files and configuration files required by each computing node to the proxy node, the proxy node sending computing tasks and the corresponding computing files and configuration files to the computing nodes, and the computing nodes reporting their own computing results after completing the tasks, and the computing results are transmitted in the form of files stored on disk.

[0004] However, if a separate transmission is performed for each file generated in the above process, then a large number of file transfer application operations and response operations need to be designed in the computing network. These frequent network transmission behaviors greatly affect the stability and reliability of the computing network system. At the same time, if the traditional data transmission method is used, it will also lead to too many disk-dropping actions; for example, after a computing node completes a computing task, the generated calculation result file is first dropped locally, and then sent to the upper-level proxy node. After the proxy node completes the disk drop, it is sent to the node of the management layer. This file drop behavior is an extremely time-consuming operation, which seriously affects the efficiency of the system and increases the data storage pressure of the computing network system. Summary of the invention

[0005] The present invention provides a network computing system based on network file sharing, which can solve the problems that the stability, reliability and computing efficiency of the existing network computing system are low and the data storage pressure of the network computing system is high.

[0006] According to one aspect of the present invention, there is provided a computing network system based on network file sharing, the system comprising: a control node, at least one proxy node, at least one computing node, a primary file sharing disk and a secondary file sharing disk;

[0007] A network connection is established between the control node and at least one proxy node, a network connection is established between the proxy node and at least one computing node, the first-level file sharing disk is respectively connected to the control node and each proxy node, and the second-level file sharing disk is respectively connected to the proxy node and the computing node having a network connection with each proxy node; the second-level file sharing disk stores a pre-configured computing power file;

[0008] The control node is used to generate a control command in response to an activation operation of a user and send the control command to each proxy node;

[0009] The proxy node is configured to, after receiving a control command sent by the control node, generate a proxy command in response to the control command and send the proxy command to a computing node having a network connection with the proxy node;

[0010] The computing node is used to generate a file acquisition instruction matching the proxy command and send it to the secondary file sharing disk after receiving the proxy command;

[0011] The secondary file sharing disk is used to extract the target computing power file matching the file acquisition instruction after receiving the file acquisition instruction, and send it to the computing node matching the file acquisition instruction;

[0012] The computing node is also used to cache the target computing power file into the memory after receiving the target computing power file, perform computing operations on the target computing power file according to the proxy command, obtain the computing results and clear the memory.

[0013] Among them, the computing node is also used to: send the calculation result to the secondary file shared disk based on the preset calculation storage rule, and generate the calculation completion information and send it to the proxy node, wherein the calculation completion information includes the calculation storage rule; the proxy node is also used to generate the file acquisition instruction based on the calculation storage rule in the calculation completion information after receiving the calculation completion information sent by the computing node and send it to the secondary file shared disk; the secondary file shared disk is also used to send the corresponding calculation result to the proxy node based on the calculation storage rule after receiving the file acquisition instruction sent by the proxy node; the proxy node is also used to cache the received calculation result in the memory, reprocess the calculation result, obtain the proxy result and clear the memory.

[0014] Wherein, the proxy node is also used for: after the proxy result is generated, sending the calculation result to the first-level file sharing disk based on the preset proxy storage rule, and generating a proxy completion command and sending it to the proxy node, wherein the proxy completion command includes the proxy storage rule; and the control node is also used for: after receiving the proxy completion command sent by the proxy node, obtaining the calculation result stored in the first-level file sharing disk and caching it to the memory based on the proxy storage rule in the proxy completion command, reprocessing the calculation result, obtaining the control result and clearing the memory.

[0015] Furthermore, the first-level file sharing disk specifically includes: a storage unit, which is used to store each calculation result in a corresponding directory after receiving each calculation result according to a proxy storage rule matching each calculation result; and a result sending unit, which is used to send the corresponding calculation result to the control node based on the proxy storage rule after receiving a control command sent by the control node.

[0016] Among them, the proxy node specifically includes: a verification unit, which is used to verify the calculation results sent by the secondary file sharing disk according to preset verification rules after obtaining the calculation results to determine the correctness of the verification results; a result cleaning unit, which is used to perform data cleaning operations on the calculation results that have passed the correctness verification, obtain each cleaned calculation result and send it to the calculation counting unit; the calculation counting unit is used to obtain the number of computing nodes matching the proxy node, and when the number of cleaned calculation results is equal to the number of computing nodes, send each calculation result to the result sending unit; the result sending unit is used to combine each calculation result according to preset rules to obtain the proxy result.

[0017] Furthermore, the control node specifically includes: an agent verification unit, which is used to verify the calculation result sent by the first-level file sharing disk according to preset verification rules to determine the correctness of the verification result; an agent result cleaning unit, which is used to perform data cleaning operations on the calculation result that has passed the correctness verification, obtain each cleaned calculation result and send it to the agent counting unit; the agent counting unit is used to obtain the number of agent nodes matching the control node, and when the number of cleaned calculation results is equal to the number of agent nodes, send each calculation result to the result sending unit; a result combination unit, which is used to combine the calculation results sent by the agent counting unit according to preset rules to obtain the control result.

[0018] Furthermore, the control node is also used to: send the control result to a display device for display.

[0019] Optionally, both the primary file sharing disk and the secondary file sharing disk are disks that support a network file sharing function and have a storage function.

[0020] Optionally, the computing network system also includes: a monitoring module, used to monitor the network file sharing functions of the primary file sharing disk and the secondary file sharing disk at a preset monitoring frequency to determine whether the computing network system is operating normally; and a restart module, used to restart the computing network system when the monitoring module determines that the computing network system is operating abnormally.

[0021] Furthermore, the restart module specifically includes: a node restart unit, which is used to perform a restart operation on the control node, each proxy node and each computing node; a disk restart unit, which is used to restart the network file sharing function of the first-level file sharing disk and the second-level file sharing disk; a reconnection unit, which is used to send a first-level reconnection command to the control node and the proxy node after sensing that the operations of the node restart unit and the disk restart unit are completed, so that the control node and the proxy node establish a network connection with the first-level file sharing disk according to the first-level reconnection command, and at the same time send a second-level reconnection command to each proxy node and each computing node, so that each proxy node and each computing node establish a network connection with the second-level file sharing disk according to the second-level reconnection command.

[0022] The technical solution of the embodiment of the present invention is to generate a control command in response to the user's activation operation by the control node and send it to each proxy node. After receiving the control command sent by the control node, the proxy node generates a proxy command in response to the control command and sends it to a computing node having a network connection with the proxy node. After receiving the proxy command, the computing node generates a file acquisition instruction matching the proxy command and sends it to a secondary file shared disk. After receiving the file acquisition instruction, the secondary file shared disk extracts the target computing power file matching the file acquisition instruction and sends it to the computing node matching the file acquisition instruction. After receiving the target computing power file, the computing node caches the target computing power file to the memory, performs computing operations on the target computing power file according to the proxy command, obtains the computing result and clears the memory, thereby solving the problems of low stability, reliability and computing efficiency of the existing computing network system and high data storage pressure of the computing network system, improving the stability, reliability and computing efficiency of the computing network system and reducing the data storage pressure of the computing network system.

[0023] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0025] Figure 1 It is a structural diagram of a computing network system based on network file sharing provided according to the first embodiment of the present invention;

[0026] Figure 2 It is a structural diagram of a computing network system based on network file sharing provided according to the second embodiment of the present invention. DETAILED DESCRIPTION

[0027] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0028] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0029] Embodiment 1

[0030] Figure 1 A computing network system based on network file sharing is provided in the first embodiment of the present invention. This embodiment is applicable to the situation where the computing network system is constructed using network file sharing.

[0031] like Figure 1 As shown, the system includes: a control node 110 , at least one proxy node 120 , at least one computing node 130 , a primary file sharing disk 140 , and a secondary file sharing disk 150 .

[0032] Among them, a network connection is established between the control node 110 and at least one proxy node 120, and a network connection is established between the proxy node 120 and at least one computing node 130. The first-level file shared disk 140 establishes a network connection with the control node 110 and each proxy node 120 respectively, and the second-level file shared disk 150 establishes a network connection with the proxy node 120 and the computing node 130 having a network connection with each proxy node 120 respectively; the second-level file shared disk 150 stores a pre-configured computing power file.

[0033] Exemplarily, the pre-configured computing power files may include: node performance parameter files, task allocation record files, computing power resource statistics files, computing node status files, specific algorithm computing power demand files, historical computing power usage trend files, computing power adjustment strategy files, and computing power resource distribution map files, etc.; relevant personnel in this field should understand that the number and type of computing power files are determined by the specific computing power tasks of the computing power system, and the computing power files stored in the secondary file sharing disk corresponding to each node can be the same or different, and this embodiment does not limit this; at the same time, due to the attribute requirements of the computing node itself, the computing power files applied to the current computing node should be pre-configured manually in the secondary directory related to the computing power task, and each computing node corresponding to the same secondary file sharing disk should be pre-configured with and only with a specific computing node matching the secondary directory. When the computing node receives the corresponding computing command, it will directly obtain the files in the secondary directory matching the current computing node in the secondary file sharing disk. Since the configuration method of the computing power file in the storage device is a mature existing technology, this embodiment will not be repeated here.

[0034] The control node 110 is used to generate a control command in response to an activation operation of a user and send the control command to each agent node 120;

[0035] The proxy node 120 is configured to generate a proxy command in response to a control command after receiving the control command sent by the control node 110 and send the proxy command to a computing node 130 having a network connection with the proxy node 120;

[0036] The computing node 130 is used to generate a file acquisition instruction matching the proxy command after receiving the proxy command and send it to the secondary file sharing disk 150;

[0037] The secondary file sharing disk 150 is used to extract the target computing power file matching the file acquisition instruction after receiving the file acquisition instruction, and send it to the computing node 130 matching the file acquisition instruction;

[0038] The computing node 130 is also used to cache the target computing power file into the memory after receiving the target computing power file, perform computing operations on the target computing power file according to the proxy command, obtain the computing results and clear the memory.

[0039] In a specific implementation scenario of this embodiment, the control node 110 can be a central processing unit or a specific control device with powerful computing and instruction distribution capabilities. When receiving an activation operation implemented by a user through an input device or a specific interface, it can respond quickly and accurately and generate a corresponding control command, and then accurately send the control command to each proxy node 120 through a data transmission channel; further, the proxy node 120, which serves as an intermediate bridge connecting the control node 110 and the computing node 130, can be, for example, a server or processing unit with certain data processing and transmission capabilities. After successfully receiving the control command sent by the control node 110, it can immediately respond sensitively to the control command and then generate a proxy command. The proxy command here can be a specific task assignment instruction or operation instruction, and then this proxy command is sent through a network link to the computing nodes 130 that have a stable network connection relationship with the proxy node 120; further, the computing node 130 can be a plurality of computing units distributed in the computing network, such as a high-performance computer or a dedicated computing device. After receiving the proxy command, a file acquisition instruction that matches the proxy command can be generated, such as an instruction to request the acquisition of data files or resources in a specific secondary directory in the secondary file sharing disk 150, and then sent to the secondary file sharing disk 150; further, the secondary file sharing disk 150 can be a centralized or distributed storage area, such as a large-capacity disk array or cloud storage. When receiving the file acquisition instruction, the target computing power file that matches the file acquisition instruction can be accurately extracted from the large amount of data stored therein, where the target computing power file can be various configuration files, data files, etc. related to calculations, and then sent to the computing node 130 that matches the file acquisition instruction; further, the computing node 130 also has the ability to cache the target computing power file into its own memory after receiving the target computing power file, where the memory can be a high-speed random access memory. And it can implement complex computing operations on the target computing power file according to the proxy command, and finally obtain the computing results through a series of computing processes. At the same time, in order to release resources, the memory will be cleared to carry out the next round of computing task processing.

[0040] Optionally, the computing node 130 is also used to: send the calculation result to the secondary file shared disk 150 based on preset calculation storage rules, and generate calculation completion information and send it to the proxy node 120, wherein the calculation completion information includes the calculation storage rules; the proxy node 120 is also used to generate a file acquisition instruction based on the calculation storage rules in the calculation completion information after receiving the calculation completion information sent by the computing node 130 and send it to the secondary file shared disk 150; the secondary file shared disk 150 is also used to send the corresponding calculation result to the proxy node 120 based on the calculation storage rules after receiving the file acquisition instruction sent by the proxy node 120; the proxy node 120 is also used to cache the received calculation result in the memory, reprocess the calculation result, obtain the proxy result and clear the memory.

[0041] Specifically, the computing node 130 can also accurately send the processed computing results to the secondary file shared disk 150 according to pre-set computing storage rules. At the same time, it will also generate computing completion information containing computing storage rules and send it to the proxy node 120; wherein the computing storage rules can be the pre-set storage location of the computing results when they are uploaded to the secondary file shared disk. After successfully receiving the calculation completion information sent by the computing node 130, the proxy node 120 will further generate a file acquisition instruction according to the calculation storage rules contained in the calculation completion information, and then send the file acquisition instruction to the secondary file shared disk 150; further, the secondary file shared disk 150, in addition to the functions described above, when receiving the file acquisition instruction sent by the proxy node 120, will send the corresponding calculation result to the proxy node 120 according to the calculation storage rules; finally, the proxy node 120, after caching the received calculation result in its own memory, performs further reprocessing operations on the calculation result, and finally obtains the proxy result through a series of processing processes, and will clear the memory in time after completing these operations to prepare for subsequent tasks.

[0042] Furthermore, the proxy node 120 is also used to: after the proxy result is generated, send the calculation result to the first-level file shared disk 140 based on the preset proxy storage rule, and generate a proxy completion command and send it to the proxy node 120, wherein the proxy completion command includes the proxy storage rule; and the control node 110 is also used to: after receiving the proxy completion command sent by the proxy node 120, obtain the calculation result stored in the first-level file shared disk 140 based on the proxy storage rule in the proxy completion command and cache it to the memory, reprocess the calculation result, obtain the control result and clear the memory.

[0043] The proxy storage rule may be a preset storage location of the calculation result uploaded to the primary file sharing disk.

[0044] In this embodiment, the first-level file sharing disk 140 specifically includes: a storage unit, which is used to store each calculation result in a corresponding directory after receiving each calculation result according to a proxy storage rule matching each calculation result; and a result sending unit, which is used to send the corresponding calculation result to the control node 110 based on the proxy storage rule after receiving a control command sent by the control node 110.

[0045] Furthermore, the proxy node 120 specifically includes: a verification unit, which is used to verify the calculation result sent by the secondary file sharing disk 150 according to a preset verification rule to determine the correctness of the verification result. Exemplarily, the verification unit can verify whether the calculation result complies with a preset format or specification after receiving the calculation result, and whether there is any missing data or error; optionally, if any abnormality or non-compliance is found, the proxy node 120 may take corresponding measures, such as requesting the computing node to recalculate or correct errors.

[0046] Furthermore, the result cleaning unit is used to perform data cleaning operations on the calculation results that have passed the correctness verification, obtain the cleaned calculation results and send them to the calculation counting unit; the calculation counting unit is used to obtain the number of computing nodes 130 matching the proxy node 120, and when the number of cleaned calculation results is equal to the number of computing nodes 130, send each calculation result to the result sending unit; the result sending unit is used to combine each calculation result according to a preset rule to obtain a proxy result.

[0047] Specifically, the control node 110 specifically includes: a proxy verification unit, which is used to verify the calculation result sent by the first-level file sharing disk 140 according to preset verification rules to determine the correctness of the verification result; exemplarily, the proxy verification unit can verify whether the calculation result conforms to the preset format or specification after receiving the calculation result, and whether there is any missing data or error; optionally, if any abnormality or non-compliance is found, the control node 110 may take corresponding measures, such as requesting the computing node to recalculate or correct errors.

[0048] Furthermore, the proxy result cleaning unit is used to perform data cleaning operations on the calculation results that have passed the correctness verification, obtain the cleaned calculation results and send them to the proxy counting unit; the proxy counting unit is used to obtain the number of proxy nodes 120 matching the control node 110, and when the number of cleaned calculation results is equal to the number of proxy nodes 120, send each calculation result to the result sending unit; the result combination unit is used to combine the calculation results sent by the proxy counting unit according to preset rules to obtain the control result.

[0049] Optionally, the control node 110 is further configured to send the control result to a display device for display.

[0050] It should be noted that the first-level file sharing disk 140 and the second-level file sharing disk 150 are disks that support network file sharing functions and have storage functions; illustratively, the first-level file sharing disk 140 and the second-level file sharing disk 150 can be network storage disks that support network file sharing services such as nfs or sshfs; it should be noted that the network file sharing services specifically supported by each file sharing disk can be configured by relevant personnel according to actual computing power needs and scenario requirements, and this embodiment does not limit this.

[0051] The technical solution of the embodiment of the present invention is to generate a control command in response to the user's activation operation through a control node and send it to each proxy node. After receiving the control command sent by the control node, the proxy node generates a proxy command in response to the control command and sends it to a computing node having a network connection with the proxy node. After receiving the proxy command, the computing node generates a file acquisition instruction matching the proxy command and sends it to a secondary file shared disk. After receiving the file acquisition instruction, the secondary file shared disk extracts the target computing power file matching the file acquisition instruction and sends it to the computing node matching the file acquisition instruction. After receiving the target computing power file, the computing node caches the target computing power file to the memory, performs computing operations on the target computing power file according to the proxy command, obtains the computing result and clears the memory, thereby improving the stability, reliability and computing efficiency of the computing network system and reducing the data storage pressure of the computing network system.

[0052] Embodiment 2

[0053] Figure 2 A computing network system based on network file sharing is provided in the second embodiment of the present invention. This embodiment is applicable to the situation where a computing network system is constructed using network file sharing.

[0054] like Figure 2As shown, the network computing system based on network file sharing includes: a control node, at least one proxy node, at least one computing node, a primary file sharing disk, a secondary file sharing disk, a monitoring module 210 and a restart module 220.

[0055] Among them, the monitoring module 210 establishes a communication connection with the primary file sharing disk and the secondary file sharing disk, and the restart module 220 establishes a communication connection with the control node, each proxy node, each computing node, the primary file sharing disk and the secondary file sharing disk.

[0056] The monitoring module 210 is used to monitor the network file sharing function of the primary file sharing disk and the secondary file sharing disk according to a preset monitoring frequency to determine whether the computing network system is operating normally;

[0057] The restart module 220 is used to restart the computing network system when the monitoring module determines that the computing network system is not operating normally.

[0058] Furthermore, the restart module 220 specifically includes: a node restart unit, which is used to perform a restart operation on the control node, each proxy node and each computing node; a disk restart unit, which is used to restart the network file sharing function of the first-level file sharing disk and the second-level file sharing disk; a reconnection unit, which is used to send a first-level reconnection command to the control node and the proxy node after sensing that the operations of the node restart unit and the disk restart unit are completed, so that the control node and the proxy node establish a network connection with the first-level file sharing disk according to the first-level reconnection command, and at the same time send a second-level reconnection command to each proxy node and each computing node, so that each proxy node and each computing node establish a network connection with the second-level file sharing disk according to the second-level reconnection command.

[0059] Exemplarily, in a specific implementation scenario of the present embodiment, the monitoring module 210 performs an operation similar to sudo systemctl status nfs-server in the system every 10 seconds to check the status of the network file sharing service such as nfs. If it is displayed as running, it means that the service is in a normal operating state, otherwise it means that there is an abnormality. Once an abnormal situation occurs, the restart module 220 can be used to try to restart the service, and then further monitoring commands are used to determine the status of the service. If the monitoring module 210 monitors that the network file sharing service is abnormal, then the node restart unit of the restart module 220 can perform a restart operation on the node corresponding to the abnormal file sharing disk, and after the network file sharing service returns to normal, the reconnection unit of the restart module 220 needs to send a reconnection command to the restarted node and its subordinate nodes. Specifically, the sshpass method can be used here to send a reconnection command to the subordinate nodes to connect to the network file sharing service, thereby realizing the recovery of the network file sharing operation and achieving the function of disaster recovery response.

[0060] The technical solution of the embodiment of the present invention is as follows: a control node generates a control command in response to a user's activation operation and sends it to each proxy node; after receiving the control command sent by the control node, the proxy node generates a proxy command in response to the control command and sends it to a computing node having a network connection with the proxy node; after receiving the proxy command, the computing node generates a file acquisition instruction matching the proxy command and sends it to a secondary file sharing disk; after receiving the file acquisition instruction, the secondary file sharing disk extracts a target computing power file matching the file acquisition instruction and sends it to a computing node matching the file acquisition instruction; after receiving the target computing power file, the computing node caches the target computing power file to a memory; performs a computing operation on the target computing power file according to the proxy command, obtains a computing result and clears the memory; a monitoring module monitors the network file sharing function of the primary file sharing disk and the secondary file sharing disk according to a preset monitoring frequency to determine whether the computing network system is operating normally; and a restart module restarts the computing network system when the monitoring module determines that the computing network system is operating abnormally, thereby improving the stability, reliability and computing efficiency of the computing network system and reducing the data storage pressure of the computing network system.

[0061] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention is described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A computing network system based on network file sharing, characterized in that: include: A control node, at least one proxy node, at least one computing node, a primary file sharing disk, and a secondary file sharing disk; A network connection is established between the control node and at least one proxy node, a network connection is established between the proxy node and at least one computing node, the first-level file sharing disk is respectively connected to the control node and each proxy node, and the second-level file sharing disk is respectively connected to the proxy node and the computing node having a network connection with each proxy node; the second-level file sharing disk stores a pre-configured computing power file; The control node is used to generate a control command in response to an activation operation of a user and send the control command to each proxy node; The proxy node is configured to, after receiving a control command sent by the control node, generate a proxy command in response to the control command and send the proxy command to a computing node having a network connection with the proxy node; The computing node is used to generate a file acquisition instruction matching the proxy command and send it to the secondary file sharing disk after receiving the proxy command; The secondary file sharing disk is used to extract the target computing power file matching the file acquisition instruction after receiving the file acquisition instruction, and send it to the computing node matching the file acquisition instruction; The computing node is also used to cache the target computing power file into the memory after receiving the target computing power file, perform computing operations on the target computing power file according to the proxy command, obtain the computing results and clear the memory.

2. The system according to claim 1, characterized in that The computing node is further used to: send the computing result to the secondary file sharing disk based on the preset computing storage rule, and generate computing completion information and send it to the proxy node, wherein the computing completion information includes the computing storage rule; The proxy node is further used to generate a file acquisition instruction based on the calculation storage rule in the calculation completion information and send it to the secondary file sharing disk after receiving the calculation completion information sent by the calculation node; The secondary file sharing disk is further used to send the corresponding calculation result to the proxy node based on the calculation storage rule after receiving the file acquisition instruction sent by the proxy node; The proxy node is further used to cache the received calculation results in the memory, reprocess the calculation results, obtain the proxy results and clear the memory.

3. The system according to any one of claims 1 to 2, characterized in that: The proxy node is further used to: after the proxy result is generated, send the calculation result to the primary file sharing disk based on the preset proxy storage rule, and generate a proxy completion command and send it to the proxy node, wherein the proxy completion command includes the proxy storage rule; In addition, the control node is also used to: after receiving the proxy completion command sent by the proxy node, obtain the calculation results stored in the first-level file shared disk based on the proxy storage rules in the proxy completion command and cache them to the memory, reprocess the calculation results, obtain the control results and clear the memory.

4. The system according to claim 3, characterized in that The first-level file sharing disk specifically includes: A storage unit, configured to store each calculation result in a corresponding directory according to a proxy storage rule matching each calculation result after receiving the calculation result; The result sending unit is used to send the corresponding calculation result to the control node based on the proxy storage rule after receiving the control command sent by the control node.

5. The system according to claim 2, characterized in that The proxy node specifically includes: A verification unit, configured to verify the calculation result sent by the secondary file sharing disk according to a preset verification rule after obtaining the calculation result, so as to determine the correctness of the verification result; A result cleaning unit is used to perform data cleaning operations on the calculation results that have passed the correctness verification, obtain the cleaned calculation results and send them to the calculation counting unit; A calculation counting unit, used for obtaining the number of calculation nodes matching the proxy node, and sending each calculation result to a result sending unit when the number of cleaned calculation results is equal to the number of calculation nodes; The result sending unit is used to combine the calculation results according to preset rules to obtain the proxy result.

6. The system according to claim 3, characterized in that The control node specifically includes: The proxy verification unit is used to verify the calculation result sent by the primary file sharing disk according to a preset verification rule after obtaining the calculation result to determine the correctness of the verification result; The proxy result cleaning unit is used to perform data cleaning operations on the calculation results that have passed the correctness verification, obtain the cleaned calculation results and send them to the proxy counting unit; an agent counting unit, used to obtain the number of agent nodes matching the control node, and send each calculation result to the result sending unit when the number of cleaned calculation results is equal to the number of agent nodes; The result combining unit is used to combine the calculation results sent by the proxy counting unit according to a preset rule to obtain a control result.

7. The system according to claim 6, characterized in that The control node is further used for: The control result is sent to a display device for display.

8. The system according to claim 1, characterized in that The primary file sharing disk and the secondary file sharing disk are disks that support network file sharing functions and have storage functions.

9. The system according to claim 1, characterized in that The computing network system further includes: A monitoring module, used to monitor the network file sharing function of the primary file sharing disk and the secondary file sharing disk according to a preset monitoring frequency to determine whether the computing network system is operating normally; The restart module is used to restart the computing network system when the monitoring module determines that the computing network system is not operating normally.

10. The system according to claim 9, characterized in that The restart module specifically includes: A node restart unit, used to perform a restart operation on the control node, each proxy node and each computing node; A disk restart unit, used to restart the network file sharing function of the primary file sharing disk and the secondary file sharing disk; The reconnection unit is used to send a first-level reconnection command to the control node and the proxy node after sensing that the operations of the node restart unit and the disk restart unit are completed, so that the control node and the proxy node establish a network connection with the first-level file sharing disk according to the first-level reconnection command, and at the same time send a second-level reconnection command to each proxy node and each computing node, so that each proxy node and each computing node establish a network connection with the second-level file sharing disk according to the second-level reconnection command.

Citation Information

Patent Citations

  • Method and system for sharing computing power resources and storage medium

    CN111949394A

  • Storage management method, node, computer storage medium and system

    CN113971167A

  • Data transmission method, data processing method and related products

    CN115269174A

  • Spacecraft mass data proxy distribution real-time system and computing power adjustment method

    CN117234714A

  • Methods, apparatus, and computer program products for accessing a shared computing resource

    US20200174837A1