Computing power network architecture suitable for super-large scale intelligent computing center industrial park

Abstract

The invention discloses a computing power network architecture suitable for a super-large-scale intelligent computing center industrial park, and relates to the technical field of data center network architectures. The computing power network architecture comprises a computing power network, a wide area network and a platform area, and the computing power network comprises a computing network for training, a computing network for reasoning, a front-end and rear-end storage network, an in-band management network and an out-of-band management network. The in-band management network comprises a first switch, a second switch, a first leaf switch, a second leaf switch, a third leaf switch, a fourth leaf switch, a first spine switch and a second spine switch, and the wide area network comprises an internet cloud platform, a core switch and a private line. Through the mutual connection relation and function limitation, the problems that an existing data center network architecture lacks a computing power network, cannot be suitable for project characteristics of a super-large-scale intelligent computing center industrial park, is difficult to meet elastic deployment and is high in cost can be solved, and practical application and popularization are facilitated.

Description

Technical Field

[0001] The present invention belongs to the technical field of data center network architecture, and specifically relates to a computing power network architecture suitable for an ultra-large-scale intelligent computing center industrial park. Background Art

[0002] In recent years, with the increasing development of intelligent computing centers (which are used to create new growth models for industrial parks through cloud computing, artificial intelligence application development, high-performance computing outsourcing and edge computing and other services), traditional IDC (Internet Data Center) data centers are facing the situation of transformation into intelligent computing centers. For the construction party, it is necessary to propose a set of computing power network top-level design architecture solutions for the entire ultra-large-scale intelligent computing center industrial park to meet the construction needs of the construction party and the changing final business landing.

[0003] At present, the traditional data center network architecture has the following disadvantages: (1) Lack of overall planning of computing power network and its integration with IDC computing network; (2) Not applicable to the project characteristics of ultra-large-scale intelligent computing center industrial park; (3) The starting point of the common computing power network on the market is based on the products of different manufacturers, not from the perspective of the builder. The functions are not targeted, repetitive and bloated, making it difficult to meet the needs of flexible deployment and the cost is high; (4) There is a lack of functional integration and a unified architecture to simplify the different computing power requirements for training and inference, different computing power cards, different storage configurations, computing power management and / or in-band and out-of-band management functions. Summary of the invention

[0004] The purpose of the present invention is to provide a computing power network architecture suitable for ultra-large-scale intelligent computing center industrial parks, so as to solve the problems of existing data center network architecture, such as lack of computing power network, inability to be applicable to the project characteristics of ultra-large-scale intelligent computing center industrial parks, difficulty in meeting flexible deployment and high cost.

[0005] In order to achieve the above object, the present invention adopts the following technical solutions:

[0006] In the first aspect, a computing power network architecture suitable for an ultra-large-scale intelligent computing center industrial park is provided, including a computing power network, a wide area network and a platform area, wherein the computing power network includes a computing network for training, a computing network for inference, a front-end and back-end storage network, an in-band management network and an out-of-band management network, the in-band management network includes a first switch, a second switch, a first leaf switch, a second leaf switch, a third leaf switch, a fourth leaf switch, a first spine switch and a second spine switch, the wide area network includes an Internet cloud platform, a core switch and a dedicated line, the core switch is respectively connected to the Internet cloud platform and the first switch, and the dedicated line is connected to the first switch through the fourth leaf switch The first switch is communicatively connected to the platform area, the first switch is communicatively connected to the front-end and back-end storage networks through the second switch, the first switch is communicatively connected to the out-of-band management network through the third switch, the front-end and back-end storage networks are communicatively connected to the training computing network and the reasoning computing network respectively through the third leaf switch, any two training servers in the training computing network are communicatively interconnected through the first leaf switch and the first spine switch, any two reasoning servers in the reasoning computing network are communicatively interconnected through the second leaf switch and the second spine switch, and the training computing network and the reasoning computing network are both compatible with the RoCE protocol and the IB protocol;

[0007] The Internet cloud platform is used to aggregate and form a unified computing power network resource pool;

[0008] The core switch is responsible for establishing a connection with the Internet cloud platform and the in-band management network;

[0009] The first switch is used to forward the source data from the Internet cloud platform to the front-end and back-end storage networks together with the second switch, and to forward the management data from the platform area to the out-of-band management network together with the third switch;

[0010] The front-end and back-end storage networks are used to provide the training computing network with source data required for training, and to provide the inference computing network with source data required for inference.

[0011] Based on the above invention content, a comprehensive network architecture solution designed for the characteristics of ultra-large-scale intelligent computing center industrial park is provided, namely, it includes a computing power network, a wide area network and a platform area, wherein the computing power network includes a computing network for training, a computing network for inference, a front-end and back-end storage network, an in-band management network and an out-of-band management network, the in-band management network includes a first switch, a second switch, a first leaf switch, a second leaf switch, a third leaf switch, a fourth leaf switch, a first spine switch and a second spine switch, the wide area network includes an Internet cloud platform, a core switch and a dedicated line, and through their interconnection relationship and functional limitation, it can solve the problems of the existing data center network architecture that lacks a computing power network, is not suitable for the project characteristics of the ultra-large-scale intelligent computing center industrial park, is difficult to meet the elastic deployment and has a high cost, and is convenient for practical application and promotion.

[0012] In a possible design, the training computing network includes a plurality of the training servers, a plurality of the first leaf switches, and a plurality of the first spine switches, wherein each of the first leaf switches is respectively communicatively connected to each of the training servers, and each of the first spine switches is respectively communicatively connected to each of the first leaf switches;

[0013] And / or, the computing network for inference includes multiple servers for inference, multiple second leaf switches and multiple second spine switches, wherein each of the second leaf switches is respectively communicated and connected to each of the servers for inference, and each of the second spine switches is respectively communicated and connected to each of the second leaf switches.

[0014] In a possible design, the front-end and back-end storage networks include a plurality of data storage servers and a plurality of the third leaf switches;

[0015] Each of the third leaf switches is respectively communicatively connected to the second switch, each of the multiple data storage servers, and each server in the computing network, wherein the computing network refers to the computing network for training and the computing network for inference.

[0016] In a possible design, the front-end and back-end storage networks use storage virtualization technology to abstract a portion of the multiple data storage servers into a logical storage resource pool to store hot data, and abstract another portion of the multiple data storage servers into another logical storage resource pool to store cold data;

[0017] And / or, each data storage server in the front-end and back-end storage networks supports single-port network cards and dual-port network cards.

[0018] In one possible design, the out-of-band management network includes multiple OOB channels, server management interfaces, and switch management interfaces, wherein the server management interface refers to the management interface of the server in the training computing network, the reasoning computing network, and the front-end and back-end storage networks, and the switch management interface refers to the management interface of the switch in the training computing network, the reasoning computing network, and the front-end and back-end storage networks;

[0019] Each OOB channel among the plurality of OOB channels is respectively communicatively connected to the third switch, and each OOB channel is respectively communicatively connected to the server management interface or the switch management interface.

[0020] In one possible design, the first switch is a leaf switch and the number is at least two, the second switch is a spine switch and the number is multiple, and the third switch is a leaf switch and the number is multiple.

[0021] In one possible design, an IDC network is included that is communicatively connected to the core switch, wherein the IDC network includes a computer room core switch, a computer room aggregation switch, a computer room access switch and a computer room server that are communicatively connected in sequence, the computer room core switch is communicatively connected to the core switch, and the computer room server is used to store various types of files, undertake general computing tasks, and perform data encryption and decryption operations.

[0022] In one possible design, the wide area network includes a traffic monitoring, analyzing and cleaning module that is communicatively connected to the core switch;

[0023] The traffic monitoring, analysis and cleaning module is used to monitor the network traffic flowing through the core switch in real time to identify whether there is abnormal traffic. If so, the network traffic is pulled to a traffic cleaning device or area to separate the abnormal traffic from the normal traffic in the network traffic, and the normal traffic is re-injected into the original path of the network traffic.

[0024] In one possible design, the wide area network includes a firewall disposed between the core switch and the first switch;

[0025] And / or, the dedicated line includes a telecommunications network dedicated line, a Unicom network dedicated line and / or a mobile / third-party network dedicated line.

[0026] In one possible design, the platform area includes an SDN controller, a heterogeneous computing power debugging platform, a monitoring platform, a storage management platform, a log platform and / or a bastion host;

[0027] The SDN controller is used to configure, manage and monitor the network through a unified platform, and is responsible for the management and scheduling of network traffic, and dynamically adjusts the path and distribution of traffic according to different application requirements and network conditions, and uniformly manages network devices through the southbound interface protocol Openflow, and uniformly sends various configuration scripts required for the operation of network devices to the first switch;

[0028] The heterogeneous computing power debugging platform is used to monitor computing resources in real time and display the monitoring results through a dashboard and a graphical interface, and adopt an intelligent scheduling algorithm to dynamically allocate computing resources according to the needs and priorities of different tasks, and after receiving various computing tasks submitted, put the tasks into a task queue and queue them according to the priority and resource requirements of the tasks, and display the status and progress of the tasks to the user, and provide intelligent performance optimization suggestions through real-time monitoring and analysis of computing resources and task execution, and authenticate and authorize users to ensure that only legitimate users can access computing resources;

[0029] The monitoring platform is used to monitor the temperature and humidity of network equipment, hardware usage, port traffic and / or network quality in real time, and to determine whether potential fault problems and / or abnormal problems occur through real-time data collection and analysis. If so, the pre-set early warning mechanism is used to trigger the execution of alarm actions before the problem occurs, and to provide administrators with system performance bottlenecks and / or performance optimization directions through monitoring and analysis of system performance indicators;

[0030] The storage management platform is a software system or tool for centralized management and control of storage resources, and by building an intelligent operation and maintenance management platform, it can realize intelligent operation of the storage platform in terms of automated deployment, status monitoring, capacity prediction, performance optimization, remote inspection, fault diagnosis and / or hard disk failure prediction, as well as real-time monitoring of the performance indicators of storage devices, so as to timely discover performance bottlenecks and problems, and improve the performance of the storage system by adjusting the storage configuration and optimizing the storage layout;

[0031] The log platform is used to monitor log data in real time, and when specific events or abnormal situations are found, promptly trigger alarm notifications to administrators, and when a system failure occurs, respond to administrators' inquiries about relevant log records to quickly locate the root cause of the problem, and record various system operations and access logs to provide a basis for security audits, and through log analysis, discover potential security vulnerabilities and violations to enhance system security;

[0032] The bastion host is used to protect the network and data from intrusion and damage from internal and external users.

[0033] Beneficial effects of the above scheme:

[0034] (1) The present invention provides a comprehensive network architecture solution designed for the characteristics of a super-large-scale intelligent computing center industrial park, namely, it includes a computing network, a wide area network and a platform area, wherein the computing network includes a computing network for training, a computing network for reasoning, a front-end and back-end storage network, an in-band management network and an out-of-band management network, the in-band management network includes a first switch, a second switch, a first leaf switch, a second leaf switch, a third leaf switch, a fourth leaf switch, a first spine switch and a second spine switch, and the wide area network includes an Internet cloud platform, a core switch and a dedicated line, and through their interconnection relationship and functional limitations, it can solve the problems of the existing data center network architecture, such as lack of computing network, inability to be applicable to the project characteristics of a super-large-scale intelligent computing center industrial park, difficulty in meeting the requirements of flexible deployment and high cost, and facilitate practical application and promotion;

[0035] (2) It has elastic scalability, that is, the architecture design allows for "elastic" changes between private and public protocols, avoiding the problem that the intelligent computing network architecture cannot be "elastically expanded" due to the binding of hardware and software. In contrast, existing technologies may be limited to the products or protocols of specific manufacturers and are difficult to flexibly adapt to changes in different scales and needs;

[0036] (3) Compatibility means that it is compatible with computing power cards from different manufacturers at home and abroad, such as computing power cards produced by NVIDIA, Huawei, and other domestic card manufacturers, to meet the needs of different cluster sizes and easily expand from small-scale clusters to large-scale computing clusters; this means that customers can freely choose the hardware that best suits their needs, rather than being restricted to a single supplier;

[0037] (4) Storage network customization, that is, customizing the storage network architecture according to user needs, supporting "single-port" and "dual-port" network application scenarios, and realizing partitioned storage of hot data and cold data. This provides higher flexibility and efficiency, while existing technologies may only support standard configurations and are not flexible enough;

[0038] (5) Out-of-band management network, which is physically isolated from the business network. This ensures that when the business network fails, the out-of-band management channel can still work normally, ensuring remote management of ultra-large cluster networks. This is an important security feature that prevents management communications from being affected by business traffic.

[0039] (6) Intelligent scheduling and monitoring, that is, the heterogeneous computing power debugging platform performs real-time monitoring and intelligent scheduling of computing resources. The monitoring platform provides real-time data collection and analysis to timely discover problems and optimize performance. This intelligent resource management can improve the overall efficiency and responsiveness of the system.

[0040] (7) Centralized management and security auditing, that is, the SDN controller uniformly configures, manages and monitors the network, and the bastion host provides monitoring and recording of operation behaviors to enhance system security. Centralized management and security auditing functions can help simplify operations, reduce human errors, and improve system transparency and security;

[0041] (8) Cost-effectiveness, that is, due to its elastic scalability and compatibility, this technology can help users save costs and avoid additional expenses caused by hardware binding. By optimizing resource usage, it can reduce waste and further reduce operating costs;

[0042] (9) Adaptability, that is, the architecture takes into account the characteristics of the ultra-large-scale intelligent computing center industrial park and can adapt to the special needs of this environment, while existing technologies may not be specifically designed for this scale and complexity;

[0043] (10) It has the characteristics of system integration, that is, the solution provides an integrated platform area, including SDN controller, heterogeneous computing power debugging platform and monitoring platform. The tight integration of these components provides a unified management interface, simplifying the management and maintenance of the network;

[0044] (11) It has the characteristics of performance optimization, that is, through real-time monitoring and intelligent scheduling, the architecture can optimize network performance, ensure that key tasks obtain resources first, and improve overall computing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0046] Figure 1 A schematic diagram of a computing power network architecture suitable for an ultra-large-scale intelligent computing center industrial park provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the present invention will be briefly introduced below in combination with the drawings and the description of the embodiments or the prior art. Obviously, the following description of the structures of the drawings is only some embodiments of the present invention. For ordinary technicians in this field, other embodiments can be obtained based on these embodiments without creative work. It should be noted that the description of these embodiments is used to help understand the present invention, but does not constitute a limitation of the present invention.

[0048] It should be understood that although the terms first and second, etc. may be used herein to describe various objects, these objects should not be limited by these terms. These terms are only used to distinguish one object from another object. For example, a first object can be referred to as a second object, and similarly, a second object can be referred to as a first object without departing from the scope of the exemplary embodiments of the present invention.

[0049] It should be understood that the term "and / or" that may appear in this document is merely a description of the association relationship between associated objects, indicating that there may be three relationships. For example, A and / or B can indicate three situations: A exists alone, B exists alone, or A and B exist at the same time. For another example, A, B and / or C can indicate the existence of any one of A, B and C or any combination of them. The term " / and" that may appear in this document describes another type of association object relationship, indicating that there may be two relationships. For example, A / and B can indicate two situations: A exists alone or A and B exist at the same time. In addition, the character " / " that may appear in this document generally indicates that the previous and next associated objects are in an "or" relationship.

[0050] Embodiment 1

[0051] like Figure 1As shown, the computing power network architecture provided in this embodiment and suitable for use in a super-large-scale intelligent computing center industrial park includes but is not limited to a computing power network, a wide area network, and a platform area, etc., wherein the computing power network includes but is not limited to a computing network for training, a computing network for reasoning, a front-end and back-end storage network, an in-band management network, and an out-of-band management network, etc., the in-band management network includes but is not limited to a first switch, a second switch, a first leaf switch, a second leaf switch, a third leaf switch, a fourth leaf switch, a first spine switch, and a second spine switch, etc., the wide area network includes but is not limited to an Internet cloud platform, a core switch, and a dedicated line, etc., the core switch is respectively connected to the Internet cloud platform and the first switch for communication, and the dedicated line is connected through the fourth leaf switch. The switch is communicatively connected to the first switch, the first switch is communicatively connected to the platform area, the first switch is communicatively connected to the front-end and back-end storage networks through the second switch, the first switch is communicatively connected to the out-of-band management network through the third switch, the front-end and back-end storage networks are communicatively connected to the training computing network and the reasoning computing network respectively through the third leaf switch, any two training servers in the training computing network are communicatively interconnected through the first leaf switch and the first spine switch, any two reasoning servers in the reasoning computing network are communicatively interconnected through the second leaf switch and the second spine switch, and the training computing network and the reasoning computing network are both compatible with RoCE (RDMA over Converged Ethernet, which is a remote direct memory access technology based on Ethernet) protocol and IB (InfiniBand, literally translated as "infinite bandwidth" technology, abbreviated as IB, is a computer network communication standard for high-performance computing, it has extremely high throughput and extremely low latency, and is used for data interconnection between computers) protocol. Figure 1 As shown, the computing power network can be arranged in the intelligent computing building of the intelligent computing center industrial park, and the wide area network and platform network can be arranged in the equipment information building of the intelligent computing center industrial park.

[0052] The Internet cloud platform is used to aggregate and form a unified computing power network resource pool, that is, to connect the originally dispersed and heterogeneous computing power resources to form a large and unified computing power network resource pool, which can be used to achieve the following purposes: regardless of the physical location and specific form of the computing power resources, they can be uniformly managed and deployed on the platform; and it can intelligently analyze the status (such as whether they are idle or in use), performance (such as computing speed or processing power) and utilization rate of various computing power resources, and through comprehensive consideration of these indicators, it can accurately perform unified scheduling of computing power; and it can also intuitively display resource usage through dashboards and graphical interfaces, so that administrators can understand the overall resource status at a glance (this visual presentation method greatly improves management efficiency and facilitates administrators to quickly discover potential problem areas); and it can also analyze resource usage patterns and historical trends to provide administrators with in-depth insights, and through mining these data, it can understand the resource demand characteristics of different tasks and the usage patterns of resources in different time periods; and it also provides optimization suggestions based on the analysis results, such as adjusting server configuration and optimizing application code, etc. These suggestions help improve computing performance and resource utilization efficiency and reduce system operating costs.

[0053] The core switch is responsible for establishing a connection with the Internet cloud platform and the in-band management network, that is, it is specifically used to select the best transmission path for data entering and leaving the intelligent computing center network according to the network topology and routing protocol, improve network transmission efficiency and reliability, and guide and allocate traffic of different types and / or different priorities through routing functions, ensure that traffic of key businesses can be processed and transmitted first, and reasonably allocate network resources. In addition, in order to improve the stability of the entire wide area network, the number of core switches is preferably at least two, and each of them is respectively connected to the Internet cloud platform and the first switch.

[0054] The dedicated line is used to provide high bandwidth to meet the needs of enterprises or institutions for large amounts of data transmission, such as high-definition video conferencing and large-scale file transfer, etc., to ensure fast and stable data transmission, and effectively avoid delays and freezes caused by network congestion. The dedicated line also has a low latency feature, which is very critical for applications with high real-time requirements, such as financial transactions, online games, and telemedicine, etc., to ensure that data can be transmitted and processed in a timely manner and reduce response time; compared with ordinary network connections, dedicated lines have higher stability and less network fluctuations, which can effectively reduce packet loss in data transmission and ensure continuous and reliable operation of services. The dedicated line can also achieve physical isolation, relatively isolate the network of an enterprise or institution from the public Internet, and reduce security threats from external networks, such as hacker attacks and malware propagation. Specifically, the dedicated line includes but is not limited to a telecom network dedicated line, a Unicom network dedicated line, and / or a mobile / third-party network dedicated line, etc., so that the telecom network dedicated line, the Unicom network dedicated line, or the mobile / third-party network dedicated line, etc. can be selected based on specific resource conditions. In addition, since the fourth leaf switch is the network interface between the in-band management network and the wide area network, the fourth leaf switch can also be regarded as belonging to the wide area network. Figure 1 shown.

[0055] The first switch is used to forward the source data from the Internet cloud platform to the front-end and back-end storage networks together with the second switch, and is used to forward the management data from the platform area to the out-of-band management network together with the third switch. Through the above design, the in-band management network can import a large amount of source data according to the needs of customers of ultra-large-scale computing clusters, and carry out the import of source data of customers in the in-band management and enable the storage network to communicate data with the platform area, thereby enabling the computing nodes in the training computing network to start training models according to algorithms (such as existing deep learning algorithms and optimization algorithms, etc.) so as to be applied to the inference computing network for inference. Specifically, the first switch adopts a leaf switch (i.e., a Leaf switch, which is a next-level switch connected to a Spine switch, and serves as an entry point for connecting servers and other network devices. It is responsible for providing an interface connected to the data center network and providing network connection for servers and other devices; Leaf switches usually have more ports, support the connection of multiple servers and devices, and provide high-bandwidth and low-latency data forwarding capabilities) and there are at least two of them, the second switch adopts a spine switch (i.e., a Spine switch, which is a core switch in a data center network, and is usually used to build a high-performance, scalable network architecture. It has high bandwidth and low latency characteristics, is used to connect multiple Leaf switches, and provides horizontal high-speed data transmission and forwarding functions; the Spine switch is responsible for achieving high availability and fault tolerance of the data center network, and achieves load balancing and redundancy through a multi-path network architecture) and there are multiple of them, and the third switch adopts a leaf switch and there are multiple of them (at this time, relative to the third switch, the second switch can be regarded as a spine switch). In addition, each of the first switches needs to communicate and connect with each of the second switches and each of the third switches separately to improve the stability of the entire in-band management network.

[0056] The front-end and back-end storage networks are used to provide the training computing network with the source data required for training, and to provide the inference computing network with the source data required for inference. The training computing network is used to implement specific model training functions, and the inference computing network is used to implement specific inference functions based on the trained model. Since they are both compatible with the RoCE protocol and the IB protocol, they are not limited to any domestic or foreign hardware manufacturer solutions (currently domestic Ethernet manufacturers can only support RoCE protocol networking, and cannot support IB protocol networking), and thus can be extremely flexible for ultra-large-scale intelligent computing network architecture, so that it can "flexibly" change between private protocols and public protocols, avoiding the problem that its intelligent computing network architecture cannot be "elastically expanded" due to the binding of hardware and software, that is, it can achieve "elasticity" for large-scale intelligent computing network architecture, greatly reducing the cost of intelligent computing network.

[0057] Based on the detailed description of the above computing power network architecture, it can be seen that this embodiment provides a comprehensive network architecture solution designed for the characteristics of ultra-large-scale intelligent computing center industrial parks, namely, it includes a computing power network, a wide area network and a platform area, wherein the computing power network includes a computing network for training, a computing network for inference, a front-end and back-end storage network, an in-band management network and an out-of-band management network, the in-band management network includes a first switch, a second switch, a first leaf switch, a second leaf switch, a third leaf switch, a fourth leaf switch, a first spine switch and a second spine switch, the wide area network includes an Internet cloud platform, a core switch and a dedicated line, and through their interconnection relationship and functional limitations, it can solve the problems of the existing data center network architecture, such as lack of computing power network, inability to be applicable to the project characteristics of ultra-large-scale intelligent computing center industrial parks, difficulty in meeting flexible deployment and high cost, and is convenient for practical application and promotion.

[0058] Preferably, the training computing network includes but is not limited to a plurality of the training servers, a plurality of the first leaf switches and a plurality of the first spine switches, wherein each of the first leaf switches is respectively connected to each of the training servers, and each of the first spine switches is respectively connected to each of the first leaf switches. Specifically, the training server is mainly used for, but not limited to, realizing the following functions: processing a large amount of data at the same time, greatly improving the computing efficiency, and being able to quickly extract and analyze features of a large amount of image data; since deep learning models usually require a large amount of computing resources for training, the server greatly shortens the training time by performing operations such as matrix multiplication and convolution in parallel. The first leaf switch is used as an edge device of the training computing network (that is, the first leaf switch also belongs to the training computing network, and there are two cases), responsible for connecting various terminal devices, such as the training servers, etc. It provides network access ports for these devices to realize the connection between the devices and the network, that is, to aggregate the traffic from the terminal devices and distribute the traffic to the appropriate destination according to the network topology and routing strategy; it plays the role of traffic inlet and outlet, ensuring the efficient transmission of data in the intelligent computing network. The first spine switch is located at the core of the training computing network (that is, the first spine switch also belongs to the training computing network, and there are two cases), responsible for high-speed forwarding of a large amount of data traffic. It is usually equipped with a high-bandwidth port (such as 400Gbps or higher) and can quickly process data from each leaf switch. Through the fully connected topology of the aforementioned first spine switch and each first leaf switch, data can be transmitted in the network through multiple paths, which improves the reliability and bandwidth utilization of the network. That is, no matter which leaf switch the data enters the network from, it can reach the destination through the shortest path, reducing the delay in data transmission. And it is also considered that a large amount of data needs to be transmitted quickly between different devices. For example, in large-scale deep learning training, massive training data needs to be transmitted from the storage device to the computing node (such as the training server). Therefore, through the aforementioned fully connected topology design, high bandwidth support can be provided for data transmission, meeting the high requirements of intelligent computing tasks for data throughput, ensuring that data can flow quickly and stably between nodes, avoiding data transmission bottlenecks, and improving overall computing efficiency.In addition, since the number of the first leaf switch and the first spine switch is adjustable, it can also adapt to different cluster sizes to achieve scalable construction and more flexible and changeable purposes, that is, to adapt to the deployment of small clusters and large clusters (such as 32POD, 64POD, 128POD, 256POD, 512POD and 1024POD clusters; the aforementioned POD is an existing concept, usually including high-performance computing chips, such as graphics processors and tensor processing units and other processors specially optimized for artificial intelligence and high-performance computing), fully meeting the positioning of ten thousand card level clusters, and having the advantage of being easily expanded from small-scale clusters to large-scale computing clusters.

[0059] Preferably, the computing network for inference includes but is not limited to a plurality of the inference servers, a plurality of the second leaf switches and a plurality of the second spine switches, wherein each of the second leaf switches is respectively communicated and connected to each of the inference servers, and each of the second spine switches is respectively communicated and connected to each of the second leaf switches. The inference server is mainly used for, but not limited to, realizing the following functions: large-scale data parallel processing when performing inference tasks (for example, in the inference scenario of image recognition, facing the input of thousands of pictures, the graphics processor can simultaneously extract features and classify these pictures and quickly give results); complex model parallel computing (for example, for complex models such as deep neural networks, the graphics processor can efficiently perform matrix multiplication, convolution and other operations in parallel; in the inference process, these operations occupy most of the computing time, and the parallel processing capability of the graphics processor can significantly shorten the inference time, making real-time applications possible); in the inference process, the input data needs to be continuously transmitted to the graphics processor for processing, and the high-bandwidth memory can ensure the rapid transmission of data and avoid data transmission becoming a bottleneck (for example, in the inference scenario of video stream analysis, the graphics processor can process high-resolution video streams in real time without delays due to slow data transmission speeds). ; At the beginning of model inference, the pre-trained model parameters need to be loaded into the memory (the high memory bandwidth of the graphics processor can quickly complete this process and reduce the startup time). The second leaf switch is used as the edge device of the computing network for reasoning (that is, the second leaf switch also belongs to the computing network for reasoning, and there are two cases), responsible for connecting various terminal devices, such as the server for reasoning, etc. The specific details can be obtained by referring to the conventional derivation of the aforementioned first leaf switch, and will not be repeated here. The second spine switch is located at the core position of the computing network for reasoning (that is, the second spine switch also belongs to the computing network for reasoning, and there are two cases). The specific details can be obtained by referring to the conventional derivation of the aforementioned first spine switch, and will not be repeated here. In addition, since the number of the second leaf switch and the second spine switch can be adjusted, it can also adapt to different cluster sizes to achieve scalable construction and more flexible and changeable purposes.

[0060] Preferably, the front-end and back-end storage network includes but is not limited to a plurality of data storage servers and a plurality of the third leaf switches, etc.; each of the third leaf switches is respectively connected to the second switch, each of the data storage servers in the plurality of data storage servers, and each server in the computing network, wherein the computing network refers to the computing network for training and the computing network for inference. The data storage server is used to provide a large-capacity storage space for the computing network that usually needs to process a large amount of data (specifically including training data, model parameters, and intermediate results, etc.) to meet the storage requirements of these data, and to ensure the security and reliability of the data, data backup is usually performed. The function of the third leaf switch is similar to that of the first leaf switch and the second leaf switch, and will not be repeated here. Specifically, each data storage server in the front-end and back-end storage network supports single-port network cards and dual-port network cards, so that the storage network architecture and compatible storage server selection requirements can be customized according to the needs of the end user, that is, its customized network can flexibly respond to the "single-port" network carrying business needs and can also meet the "dual-port" network application scenarios, avoiding the rigid conditions that manufacturers must have "dual-port" networks, thereby providing the function of "elastic" network in the storage area. Specifically, the front-end and back-end storage networks use storage virtualization technology (which is an existing technology that can abstract multiple physical storage devices into a logical storage resource pool and manage and allocate them through a unified management interface. It can integrate storage devices of different types and brands to achieve unified management and allocation of storage resources; for example, storage area network virtualization and network attached storage virtualization are storage virtualization technologies) to abstract a part of the multiple data storage servers into a logical storage resource pool to store hot data (that is, data that is frequently accessed and requires real-time or near real-time processing), and to abstract another part of the multiple data storage servers into another logical storage resource pool to store cold data (that is, data that is not frequently accessed and has a long storage time). In this way, partitioning can be performed through resource pooling to achieve storage space for "hot data" and "cold data", thereby solving the different requirements for storing hot data and cold data, and also avoiding the hot storage servers and cold storage servers that are strongly bound to traditional manufacturers and have bloated configurations, thereby reducing unnecessary expenses on storage servers; at the same time, it is compatible with more storage server manufacturers (such as IBM, DDN and Netapp, etc.), and is more suitable for ultra-large-scale intelligent computing power cluster application scenarios.

[0061] Preferably, the out-of-band management network includes but is not limited to multiple OOB channels, server management interfaces, and switch management interfaces, etc., wherein the server management interface refers to the management interface of the server in the training computing network, the reasoning computing network, and the front-end and back-end storage network, and the switch management interface refers to the management interface of the switch in the training computing network, the reasoning computing network, and the front-end and back-end storage network; each OOB channel in the multiple OOB channels is respectively communicatively connected to the third switch, and each OOB channel is respectively communicatively connected to the server management interface or the switch management interface. The aforementioned OOB (Out of Band) channel is used to provide a communication channel independent of the data network, so as to allow administrators to remotely access and control devices in the intelligent computing network at any time and any place; even if the data network fails or the device cannot be started normally, the administrator can still connect to the device through the OOB channel to perform fault diagnosis and repair. In this way, the out-of-band management network can be physically isolated from the business networks such as the training computing network, the inference computing network, and the front-end and back-end storage networks within the computing power network. Even if the business network is completely paralyzed, the out-of-band management channel can still work normally, ensuring that the administrator can perform emergency processing and fault recovery on the equipment (this is necessary for ultra-large-scale intelligent computing power clusters, otherwise there will be the problem of "disconnection" in remote management of ultra-large cluster networks).

[0062] Preferably, an IDC network is included that is communicatively connected to the core switch, wherein the IDC network includes but is not limited to a computer room core switch, a computer room aggregation switch, a computer room access switch and a computer room server that are communicatively connected in sequence, the computer room core switch is communicatively connected to the core switch, and the computer room server is used to store various types of files, undertake general computing tasks and perform data encryption and decryption operations. The computer room core switch is responsible for quickly forwarding data from the aggregation layer and other network areas; it has the characteristics of high bandwidth and low latency, and can ensure the efficient transmission of a large amount of data; for example, in a large enterprise network, this core switch can quickly process data interactions between departments and with external networks; in the backbone of the network, this core switch can connect various aggregation switches and other important network devices (such as servers and routers, etc.) together to form a unified network as a whole, so that networks in different areas can communicate with each other. The computer room aggregation switch is used to connect multiple computer room access switches, collect a large amount of data from the access layer, and perform preliminary processing and integration, and then forward these data to the computer room core switch. The computer room access switch is used to directly connect end-user devices, such as CPU (Central Processing Unit) servers and storage servers, etc., to provide network access ports for these devices so that they can access the network and achieve communication and resource sharing with other devices. The aforementioned various types of files are specifically exemplified but not limited to documents, pictures, and videos, so that users can access files on the computer room server through the network to achieve file sharing and collaboration. The aforementioned general computing tasks are specifically exemplified but not limited to running operating systems and executing applications, etc. It can process various types of data, including text, numbers, images, and audio. And because the security of data is crucial in network communications, the confidentiality and integrity of data can be protected by performing data encryption and decryption operations. Therefore, through the configuration of the aforementioned IDC network, the computing power network and the IDC general computing network can also be coordinated to meet the business needs of the two major customers of computing power and IDC. In addition, the IDC network can be arranged in the IDC building of the intelligent computing center industrial park.

[0063] Preferably, the wide area network includes a flow monitoring, analysis and cleaning module that is communicatively connected to the core switch; the flow monitoring, analysis and cleaning module is used to monitor the network flow flowing through the core switch in real time to identify whether there is abnormal flow. If there is, the network flow is pulled to the flow cleaning device or area to separate the abnormal flow from the normal flow in the network flow, and the normal flow is re-injected into the original path of the network flow. The aforementioned abnormal flow situation is specific but not limited to abnormal flow with signs of DDoS (Distributed Denial of Service) attack, and the type of attack can be further analyzed and determined: whether it is an attack at the network layer (such as SYN Flood), an attack at the application layer (such as HTTP Flood) or an attack of other specific protocols, so as to provide a basis for subsequent targeted cleaning measures. In this way, through the configuration of the aforementioned flow monitoring, analysis and cleaning module, it can be ensured that normal business is not affected, and normal flow is accurately delivered to the target server or application, ensuring the continuity and stability of the business. In addition, the traffic monitoring, analyzing and cleaning modules need to correspond one-to-one with the core switches, that is, when there are at least two core switches, the traffic monitoring, analyzing and cleaning modules also need to correspond one-to-one with each other.

[0064] Preferably, the wide area network includes a firewall disposed between the core switch and the first switch. The firewall is used to strictly control access rights and data flows between different areas when dividing network areas (for example, dividing the network of the IDC computer room into different security areas, such as the internal server area, the isolation area, and the external network area) according to preset rules (such as allowing qualified network data packets to enter and exit the IDC computer room based on IP addresses, port numbers, and protocol types), and also prevent the spread of internal threats: even when a security incident occurs or malicious behavior occurs inside the IDC computer room, the firewall can limit the communication between the infected or problematic host and other devices, avoiding the rapid spread of security threats throughout the computer room. In addition, the firewall also needs to correspond one-to-one with the core switch, that is, when there are at least two core switches, the firewall also needs to correspond one-to-one with one of them.

[0065] Preferably, the platform area includes but is not limited to an SDN controller, a heterogeneous computing power debugging platform, a monitoring platform, a storage management platform, a logging platform and / or a bastion host.

[0066] The SDN (Software Defined Network) controller is used to configure, manage and monitor the network through a unified platform (this is very necessary for ultra-large-scale campus equipment, and there is no need to operate each network device separately), and is responsible for the management and scheduling of network traffic, and dynamically adjusts the path and distribution of traffic according to different application requirements and network conditions, and uniformly manages network devices through the southbound interface protocol Openflow, and uniformly sends various configuration scripts required for the operation of network devices to the first switch.

[0067] The heterogeneous computing power debugging platform is used to monitor computing resources in real time, and display the monitoring results (such as GPU utilization, CPU utilization, memory usage, disk space and / or network bandwidth, etc.) through a dashboard and a graphical interface, and adopt an intelligent scheduling algorithm (such as an existing greedy algorithm, etc.) to dynamically allocate computing resources according to the needs and priorities of different tasks (for example, for high-priority tasks, such as key artificial intelligence training tasks, more GPU resources and memory resources can be allocated preferentially to ensure that the tasks can be completed quickly; and for low-priority tasks, they can be scheduled when resources are idle to avoid resource waste), and upon receiving the submitted After completing various computing tasks (such as data analysis tasks, model training tasks, and scientific computing tasks submitted through a simple interface), the tasks are placed in a task queue and queued according to task priority and resource requirements. The status and progress of the tasks are displayed to the user. Through real-time monitoring and analysis of computing resources and task execution, intelligent performance optimization suggestions are provided (for example, the bottleneck of the task can be analyzed based on the execution time, resource usage, and performance indicators of the task, and corresponding optimization suggestions can be made, such as adjusting task parameters, optimizing algorithms, and increasing resource allocation, etc.), as well as user authentication and authorization to ensure that only legitimate users can access computing resources.

[0068] The monitoring platform is used to monitor the temperature and humidity of network equipment, the utilization rate of hardware (such as graphics processor, central processing unit and memory, etc.), port traffic and / or network quality (such as packet loss rate and delay time) in real time, and through real-time data collection and analysis, determine whether potential fault problems and / or abnormal problems occur. If so, the pre-set early warning mechanism is used to trigger the execution of alarm actions before the problem occurs (this can help administrators have enough time to take preventive measures), and through monitoring and analysis of system performance indicators, provide administrators with system performance bottlenecks and / or performance optimization directions. For example, by analyzing network traffic data, the time period and cause of network congestion can be found, so that corresponding optimization measures can be taken, such as increasing bandwidth and optimizing network configuration.

[0069] The storage management platform is a software system or tool for centrally managing and controlling storage resources (which can help users use storage devices more efficiently, improve the utilization, reliability and manageability of storage resources, and meet the growing data storage and management needs of enterprises or individuals), and through the construction of an intelligent operation and maintenance management platform, it can realize intelligent operation of the storage platform in terms of automated deployment, status monitoring, capacity prediction, performance optimization, remote inspection, fault diagnosis and / or hard disk failure prediction, as well as real-time monitoring of the performance indicators of storage devices (such as read and write speeds, the number of read and write operations per second and / or latency, etc.) to promptly discover performance bottlenecks and problems, and improve the performance of the storage system by adjusting the storage configuration and optimizing the storage layout.

[0070] The log platform is used to monitor log data in real time, and when specific events or abnormal situations are found, it promptly triggers an alarm notification to the administrator, and when a system failure occurs, it responds to the administrator's query for related log records to quickly locate the root cause of the problem, and records various system operations and access logs to provide a basis for security audits, and through the analysis of logs, discovers potential security vulnerabilities and violations to enhance the security of the system.

[0071] The bastion host is used to protect the network and data from intrusion and destruction from internal and external users. Specifically, various technical means can be used to monitor and record the operation behavior of operation and maintenance personnel on servers, network equipment, security equipment, databases and other equipment in the network, so as to centrally alarm, handle in time and audit and determine responsibilities.

[0072] In summary, the computing power network architecture provided by this embodiment has the following technical effects:

[0073] (1) This embodiment provides a comprehensive network architecture solution designed for the characteristics of a super-large-scale intelligent computing center industrial park, namely, it includes a computing network, a wide area network and a platform area, wherein the computing network includes a computing network for training, a computing network for reasoning, a front-end and back-end storage network, an in-band management network and an out-of-band management network, the in-band management network includes a first switch, a second switch, a first leaf switch, a second leaf switch, a third leaf switch, a fourth leaf switch, a first spine switch and a second spine switch, and the wide area network includes an Internet cloud platform, a core switch and a dedicated line, and through their interconnection relationship and functional limitations, it can solve the problems of the existing data center network architecture, such as lack of computing network, inability to be applicable to the project characteristics of a super-large-scale intelligent computing center industrial park, difficulty in meeting the requirements of flexible deployment and high cost, and facilitate practical application and promotion;

[0074] (2) It has elastic scalability, that is, the architecture design allows for "elastic" changes between private and public protocols, avoiding the problem that the intelligent computing network architecture cannot be "elastically expanded" due to the binding of hardware and software. In contrast, existing technologies may be limited to the products or protocols of specific manufacturers and are difficult to flexibly adapt to changes in different scales and needs;

[0075] (3) Compatibility means that it is compatible with computing power cards from different manufacturers at home and abroad, such as computing power cards produced by NVIDIA, Huawei, and other domestic card manufacturers, to meet the needs of different cluster sizes and easily expand from small-scale clusters to large-scale computing clusters; this means that customers can freely choose the hardware that best suits their needs, rather than being restricted to a single supplier;

[0076] (4) Storage network customization, that is, customizing the storage network architecture according to user needs, supporting "single-port" and "dual-port" network application scenarios, and realizing partitioned storage of hot data and cold data. This provides higher flexibility and efficiency, while existing technologies may only support standard configurations and are not flexible enough;

[0077] (5) Out-of-band management network, which is physically isolated from the business network. This ensures that when the business network fails, the out-of-band management channel can still work normally, ensuring remote management of ultra-large cluster networks. This is an important security feature that prevents management communications from being affected by business traffic.

[0078] (6) Intelligent scheduling and monitoring, that is, the heterogeneous computing power debugging platform performs real-time monitoring and intelligent scheduling of computing resources. The monitoring platform provides real-time data collection and analysis to timely discover problems and optimize performance. This intelligent resource management can improve the overall efficiency and responsiveness of the system.

[0079] (7) Centralized management and security auditing, that is, the SDN controller uniformly configures, manages and monitors the network, and the bastion host provides monitoring and recording of operation behaviors to enhance system security. Centralized management and security auditing functions can help simplify operations, reduce human errors, and improve system transparency and security;

[0080] (8) Cost-effectiveness, that is, due to its elastic scalability and compatibility, this technology can help users save costs and avoid additional expenses caused by hardware binding. By optimizing resource usage, it can reduce waste and further reduce operating costs;

[0081] (9) Adaptability, that is, the architecture takes into account the characteristics of the ultra-large-scale intelligent computing center industrial park and can adapt to the special needs of this environment, while existing technologies may not be specifically designed for this scale and complexity;

[0082] (10) It has the characteristics of system integration, that is, the solution provides an integrated platform area, including SDN controller, heterogeneous computing power debugging platform and monitoring platform. The tight integration of these components provides a unified management interface, simplifying the management and maintenance of the network;

[0083] (11) It has the characteristics of performance optimization, that is, through real-time monitoring and intelligent scheduling, the architecture can optimize network performance, ensure that key tasks obtain resources first, and improve overall computing efficiency.

[0084] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A computing network architecture suitable for ultra-large-scale intelligent computing center industrial park, characterized in that: It includes a computing network, a wide area network and a platform area, wherein the computing network includes a computing network for training, a computing network for inference, a front-end and back-end storage network, an in-band management network and an out-of-band management network, the in-band management network includes a first switch, a second switch, a first leaf switch, a second leaf switch, a third leaf switch, a fourth leaf switch, a first spine switch and a second spine switch, the wide area network includes an Internet cloud platform, a core switch and a dedicated line, the core switch is respectively connected to the Internet cloud platform and the first switch, the dedicated line is connected to the first switch through the fourth leaf switch, and the first switch is connected to the platform Area, the first switch is connected to the front-end and back-end storage networks through the second switch, the first switch is connected to the out-of-band management network through the third switch, the front-end and back-end storage networks are respectively connected to the training computing network and the reasoning computing network through the third leaf switch, any two training servers in the training computing network are interconnected through the first leaf switch and the first spine switch, any two reasoning servers in the reasoning computing network are interconnected through the second leaf switch and the second spine switch, and the training computing network and the reasoning computing network are compatible with RoCE protocol and IB protocol; The Internet cloud platform is used to aggregate and form a unified computing power network resource pool; The core switch is responsible for establishing a connection with the Internet cloud platform and the in-band management network; The first switch is used to forward the source data from the Internet cloud platform to the front-end and back-end storage networks together with the second switch, and to forward the management data from the platform area to the out-of-band management network together with the third switch; The front-end and back-end storage networks are used to provide the training computing network with source data required for training, and to provide the inference computing network with source data required for inference.

2. The computing power network architecture according to claim 1, characterized in that: The training computing network includes a plurality of the training servers, a plurality of the first leaf switches and a plurality of the first spine switches, wherein each of the first leaf switches is respectively connected to each of the training servers for communication, and each of the first spine switches is respectively connected to each of the first leaf switches for communication; And / or, the computing network for inference includes multiple servers for inference, multiple second leaf switches and multiple second spine switches, wherein each of the second leaf switches is respectively communicated and connected to each of the servers for inference, and each of the second spine switches is respectively communicated and connected to each of the second leaf switches.

3. The computing power network architecture according to claim 1, characterized in that: The front-end and back-end storage network includes a plurality of data storage servers and a plurality of the third leaf switches; Each of the third leaf switches is respectively communicatively connected to the second switch, each of the multiple data storage servers, and each server in the computing network, wherein the computing network refers to the computing network for training and the computing network for inference.

4. The computing power network architecture according to claim 3, characterized in that: The front-end and back-end storage networks use storage virtualization technology to abstract a portion of the multiple data storage servers into a logical storage resource pool to store hot data, and abstract another portion of the multiple data storage servers into another logical storage resource pool to store cold data; And / or, each data storage server in the front-end and back-end storage networks supports single-port network cards and dual-port network cards.

5. The computing power network architecture according to claim 1, characterized in that: The out-of-band management network includes multiple OOB channels, server management interfaces and switch management interfaces, wherein the server management interface refers to the management interface of the server in the training computing network, the reasoning computing network and the front-end and back-end storage network, and the switch management interface refers to the management interface of the switch in the training computing network, the reasoning computing network and the front-end and back-end storage network; Each OOB channel among the multiple OOB channels is respectively communicatively connected to the third switch, and each OOB channel is respectively communicatively connected to the server management interface or the switch management interface.

6. The computing power network architecture according to claim 1, characterized in that: The first switch is a leaf switch and the number is at least two, the second switch is a spine switch and the number is multiple, and the third switch is a leaf switch and the number is multiple.

7. The computing power network architecture according to claim 1, characterized in that: It includes an IDC network that is communicatively connected to the core switch, wherein the IDC network includes a computer room core switch, a computer room aggregation switch, a computer room access switch and a computer room server that are communicatively connected in sequence, the computer room core switch is communicatively connected to the core switch, and the computer room server is used to store various types of files, undertake general computing tasks and perform data encryption and decryption operations.

8. The computing power network architecture according to claim 1, characterized in that: The wide area network includes a traffic monitoring, analysis and cleaning module that is communicatively connected to the core switch; The traffic monitoring, analysis and cleaning module is used to monitor the network traffic flowing through the core switch in real time to identify whether there is abnormal traffic. If so, the network traffic is pulled to a traffic cleaning device or area to separate the abnormal traffic from the normal traffic in the network traffic, and the normal traffic is re-injected into the original path of the network traffic.

9. The computing power network architecture according to claim 1, characterized in that: The wide area network includes a firewall arranged between the core switch and the first switch; And / or, the dedicated line includes a telecommunications network dedicated line, a Unicom network dedicated line and / or a mobile / third-party network dedicated line.

10. The computing power network architecture according to claim 1, characterized in that: The platform area includes an SDN controller, a heterogeneous computing power debugging platform, a monitoring platform, a storage management platform, a log platform and / or a bastion host; The SDN controller is used to configure, manage and monitor the network through a unified platform, and is responsible for the management and scheduling of network traffic, and dynamically adjusts the path and distribution of traffic according to different application requirements and network conditions, and uniformly manages network devices through the southbound interface protocol Openflow, and uniformly sends various configuration scripts required for the operation of network devices to the first switch; The heterogeneous computing power debugging platform is used to monitor computing resources in real time and display the monitoring results through a dashboard and a graphical interface, and adopt an intelligent scheduling algorithm to dynamically allocate computing resources according to the needs and priorities of different tasks, and after receiving various computing tasks submitted, put the tasks into a task queue and queue them according to the priority and resource requirements of the tasks, and display the status and progress of the tasks to the user, and provide intelligent performance optimization suggestions through real-time monitoring and analysis of computing resources and task execution, and authenticate and authorize users to ensure that only legitimate users can access computing resources; The monitoring platform is used to monitor the temperature and humidity of network equipment, hardware usage, port traffic and / or network quality in real time, and to determine whether potential fault problems and / or abnormal problems occur through real-time data collection and analysis. If so, the pre-set early warning mechanism is used to trigger the execution of alarm actions before the problem occurs, and to provide administrators with system performance bottlenecks and / or performance optimization directions through monitoring and analysis of system performance indicators; The storage management platform is a software system or tool for centralized management and control of storage resources, and by building an intelligent operation and maintenance management platform, it can realize intelligent operation of the storage platform in terms of automated deployment, status monitoring, capacity prediction, performance optimization, remote inspection, fault diagnosis and / or hard disk failure prediction, as well as real-time monitoring of the performance indicators of storage devices, so as to timely discover performance bottlenecks and problems, and improve the performance of the storage system by adjusting the storage configuration and optimizing the storage layout; The log platform is used to monitor log data in real time, and when specific events or abnormal situations are found, promptly trigger alarm notifications to administrators, and when a system failure occurs, respond to administrators' inquiries about relevant log records to quickly locate the root cause of the problem, and record various system operations and access logs to provide a basis for security audits, and through log analysis, discover potential security vulnerabilities and violations to enhance system security; The bastion host is used to protect the network and data from intrusion and damage from internal and external users.

Images