Cluster control method and device for non-containerized deployment, equipment and storage medium
By obtaining node and task status information of the non-containerized deployment cluster, using artificial intelligence technology to generate control prompt words, and entering a large language model for real-time control, it solves the problem of low scheduling efficiency of non-containerized deployment clusters and realizes efficient real-time control .
Patent Information
- Application Number
- CN202410977241.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-19
- Publication Date
- 2024-11-22
AI Technical Summary
The existing containerized deployment cluster scheduling methods cannot be directly applied to non-containerized deployment clusters, resulting in the problem of lack of real-time and inefficient scheduling control.
By obtaining the node resource status information of business nodes and the status information of business tasks, using artificial intelligence technology to generate control prompt words in real time, input a pre-trained cluster control large language model for content generation, and obtain real-time feedback, thereby real-time control of the cluster.
It improves the control efficiency of non-container deployment clusters, can flexibly adapt to rapidly changing business scenarios and diversified cluster business needs, and realizes real-time scheduling and management.
Smart Images

Figure CN119003086A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a cluster control method, apparatus, device and storage medium for non-containerized deployment. Background Art
[0002] A non-containerized cluster deployment refers to directly deploying and running applications and services on multiple physical servers or virtual machines, rather than packaging them into containers before deployment. This approach is suitable for environments that require high resource utilization and system stability.
[0003] In related technologies, cluster scheduling management is usually concentrated in a containerized deployment environment, and resource isolation and scheduling are achieved through virtualization technology. Since non-containerized clusters lack a container layer, existing scheduling methods for containerized clusters cannot be directly applied to non-containerized clusters. The scheduling control process of non-containerized clusters often relies on pre-set strategies, which makes them less real-time and less efficient in scheduling control. Summary of the invention
[0004] The main purpose of the embodiments of the present application is to propose a cluster control method, device, equipment and storage medium for non-containerized deployment, which can adapt to the needs of real-time scheduling control and improve the control efficiency of the cluster for non-containerized deployment.
[0005] To achieve the above object, a first aspect of an embodiment of the present application proposes a cluster control method for non-containerized deployment, wherein the cluster includes multiple service nodes, and the service nodes are used to process at least one service task simultaneously. The method includes:
[0006] Acquire node resource status information of the service node and service status information corresponding to each service task, and obtain cluster status data according to all the acquired node resource status information and service status information;
[0007] Acquire the business domain and business requirements of the cluster, and select a target template from preset prompt word templates according to the business domain and business requirements;
[0008] Acquire a cluster control strategy, acquire demand threshold information corresponding to the business demand, write the cluster control strategy, the cluster status data and the demand threshold information into a preset position of the target template, and obtain a control prompt word suitable for the business demand;
[0009] The control prompt words are input into a pre-trained cluster control large language model for content generation to obtain control data of the cluster.
[0010] In some embodiments, obtaining cluster status data according to all the acquired node resource status information and the acquired service status information includes:
[0011] Summarizing the node resource status information and the service status information to obtain initial status data;
[0012] After performing a preliminary analysis on the initial state data and determining that the initial state data does not have an abnormality, performing data preprocessing on the initial state data to obtain intermediate state data, and encoding the intermediate state data to obtain the cluster state data.
[0013] In some embodiments, encoding the intermediate state data to obtain the cluster state data includes:
[0014] Generate a target format object that is consistent with the number of the service nodes, wherein the target format object includes key-value pairs that are consistent with the number of elements in the intermediate data state;
[0015] The intermediate state data corresponding to each of the service nodes is filled into the key-value pairs one by one to obtain the performance index of the service node, and the cluster state data is obtained according to the performance index.
[0016] In some embodiments, obtaining the cluster control strategy includes:
[0017] Obtaining a focus factor including at least one of a time-space factor, a business node factor, and a business task factor;
[0018] Based on the concern factors, key business nodes and / or key business tasks are determined, and the cluster control strategy corresponding to the key business nodes and / or the key business tasks is acquired.
[0019] In some embodiments, obtaining demand threshold information corresponding to the service demand includes:
[0020] Acquire cluster state threshold information related to the cluster, acquire node state threshold information related to the service node, and acquire task state threshold information related to the service task;
[0021] Based on the business demand, the demand threshold information is obtained according to at least one of the cluster state threshold information, the node state threshold information and the task state threshold information.
[0022] In some embodiments, the step of inputting the control prompt word into a pre-trained cluster control large language model for content generation to obtain the control data of the cluster includes:
[0023] When the business demand is a cluster status monitoring demand, at least one of the overall status monitoring data of the cluster, the node resource status monitoring data of the business node, and the business status monitoring data of the business task is obtained according to the control prompt word using the cluster control large language model;
[0024] When the business demand is a cluster scheduling demand, the cluster control large language model is used to obtain at least one of the overall scheduling data of the cluster, the node scheduling data of the business node, and the business status scheduling data of the business task according to the control prompt word.
[0025] In some embodiments, the acquiring the node resource status information of the service node and the service status information corresponding to each of the service tasks includes:
[0026] Receiving at least one of CPU usage, memory occupancy or disk space sent by the service node as the node resource status information;
[0027] At least one of task execution progress data, error log or load information of the business task sent by the business node is received as the business status information.
[0028] To achieve the above object, a second aspect of an embodiment of the present application proposes a cluster control device for non-containerized deployment, wherein the cluster includes multiple service nodes, and the service nodes are used to process at least one service task simultaneously, and the device includes:
[0029] Status data acquisition module: used to acquire node resource status information of the service node and service status information corresponding to each service task, and obtain cluster status data according to all acquired node resource status information and service status information;
[0030] Target template selection module: used for obtaining the business domain and business requirements of the cluster, and selecting a target template from preset prompt word templates according to the business domain and business requirements;
[0031] Prompt word generation module: used to obtain the cluster control strategy, obtain the demand threshold information corresponding to the business demand, write the cluster control strategy, the cluster state data and the demand threshold information into the preset position of the target template, and obtain the control prompt word suitable for the business demand;
[0032] Content generation module: used for inputting the control prompt words into the pre-trained cluster control large language model to generate content and obtain the control data of the cluster.
[0033] To achieve the above objectives, a third aspect of an embodiment of the present application proposes an electronic device, which includes a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the method described in the first aspect is implemented.
[0034] To achieve the above-mentioned purpose, the fourth aspect of an embodiment of the present application proposes a storage medium, which is a storage medium. The storage medium stores a computer program, and when the computer program is executed by a processor, the method described in the first aspect is implemented.
[0035] The cluster control method, device, equipment and storage medium of the non-containerized deployment proposed in the embodiment of the present application, obtain the node resource status information of the service node and the service status information corresponding to each service task, and obtain the cluster status data according to all the node resource status information and service status information obtained, obtain the service field and service demand of the cluster, and select the target template from the preset prompt word template according to the service field and service demand, obtain the cluster control strategy, obtain the demand threshold information corresponding to the service demand, write the cluster control strategy, cluster status data and demand threshold information into the preset position of the target template, obtain the control prompt word applicable to the service demand, input the control prompt word into the pre-trained cluster control large language model for content generation, and obtain the control data of the cluster. The embodiment of the present application obtains the node-related status and task-related status in the cluster in real time, and uses these status data and the current service demand, business field knowledge and cluster control strategy to generate the corresponding control prompt word in real time. These control prompt words are used as the input of the large language model of cluster control, and the content analysis ability of the large language model is used to obtain real-time feedback. Cluster control is carried out by this real-time feedback mechanism, and the purpose of real-time control can be achieved, thereby improving the control efficiency of the cluster. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] Figure 1 It is a schematic diagram of the implementation environment of the non-containerized deployment cluster control method of an embodiment of the present application.
[0037] Figure 2 It is a flow chart of a cluster control method for non-containerized deployment provided in an embodiment of the present application.
[0038] Figure 3 It is a schematic diagram of encoding intermediate state data to obtain cluster state data provided by an embodiment of the present application.
[0039] Figure 4 It is a flow chart for obtaining a cluster control strategy provided in an embodiment of the present application.
[0040] Figure 5 This is a flowchart for obtaining demand threshold information corresponding to business requirements provided in an embodiment of the present application.
[0041] Figure 6 It is a schematic diagram of a cluster control method for non-containerized deployment provided in an embodiment of the present application.
[0042] Figure 7 This is another schematic diagram of the non-containerized deployment cluster control method provided in an embodiment of the present application.
[0043] Figure 8 This is a structural block diagram of a cluster control device for non-containerized deployment provided by another embodiment of the present application.
[0044] Fig. 9 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION
[0045] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0046] It should be noted that although the functional modules are divided in the device schematic and the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart.
[0047] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.
[0048] First, some nouns involved in this application are analyzed:
[0049] Artificial intelligence (AI) is a new technical science that studies and develops theories, methods, technologies and application systems for simulating, extending and expanding human intelligence. AI is a branch of computer science that attempts to understand the essence of intelligence and produce a new type of intelligent machine that can respond in a similar way to human intelligence. Research in this field includes robotics, speech recognition, image recognition, natural language processing and expert systems. AI can simulate the information process of human consciousness and thinking. AI is also a theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.
[0050] In modern data centers and cloud environments, resource management and task scheduling are key factors in ensuring efficient operation. Containerized deployment achieves resource isolation and scheduling through virtualization technology, providing a standardized method to manage resource usage by different tasks. However, in some cases, such as those application environments that require high resource utilization and system stability, non-containerized deployment is more applicable. A non-containerized cluster deployment refers to directly deploying and running applications and services on multiple physical servers or virtual machines, rather than packaging them into containers and then deploying them.
[0051] Non-containerized deployment does not have the additional overhead of the container layer, which reduces resource consumption and improves system performance, but at the same time brings challenges in resource management and task scheduling. In related technologies, cluster scheduling management is usually concentrated in the environment of containerized deployment. Since non-containerized clusters lack a container layer, the existing scheduling methods for containerized clusters cannot be directly applied to non-containerized clusters. The scheduling and control process of non-containerized cluster deployments, such as cluster status monitoring and task scheduling strategies, often relies on manually written rules and scripts for monitoring and diagnosis, that is, pre-set scheduling strategies. This process not only consumes a lot of manpower and time resources, but also does not have good real-time performance. The efficiency of scheduling control is low and it is difficult to adapt to rapidly changing business scenarios and diverse cluster business needs.
[0052] Based on this, the embodiments of the present application provide a cluster control method, device, equipment and storage medium for non-containerized deployment, which obtains the node-related status and task-related status in the cluster in real time, and uses these status data and current business needs, business domain knowledge and cluster control strategies to generate corresponding control prompts in real time. These control prompts are used as inputs to the large language model for cluster control, and real-time feedback is obtained with the help of the content analysis capability of the large language model. Cluster control through this real-time feedback mechanism can achieve the purpose of real-time control, thereby improving the control efficiency of the cluster.
[0053] The embodiments of the present application provide a cluster control method, apparatus, device and storage medium for non-containerized deployment, which are specifically illustrated by the following embodiments. First, the cluster control method for non-containerized deployment in the embodiments of the present application is described.
[0054] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Among them, artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that the machines have the functions of perception, reasoning and decision-making.
[0055] Artificial intelligence technology is a comprehensive discipline that covers a wide range of fields, including both hardware-level and software-level technologies. The basic technologies of artificial intelligence generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics and other technologies. Artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.
[0056] The cluster control method of non-containerized deployment provided in the embodiment of the present application relates to the field of computer technology. The cluster control method of non-containerized deployment provided in the embodiment of the present application can be applied to a terminal, can also be applied to a server side, and can also be a computer program running in a terminal or a server side. For example, the computer program can be a native program or software module in an operating system; it can be a local (Native) application (APP, Application), that is, a program that needs to be installed in the operating system to run, such as a client that supports cluster control of non-containerized deployment, or it can be a small program, that is, a program that can be run only by downloading it to a browser environment; it can also be a small program that can be embedded in any APP. In short, the above-mentioned computer program can be any form of application, module or plug-in. Among them, the terminal communicates with the server via a network. The cluster control method of non-containerized deployment can be executed by a terminal or a server, or by a terminal and a server in collaboration.
[0057] In some embodiments, the terminal may be a smart phone, a tablet computer, a laptop computer, a desktop computer or a smart watch. The server may be an independent server, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms; or a service node in a blockchain system, wherein each service node in the blockchain system forms a peer-to-peer (P2P, PeerTo Peer, P2P) network, and the P2P protocol is an application layer protocol running on the Transmission Control Protocol (TCP) protocol. The terminal and the server may be connected via Bluetooth, Universal Serial Bus (USB) or a network or other communication connection methods, which are not limited in this embodiment.
[0058] The present application can be used in many general or special computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in distributed computing environments, in which tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media including storage devices.
[0059] It should be noted that in each specific implementation of the present application, when it comes to the need to perform relevant processing based on data related to user identity or characteristics such as user information, user behavior data, user historical data, and user location information, the user's permission or consent will be obtained first, and the collection, use, and processing of these data will comply with the relevant laws, regulations, and standards of the relevant countries and regions. In addition, when the embodiment of the present application needs to obtain the user's sensitive personal information, the user's separate permission or consent will be obtained through a pop-up window or by jumping to a confirmation page. After clearly obtaining the user's separate permission or consent, the necessary user-related data for the normal operation of the embodiment of the present application will be obtained.
[0060] The following describes the implementation environment of the non-containerized deployment cluster control method of an embodiment of the present application.
[0061] Reference Figure 1 , Figure 1 It is a schematic diagram of the implementation environment of the non-containerized deployment cluster control method of an embodiment of the present application. Figure 1 The cluster system includes a cluster management unit, multiple service nodes and a cluster control language model.
[0062] In one embodiment, the cluster state management in the cluster management unit is responsible for interacting with all service nodes, collecting relevant state information reported by the service nodes, and obtaining scheduling decisions based on the control data returned by the cluster control large language model, and issuing corresponding scheduling instructions to the service nodes.
[0063] The cluster management unit also includes a status monitoring component, which is used to send relevant status information and other data to the cluster control large language model when cluster status monitoring is required, receive status monitoring related data returned by the cluster control large language model, and send the status monitoring related data as control data to the cluster management unit. The status monitoring related data may include the overall status monitoring data of the cluster, the node resource status monitoring data of the service node, and the business status monitoring data of the business task.
[0064] The cluster management unit also includes a scheduling control component, which is used to send relevant status information and other data to the cluster control large language model when cluster scheduling is required, receive cluster scheduling related data returned by the cluster control large language model, and send the cluster scheduling related data as control data to the cluster management unit. The cluster scheduling related data may include the overall scheduling data of the cluster, the node scheduling data of the service node, and the business status scheduling data of the business task.
[0065] In one embodiment, the service node includes service execution software, wherein the service execution software is responsible for the specific service execution work of the cluster and is strongly related to the service scenario executed by the cluster. The service software here is usually service software that needs to run for a long time and is a core component of key services, which has high requirements for system stability and resource management. In addition, each service software may need to process multiple different service tasks in parallel, so it is necessary to fairly and efficiently allocate and execute these tasks to ensure service continuity and performance optimization.
[0066] Furthermore, the service node also includes a state collection agent and a scheduling execution agent, wherein the state collection agent is used to collect node resource state information of the service node and the service state information corresponding to each service task. The scheduling execution agent is used to receive the corresponding scheduling instruction returned by the cluster management unit, and drive the service execution system to receive new tasks or stop target tasks.
[0067] In one embodiment, the cluster management unit can also automatically generate notification information such as status notifications or abnormal alarms based on status monitoring related data and push them to business-related users. These notification information may be sent via email, text messages or other instant messaging tools to ensure timely response, to ensure that the system administrator or operation and maintenance team can obtain the cluster's operating status and respond in a timely manner.
[0068] In one embodiment, cluster scheduling related data can also be reported and archived, and the archived results can be pushed to business-related users. By reporting and archiving each step of scheduling actions and scheduling results, subsequent performance analysis, audit tracking and system optimization are facilitated, and the system transparency and evaluability of non-containerized cluster deployment can be improved.
[0069] The following is based on Figure 1 The implementation scenario described in the description describes the cluster control method for non-containerized deployment in the embodiment of the present application.
[0070] Figure 2 is an optional flow chart of a cluster control method for non-containerized deployment provided in an embodiment of the present application. Figure 2 The method may include but is not limited to steps 110 to 140. It can also be understood that this embodiment Figure 2 The order of step 110 to step 140 is not specifically limited, and the order of steps can be adjusted or some steps can be reduced or added according to actual needs.
[0071] Step 110: Obtain node resource status information of the service node and service status information corresponding to each service task, and obtain cluster status data according to all the acquired node resource status information and service status information.
[0072] In one embodiment, considering that in actual applications, the execution progress and resource consumption patterns of different business tasks may change over time, the embodiment of the present application needs to be able to dynamically adjust the resource allocation strategy according to these changes during the scheduling process to achieve optimal resource utilization and efficient execution of tasks.
[0073] Combination Figure 1, the status collection agent implements continuous monitoring and data collection on the business nodes, and collects the real-time status information and business operation status of each business node in real time. Specifically, it collects status data related to node resources such as CPU usage, memory usage, disk space, and collects status data related to node tasks such as task execution progress data and error logs. And the collected node resource-related status data and node task-related status data are sent to the cluster control node. At this time, the cluster control node receives at least one of the CPU usage, memory usage or disk space sent by the business node as the node resource status information, and receives at least one of the task execution progress data, error log or load information of the business task sent by the business node as the business status information. Among them, the task execution progress data may include the CPU usage of the current process, the memory usage of the current process, the total number of task routes, etc.
[0074] It is understandable that the status data related to node resources and the status data related to node tasks are for illustration only, and these data need to be encrypted and security verified during transmission to ensure the integrity and security of data transmission.
[0075] Compared with the static resource allocation or optimization for specific scenarios in related technologies, the above real-time monitoring process can improve the flexibility and adaptability of the entire cluster scheduling control. When the workload corresponding to a business task changes, the status data related to the node task can be collected in real time to support the subsequent real-time adjustment of resource allocation to optimize performance and efficiency. In addition, the special needs of some high-resource-consuming business tasks such as large-scale machine learning models can be obtained through real-time collection, thereby improving the adaptability of the overall scheduling process.
[0076] Next, the cluster management system aggregates all data reported by each service node to ensure that all real-time monitoring data is sent to the cluster management unit. Specifically, the node resource status information and service status information are aggregated to obtain the initial status data, and then the initial status data is preliminarily analyzed to determine that there is no abnormality in the initial status data. The initial status data is preprocessed to obtain the intermediate status data, and the intermediate status data is encoded to obtain the cluster status data.
[0077] In one embodiment, the initial state data is first preliminarily analyzed to determine whether the initial state data has any anomalies. Here, the preliminary analysis can be performed by using an outlier detection method, and the initial state data is preprocessed after no obvious anomalies exist. Among them, data preprocessing includes data cleaning, deduplication, formatting, smoothing, etc., and the initial state data is optimized through data preprocessing to obtain intermediate state data. After obtaining the intermediate state data, a real-time updated state information library can also be established and maintained. The state information library includes data for each business node and is updated in real time according to the intermediate state data. After having a state information library, an overview of resource usage of the entire cluster can be generated based on the state information library, so as to more conveniently preliminarily identify any potential problems or abnormal situations.
[0078] In one embodiment, the intermediate state data needs to be encoded to obtain cluster state data, and the encoded cluster state data can be recognized by the cluster control large language model. Figure 3 , Figure 3 This is a schematic diagram of encoding intermediate state data to obtain cluster state data provided by an embodiment of the present application, which specifically includes the following steps:
[0079] Step 310: Generate a target format object consistent with the number of service nodes.
[0080] The target format object may be a JSON object, which includes a key-value pair with the same number of elements in the intermediate data state. The key-value pair includes a key and a value, wherein the key is used to indicate the state name in the intermediate data state, and the value is the specific value of the corresponding state name. For example, the keys in the intermediate data state include: node ID "nodeId", CPU usage "cpuUsage", memory usage "memoryUsage", disk space "totalStorage", available storage space "availableStorage", CPU usage of the current process "processCpuUsage", memory usage of the current process "processMemoryUsage", total task routes "totalTaskRoutes", etc. Taking the key of CPU usage "cpuUsage" as an example, the corresponding key-value pair is expressed as: "cpuUsage":"".
[0081] Step 320: Fill the intermediate state data corresponding to each business node into the key-value pair one by one, obtain the performance index of the business node, and obtain the cluster state data according to the performance index.
[0082] In a specific implementation, taking three service nodes as an example, three groups of intermediate data states are obtained. When the CPU usage rate in a group of intermediate data states is 45%, the filled key-value pair is expressed as: "cpuUsage": "45%". The performance index thus obtained is expressed as:
[0083] {"nodeId":"Node1",
[0084] "cpuUsage":"45%",
[0085] "memoryUsage":"70%",
[0086] "totalStorage":"1TB",
[0087] "availableStorage":"300GB",
[0088] "processCpuUsage":"25%",
[0089] "processMemoryUsage":"50%",
[0090] "totalTaskRoutes":20}
[0091] Furthermore, the cluster status data including the performance indicators of the three service nodes is expressed as:
[0092] {"clusterStatus":{
[0093] "nodes":[
[0094] {"nodeId":"Node1",
[0095] "cpuUsage":"45%",
[0096] "memoryUsage":"70%",
[0097] "totalStorage":"1TB",
[0098] "availableStorage":"300GB",
[0099] "processCpuUsage":"25%",
[0100] "processMemoryUsage":"50%",
[0101] "totalTaskRoutes":20},
[0102] {"nodeId":"Node2",
[0103] "cpuUsage":"60%",
[0104] "memoryUsage":"80%",
[0105] "totalStorage":"2TB",
[0106] "availableStorage":"500GB",
[0107] "processCpuUsage":"30%",
[0108] "processMemoryUsage":"60%",
[0109] "totalTaskRoutes":15},
[0110] {"nodeId":"Node3",
[0111] "cpuUsage":"55%",
[0112] "memoryUsage":"75%",
[0113] "totalStorage":"1.5TB",
[0114] "availableStorage":"700GB",
[0115] "processCpuUsage":"28%",
[0116] "processMemoryUsage":"55%",
[0117] "totalTaskRoutes":18}]}}
[0118] It is understandable that the cluster state data obtained after encoding in the embodiment of the present application retains semantic information, including rich states over a long time span, so the subsequent cluster control large language model can more accurately capture the relationship and dependency between tasks, thereby improving the accuracy and efficiency of cluster control. In addition, the above cluster state data is only for illustration, and does not mean that the encoding method of the embodiment of the present application is the only implementation method.
[0119] Step 120: Obtain the business domain and business requirements of the cluster, and select a target template from preset prompt word templates according to the business domain and business requirements.
[0120] In one embodiment, when the business domains of the clusters are different, it means that the workloads, application scenarios, and performance requirements undertaken by each cluster are different, so the specific contents of the corresponding status monitoring or scheduling control are also different. For example, a database cluster may focus on transaction processing speed and response time, while a video rendering cluster may be more concerned with GPU utilization and rendering quality. The embodiment of the present application takes into account the impact of the business domain on cluster control, and it is also necessary to obtain the business domain of the cluster. Next, different cluster controls correspond to different business requirements. For example, business requirements may be cluster status monitoring requirements or cluster scheduling requirements. Different business requirements also have different control data requirements for the cluster control large language model, so it is also necessary to obtain business requirements.
[0121] Since one purpose of the embodiment of the present application is to determine the control prompt words of the cluster control large language model, for the purpose of improving processing efficiency, preset prompt word templates that adapt to different business fields and business needs can be pre-built, and the preset prompt word templates can be used as the skeleton of data fusion. Among them, the preset prompt word templates in the prompt word template library are all sufficiently versatile to adapt to the business needs under various business fields. For example, templates suitable for computing task monitoring, templates suitable for storage task monitoring, templates suitable for computing task scheduling, or templates suitable for storage task scheduling, etc., the emphasis of the prompt words in each scenario is different, so the commonality is extracted as the preset prompt word template, thereby avoiding a large amount of manual repeated input.
[0122] In one embodiment, a corresponding preset prompt word template is selected as a target template according to the business field and business needs. In this case, the target template is a prompt word framework, wherein the target template prompts the user to enter relevant content in a similar manner to filling in the blanks. In addition, the preset prompt word template can be flexibly adjusted and adaptively optimized, that is, optimized according to the results of real-time feedback, so that it can continuously adapt to actual needs and environmental changes.
[0123] Step 130: Obtain the cluster control strategy, obtain the demand threshold information corresponding to the business demand, write the cluster control strategy, cluster status data and demand threshold information into the preset position of the target template, and obtain the control prompt words suitable for the business demand.
[0124] In one embodiment, since the cluster scheduling control process has different focuses, it is necessary to obtain a cluster control strategy to meet various scheduling requirements. Figure 4 , Figure 4 This is a flow chart of obtaining a cluster control strategy provided by an embodiment of the present application, which specifically includes the following steps:
[0125] Step 410: Obtain a focus factor including at least one of a time-space factor, a business node factor, and a business task factor.
[0126] Step 420: Determine key business nodes and / or key business tasks based on the concern factors, and obtain cluster control policies corresponding to the key business nodes and / or key business tasks.
[0127] In one embodiment, the time and space factors mainly involve the time window for the execution of business tasks or the geographical location of business nodes. For example, some business tasks may need to be completed within a specific time, and the geographical location of some business nodes may affect the delay of data transmission. Therefore, if the key factor is the time and space factor, one or more business tasks with time window requirements will be regarded as key business tasks, and the cluster control strategy can give priority to meeting the time window requirements of key business tasks. Or one or more business nodes that affect data transmission will be regarded as key business nodes. At this time, the cluster control strategy can schedule the tasks on the key business node to other business nodes that need to reduce delays.
[0128] In one embodiment, the service node factors include the resource usage, fault history, hardware configuration, etc. of the service node, which affect the execution efficiency and stability of the corresponding service tasks. Therefore, if the key factor is the service node factor, one or more service nodes that affect the execution of the service task will be regarded as key service nodes. The cluster control strategy can be to monitor the resource usage and abnormal conditions of the key service nodes, and avoid scheduling the corresponding service tasks to other service nodes when the scheduling requirements cannot be met.
[0129] In one embodiment, the business task factors include the resource requirements, priorities, dependencies, etc. of the business tasks, which affect the execution order and resource allocation of the business tasks. Therefore, if the key factor is the business task factor, multiple key business tasks can be determined according to the priority or dependency relationship, and the cluster control strategy can be that high-priority business tasks are scheduled first, while business tasks with dependencies need to be scheduled in the order of dependency. In addition, the embodiment of the present application can adaptively adjust the cluster control strategy when the business scenario is expanded, and has good generalization ability.
[0130] It is understandable that the purpose of the cluster control strategy is to ensure the systematicness and feasibility of the scheduling process and to meet the special needs of some special situation modifications, such as attention to special time points, attention to key tasks, etc. The above process illustrates the cluster control strategy, which does not mean that the embodiment of the present application only has the centralized cluster control strategy illustrated above.
[0131] Next, obtain the demand threshold information corresponding to the business requirements. Figure 5 , Figure 5 This is a flowchart of obtaining demand threshold information corresponding to a business demand provided by an embodiment of the present application, which specifically includes the following steps:
[0132] Step 510: Acquire cluster status threshold information related to the cluster, acquire node status threshold information related to the service node, and acquire task status threshold information related to the service task.
[0133] Step 520: Based on the business demand, demand threshold information is obtained according to at least one of cluster state threshold information, node state threshold information and task state threshold information.
[0134] In one embodiment, clusters, business nodes, and business tasks belong to different objects of interest, and their corresponding state thresholds also vary due to factors such as application load, time changes, and hardware performance. The state thresholds here are used to indicate the upper limits of the pressure values of different objects of interest, with the purpose of instructing the cluster control large language model not to exceed the corresponding upper limits during the content generation process to avoid control errors. Therefore, the embodiment of the present application obtains cluster state threshold information related to the cluster, node state threshold information related to the business node, and task state threshold information related to the business task, thereby obtaining the relevant thresholds of objects of interest at different levels, thereby performing overall dynamic regulation.
[0135] In one embodiment, the state thresholds of different objects of interest obtained above include all threshold data of the current object of interest under different business requirements, so it is also necessary to select demand threshold information corresponding to the business requirements according to the business requirements. For example, when the business requirement is a cluster status monitoring requirement, the cluster state threshold information in the demand threshold information may be: the resource usage of the cluster, etc.; the node state threshold information in the demand threshold information may be: the load, resource availability and historical performance data of each business node, etc.; the task state threshold information in the demand threshold information may be: the task completion degree and task error rate of each business task, etc. For example, when the business requirement is a cluster scheduling requirement, the cluster state threshold information in the demand threshold information may be: the health status of the cluster, the number of active shards, and the number of shards being initialized, migrated and unallocated, etc.; the node state threshold information in the demand threshold information may be: the resource usage of each business node, the query index index, etc.; the task state threshold information in the demand threshold information may be: the task performance index of each business task, etc. It can be understood that the above demand threshold information is only for illustration and does not represent a limitation.
[0136] Next, after obtaining the cluster control strategy, cluster status data and demand threshold information, these data are written into the preset position of the target template to obtain the control prompt words suitable for the business needs.
[0137] An example of a control prompt word is given below, where the target template is cluster status monitoring as a business requirement and cluster management as a business domain.
[0138] "Assume that you are a professional cluster manager and need to perform "cluster status monitoring (write business requirements here)" and "determine whether the cluster status is overloaded and whether each node in the cluster is overloaded, and give an overall status judgment of the cluster (write the goals corresponding to the business requirements here)". The following is the status of all nodes in the cluster currently collected (the cluster status data is written in the following location):
[0139] {"clusterStatus":{
[0140] "nodes":[
[0141] {"nodeId":"Node1",
[0142] "cpuUsage":"45%",
[0143] "memoryUsage":"70%",
[0144] "totalStorage":"1TB",
[0145] "availableStorage":"300GB",
[0146] "processCpuUsage":"25%",
[0147] "processMemoryUsage":"50%",
[0148] "totalTaskRoutes":20},
[0149] {"nodeId":"Node2",
[0150] "cpuUsage":"60%",
[0151] "memoryUsage":"80%",
[0152] "totalStorage":"2TB",
[0153] "availableStorage":"500GB",
[0154] "processCpuUsage":"30%",
[0155] "processMemoryUsage":"60%",
[0156] "totalTaskRoutes":15},
[0157] {"nodeId":"Node3",
[0158] "cpuUsage":"55%",
[0159] "memoryUsage":"75%",
[0160] "totalStorage":"1.5TB",
[0161] "availableStorage":"700GB",
[0162] "processCpuUsage":"28%",
[0163] "processMemoryUsage":"55%",
[0164] "totalTaskRoutes":18}]}}
[0165] The cluster status judgment includes the following conditions (the required threshold information is written in the following location):
[0166] 1) The CPU usage of a single node is not allowed to exceed 80%;
[0167] 2) The memory usage of a single node is not allowed to exceed 75%;
[0168] 3) The available storage space of a single node needs to be more than 300GB;
[0169] 4) The CPU usage of a single node process is not allowed to exceed 70%;
[0170] 5) The number of task paths for a single node is not allowed to exceed 20;
[0171] 6) The remaining storage space of the entire cluster is more than 2TB;
[0172] 7) The number of task paths in the entire cluster is not allowed to exceed 100;
[0173] In addition, "the first node is the cluster management unit, and its CPU usage is not allowed to exceed 60% and its memory usage is not allowed to exceed 70% (the cluster control policy is written here)."
[0174] Please refer to the above information to make a judgment on the cluster status."
[0175] It can be seen from the control prompt word examples given above that the control prompt words of the embodiments of the present application can be written into the cluster control strategy, cluster status data and demand threshold information based on the selected target template. Since the cluster control strategy, cluster status data and demand threshold information can be data acquired in real time, the generated control prompt words can be applied to scenarios with high response requirements, and provide real-time and dynamic guidance on the focus and analysis logic of the cluster control large language model in subsequent operations, thereby achieving flexibility and customization of the scheduling management process of non-containerized deployed clusters, and improving scheduling management efficiency and scope of application.
[0176] Step 140: Input the control prompt words into the pre-trained cluster control large language model to generate content and obtain cluster control data.
[0177] In one embodiment, after the control prompt word is obtained according to the above process, it is input into a pre-trained cluster control large language model for content generation to obtain the control data of the cluster. Among them, the control data is different due to different business needs. For example, when the business demand is a cluster status monitoring demand, the cluster control large language model is used to obtain at least one of the overall status monitoring data of the cluster, the node resource status monitoring data of the business node, and the business status monitoring data of the business task according to the control prompt word. Cluster status monitoring is the basis of cluster task scheduling, ensuring that the manager of the cluster system has real-time and comprehensive understanding of the status of the resources of each business node in the cluster and the running status of the corresponding business software.
[0178] In addition, when the business demand is a cluster scheduling demand, the cluster control large language model is used to obtain at least one of the overall scheduling data of the cluster, the node scheduling data of the business node, and the business status scheduling data of the business task according to the control prompt word. Cluster scheduling is the core hub to ensure the efficient operation of the cluster and ensure that the cluster system adapts to the changing resource environment and business needs. The embodiment of the present application analyzes the comprehensive state of the cluster based on the cluster control large language model, and performs a comprehensive analysis based on the different state thresholds of each object of concern and the cluster control strategy, thereby forming reasonable scheduling data.
[0179] In one embodiment, after receiving the corresponding control data, the cluster management unit may analyze the status detection result or perform a corresponding scheduling process according to actual needs.
[0180] Reference Figure 6 , Figure 6 It is a schematic diagram of a cluster control method for non-containerized deployment provided in an embodiment of the present application. Figure 6In the example of cluster status monitoring demand as a business demand, different business nodes send node resource status information and business status information to the cluster management unit. The cluster management unit receives the node resource status information and business status information of each node through the status monitoring component to obtain cluster status data, and generates control prompt words based on the target template according to the cluster control strategy, cluster status data and demand threshold information. Among them, the cluster control strategy is generated based on at least one of the time and space factors, business node factors, and business task factors as the focus factor. And the demand threshold information is generated based on the cluster status threshold information, node status threshold information and task status threshold information. Next, the control prompt words are sent to the cluster control large language model for content generation. The cluster control large language model makes a comprehensive judgment based on the control prompt words, and gives at least one of the overall status monitoring data of the cluster, the node resource status monitoring data of the business node, and the business status monitoring data of the business task. In addition, the cluster control large language model can also generate a monitoring report in a predetermined format with these data as control data, and return it to the cluster management unit through the status monitoring component.
[0181] Reference Figure 7 , Figure 7 This is another schematic diagram of the non-containerized deployment cluster control method provided in an embodiment of the present application. Figure 7 In the example of cluster scheduling demand as a business demand, different business nodes send node resource status information and business status information to the cluster management unit. The cluster management unit receives the node resource status information and business status information of each node through the scheduling control component to obtain cluster status data, and generates control prompt words based on the target template according to the cluster control strategy, cluster status data and demand threshold information. Among them, the cluster control strategy is generated based on at least one of the time and space factors, business node factors, and business task factors as the focus factor. And the demand threshold information is generated based on the cluster status threshold information, node status threshold information and task status threshold information. Next, the control prompt words are sent to the cluster control large language model for content generation. The cluster control large language model makes a comprehensive judgment based on the control prompt words and gives at least one of the overall scheduling data of the cluster, the node scheduling data of the business node, and the business status scheduling data of the business task. In addition, the cluster control large language model can also generate a pre-scheduling report in a predetermined format with these data as control data, and return it to the cluster management unit through the scheduling control component. The cluster management unit can generate specific scheduling instructions based on the pre-scheduling report and send them to the corresponding business nodes to instruct them to perform corresponding tasks, including tasks starting, stopping, migrating and other operations, to achieve the optimization goals defined by the strategy.
[0182] It can be seen from the above that the embodiments of the present application can perform cluster control of multiple business nodes and multiple business tasks in a non-containerized deployed cluster, perform control according to the real-time data corresponding to the cluster, have high real-time performance, and can flexibly adapt to changing workloads and complex computing environments, thereby improving the resource utilization and task processing capabilities of the cluster.
[0183] The technical solution provided by the embodiment of the present application is obtained by obtaining the node resource status information of the business node and the business status information corresponding to each business task, and obtaining the cluster state data according to all the node resource status information and business status information obtained, obtaining the business field and business demand of the cluster, and selecting the target template from the preset prompt word template according to the business field and business demand, obtaining the cluster control strategy, obtaining the demand threshold information corresponding to the business demand, writing the cluster control strategy, cluster state data and demand threshold information into the preset position of the target template, obtaining the control prompt words applicable to the business demand, inputting the control prompt words into the pre-trained cluster control large language model for content generation, and obtaining the control data of the cluster. The embodiment of the present application obtains the node-related state and task-related state in the cluster in real time, and uses these state data and current business demand, business field knowledge and cluster control strategy to generate corresponding control prompt words in real time. These control prompt words are used as the input of the cluster control large language model, and real-time feedback is obtained by means of the content analysis ability of the large language model. Cluster control is carried out by this real-time feedback mechanism, and the purpose of real-time control can be achieved, thereby improving the control efficiency of the cluster.
[0184] The present application also provides a cluster control device for non-containerized deployment, which can implement the above-mentioned cluster control method for non-containerized deployment, referring to Figure 8 , the device comprises:
[0185] The status data acquisition module 810 is used to acquire the node resource status information of the service node and the service status information corresponding to each service task, and obtain the cluster status data according to all the acquired node resource status information and service status information.
[0186] The target template selection module 820 is used to obtain the business domain and business requirements of the cluster, and select a target template from the preset prompt word templates according to the business domain and business requirements.
[0187] Prompt word generation module 830: used to obtain cluster control strategy, obtain demand threshold information corresponding to business demand, write cluster control strategy, cluster status data and demand threshold information into the preset position of the target template, and obtain control prompt words suitable for business demand.
[0188] Content generation module 840: used to input control prompt words into a pre-trained cluster control large language model to generate content and obtain cluster control data.
[0189] The specific implementation of the non-containerized cluster control device of this embodiment is basically the same as the specific implementation of the non-containerized cluster control method described above, and will not be repeated here.
[0190] The present application also provides an electronic device, including:
[0191] at least one memory;
[0192] at least one processor;
[0193] at least one program;
[0194] The program is stored in the memory, and the processor executes the at least one program to implement the cluster control method for non-containerized deployment implemented in the present application. The electronic device can be any intelligent terminal including a mobile phone, a tablet computer, a personal digital assistant (PDA), a car computer, etc.
[0195] See also Fig. 9 , Fig. 9 The hardware structure of an electronic device of another embodiment is illustrated, and the electronic device includes:
[0196] The processor 901 may be implemented by a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application;
[0197] The memory 902 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 902 can store an operating system and other applications. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 902, and the processor 901 calls and executes the cluster control method for non-containerized deployment of the embodiment of the present application;
[0198] Input / output interface 903, used to implement information input and output;
[0199] Communication interface 904, used to realize communication interaction between the device and other devices, which can be realized by wired means (such as USB, network cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.); and
[0200] A bus 905 that transmits information between various components of the device (e.g., the processor 901, the memory 902, the input / output interface 903, and the communication interface 904);
[0201] The processor 901 , the memory 902 , the input / output interface 903 and the communication interface 904 are connected to each other in communication within the device via a bus 905 .
[0202] An embodiment of the present application further provides a storage medium, which is a storage medium storing a computer program. When the computer program is executed by a processor, the above-mentioned non-containerized deployment cluster control method is implemented.
[0203] As a non-transitory storage medium, the memory can be used to store non-transitory software programs and non-transitory computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one disk storage device, a flash memory device, or other non-transitory solid-state storage device. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0204] The cluster control method, device, equipment and storage medium of the non-containerized deployment proposed in the embodiment of the present application, by obtaining the node resource status information of the business node and the business status information corresponding to each business task, and obtaining the cluster status data according to all the node resource status information and business status information obtained, obtaining the business field and business demand of the cluster, and selecting the target template from the preset prompt word template according to the business field and business demand, obtaining the cluster control strategy, obtaining the demand threshold information corresponding to the business demand, writing the cluster control strategy, cluster state data and demand threshold information into the preset position of the target template, obtaining the control prompt word applicable to the business demand, inputting the control prompt word into the pre-trained cluster control large language model for content generation, and obtaining the control data of the cluster. The embodiment of the present application obtains the node-related state and task-related state in the cluster in real time, and uses these state data and the current business demand, business field knowledge and cluster control strategy to generate the corresponding control prompt word in real time. These control prompt words are used as the input of the large language model of cluster control, and the content analysis ability of the large language model is used to obtain real-time feedback. Cluster control can achieve the purpose of real-time control through this real-time feedback mechanism, thereby improving the control efficiency of the cluster.
[0205] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0206] Those skilled in the art will appreciate that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.
[0207] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0208] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.
[0209] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0210] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.
[0211] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0212] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0213] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0214] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store programs.
[0215] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the rights of the present invention is not limited thereto. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present invention should be within the scope of the rights of the present invention.
Claims
1. A cluster control method for non-containerized deployment, characterized in that: The cluster includes a plurality of service nodes, each of which is used to process at least one service task simultaneously. The method includes: Acquire node resource status information of the service node and service status information corresponding to each service task, and obtain cluster status data according to all the acquired node resource status information and service status information; Acquire the business domain and business requirements of the cluster, and select a target template from preset prompt word templates according to the business domain and business requirements; Acquire a cluster control strategy, acquire demand threshold information corresponding to the business demand, write the cluster control strategy, the cluster status data and the demand threshold information into a preset position of the target template, and obtain a control prompt word suitable for the business demand; The control prompt words are input into a pre-trained cluster control large language model for content generation to obtain control data of the cluster.
2. The cluster control method for non-containerized deployment according to claim 1, characterized in that: The obtaining of cluster status data according to all the node resource status information and the business status information includes: Summarizing the node resource status information and the service status information to obtain initial status data; After performing a preliminary analysis on the initial state data and determining that the initial state data does not have an abnormality, performing data preprocessing on the initial state data to obtain intermediate state data, and encoding the intermediate state data to obtain the cluster state data.
3. The cluster control method for non-containerized deployment according to claim 2, characterized in that: The step of encoding the intermediate state data to obtain the cluster state data includes: Generate a target format object that is consistent with the number of the service nodes, wherein the target format object includes key-value pairs that are consistent with the number of elements in the intermediate data state; The intermediate state data corresponding to each of the service nodes is filled into the key-value pairs one by one to obtain the performance index of the service node, and the cluster state data is obtained according to the performance index.
4. The cluster control method for non-containerized deployment according to claim 1, characterized in that: The obtaining of the cluster control strategy includes: Obtaining a focus factor including at least one of a time-space factor, a business node factor, and a business task factor; Based on the concern factors, key business nodes and / or key business tasks are determined, and the cluster control strategy corresponding to the key business nodes and / or the key business tasks is acquired.
5. The cluster control method for non-containerized deployment according to claim 1, characterized in that: The obtaining demand threshold information corresponding to the business demand includes: Acquire cluster state threshold information related to the cluster, acquire node state threshold information related to the service node, and acquire task state threshold information related to the service task; Based on the business demand, the demand threshold information is obtained according to at least one of the cluster state threshold information, the node state threshold information and the task state threshold information.
6. The cluster control method for non-containerized deployment according to claim 1, characterized in that: The step of inputting the control prompt words into a pre-trained cluster control large language model for content generation to obtain control data of the cluster includes: When the business demand is a cluster status monitoring demand, at least one of the overall status monitoring data of the cluster, the node resource status monitoring data of the business node, and the business status monitoring data of the business task is obtained according to the control prompt word using the cluster control large language model; When the business demand is a cluster scheduling demand, the cluster control large language model is used to obtain at least one of the overall scheduling data of the cluster, the node scheduling data of the business node, and the business status scheduling data of the business task according to the control prompt word.
7. The cluster control method for non-containerized deployment according to any one of claims 1 to 6, characterized in that: The acquiring the node resource status information of the service node and the service status information corresponding to each of the service tasks includes: Receiving at least one of CPU usage, memory occupancy or disk space sent by the service node as the node resource status information; At least one of task execution progress data, error log or load information of the business task sent by the business node is received as the business status information.
8. A cluster control device for non-containerized deployment, characterized in that: The cluster includes a plurality of service nodes, each of which is used to process at least one service task simultaneously. The device includes: Status data acquisition module: used to acquire node resource status information of the service node and service status information corresponding to each service task, and obtain cluster status data according to all acquired node resource status information and service status information; Target template selection module: used for obtaining the business domain and business requirements of the cluster, and selecting a target template from preset prompt word templates according to the business domain and business requirements; Prompt word generation module: used to obtain the cluster control strategy, obtain the demand threshold information corresponding to the business demand, write the cluster control strategy, the cluster state data and the demand threshold information into the preset position of the target template, and obtain the control prompt word suitable for the business demand; Content generation module: used for inputting the control prompt words into the pre-trained cluster control large language model to generate content and obtain the control data of the cluster.
9. An electronic device, characterized in that: The electronic device includes a memory and a processor, the memory stores a computer program, and the processor implements the cluster control method for non-containerized deployment as described in any one of claims 1 to 7 when executing the computer program.
10. A storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the non-containerized deployment cluster control method according to any one of claims 1 to 7 is implemented.
Citation Information
Cited By
Configuration method and device of storage cluster, electronic equipment and storage medium
CN120762781A
CDN (Content Delivery Network) traffic scheduling method and device, electronic equipment and storage medium
CN121644460A
