Method and device for generating network operation and maintenance scheme

Abstract

The invention discloses a method and a device for generating a network operation and maintenance scheme, and belongs to the technical field of communication. According to the method, based on a large language model, a processing flow of a network operation and maintenance task described through a natural language is converted into a network operation and maintenance scheme capable of being executed by a network operation and maintenance system, and the network operation and maintenance task can be completed by executing the network operation and maintenance scheme through the network operation and maintenance system subsequently. A user does not need to write a script program of each subtask of the network operation and maintenance task, and the network operation and maintenance efficiency is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of communication, in particular to a network operation scheme generation method and device. BACKGROUND

[0002] For a network composed of multiple network devices, a user (such as an operation and maintenance personnel) performs a network operation task on the network to ensure the normal operation, efficient performance and security of the network. In related technologies, the execution process of the network operation task can be: for a network operation task to be executed, assuming that the network operation task includes multiple sub-tasks, the user triggers the network operation system to execute the multiple sub-tasks on the network according to the execution order of the multiple sub-tasks in the network operation task by performing certain operations to complete the network operation task, such as, for each sub-task, the user writes the processing flow of the sub-task into a script program, takes the script program written out as the network operation scheme of the sub-task, and executes the network operation scheme through the network operation system to implement the execution of the sub-task on the network.

[0003] However, in the above execution process of the network operation task, the user needs to trigger the network operation system to execute each sub-task of the network operation task by performing certain operations, and the user also needs to write the processing flow of each sub-task into a script program, which increases the execution time of the network operation task and reduces the network operation efficiency. Moreover, if the user's programming proficiency is not enough or the user is not familiar with the processing flow of the network operation task / sub-task, the script program will increase the writing time, thereby further increasing the execution time of the network operation task and further reducing the network operation efficiency. SUMMARY

[0004] Embodiments of the present application provide a network operation scheme generation method and device, which can improve the network operation efficiency of the network operation system. The technical solution is as follows:

[0005] In a first aspect, a network operation scheme generation method is provided, which involves network operation experience including the processing flow obtained by the user performing a network operation task. In the method, network operation experience described by natural language is obtained, and then a network operation scheme for execution by a network operation system is obtained based on a large language model and the network operation experience, the network operation scheme corresponding to a network operation task.

[0006] The method converts the processing flow of the network operation task described by natural language into a network operation scheme executable by the network operation system based on the large language model, and then the network operation task can be completed by executing the network operation scheme through the network operation system without the user writing script programs for each sub-task of the network operation task, thereby improving the network operation efficiency.

[0007] In a possible implementation, the obtaining, based on the large language model and the network operation experience, of a network operation scheme for execution by the network operation system includes: performing operation task analysis on the network operation experience based on the large language model to obtain a plurality of subtasks of the network operation task and a target dependency relationship; and arranging, based on the large language model, network operation sub-schemes corresponding to the plurality of subtasks according to the target dependency relationship to obtain the network operation scheme. The target dependency relationship is a dependency relationship between the plurality of subtasks in a processing flow.

[0008] Based on the above possible implementation, the subtasks of the network operation task and the dependency relationship between the subtasks are analyzed based on the large language model, and the network operation sub-schemes of the subtasks are arranged into the network operation scheme according to the target dependency relationship, so that the arranged network operation scheme can implement the subtasks in the network operation task.

[0009] In a possible implementation, the operation task analysis on the network operation experience based on the large language model to obtain the plurality of subtasks of the network operation task and the target dependency relationship includes: decomposing the network operation experience based on the large language model to obtain description information of the plurality of subtasks; and performing dependency relationship analysis on the network operation experience based on the large language model to obtain the target dependency relationship.

[0010] Based on the above possible implementation, the network operation experience is decomposed to accurately obtain each subtask of the network operation task, and the dependency relationship analysis is performed to analyze the dependency relationship between each subtask of the network operation task, so as to subsequently arrange the network operation sub-schemes of the subtasks into an accurate network operation scheme according to the dependency relationship.

[0011] In a possible implementation, the dependency relationship analysis on the network operation experience based on the large language model to obtain the target dependency relationship includes: analyzing, based on the large language model, an execution order of the plurality of subtasks in the network operation experience; and determining the target dependency relationship based on the execution order of the plurality of subtasks.

[0012] Based on the above possible implementation, the dependency relationship between the subtasks of the network operation task can be accurately determined based on the execution order of the plurality of subtasks in the network operation experience, so as to subsequently arrange the network operation sub-schemes of the subtasks into an accurate network operation scheme according to the dependency relationship.

[0013] In a possible implementation, the obtaining of the network operation experience described in the natural language includes: obtaining a processing flow through a first input box of a task editing interface, the task editing interface being used for a user to input the network operation experience.

[0014] In a possible implementation, the network operation experience further includes task description information of the network operation task, and the obtaining the network operation experience described by the natural language includes:

[0015] The processing flow is obtained through a first input box of the task editing interface, and the task editing interface is used for the user to input the network operation experience.

[0016] The task description information of the network operation task is obtained through a second input box of the task editing interface.

[0017] Based on the above possible implementation, a man-machine interaction interface is provided for the user to input the network operation experience to the background through the man-machine interaction interface, so that the background automatically generates the network operation scheme for the network operation task based on the network operation experience input by the user.

[0018] In a possible implementation, after the network operation scheme for the network operation system to execute is obtained, the method further includes: outputting the network operation scheme; and in response to a confirmation operation on the network operation scheme, associating the network operation scheme with the task description information of the network operation task, the confirmation operation indicating that the network operation scheme is confirmed to be used to implement the network operation task.

[0019] Based on the above possible implementation, the network operation scheme confirmed by the user can be obtained, and the accuracy of the network operation scheme can be ensured, so that the network operation system can run the network operation scheme.

[0020] In a possible implementation, after the network operation scheme for the network operation system to execute is obtained, the method further includes: obtaining an input dialogue message, the dialogue message including a network operation intention described by the natural language; in response to the network operation intention matching the task description information of the network operation task, calling the network operation scheme and running the network operation scheme in the network operation system; and outputting an execution result of the network operation task.

[0021] Based on the above possible implementation, the user only needs to provide the dialogue message in the form of a dialogue, without the need for multiple interactions with the network operation system, and the operation process is simple, thereby improving the network operation efficiency.

[0022] In a possible implementation, after the network operation scheme for the network operation system to execute is obtained, the method further includes: receiving network alarm information, the network alarm information indicating an abnormal situation occurring in the network; in response to the abnormal situation matching the task description information of the network operation task, calling the network operation scheme and running the network operation scheme in the network operation system; and outputting an execution result of the network operation task.

[0023] Based on the above possible implementation methods, when an anomaly occurs in the network, network operation and maintenance tasks related to the anomaly can be automatically executed to resolve or alleviate the anomaly in the network without waiting for manual handling, thereby improving the network operation and maintenance efficiency of the network operation and maintenance system.

[0024] In one possible implementation, after obtaining the network operation and maintenance plan for execution by the network operation and maintenance system, the method further includes: in response to a modification operation on the network operation and maintenance experience, obtaining the modified network operation and maintenance experience; and based on the large language model and the modified network operation and maintenance experience, obtaining the modified network operation and maintenance plan and updating the network operation and maintenance plan.

[0025] Based on the above possible implementation methods, when there is a need to modify the processing flow of network operation and maintenance tasks, users can simply modify their network operation and maintenance experience without having to perform any other operations, thereby improving network operation and maintenance efficiency.

[0026] In one possible implementation, after obtaining the network operation and maintenance plan for execution by the network operation and maintenance system, the method further includes: in response to a modification operation of the network operation and maintenance plan, obtaining the modified network operation and maintenance plan; in response to a confirmation operation of the modified network operation and maintenance plan, associating the modified network operation and maintenance plan with the task description information of the network operation and maintenance task, and the confirmation operation instructing the confirmation that the network operation and maintenance plan is used to implement the network operation and maintenance task.

[0027] Based on the above possible implementation methods, if there is a need to modify the processing flow of network operation and maintenance tasks, users can simply modify the network operation and maintenance plan without having to perform any other operations, thereby improving network operation and maintenance efficiency.

[0028] Secondly, a network operation and maintenance scheme generation apparatus is provided for executing the method provided in the first aspect or any optional mode of the first aspect.

[0029] Thirdly, a computer device is provided, the computer device including a processor for executing program code, causing the computer device to perform a method as provided in the first aspect above or any alternative method of the first aspect above.

[0030] Fourthly, a computer-readable storage medium is provided, wherein at least one piece of program code is stored therein, the program code being read by a processor to cause a computer device to perform the method provided as described in the first aspect or any alternative method of the first aspect.

[0031] Fifthly, a computer program product or computer program is provided, the computer program product or computer program including program code stored in a computer-readable storage medium, a processor reading the program code from the computer-readable storage medium, the processor executing the program code, causing a computer device to perform the method provided in the first aspect or various optional implementations of the first aspect.

[0032] Based on the implementation methods provided in the above aspects, this application can be further combined to provide more implementation methods. Attached Figure Description

[0033] Figure 1 This is a schematic diagram of the implementation environment of a network operation and maintenance system provided in an embodiment of this application;

[0034] Figure 2 This is a flowchart illustrating a method for generating a network operation and maintenance solution provided in an embodiment of this application;

[0035] Figure 3 This is a schematic diagram of a task editing interface provided in an embodiment of this application;

[0036] Figure 4 This is a network operation and maintenance interaction flowchart based on a large language model provided in an embodiment of this application;

[0037] Figure 5 This is a schematic diagram of a program display interface provided in an embodiment of this application;

[0038] Figure 6 This is a schematic diagram of a result display interface provided in an embodiment of this application;

[0039] Figure 7 This is a flowchart of a method for generating another network operation and maintenance solution provided in an embodiment of this application;

[0040] Figure 8 This is a flowchart of a method for generating another network operation and maintenance solution provided in an embodiment of this application;

[0041] Figure 9 This is a schematic diagram of a session interface provided in an embodiment of this application;

[0042] Figure 10 This is a schematic diagram of a task display interface provided in an embodiment of this application;

[0043] Figure 11 This is a schematic diagram of the structure of a network operation and maintenance solution generation device provided in an embodiment of this application;

[0044] Figure 12 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0045] To facilitate understanding of the technical solutions proposed in this application, the following explanations are provided for some of the terms used in this application:

[0046] Large language models (LLMs) are computer models capable of processing and generating natural language. LLMs are a deep learning-based artificial intelligence technique that predicts the next word or sentence by learning statistical patterns and semantic information from language data. LLMs typically consist of multiple neural networks (such as feedforward neural networks and recurrent neural networks). Feedforward neural networks are used for feature extraction from the input text, while recurrent neural networks are used to model the text sequence. By continuously training on large amounts of text data, LLMs can gradually improve their ability to understand and predict natural language. With the improvement of LLM capabilities, they can be applied to various fields, such as natural language processing, machine translation, text generation, robotics, machine learning, speech recognition, and image processing. Therefore, LLMs can also be called multimodal large language models (MLLMs).

[0047] Network operations and maintenance (O&M) is short for network operation and maintenance. It refers to a series of tasks including planning, deployment, monitoring, maintenance, optimization, and troubleshooting of network infrastructure, network equipment, network systems, and network applications.

[0048] Network operation and maintenance tasks are tasks performed to complete network operation and maintenance. Operation and maintenance personnel execute these tasks to ensure network stability, security, availability, and efficiency, thereby meeting the needs of daily network operation and business development. There are various types of network operation and maintenance tasks, such as planning, deployment, monitoring, maintenance, optimization, and troubleshooting. These tasks are used to perform network planning, service deployment, performance monitoring, performance maintenance, performance optimization, and troubleshooting on at least one of the network infrastructure, network devices, network systems, and network applications. Different network operation and maintenance tasks may have different or the same task types. This application embodiment does not limit the task types of the network operation and maintenance tasks described herein.

[0049] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0050] Figure 1 This is a schematic diagram of the implementation environment of a network operation and maintenance system provided in an embodiment of this application. See also... Figure 1The implementation environment includes a network 11, a network operation and maintenance system 12, and a terminal 13. The network 11 includes at least one network device 111. Figure 1 The example shown is that network 11 includes two network devices 11, but the number of network devices 11 in network 11 is not limited to two, but can also be one or more. Here, the embodiment of this application does not limit the number of network devices 111 in network 11.

[0051] Network device 111 may be a network element device, a computing device, or a storage device. This application embodiment does not limit the type of network device 111. When network 11 includes multiple network devices 111, if a network device 111 is a network element device, then network 11 is a communication network for providing communication functions. If a network device 111 is a computing device, then network 11 is a cluster of computing devices for providing computing functions. If a network device 111 is a storage device, then network 11 is a cluster of storage devices for providing data storage functions. Network 11 may or may not be deployed in the cloud (private cloud or public cloud). This application embodiment does not limit the deployment environment of network 11.

[0052] The network operation and maintenance system 12 is used to provide network operation and maintenance services for network devices 111 in the network 11. For example, the network operation and maintenance system 12 ensures the normal operation, high efficiency, and security of the network 11 by performing network operation and maintenance tasks on the network 11. The network operation and maintenance system 12 may be a network cloud engine (NCE). In other embodiments, the network operation and maintenance system 12 may also be other systems for managing and maintaining the network 11 besides NCE, such as operation support systems (OSS), element management systems (EMS), or network management systems (NMS). Here, the type of network operation and maintenance system 12 is not limited in this application embodiment.

[0053] like Figure 1As shown, the network operation and maintenance system 12 includes a network management module 121, a control module 122, and a large language model 123. The network management module 121 has the capability to perform network operation and maintenance on the network 11, managing and / or maintaining the resources of the network 11, such as hardware resources, software resources, and service resources. Hardware resources refer to the hardware resources of the network 11, software resources refer to the software resources of the network 11, and service resources refer to the resources of the services provided by the network 11, such as computing resources, storage resources, and communication resources. Communication resources refer to resources related to the communication of the network 11, such as network bandwidth, network latency, network packet loss, and network infrastructure. Network infrastructure refers to all hardware and software used to support network communication.

[0054] Terminal 13 is an electronic device used by a user (such as the maintenance personnel of network 11), such as at least one of smartphones, tablets, personal computers, laptops, and desktop computers. Here, the embodiments of this application do not limit the device type or number of terminals 13.

[0055] Terminal 13 has an application (referred to as the network operation and maintenance application) installed and running. The control module 122 provides background computing services for the network operation and maintenance application. Users can trigger the control module 122 to perform network operation and maintenance tasks on network 11 through the network operation and maintenance application in terminal 122. The control module 122 can call the network management module 121 to perform network operation and maintenance tasks on network 11.

[0056] For example, the process of a user performing network operation and maintenance tasks described in natural language is called network operation and maintenance experience. The user can input network operation and maintenance experience into the network operation and maintenance application on terminal 13. Terminal 13 imports the input network operation and maintenance experience into control module 122 through the network operation and maintenance application. Control module 122 compiles the imported network operation and maintenance experience into a network operation and maintenance plan that network operation and maintenance system 12 can execute through large language model 123. Then, control module 122 calls network management module 121 to run the network operation and maintenance plan, so that network management module 121 performs network operation and maintenance tasks on network 11. Thus, when the user provides network operation and maintenance experience to network operation and maintenance system 12, network operation and maintenance system 12 can be triggered to automatically complete network operation and maintenance tasks. Alternatively, after compiling network operation and maintenance experience into a network operation and maintenance plan, the control module 122 can also distribute the network operation and maintenance plan to the network management module 121. The network management module 121 establishes a correspondence between network operation and maintenance tasks and network operation and maintenance plans. When the network device 111 reports network alarm information to the network management module 121, if the abnormal situation of the network 11 indicated by the network alarm information is related to the network operation and maintenance task, the network management module 121 runs the network operation and maintenance plan corresponding to the network operation and maintenance task to perform the network operation and maintenance task on the network 11 to resolve the abnormal situation.

[0057] The large language model 123 is a language model used in the field of network operation and maintenance. The large language model 123 is trained based on network operation and maintenance experience and basic large language models in the field of communication. This enables the large language model 123 to analyze the sub-tasks of network operation and maintenance tasks and the dependencies between sub-tasks based on network operation and maintenance experience, and to arrange the processing flow of network operation and maintenance tasks into a network operation and maintenance solution that can be executed by the network management module 121 based on the function library supported by the network management module 121 and the dependencies between sub-tasks.

[0058] Next, based on the implementation environment described above, the process of generating a network operation and maintenance solution will be introduced.

[0059] Figure 2 This is a flowchart of a method for generating a network operation and maintenance solution provided in an embodiment of this application. The method includes the following steps.

[0060] 201. The terminal obtains network operation and maintenance experience described in natural language. The network operation and maintenance experience includes the processing flow obtained by the user when performing network operation and maintenance tasks.

[0061] The network operation and maintenance task refers to any network operation and maintenance task for a network (such as network 11). The network operation and maintenance task may not include subtasks or may include multiple subtasks. Subtasks are network operation and maintenance tasks with smaller granularity than the network operation and maintenance task. The task types of different subtasks may be the same or different. Here, the embodiments of this application do not limit the number and task types of subtasks in the network operation and maintenance task.

[0062] The processing flow obtained by a user when performing network operation and maintenance tasks refers to the process by which a user executes network operation and maintenance tasks within the network operation and maintenance system. It represents the user's experience in performing these tasks; therefore, network operation and maintenance experience refers to the user's experience with network operation and maintenance tasks, described using natural language. For example, network operation and maintenance experience includes process description information for the network operation and maintenance task. This process description information is a natural language description of the user's execution of the task, and can be text-based. Within the network operation and maintenance experience, each subtask of the task and its execution order within the task's processing flow are described using natural language. For instance, network operation and maintenance experience includes description information for each subtask and its execution order; the subtask description information is used to describe the subtasks using natural language. For example, suppose the network devices in the network include base stations, and the network maintenance task is "single base station out of service," with the purpose of diagnosing the root cause of a single base station failure. The network maintenance task "single base station out of service" includes subtasks 1-5. Subtask 1 is described as "querying the base station access network element based on the base station IP," subtask 2 is described as "querying the status of the base station access network element," subtask 3 is described as "performing offline diagnosis of the network element and determining the cause of the offline status," subtask 4 is described as "querying the ETH_LOS alarms of all connected links of the offline network element and comparing the occurrence time of the ETH_LOS alarms," ​​and subtask 5 is described as "querying yyyyy." Network maintenance experience for the task "single base station out of service" includes:

[0063] 1. Query the base station access network element based on the base station IP address;

[0064] 2. Query the status of the base station access network element:

[0065] If the network element is offline, perform offline diagnostics on the network element and execute step 3.

[0066] The network element is online; proceed to step 5.

[0067] 3. Perform offline diagnostics on network elements to determine the cause of their offline status:

[0068] Network element DCN offline, execution 5;

[0069] The network element went offline due to a network failure, so step 4 was executed.

[0070] 4. Query the ETH_LOS alarms of all connected links of this offline network element and compare the occurrence time of the ETH_LOS alarms:

[0071] Xxxxxx;

[0072] 5. Query yyyyy.

[0073] For a specific network operations and maintenance (O&M) task, users can use their own O&M experience to write the task's processing flow into a network O&M guide using natural language. Alternatively, users can consult the network's runbook for the corresponding network O&M guide for that task. The runbook records network O&M guides for multiple tasks related to that network.

[0074] Users can input network operation and maintenance experience into the terminal. The terminal obtains the network operation and maintenance experience input by the user. In some embodiments, the terminal obtains the processing flow obtained by the user when performing network operation and maintenance tasks through the first input box of the task editing interface. The task editing interface is used for users to input network operation and maintenance experience. For example, steps A1 and A2 below.

[0075] Step A1: The terminal displays the task editing interface, which includes a first input box for entering the process description information of the network operation and maintenance task.

[0076] The task editing interface is a human-computer interaction interface for network operation and maintenance applications, used to input network operation and maintenance experience. This experience includes a process description of the network operation and maintenance task and task information. The task information indicates the network operation and maintenance task and includes at least one of the following: task identifier, task type, and task description. The task identifier represents the network operation and maintenance task and can be the name or task number, etc. The task description is a brief summary of the task, briefly describing its purpose or the problem it can solve. In some embodiments, the network operation and maintenance experience does not include task information; instead, it consists of a process description of the task. The task information and the network operation and maintenance experience together constitute the information of the network operation and maintenance task.

[0077] For example, Figure 3 This is a schematic diagram of a task editing interface provided in an embodiment of this application, such as... Figure 3As shown, the task editing interface 300 includes a first input box 31, a second input box 32, a third input box 33, a fourth input box 34, and a compilation control 35. The second input box 32 is used to input the task description information of the network operation and maintenance task, the third input box 33 is used to input the task identifier of the network operation and maintenance task, and the fourth input box 34 is used to input the task type of the network operation and maintenance task.

[0078] Users can trigger the display of the task editing interface 300 on the terminal through the network operation and maintenance application, allowing them to input their network operation and maintenance experience. Taking the network operation and maintenance task "Single Base Station Deactivation" as an example, the user enters the process description information 311 of the network operation and maintenance task "Single Base Station Deactivation" in the first input box 31. For example, the user can edit the process description information 311 in the first input box 31, or the user can copy the process description information 311 of the network operation and maintenance task "Single Base Station Deactivation" from the operation manual to the first input box 31. The user enters the task description information 321 of the network operation and maintenance task "Single Base Station Deactivation" in the second input box 32 to briefly describe this network operation and maintenance task. The user also enters the name of the network operation and maintenance task in the third input box 33 as a task identifier, and selects the task type "Fault Diagnosis" from the multiple task types associated with the fourth input box 34 as the task type for the network operation and maintenance task "Single Base Station Deactivation" and enters it into the fourth input box 34.

[0079] Step A2: The terminal will retrieve the network operation and maintenance experience corresponding to the network operation and maintenance task from the information entered in the first input box.

[0080] The terminal extracts the process description information 311 entered by the user in the first input box 31 as network operation and maintenance experience. Alternatively, the terminal can also extract the task description information of the network operation and maintenance task through the second input box 32 of the task editing interface, and extract the task description information of the network operation and maintenance task from the task description information and the process description information 311 entered in the first input box 31.

[0081] by Figure 3For example, after a user enters information in each input box of the task editing interface 300, they trigger an operation on the compilation control 35 in the task editing interface 300. This triggering operation could be a click, a swipe, or similar action. In this embodiment, the triggering operation is not limited. The terminal responds to this triggering operation by acquiring the information entered in each input box of the task editing interface 300. It uses the information entered in the third input box 33 as the task identifier, the information entered in the first input box 31 as the process description information, the information entered in the fourth input box 34 as the task type, and the information entered in the second input box 32 as the task description information. The acquired task identifier, task type, and task description information are used as the task information for the network operation and maintenance task. The acquired process description information is used as the network operation and maintenance experience entered by the user. Alternatively, the task information and the acquired process description information can be used as the network operation and maintenance experience entered by the user.

[0082] Steps A1 and A2 above provide users with a human-computer interaction interface, allowing users to input network operation and maintenance experience into the backend through the human-computer interaction interface, so that the backend can automatically generate network operation and maintenance solutions for network operation and maintenance tasks based on the network operation and maintenance experience input by the user.

[0083] 202. The terminal sends network operation and maintenance experience described in natural language to the control module in the network operation and maintenance system.

[0084] by Figure 3 For example, when a user triggers the compilation control 35 in the task editing interface 300, the terminal responds to the triggering operation by using the process description information as network operation and maintenance experience, generating a compilation request based on the acquired task information and network operation and maintenance experience, and sending the compilation request to the server. The compilation request includes task information and network operation and maintenance experience to instruct the network operation and maintenance experience to be compiled.

[0085] At least one of the second input box 32, the third input box 33, and the fourth input box 34 in the task editing interface 300 is optional. In some other embodiments, the task editing interface 300 does not include the at least one item. Accordingly, after the terminal displays the task editing interface 300, the user will not input information in the at least one item, and the task information obtained by the terminal from the task editing interface 300 will not include the information input in the at least one item.

[0086] 203. The control module acquires network operation and maintenance experience described in natural language.

[0087] For example, the control module receives compilation requests sent by the terminal and obtains network operation and maintenance experience and task information from the compilation requests.

[0088] The above steps 201 to 203 are illustrated using the example of the terminal providing network operation and maintenance experience to the control module. In other embodiments, the control module has preset network operation and maintenance experience corresponding to at least one network operation and maintenance task. The control module can also obtain network operation and maintenance experience from the preset network operation and maintenance experience without obtaining network operation and maintenance experience from the terminal. In this case, the terminal does not need to execute the above steps 201 and 202.

[0089] 204. The control module, based on the large language model and network operation and maintenance experience, obtains a network operation and maintenance plan for the network operation and maintenance system to execute. This network operation and maintenance plan corresponds to the network operation and maintenance task.

[0090] The network operation and maintenance (O&M) plan is a compilation of the network O&M experience. It describes the processing flow of network O&M tasks using a language (such as a computer language) that the network O&M system can recognize, enabling the system to execute the plan. When a network O&M task includes multiple sub-tasks, the network O&M plan includes network O&M sub-plans corresponding to each sub-task. Each sub-plan is used to implement its corresponding sub-task.

[0091] In one possible implementation, the control module compiles network operation and maintenance experience into a network operation and maintenance plan based on a language model. The compilation process is exemplarily achieved through steps B1 to B3 below.

[0092] Step B1: The control module, based on the large language model, performs operation and maintenance task parsing on the network operation and maintenance experience to obtain multiple sub-tasks of the network operation and maintenance task and target dependencies. The target dependencies are the dependencies between multiple sub-tasks in the processing flow described by the network operation and maintenance experience.

[0093] The target dependency relationship includes the branch execution order corresponding to each first subtask in multiple subtasks. The first subtask is the first subtask executed in the execution flow of the network operation and maintenance task, and there is at least one first subtask. The branch execution order corresponding to any first subtask is used to represent the dependency relationship between the first subtask and other subtasks in the multiple subtasks. The first subtask and the other subtasks form a branch task in the network operation and maintenance task. Taking the above network operation and maintenance task "single base station outage" as an example, based on the network operation and maintenance experience of "single base station outage", we know that subtask 1 is the first subtask, and subtask 1 corresponds to branch execution order 1 and 2. Branch execution order 1 is subtask 1 → subtask 2 → subtask 3 → subtask 4, and subtask 1, subtask 2, subtask 3, and subtask 4 form branch task 1; branch execution order 2 is subtask 1 → subtask 2 → subtask 5, and subtask 1, subtask 2, and subtask 5 form branch task 2.

[0094] The process of parsing network operation and maintenance experience into operational tasks involves breaking down the experience into descriptive information for multiple sub-tasks. For example, the control module uses a large language model to break down the network operation and maintenance experience into descriptive information for multiple sub-tasks.

[0095] The large language model can break down input network operation and maintenance experience into multiple sub-task descriptions according to task decomposition rules. Each sub-task description describes the corresponding sub-task. These task decomposition rules refer to the rules for breaking down network operation and maintenance experience into multiple descriptions. For example, the task parsing rule might be to decompose iteratively, breaking down each sentence, piece of information, or step in the network operation and maintenance experience into a sub-task description. Taking the breakdown of each step into a sub-task description as an example, in the network operation and maintenance experience of "single base station outage," "querying the base station access network element based on the base station IP" can be considered as a sub-task description, and "querying the status of the base station access network element" can be considered as another sub-task description. In practical applications, different task decomposition rules can be preset for different application scenarios. Here, this application embodiment does not specifically limit the task decomposition rules.

[0096] For example, the control module has preset task decomposition rules. The control module concatenates network operation and maintenance experience and task decomposition rules into a first prompt message according to the prompt template that the large language model can recognize. The first prompt message is used to prompt the large language model to decompose the network operation and maintenance experience into description information of multiple sub-tasks according to the task decomposition rules. The control module inputs the first prompt message into the large language model. The large language model, according to the prompt message and based on the task decomposition rules, decomposes the input network operation and maintenance experience into description information of multiple sub-tasks and outputs the description information of multiple sub-tasks. The control module obtains the description information of multiple sub-tasks output by the large language model.

[0097] The analysis of network operation and maintenance experience into operation and maintenance tasks also includes dependency analysis to obtain target dependencies. For example, the control module analyzes the execution order of multiple sub-tasks in the network operation and maintenance experience based on a large language model. For instance, the large language model identifies the step numbers corresponding to the description information of multiple sub-tasks, and uses these identified step numbers as the execution order of the corresponding sub-tasks. Taking the network operation and maintenance task "single base station outage" as an example, the step number 1 corresponding to the description information "query the base station access network element based on the base station IP" in the network operation and maintenance experience for "single base station outage" is used as the execution order of the corresponding sub-task.

[0098] After analyzing the execution order of multiple subtasks, the control module determines the target dependencies based on this order. For example, the control module uses a large language model to perform contextual analysis on the description information of multiple subtasks based on their execution order to obtain the target dependencies. Taking the network operation and maintenance task "single base station outage" as an example, contextual analysis of the description information of subtask 2, "querying the status of the base station access network element," reveals that if the execution result of subtask 2 is "network element status is offline," then step 3 is executed, and subtask 3 is executed in step 3. Therefore, there is a dependency between subtask 2 and subtask 3.

[0099] The control module can input network operation and maintenance experience into the large language model, which then performs dependency analysis. For example, the first prompt message also guides the large language model to perform dependency analysis on the network operation and maintenance experience. After breaking down the network operation and maintenance experience into descriptions of multiple sub-tasks, the large language model, following the prompt message, performs contextual analysis on the descriptions of the multiple sub-tasks based on their execution order to obtain the target dependency, and outputs the descriptions of the multiple sub-tasks and the target dependency.

[0100] The above solution breaks down network operation and maintenance experience to accurately identify the sub-tasks of a network operation and maintenance task. Through dependency analysis, it identifies the dependencies between these sub-tasks, allowing for the subsequent arrangement of network operation and maintenance sub-schemes into a precise network operation and maintenance plan based on these dependencies. Furthermore, by analyzing the execution order of multiple sub-tasks within the network operation and maintenance experience, the solution accurately determines the dependencies between these sub-tasks, enabling the subsequent arrangement of network operation and maintenance sub-schemes into a precise network operation and maintenance plan.

[0101] Step B2: The control module obtains the network operation and maintenance sub-solutions corresponding to the multiple sub-tasks based on the description information of the multiple sub-tasks.

[0102] The network operation and maintenance sub-scheme corresponding to any sub-task is a network operation and maintenance plan used to implement the corresponding sub-task. Any network operation and maintenance sub-scheme can be implemented by calling at least one function supported by the network operation and maintenance system (network management module). The network management module has a function library containing multiple functions. The network management module supports running these multiple functions, each function corresponding to a network operation and maintenance task. Different functions correspond to different network operation and maintenance tasks, and each function is used to implement the corresponding network operation and maintenance task. The granularity of the network operation and maintenance tasks corresponding to different functions may be different or the same. For example, some functions may not include sub-tasks in their network operation and maintenance tasks, while others may include multiple sub-tasks. Any function can be an application programming interface (API) function or a tool. Tools are interfaces used by agents or chains to interact with the world. Here, this application embodiment does not limit the type of function.

[0103] The functions in this function library can be recorded through a function listing. The function listing includes the function identifier of each function in the function library and the description information of the network operation and maintenance task corresponding to each function. The function identifier is used to represent the function, and the function identifier can be the name of the function.

[0104] The control module can query the network management module for the functions supported by the network management module. Based on the query, the network management module sends the function list to the control module so that it can subsequently obtain a network operation and maintenance solution based on the function list. In some embodiments, after obtaining the function list from the network management module, the control module may query the function list again. For example, the control module periodically queries the function list from the network management module. When generating a network operation and maintenance solution for any network operation and maintenance task, the latest queried function list is used. This ensures that even if the function library in the network management module is updated, the control module can generate a network operation and maintenance solution based on the updated function library, allowing the generated solution to be successfully run by the network management module. This avoids generating multiple network operation and maintenance solutions for the same task, improving the network operation and maintenance efficiency of the network operation and maintenance system. In other embodiments, the control module does not need to obtain the function list from the network management module; instead, the user configures the function list for the control module, and the control module obtains the user-configured function list.

[0105] For a network operation and maintenance task corresponding to this network operation and maintenance experience, the function required to implement the task is called the first function, and there is at least one first function. For example, if the network operation and maintenance task does not include subtasks, the first function is the function in the function library corresponding to the task. If the task includes multiple subtasks, there are multiple first functions, each corresponding to a subtask in the function library. The calling process of each first function is considered as a network operation and maintenance sub-solution for a subtask, ensuring that any network operation and maintenance solution for a subtask can implement the corresponding subtask.

[0106] Each subtask may include multiple sub-subtasks, or it may not include any sub-subtasks. Sub-subtasks are network operation and maintenance tasks with a finer granularity than the subtask itself. When a subtask includes sub-subtasks, it can be completed by multiple first functions, each first function completing one sub-subtask. When a subtask does not include sub-subtasks, it is completed by a single first function. Therefore, each network operation and maintenance sub-solution describes the call flow of one or more first functions using a language recognizable by the network operation and maintenance system. The call flow of one or more first functions reflects the execution process of the corresponding subtask. When the network operation and maintenance solution is a script program, the network operation and maintenance sub-solution is a segment of the script program (i.e., a script segment).

[0107] For ease of description, the description information of the sub-tasks extracted from network operation and maintenance experience is called the first description information, and the description information of the network operation and maintenance tasks in the function list is called the second description information.

[0108] The control module obtains network operation and maintenance sub-solutions corresponding to multiple sub-tasks based on the large language model, the first description information of multiple sub-tasks, and the function list. For example, for the first description information of any sub-task among multiple sub-tasks, the control module inputs the first description information of the sub-task and the function list into the large language model, and the large language model generates the network operation and maintenance sub-solution corresponding to the sub-task based on the input first description information and function list.

[0109] The process of generating network operation and maintenance sub-solutions using a large language model includes, for example, querying the function list for second description information that matches the first description information. If any second description information matches the first description information, then based on the function identifier corresponding to the second description information in the function list, a network operation and maintenance sub-solution corresponding to the sub-task is generated. This network operation and maintenance sub-solution includes the call flow of the function represented by the function identifier, where the function identifier is the first function used to implement the sub-task. Querying the function list for second description information that matches the first description information includes: calculating the similarity between the first description information and each second description information in the function list; determining the second description information with the highest similarity to the first description information as the second description information that matches the first description information; and the similarity between the first description information and any second description information represents the degree of similarity between the first description information and any second description information.

[0110] For example, the control module, according to the prompt template that the large language model can recognize, concatenates the first description information and function list of any subtask into a second prompt information. The second prompt information is used to prompt the large language model to generate a network operation and maintenance sub-solution based on the function list for the subtask described by the first description information. The control module inputs the second prompt information into the large language model. The large language model, according to the prompt information, generates the network operation and maintenance sub-solution corresponding to the subtask based on the input first description information and function list, and outputs the network operation and maintenance sub-solution corresponding to the subtask. The control module obtains the network operation and maintenance sub-solution output by the large language model.

[0111] The above describes the process of obtaining a network operation and maintenance sub-solution corresponding to a sub-task. In a similar manner, the control module can obtain network operation and maintenance sub-solutions corresponding to multiple sub-tasks of a network operation and maintenance task.

[0112] Taking the artificial intelligence (AI) assistant (copilot) in the control module as an example, which triggers the generation of network operation and maintenance solutions by a large language model, the AI ​​assistant in the control module, such as... Figure 1 As shown. (Through) Figure 4The network operation and maintenance process illustrated above describes the steps. An AI assistant runs within the control module. Assuming the network operation and maintenance task is a live network fault diagnosis task, the user inputs live network fault diagnosis experience (i.e., network operation and maintenance experience) into the control module via the terminal. After obtaining the live network fault diagnosis experience, the AI ​​assistant breaks it down into task decomposition rules in a loop. These rules and the live network fault diagnosis experience are then concatenated into a prompt template to obtain prompt information. This prompt information is input into a large language model, which processes the live network fault diagnosis experience within the prompt information and returns descriptions of multiple sub-processes (i.e., sub-tasks) and the dependencies between them to the AI ​​assistant. The AI ​​assistant also queries the network management module for available functions (API functions and / or tools) to obtain a function list, which is used to concatenate prompt information when selecting functions in sub-processes. For each sub-process description generated through iterative breakdown, the AI ​​assistant concatenates the sub-process description and function list into a prompt, which is then input into the large language model. Based on this prompt, the large language model generates a corresponding network operation and maintenance (O&M) sub-solution. This sub-solution includes the call flow of API functions and / or tools, and it conforms to the runbook syntax description of the sub-process. The large language model responds to the AI ​​assistant with: a network O&M sub-solution that conforms to the runbook syntax description. In this way, the AI ​​assistant can obtain network O&M sub-solutions for each sub-process within multiple sub-processes. The AI ​​assistant then concatenates these sub-solutions into a complete runbook process plan (i.e., a network O&M solution).

[0113] The above description uses the example of the control module acquiring one network operation and maintenance sub-solution at a time. In other embodiments, the control module acquires multiple network operation and maintenance sub-solutions at once through a large language model. For example, the control module, according to the prompt template that the large language model can recognize, concatenates the first description information of multiple sub-tasks and the function list into a third prompt information. The third prompt information is used to prompt the large language model to generate a network operation and maintenance solution for each network operation and maintenance task indicated by each input description information based on the functions recorded in the function list. The control module inputs the third prompt information into the large language model. The large language model, according to the prompt information, generates a corresponding network operation and maintenance sub-solution for each sub-task described by the first sub-description information based on the functions recorded in the function list, and outputs the network operation and maintenance sub-solutions corresponding to multiple sub-tasks. The control module then acquires the network operation and maintenance sub-solutions corresponding to multiple sub-tasks output by the large language model.

[0114] Step B3: Based on the large language model, the control module orchestrates the network operation and maintenance sub-schemes corresponding to multiple sub-tasks according to the target dependencies to obtain the network operation and maintenance scheme.

[0115] Among them, orchestrating the network operation and maintenance sub-solutions corresponding to multiple sub-tasks is also known as orchestrating the processing flow of network operation and maintenance tasks.

[0116] The control module, following the prompt templates recognizable by the large language model, concatenates the target dependencies and network operation and maintenance sub-solutions corresponding to multiple sub-tasks into a fourth prompt. This fourth prompt instructs the large language model to concatenate the network operation and maintenance sub-solutions according to the target dependencies. The control module inputs the fourth prompt into the large language model, which, based on the prompt, concatenates the multiple network operation and maintenance sub-solutions into a single network operation and maintenance solution according to the target dependencies, ensuring that the execution order of the multiple sub-solutions satisfies the target dependencies. The large language model then outputs this network operation and maintenance solution, and the control module retrieves the network operation and maintenance solution output by the large language model.

[0117] Steps B1 to B3 above analyze the subtasks of the network operation and maintenance task and the dependencies between the subtasks based on the large language model. According to the target dependency relationship, the network operation and maintenance sub-schemes of the subtasks are arranged into a network operation and maintenance scheme, so that the arranged network operation and maintenance scheme can realize the subtasks in the network operation and maintenance task.

[0118] In other embodiments, the control module can also input network operation and maintenance experience into a large language model, which then outputs target dependencies and network operation and maintenance sub-solutions corresponding to each sub-task of the network operation and maintenance task. For example, the control module, according to a prompt template recognizable by the large language model, concatenates network operation and maintenance experience, task decomposition rules, and function lists into a fifth prompt message. This fifth prompt message prompts the large language model to decompose the network operation and maintenance experience into descriptions of sub-tasks according to the task decomposition rules. Based on the network operation and maintenance experience, the control module parses the target dependencies between the various sub-tasks of the corresponding network operation and maintenance task. Based on the functions recorded in the function list, the control module generates a network operation and maintenance sub-solution corresponding to each sub-task. The control module inputs the fifth prompt message into the large language model, which, based on the prompts in the fifth prompt message, processes the network operation and maintenance experience and outputs target dependencies and network operation and maintenance sub-solutions corresponding to multiple sub-tasks.

[0119] In other embodiments, the control module can also input the descriptions of multiple subtasks and their target dependencies into a large language model, which then outputs a network operation and maintenance (O&M) solution. For example, the control module, according to a prompt template recognizable by the large language model, concatenates the target dependencies, descriptions of multiple subtasks, and a function list into a sixth prompt. This sixth prompt prompts the large language model to generate a network O&M sub-solution for each subtask described by the function list; and then, based on the target dependencies, concatenates the generated network O&M sub-solutions into a network O&M solution. The control module inputs the sixth prompt into the large language model, which, based on the prompt, processes the descriptions of the multiple subtasks and outputs the network O&M solution.

[0120] In other embodiments, the control module can also output network operation and maintenance experience to a large language model, which then outputs a network operation and maintenance solution. For example, the control module, according to a prompt template recognizable by the large language model, concatenates network operation and maintenance experience, task decomposition rules, and function lists into a seventh prompt message. This seventh prompt message prompts the large language model to decompose the network operation and maintenance experience into descriptions of sub-tasks according to the task decomposition rules; parses the target dependencies between multiple sub-tasks of the corresponding network operation and maintenance task based on the network operation and maintenance experience; generates a network operation and maintenance sub-solution for each sub-task based on the function list; and concatenates the generated network operation and maintenance sub-solutions into a network operation and maintenance solution based on the target dependencies. The control module inputs the seventh prompt message into the large language model, which processes the network operation and maintenance experience based on the prompt and outputs the network operation and maintenance solution.

[0121] After obtaining the network operation and maintenance (O&M) plan, the control module also associates the O&M plan with the task description information of the network O&M task to indicate the correspondence between the O&M plan and the task. For example, the control module maintains a plan list that records network O&M plans. The control module can establish a correspondence between the plan identifier of the network O&M plan and the task information of the network O&M plan in the plan list to associate the network O&M plan with the task description information in the task information. For instance, the plan identifier of the network O&M plan and the task information of the network O&M plan can be added to the plan list, and the plan identifier corresponds to the task information. The plan identifier of the network O&M plan is used to represent the network O&M plan.

[0122] In other embodiments, after obtaining the network operation and maintenance plan, the control module outputs the plan to the terminal. In response to a confirmation operation of the network operation and maintenance plan, the control module performs a step of associating the network operation and maintenance plan with the task description information of the network operation and maintenance task. The confirmation operation indicates that the network operation and maintenance plan is used to implement the network operation and maintenance task.

[0123] For example, the control module sends a confirmation message to the terminal, indicating whether to confirm the use of the network operation and maintenance plan for the network operation and maintenance task. The confirmation message includes the network operation and maintenance plan. After receiving the confirmation message, the terminal displays the network operation and maintenance plan from the confirmation message.

[0124] by Figure 5 For example, after receiving the confirmation message, the terminal displays the program display interface 500, which shows the network operation and maintenance solution. For instance, the terminal graphically displays the network operation and maintenance solution in the program display interface 500. For example, taking the network operation and maintenance task "nceip_naie_test_0318" as an example, the terminal displays a processing flowchart 51 for the network operation and maintenance task "nceip_naie_test_0318" in the program display interface 500. The processing flowchart 51 is a graphical representation of the network operation and maintenance solution. The processing flowchart 51 includes a start node 511, multiple task nodes 512, and an end node 513, where the start node 511 represents the starting point of the network operation and maintenance solution, and the end node 513 represents the ending point of the network operation and maintenance solution. Each task node 512 represents a subtask within the network operation and maintenance task "nceip_naie_test_0318". For example, task node "llm_alarm_id" represents the subtask "llm_alarm_id" within the network operation and maintenance task "nceip_naie_test_0318", and task node "prompt_summary" represents the subtask "prompt_summary" within the network operation and maintenance task "nceip_naie_test_0318". Multiple task nodes 512 are arranged according to their target dependencies in the processing flowchart 51, allowing users to intuitively understand the various subtasks within the network operation and maintenance task and the dependencies between them. This provides a clear understanding of the entire processing flow of the network operation and maintenance task, increasing its interpretability.

[0125] Each task node 512 is associated with a network operation and maintenance sub-scheme corresponding to a subtask in the network operation and maintenance plan. The program display interface 500 also includes a program display window 52, ​​which is used to display the network operation and maintenance sub-scheme associated with the task node 512. Users can trigger an operation on any task node 512. In response to this trigger operation, the terminal displays the network operation and maintenance sub-scheme associated with that task node 512 in the program display window 52, ​​allowing users to view or modify the network operation and maintenance sub-scheme associated with that task node 512. For example, assuming the user triggers an operation on the task node "prompt_summary", the terminal responds to this trigger operation and displays the network operation and maintenance sub-scheme 521 corresponding to the subtask "prompt_summary" in the program display window 52.

[0126] Figure 5 The flowchart 51 is illustrated using multiple task nodes 512 as an example. In other embodiments, if the network operation and maintenance task does not include subtasks, then the flowchart 51 includes one task node 512, which represents the network operation and maintenance task. The network operation and maintenance sub-scheme associated with the task node 512 is also the network operation and maintenance scheme.

[0127] Regarding the network operation and maintenance plan displayed on the terminal, the confirmation operation can be a click on the confirmation control (not shown in the figure) in the program display interface 500, a voice command, or an edited confirmation command. This embodiment does not limit the confirmation operation used. If the user confirms the network operation and maintenance plan, the terminal responds by sending a confirmation response to the control module. Based on the confirmation response, the control module performs the step of associating the network operation and maintenance plan with the task description information of the network operation and maintenance task.

[0128] By confirming the network operation and maintenance plan with the user, the control module can obtain the confirmed network operation and maintenance plan, ensuring its accuracy and enabling the network operation and maintenance system to run the plan.

[0129] The method provided in this application embodiment is based on a large language model, which transforms the processing flow of network operation and maintenance tasks described in natural language into a network operation and maintenance plan that the network operation and maintenance system can execute. Subsequently, the network operation and maintenance task can be completed by executing the network operation and maintenance plan through the network operation and maintenance system. Users do not need to write scripts for each sub-task of the network operation and maintenance task, thus improving the efficiency of network operation and maintenance.

[0130] In some embodiments, after obtaining the network operation and maintenance plan corresponding to the network operation and maintenance task, or after the user confirms the network operation and maintenance plan, the control module can use the network operation and maintenance plan in the network operation and maintenance system, for example, in steps C1 to C3 below.

[0131] Step C1: The control module calls the network operation and maintenance plan and runs the network operation and maintenance plan in the network operation and maintenance system to perform the network operation and maintenance task on the network.

[0132] Running network operation and maintenance (O&M) plans within the network O&M system includes running the O&M plan within the network management module. The control module can send the O&M plan to the network management module, which then runs the O&M plan within the network O&M system.

[0133] For example, the control module sends the network operation and maintenance plan and task information corresponding to the network operation and maintenance task to the network management module. The network management module receives the network operation and maintenance plan and task information, and associates the network operation and maintenance plan with the task description information of the network operation and maintenance task in the task information. For example, it establishes a correspondence between the plan identifier of the network operation and maintenance plan and the task information of the network operation and maintenance plan in the plan list.

[0134] The network management module invokes the network operation and maintenance (O&M) plan corresponding to the network O&M task and runs the plan within the network O&M system to execute the task. During the execution of the O&M plan, the network management module runs each sub-plan within the plan according to the target dependencies, executing the corresponding sub-tasks. For example, following the branch execution order of any first sub-task in the target dependencies, the network management module first runs the network O&M sub-plan corresponding to the first sub-task to execute it, obtaining the result. Then, using the result of the first sub-task as the input parameter for the next sub-task in the same branch execution order, it runs the network O&M sub-plan corresponding to that next sub-task to execute it, obtaining the result. This process continues until the last sub-task in the branch execution order is executed, obtaining the result of that last sub-task. The result of this last sub-task is the execution result of the network O&M task. The process of running any subtask corresponding to the network operation and maintenance sub-scheme can be as follows: according to the function call process defined in the network operation and maintenance sub-scheme, the first function in the network operation and maintenance sub-scheme is called.

[0135] Step C2: The control module outputs the execution results of the network operation and maintenance task to the terminal.

[0136] The execution result includes the execution results of each subtask of the network operation and maintenance task.

[0137] The control module executes each sub-scheme of the network operation and maintenance plan, i.e., completes the corresponding sub-task, and obtains the execution result of that sub-task. The network operation and maintenance plan is considered complete after the last sub-scheme is finished, and the execution result of the network operation and maintenance task is obtained. The control module sends the execution result of each sub-task to the terminal for display, allowing the user to view the execution progress in a timely manner. Alternatively, the control module can obtain the execution results of each sub-task before sending the individual sub-task execution results to the terminal.

[0138] Step C3: The terminal receives and displays the execution results of the network operation and maintenance task.

[0139] The terminal can display the execution results of each subtask according to the execution order of each subtask in network operation and maintenance experience, so as to graphically represent the processing flow of network operation and maintenance tasks. This allows users to understand the subtasks and their execution results in detail, and improves the interpretability of the processing flow of network operation and maintenance tasks.

[0140] by Figure 6 For example, the terminal displays a results display interface 600, which shows relevant information for each subtask: a description 61 for each subtask and an execution result 62 for each subtask. The description 61 for each subtask is decomposed from network operation and maintenance experience by the large language model. The relevant information for each subtask is arranged in the execution order of each subtask on the results display interface 600, allowing users to understand the processing flow of the network operation and maintenance task in detail, thus improving the interpretability of the processing flow. In some embodiments, the terminal also displays the reason 63 for executing each subtask on the results display interface 600, further improving the interpretability of the processing flow of the network operation and maintenance task.

[0141] The method provided in this application embodiment executes a network operation and maintenance plan in a network operation and maintenance system to perform network operation and maintenance tasks. In this process, no manual intervention is required, and the network operation and maintenance tasks are automatically completed by the network operation and maintenance system, thereby improving the execution efficiency of network operation and maintenance tasks and improving the network operation and maintenance efficiency of the network operation and maintenance system.

[0142] In other embodiments, after obtaining the network operation and maintenance plan corresponding to the network operation and maintenance task, the control module does not immediately execute the step of calling the network operation and maintenance plan and running it in the network operation and maintenance system. Instead, this step is executed only when an abnormal situation related to the network operation and maintenance task occurs in the network. Next, using...Figure 7 Let's take an example to illustrate this situation.

[0143] Figure 7 This is a flowchart of another method for generating a network operation and maintenance solution provided in this application embodiment. The method includes the following steps.

[0144] 701. The terminal obtains network operation and maintenance experience described in natural language. The network operation and maintenance experience includes the processing flow obtained by the user when performing network operation and maintenance tasks.

[0145] Step 701 is similar to step 201, and will not be described again in this embodiment of the application.

[0146] 702. The terminal sends network operation and maintenance experience described in natural language to the control module in the network operation and maintenance system.

[0147] Step 702 is similar to step 202, and will not be described again in this embodiment of the application.

[0148] 703. The control module acquires network operation and maintenance experience described in natural language.

[0149] Step 703 is similar to step 203, and will not be described again in this embodiment of the application.

[0150] 704. The control module, based on the large language model and network operation and maintenance experience, obtains a network operation and maintenance plan for the network operation and maintenance system to execute. This network operation and maintenance plan corresponds to the network operation and maintenance task.

[0151] Step 704 is similar to step 204, and will not be described again in this embodiment.

[0152] 705. The control module sends the network operation and maintenance plan to the network management module in the network operation and maintenance system.

[0153] In other embodiments, the control module executes step 705 only after the user has confirmed the network operation and maintenance plan. The process of the user confirming the network operation and maintenance plan is as described above. Figure 4 Let's take an example to illustrate, such as Figure 4 As shown, after the AI ​​assistant combines the network operation and maintenance sub-solutions corresponding to multiple sub-processes into a complete runbook process solution (i.e., network operation and maintenance solution), the AI ​​assistant displays the runbook process solution on the user's terminal. After the user confirms the use of the runbook process solution, the AI ​​assistant sends the runbook process solution to the network management module so that the runbook process solution confirmed by the user can be saved in the network management module.

[0154] 706. The network management module associates the network operation and maintenance plan with the task description information of the network operation and maintenance task.

[0155] The control module can send the task information and network operation and maintenance plan of the network operation and maintenance task to the network management module. The network management module receives the task information and the network operation and maintenance plan, and stores the network operation and maintenance plan, for example, by persistently storing the network operation and maintenance plan to prevent it from being lost.

[0156] The network management module can also maintain a list of network operation and maintenance plans. After storing the network operation and maintenance plans, the network management module can also establish a correspondence between the plan identifier of the network operation and maintenance plan and the task information of the network operation and maintenance plan in the plan list, so as to associate the network operation and maintenance plan with the task description information in the task information, so as to query the network operation and maintenance plan based on the plan list in the future.

[0157] In some embodiments, each time the control module obtains a network operation and maintenance plan corresponding to a network operation and maintenance task, it sends the network operation and maintenance plan to the network management module. The network management module stores the network operation and maintenance plan and records it in the plan list. As the number of network operation and maintenance plans stored by the network management module increases, the number of network operation and maintenance plans recorded in the plan list will also increase.

[0158] 707. The network management module receives network alarm information, which indicates abnormal situations in the network.

[0159] The anomaly can be any situation that negatively impacts the stability, security, availability, and efficiency of the network in terms of network operation and maintenance. For example, any anomaly in the planning, deployment, monitoring, maintenance, optimization, and troubleshooting of network infrastructure, network equipment, network systems, or network applications, such as a fault that occurs in the network (e.g., a single base station going out of service).

[0160] The network alarm information can be reported by network devices in the network. For example, after a network device determines that an abnormal situation has occurred in the network, the network device sends a network alarm information to the control module based on the abnormal situation, and the control module receives the network alarm information sent by the network device.

[0161] 708. In response to the abnormal situation matching the task description information of the network operation and maintenance task, the network management module invokes the network operation and maintenance plan and runs the network operation and maintenance plan in the network operation and maintenance system to perform the network operation and maintenance task on the network.

[0162] The matching of the abnormal situation with the task description information of the network operation and maintenance task includes the correlation between the abnormal situation and the task description information being greater than or equal to a first threshold. The correlation indicates the degree of correlation between the abnormal situation and the network operation and maintenance task described in the task description information. The higher the correlation, the better the network operation and maintenance task described in the task description information can alleviate or resolve the abnormal situation.

[0163] Upon receiving a network alarm, the network management module determines the target network operation and maintenance plan based on the large language model, the network alarm information, and the task list. The target network operation and maintenance plan is the network operation and maintenance plan corresponding to the task description information that matches the abnormal situation.

[0164] For example, the network management module, according to the prompt template that the large language model can recognize, concatenates network alarm information and the solution list into an eighth prompt message. The eighth prompt message is used to prompt the large language model to select a target network operation and maintenance solution from the network operation and maintenance solutions recorded in the solution list according to the preset conditions. The network management module inputs the eighth prompt message into the large language model. Based on the prompt of the eighth prompt message, the large language model identifies the asynchronous situation indicated by the network alarm information, determines the correlation between the identified abnormal situation and the description information of each task in the task list, and outputs the correlation between the task description information and the abnormal situation and the solution identifier corresponding to the task description information in the solution list when the correlation between any task description information and the abnormal situation is greater than or equal to a first threshold (i.e., the task description information matches the abnormal situation). The correlation corresponds to the solution identifier. The large language model may output at least one relevance score and a scheme identifier corresponding to each of the at least one relevance scores. If the large language model outputs one relevance score and one corresponding scheme identifier, the network management module determines the network operation and maintenance scheme indicated by the scheme identifier as the target network operation and maintenance scheme. If the large language model outputs multiple relevance scores, the network management module determines the network operation and maintenance scheme indicated by the scheme identifier corresponding to the highest relevance score among the multiple relevance scores as the target network operation and maintenance scheme.

[0165] After the target network operation and maintenance plan is determined, the network management module calls the target network operation and maintenance plan and runs the target network operation and maintenance plan in the network operation and maintenance system. Taking the target network operation and maintenance plan as the network operation and maintenance plan involved in step 706 above as an example, the network management module calls the network operation and maintenance plan corresponding to the network operation and maintenance task and runs the network operation and maintenance plan in the network operation and maintenance system. For the specific process, please refer to step C1 above.

[0166] by Figure 4For example, network devices report network status to the network management module, indicating any abnormalities in the network. The network management module concatenates the network status and a solution list into a prompt template to obtain a prompt message. This prompt message instructs the large language model to select a network operation and maintenance solution based on the network status and the solution list. The large language model, based on the input prompt message, selects a network operation and maintenance solution from the solutions recorded in the solution list and returns the solution identifier of the selected solution to the network management module. The network management module then executes the network operation and maintenance solution indicated by the solution identifier. For instance, during the execution of the network operation and maintenance solution, an instruction is sent to the network device. This instruction is the one involved when the network management module calls the first function in the network operation and maintenance solution. The network device receives and executes the instruction, returning the execution result to the network management module. The network management module then returns the execution result to the user for viewing. For example, the network management module sends the execution result to an AI assistant, which then returns the execution result to the terminal, allowing the user to view the result on the terminal. The execution result includes the current information or status of the network and / or network devices after the command is executed. The execution result of the command is also the execution result of the network operation and maintenance task.

[0167] In other embodiments, the network device can directly send network alarm information to the control module, or the network device can send network alarm information to the network management module, which then forwards the network alarm information to the control module. Upon receiving the network alarm information, the control module responds to the match between the abnormal situation indicated by the network alarm information and the task description information of any network operation and maintenance task. It then invokes the network operation and maintenance plan corresponding to that task and runs the plan in the network operation and maintenance system to obtain the execution result of the task. The control module then outputs the execution result of the network operation and maintenance task to the terminal.

[0168] In network alarm scenarios, for any module in the network management module or control module, after obtaining the execution result of the network operation and maintenance task, the module can record the correlation between the execution result and the network alarm information, instead of actively outputting the execution result of the network operation and maintenance task to the terminal. The execution result of the network operation and maintenance task will only be output to the terminal when the user queries the network alarm information.

[0169] The method provided in this application embodiment, in addition to being able to achieve Figure 2 In addition to the beneficial effects of the method embodiments, when an abnormal situation occurs in the network, the network operation and maintenance system can be triggered to automatically perform network operation and maintenance tasks related to the abnormal situation to resolve or alleviate the abnormal situation in the network without waiting for manual handling, thereby improving the network operation and maintenance efficiency of the network operation and maintenance system.

[0170] In some embodiments, an abnormal situation in the network with a frequency greater than or equal to a frequency threshold is called a high-frequency abnormal situation. For a network operation and maintenance task to resolve such a high-frequency abnormal situation, the user triggers the terminal to execute the above step 701, so as to trigger the execution of the above steps 702 to 705, so as to store the network operation and maintenance solution corresponding to the network operation and maintenance task in the network management device. Alternatively, after the control module completes step 704 above and obtains the network operation and maintenance plan corresponding to a certain network operation and maintenance task, the control module determines whether the anomaly to be resolved by the network operation and maintenance task is a high-frequency anomaly based on the frequency threshold. If it is a high-frequency anomaly, the control module stores the network operation and maintenance plan corresponding to the network operation and maintenance task in the network management module. If it is not a high-frequency anomaly (the frequency of the anomaly in the network is less than the frequency threshold), the control module does not store the network operation and maintenance plan corresponding to the network operation and maintenance task in the network management module. This allows the network management module to have more storage space to store network operation and maintenance plans for resolving high-frequency anomalies. In this way, when a high-frequency anomaly occurs in the network, the network management module can quickly find the network operation and maintenance plan for resolving the current high-frequency anomaly from the stored network operation and maintenance plans. By executing the queried network operation and maintenance plan in the network operation and maintenance system, the current high-frequency anomaly can be resolved, thereby further improving network operation and maintenance efficiency.

[0171] In other embodiments, after the control module obtains the first script program for the network operation and maintenance task, the user can also trigger the network management module to run the first script program through a dialog message. Next, using... Figure 8 Let's take an example to illustrate this situation.

[0172] Figure 8 This is a flowchart of another network operation and maintenance method based on a large language model provided in an embodiment of this application. The method includes the following steps.

[0173] 801. The terminal obtains network operation and maintenance experience described in natural language. The network operation and maintenance experience includes the processing flow obtained by the user when performing network operation and maintenance tasks.

[0174] Step 801 is similar to step 201, and will not be described again in this embodiment of the application.

[0175] 802. The terminal sends network operation and maintenance experience described in natural language to the control module in the network operation and maintenance system.

[0176] Step 802 is similar to step 202, and will not be described again in this embodiment of the application.

[0177] 803. The control module acquires network operation and maintenance experience described in natural language.

[0178] Step 803 is similar to step 203, and will not be described again in this embodiment of the application.

[0179] 804. The control module, based on the large language model and network operation and maintenance experience, obtains a network operation and maintenance plan for the network operation and maintenance system to execute. This network operation and maintenance plan corresponds to the network operation and maintenance task.

[0180] The correspondence between the network operation and maintenance scheme and the network operation and maintenance task is manifested in the association of the task description information of the network operation and maintenance scheme and the network operation and maintenance task. Step 804 is the same as step 204. Therefore, this embodiment of the application will not repeat step 804.

[0181] 805. The terminal sends a dialogue message to the control module. The dialogue message includes the network operation and maintenance intent described in natural language.

[0182] Among them, network operation and maintenance intent refers to the user's intent in network operation and maintenance, that is, the network operation and maintenance tasks that the user expects to perform.

[0183] Users interact with an AI assistant in the network operations and maintenance system via a terminal. During the conversation, users interact with the AI ​​assistant through conversation messages, triggering the control module where the AI ​​assistant resides to execute network operations and maintenance plans within the network operations and maintenance system. For example, the network operations and maintenance application running on the terminal provides a conversational interface. This interface is used to provide network operations and maintenance services to users through dialogue. For instance, a user sends a conversation message to the AI ​​assistant in the control module through the conversational interface. The AI ​​assistant uses the resources of the control module to parse the conversation message and trigger the network management module to execute the network operations and maintenance plan related to that conversation message.

[0184] by Figure 9 For example, the terminal displays a session interface 900. The user enters a session message 92 in the message input box 91 of the session interface 900. The session message 92 includes a network operation and maintenance intent 921 described in natural language. The user sends the session message 92. The terminal responds to the sending operation, obtains the session message 92 entered by the user, and sends the session message 92 to the second account 94 in the session interface 900 through the first account 93. The first account 93 is the account used by the user to log in to the network operation and maintenance application, and the second account 94 is the account used by the AI ​​assistant to log in to the network operation and maintenance application. Sending the session message 92 to the second account 94 means that the terminal sends the session message 92 to the control module running the AI ​​assistant.

[0185] 806. The control module responds to the network operation and maintenance intent in the dialogue message by matching it with the task description information of the network operation and maintenance task, invoking the network operation and maintenance plan and running the network operation and maintenance plan in the network operation and maintenance system to perform the network operation and maintenance task on the network.

[0186] Among them, the matching of network operation and maintenance intentions with task description information includes the relevance between the network operation and maintenance intentions and the task description information being greater than or equal to a second threshold. This relevance indicates the degree of association (or similarity) between the network operation and maintenance intentions and the task description information.

[0187] Upon receiving the dialogue message, the control module, based on the large language model and the task description information of multiple network operation and maintenance tasks, determines the target network operation and maintenance solution from multiple network operation and maintenance solutions. These multiple network operation and maintenance solutions are the various network operation and maintenance solutions recorded in the solution list. The target network operation and maintenance solution is the network operation and maintenance solution that matches the dialogue message among the multiple network operation and maintenance solutions, and the description information corresponding to the target network operation and maintenance solution matches the network operation and maintenance intent.

[0188] For example, the control module, according to the prompt template that the large language model can recognize, concatenates the dialogue message and the solution list into a ninth prompt message. The solution list includes task description information for the multiple network operation and maintenance tasks. The ninth prompt message prompts the large language model to select the task description information from the task list that matches the network operation and maintenance intent in the dialogue message. The control module inputs the ninth prompt message into the large language model. Based on the prompt of the ninth prompt, the large language model performs operation and maintenance intent analysis on the dialogue message to obtain the network operation and maintenance intent of the dialogue message, determines the relevance between the network operation and maintenance intent and each task description information in the solution list, and outputs the relevance between the task description information and the network operation and maintenance intent and the solution identifier corresponding to the task description information in the solution list when the relevance between any task description information and the network operation and maintenance intent is greater than or equal to a second threshold (i.e., the task description information matches the network operation and maintenance intent) in response. The large language model may output at least one relevance score and a scheme identifier corresponding to each of the at least one relevance scores. If the large language model outputs one relevance score and one corresponding scheme identifier, the network management module determines the network operation and maintenance scheme indicated by the scheme identifier as the target network operation and maintenance scheme. If the large language model outputs multiple relevance scores, the network management module determines the network operation and maintenance scheme indicated by the scheme identifier corresponding to the highest relevance score among the multiple relevance scores as the target network operation and maintenance scheme.

[0189] After the target network operation and maintenance plan is determined, the control module calls the target network operation and maintenance plan and runs the target network operation and maintenance plan in the network operation and maintenance system. Taking the target network operation and maintenance plan as the network operation and maintenance plan involved in step 804 above as an example, the control module calls the network operation and maintenance plan corresponding to the network operation and maintenance task and runs the network operation and maintenance plan in the network operation and maintenance system. The specific process can be referred to step C1 above.

[0190] In other embodiments, before invoking the target network operation and maintenance solution and running the target network operation and maintenance solution in the network operation and maintenance system, the control module first sends the target network operation and maintenance solution to the terminal in the form of a session message. The terminal displays the target network operation and maintenance solution in the form of a session message in the session interface. If the user confirms the target network operation and maintenance solution in the session interface, in response to the confirmation operation, the control module executes the steps of invoking the target network operation and maintenance solution and running the target network operation and maintenance solution in the network operation and maintenance system.

[0191] 807. The control module outputs the execution result of the network operation and maintenance task to the terminal.

[0192] Step 808 is similar to step C2 above, except that the control module sends the execution result of the network operation and maintenance task to the terminal in the form of a session message. That is, the session message sent by the control module includes the execution result of the network operation and maintenance task.

[0193] 808. The terminal receives and displays the execution result of the network operation and maintenance task.

[0194] Step 808 is similar to step C3, except that in a dialogue scenario, the terminal displays the execution results of the network operation and maintenance task in the form of dialogue messages in the dialogue interface.

[0195] by Figure 9 For example, after the terminal sends session message 92 to the second account 94 in the session interface 900, it receives session message 95 returned by the control module. Session message 95 includes the execution result of network operation and maintenance task 951. The terminal uses session message 95 as the session message sent by the second account 94 to the first account 93. In the session interface 900, the session message 95 sent by the second account 94 to the first account 93 is displayed. In session message 95, the execution result 953 of each subtask 952 in the network operation and maintenance task 951 is displayed according to the execution order of each subtask 952. In some embodiments, the reason 954 for the execution of each subtask 952 is also displayed in session message 95.

[0196] In other embodiments, if the network operation and maintenance system does not contain task description information matching the network operation and maintenance intent in the dialogue message, then the network operation and maintenance system does not contain a network operation and maintenance solution matching the dialogue message. In this case, the control module can prompt the user through the terminal to input network operation and maintenance experience to achieve the network operation and maintenance intent, according to... Figure 2The process shown involves the control module generating a network operation and maintenance (O&M) plan for the network O&M intent, then invoking and running the generated plan within the network O&M system to complete the O&M intent. Alternatively, the control module may again execute the step of determining the target O&M plan for the dialogue message, invoking the corresponding determined plan and running it within the network O&M system. Or, the control module may design a processing flow for the network O&M intent based on a large language model, orchestrate the designed flow into a network O&M plan, invoke the orchestrated plan, run the new plan within the network O&M system, and obtain the execution result of the network O&M task. This result is then provided to the user as a reference.

[0197] The method provided in this application embodiment determines task description information that matches the network operation and maintenance intent in the dialogue message through a large language model, calls the network operation and maintenance plan corresponding to the network operation and maintenance task described by the task description information to execute the network operation and maintenance task, and provides the execution result of the network operation and maintenance task to the terminal after the network operation and maintenance task is completed. In this process, the user only needs to provide dialogue messages in the form of dialogue, without having to interact with the network operation and maintenance system multiple times. The operation process is simple, thereby improving the efficiency of network operation and maintenance.

[0198] Users can modify the generated network operation and maintenance (O&M) plan to meet their needs for modifying the processing flow of network O&M tasks. For example, in response to a modification operation, the control module obtains the modified O&M plan, and in response to a confirmation operation, associates the modified O&M plan with the task description information of the network O&M task. Here, the network O&M plan can be any of the network O&M plans involved in the above embodiments.

[0199] For example, the control module sends a confirmation message for a network operation and maintenance plan to the terminal, and the terminal displays the network operation and maintenance plan in the confirmation message, such as... Figure 5The program display interface 500 shows a processing flowchart 51. When a user triggers an operation on any task node 512 in the processing flowchart 51, the triggering terminal displays the network operation and maintenance sub-scheme associated with that task node 512 in the program display window 52. The user can modify this network operation and maintenance sub-scheme in the program display window 52. If the user needs to modify the network operation and maintenance sub-schemes associated with other task nodes, they can do so in a similar manner. After modification, the user confirms the modified processing flowchart 51. In response to this confirmation, for any task node 512, if the user modifies the network operation and maintenance sub-scheme associated with that task node 512, the network operation and maintenance sub-scheme associated with that task node 512 in the network operation and maintenance scheme is replaced with the user's modified network operation and maintenance sub-scheme, resulting in the modified network operation and maintenance scheme. The terminal sends a confirmation response, including the modified network operation and maintenance plan, to the control module. Upon receiving the confirmation response, the control module compares the network operation and maintenance plan in the confirmation response with the network operation and maintenance plan sent to the terminal. If the two network operation and maintenance plans are the same, it means that the user has not modified the network operation and maintenance plan. The control module then associates the network operation and maintenance plan with the task description information of the network operation and maintenance task. If the two scripts are different, it means that the user has modified the network operation and maintenance plan. The control module then obtains the network operation and maintenance plan in the confirmation response as the modified network operation and maintenance plan and associates the modified network operation and maintenance plan with the task description information of the network operation and maintenance task.

[0200] In other embodiments, the terminal sends a request to the control module to modify a certain network operation and maintenance plan. Based on the request, the control module returns a network operation and maintenance plan to the terminal. The user modifies the network operation and maintenance plan on the terminal, and the terminal sends the modified network operation and maintenance plan to the control module. In response to the confirmation operation of the modified network operation and maintenance plan, the control module associates the modified network operation and maintenance plan with the task description information of the network operation and maintenance task. This process is the same as the process described above in which the control module associates the network operation and maintenance plan with the task description information of the network operation and maintenance task in response to the confirmation operation of the network operation and maintenance plan, and will not be repeated here.

[0201] Subsequently, if the task description information matches the network operation and maintenance intent in a certain dialogue message of the terminal, or if the task description information matches the abnormal situation indicated by the network alarm information, the control module calls the modified network operation and maintenance plan and runs the modified network operation and maintenance plan in the network operation and maintenance system.

[0202] In other embodiments, users can also trigger the control module to regenerate the network operation and maintenance plan by modifying the network operation and maintenance experience corresponding to the network operation and maintenance task. Next, this situation will be described in conjunction with the following steps D1 to D2.

[0203] Step D1: The control module responds to the modification operation of the network operation and maintenance experience corresponding to the network operation and maintenance task and obtains the modified network operation and maintenance experience.

[0204] This network operation and maintenance experience refers to the network operation and maintenance experience corresponding to existing network operation and maintenance solutions in the network operation and maintenance system.

[0205] Users can modify network operation and maintenance experience on the terminal, and the control module retrieves the modified network operation and maintenance experience from the terminal. Figure 10 For example, the network operation and maintenance application also provides a task display interface 1000. The task display interface 1000 is used to display network operation and maintenance tasks with network operation and maintenance solutions in the network operation and maintenance system. The display method includes, for example, a task display table 1001, which includes task identifiers 1002 for multiple network operation and maintenance tasks with network operation and maintenance solutions. The task display table 1001 also includes an editing control 1003 corresponding to the task identifier 1002. The editing control 1003 is used to trigger the task editing interface for the corresponding network operation and maintenance task. Taking the network operation and maintenance task "Single Base Station Outage" as an example, the user triggers the editing control 1003 corresponding to the network operation and maintenance task "Single Base Station Outage" in the task display table 1001. The terminal responds to this triggering operation and displays the task editing interface 300 for the network operation and maintenance task "Single Base Station Outage". Users can modify the network operation and maintenance experience 311 for the network operation and maintenance task "Single Base Station Outage" in the first input box 31 of the task editing interface 300. After modification, the user triggers the compilation control 35 in the task editing interface 300. In response to the triggering operation, the terminal sends a compilation request to the control module. The compilation request includes the modified network operation and maintenance experience in the first input box 31. The control module receives the compilation request and extracts the network operation and maintenance experience from the compilation request as the modified network operation and maintenance experience for "Single Base Station Outage".

[0206] Step D2: Based on the large language model and the modified network operation and maintenance experience, the control module obtains the modified network operation and maintenance plan and updates the network operation and maintenance plan corresponding to the network operation and maintenance task.

[0207] For the modified network operation and maintenance (O&M) plan, following a similar approach to step 204 above, the control module, based on the large language model and the modified O&M experience, obtains the O&M plan for the network O&M system to execute. The obtained O&M plan represents the modified O&M experience for the network O&M task. The control module replaces the stored O&M plan corresponding to the network O&M task with the modified O&M plan to update the O&M plan corresponding to the task. In other embodiments, in response to a confirmation operation of the modified O&M plan, the control module replaces the stored O&M plan corresponding to the network O&M task with the modified O&M plan.

[0208] Subsequently, if the task description information of the network operation and maintenance task matches the network operation and maintenance intent in a certain dialogue message of the terminal, or if the task description information matches the abnormal situation indicated by the network alarm information, the control module calls the modified network operation and maintenance plan and runs the modified network operation and maintenance plan in the network operation and maintenance system.

[0209] For the network operation and maintenance system involved in the above embodiments, the control module in the network operation and maintenance system can be deployed on at least one first computer device, and the at least one first computer device executes the method steps executed by the control module in the above method embodiments. The first computer device can be a personal computer, a laptop computer, a desktop computer, or a server, etc. Here, the device type and number of the first computer devices are not limited in this application embodiment.

[0210] The network management module in this network operation and maintenance system can be deployed on at least one second computer device, which executes the method steps performed by the network management module in the above method embodiments. The second computer device can be a personal computer, laptop computer, desktop computer, server, network element device, or network element management device, etc. Here, this application embodiment does not limit the type or number of second computer devices. The first computer device and the second computer device can be different computer devices or the same computer device.

[0211] The large language model in the network operation and maintenance system can be deployed on at least one third computer device. The at least one third computer device is used to run the large language model. The third computer device can be a desktop computer or a server, etc. Here, the embodiments of this application do not limit the type and number of third computer devices.

[0212] The third computer device is a different computer device from the first and second computer devices. In the process of implementing the above-mentioned method for generating network operation and maintenance solutions, when there is a need to use the large language model, the control module in the first computer device and the network management module in the second computer device can call the large language model in the third computer device. For example, when generating a network operation and maintenance solution, the control module sends network operation and maintenance experience to the third computer device, which then compiles the experience into a network operation and maintenance solution using the large language model and returns the solution to the control module.

[0213] In other embodiments, the large language model may also be deployed on a first computer device or a second computer device. Here, this application embodiment does not limit the deployment location of the large language model. The large language model can be inferred and trained by the computer device where it is located, or it can be inferred and trained by other computer devices besides the computer device where it is located. Here, this application embodiment does not limit the device used for inference and training the large language model.

[0214] The above embodiments are illustrated by using the control module and the network management module as different modules. In other embodiments, the control module and the network management module can also be integrated into one module, which implements the method steps executed by the control module and the network management module in the above method embodiments.

[0215] The methods of the embodiments of this application have been described above. The apparatus of the embodiments of this application will be described below. It should be understood that the apparatus described below has the same inventive concept as the network operation and maintenance method based on the large language model described above, and can achieve the beneficial effects that the above method embodiments can achieve. The following will be combined with… Figure 11 to Figure 12 The present application relates to apparatus and devices. It should be understood that the technical features described in the above method embodiments are also applicable to the following apparatus embodiments.

[0216] Figure 11 This is a schematic diagram of the structure of a network operation and maintenance solution generation device, such as... Figure 11 The device 1100 shown includes:

[0217] The first acquisition unit 1101 is used to acquire network operation and maintenance experience described in natural language, including the processing flow obtained by the user when performing network operation and maintenance tasks;

[0218] The second acquisition unit 1102 is used to acquire network operation and maintenance solutions for network operation and maintenance system to execute based on large language models and network operation and maintenance experience. The network operation and maintenance solutions correspond to network operation and maintenance tasks.

[0219] Optionally, the second acquisition unit 1002 includes:

[0220] The parsing unit is used to parse network operation and maintenance tasks based on the large language model, and obtain multiple sub-tasks of the network operation and maintenance task and the target dependency relationship. The target dependency relationship is the dependency relationship between multiple sub-tasks in the processing flow.

[0221] The orchestration unit is used to orchestrate network operation and maintenance sub-schemes corresponding to multiple sub-tasks based on a large language model and according to target dependencies, so as to obtain a network operation and maintenance scheme.

[0222] Optionally, the parsing unit includes:

[0223] The sub-units are used to break down network operation and maintenance experience based on a large language model, and obtain description information of multiple sub-tasks.

[0224] The analysis subunit is used to perform dependency analysis on network operation and maintenance experience based on a large language model to obtain the target dependency.

[0225] Optionally, the analysis sub-unit is used for:

[0226] Based on a large language model, the execution order of multiple sub-tasks in network operation and maintenance experience is analyzed.

[0227] Determine the target dependencies based on the execution order of multiple subtasks.

[0228] Optionally, the first acquisition unit is used to: acquire the processing flow through the first input box of the task editing interface, whereby the user inputs network operation and maintenance experience.

[0229] Optionally, the first acquisition unit is used to: acquire the processing flow through the first input box of the task editing interface, whereby the user inputs network operation and maintenance experience; and acquire the task description information of the network operation and maintenance task through the second input box of the task editing interface.

[0230] Optionally, the device 1100 further includes:

[0231] The output unit is used to output network operation and maintenance solutions;

[0232] The association unit is used to associate the network operation and maintenance plan with the task description information of the network operation and maintenance task in response to the confirmation operation of the network operation and maintenance plan. The confirmation operation indicates that the network operation and maintenance plan is used to implement the network operation and maintenance task.

[0233] Optionally, the device 1100 further includes:

[0234] The third acquisition unit is used to acquire the input dialogue message, which includes the network operation and maintenance intent described in natural language;

[0235] The invocation unit is used to respond to the matching of network operation and maintenance intent with the task description information of network operation and maintenance task, invoke the network operation and maintenance plan and run the network operation and maintenance plan in the network operation and maintenance system.

[0236] The output unit is used to output the execution results of network operation and maintenance tasks.

[0237] Optionally, the device 1100 further includes:

[0238] The invocation unit is used to respond to abnormal situations and match the task description information of network operation and maintenance tasks, invoke the network operation and maintenance plan, and run the network operation and maintenance plan in the network operation and maintenance system.

[0239] The output unit is used to output the execution results of network operation and maintenance tasks.

[0240] Optionally, the device 1100 further includes:

[0241] The fourth acquisition unit is used to acquire the modified network operation and maintenance experience in response to the modification operation of the network operation and maintenance experience.

[0242] The second acquisition unit 1102 is also used to acquire and update the modified network operation and maintenance plan based on the large language model and the modified network operation and maintenance experience.

[0243] Optionally, the device 1100 further includes:

[0244] The fifth acquisition unit is used to acquire the modified network operation and maintenance plan in response to the modification operation of the network operation and maintenance plan;

[0245] The association unit is used to respond to the confirmation operation of the modified network operation and maintenance plan by associating the modified network operation and maintenance plan with the task description information of the network operation and maintenance task, and the confirmation operation indicates that the network operation and maintenance plan is used to implement the network operation and maintenance task.

[0246] It should be understood that device 1100 corresponds to the control module in the aforementioned network operation and maintenance system. Each module in device 1100 and the other operations and / or functions described above are respectively for implementing the various steps and methods performed by the control module in the method embodiments. Specific details can be found in the aforementioned method embodiments, and for simplicity, they will not be repeated here. In some other embodiments, device 1100 also corresponds to the network management module in the network operation system. Device 1100 is also used to execute the method steps performed by the network management module in the aforementioned method for generating the network operation and maintenance scheme. Specific details can be found in the aforementioned method embodiments, and for simplicity, they will not be repeated here.

[0247] It should be understood that when generating network operation and maintenance solutions, device 1100 only uses the above-described division of functional modules as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of device 1100 can be divided into different functional modules to complete all or part of the functions described above. In addition, the device 1100 provided in the above embodiments and the above method embodiments belong to the same concept, and its specific implementation process is detailed in the above method embodiments, which will not be repeated here.

[0248] Figure 12 The diagram shown is a structural schematic of a computer device provided in an embodiment of this application. Figure 12 The computer device 1200 shown is configured as a terminal or server in the aforementioned application environment, such as Figure 12 As shown, computer device 1200 includes: bus 1202, processor 1204, memory 1206, and communication interface 1208. The processor 1204, memory 1206, and communication interface 1208 communicate with each other via bus 1202. Computer device 1200 can be a server or a terminal device. It should be understood that this application does not limit the number of processors and memories in computer device 1200. Bus 1202 can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. Buses can be divided into address buses, data buses, control buses, etc. For ease of illustration, Figure 12The bus 1204 is represented by a single line, but this does not imply that there is only one bus or one type of bus. Bus 1204 may include a path for transmitting information between various components of computer device 1200 (e.g., memory 1206, processor 1204, communication interface 1208). Processor 1204 may include any one or more processors such as a central processing unit (CPU), graphics processing unit (GPU), microprocessor (MP), or digital signal processor (DSP). Memory 1206 may include volatile memory, such as random access memory (RAM). Processor 1204 may also include non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid-state drive (SSD). The memory 1206 stores executable program code. The processor 1204 executes this executable program code to implement the method steps performed by the control module and / or network management module in the network operation and maintenance scheme generation method described in the above method embodiments. Taking the computer device 1200 as a first computer device as an example, the processor 1204 executes the executable program code to implement the method steps performed by the control module in the network operation and maintenance scheme generation method. Taking the computer device 1200 as a second computer device as another example, the processor 1204 executes the executable program code to implement the method steps performed by the network management module in the network operation and maintenance scheme generation method. The communication interface 1208 uses a transceiver module, such as, but not limited to, a network interface card or transceiver, to realize communication between the computer device 1200 and other devices or communication networks.

[0249] In an exemplary embodiment, a computer-readable storage medium is also provided, such as a memory including program code, which can be executed by a processor of a computer device to complete the method for generating the network operation and maintenance plan. For example, if the computer device can be configured as a first computer device, the program code can be executed by the processor of that computer device to complete the method steps performed by the control module in the method for generating the network operation and maintenance plan. As another example, if the computer device can be configured as a second computer device, the program code can be executed by the processor of that computer device to complete the method steps performed by the network management module in the method for generating the network operation and maintenance plan. The computer-readable storage medium is a non-transitory computer-readable storage medium, such as read-only memory (ROM), random access memory (RAM), compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, and optical data storage devices.

[0250] This application also provides a computer program product or computer program, which includes program code stored in a computer-readable storage medium. The processor of a computer device reads the program code from the computer-readable storage medium and executes the program code, causing the computer device to perform the aforementioned method for generating a network operation and maintenance solution. For example, if the computer device can be configured as a first computer device, the program code can be executed by the processor of that computer device to complete the method steps performed by the control module in the aforementioned method for generating a network operation and maintenance solution. As another example, if the computer device can be configured as a second computer device, the program code can be executed by the processor of that computer device to complete the method steps performed by the network management module in the aforementioned method for generating a network operation and maintenance solution.

[0251] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory. The memory is used to store computer execution instructions. When the apparatus is running, the processor can execute the computer execution instructions stored in the memory to enable the chip to execute the network operation and maintenance scheme generation method provided in the above method embodiments.

[0252] In this embodiment, the apparatus, device, computer-readable storage medium, computer program product or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0253] In the description of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. The "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Furthermore, "at least one" means one or more, and "multiple" means two or more. The terms "first," "second," etc., do not limit the quantity or order of execution, and "first," "second," etc., do not necessarily imply differences.

[0254] In this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or illustration. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0255] It should be noted that all information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, network operation and maintenance experience and conversation messages involved in this application were obtained with full authorization.

[0256] All of the above-mentioned optional technical solutions can be combined in any way to form optional embodiments of this disclosure, and will not be described in detail here.

[0257] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A method for generating a network operation scheme, characterized in that, The method comprises: acquiring network operation and maintenance experience described in natural language, the network operation and maintenance experience comprising a processing flow obtained by a user performing a network operation and maintenance task; based on a large language model and the network operation and maintenance experience, acquiring a network operation and maintenance scheme for a network operation and maintenance system to execute, the network operation and maintenance scheme corresponding to the network operation and maintenance task.

2. The method of claim 1, wherein, The acquisition of the network operation and maintenance scheme for the network operation and maintenance system to execute based on the large language model and the network operation and maintenance experience comprises: based on the large language model, performing operation and maintenance task analysis on the network operation and maintenance experience to obtain a plurality of subtasks of the network operation and maintenance task and a target dependency relationship, the target dependency relationship being a dependency relationship between the plurality of subtasks in the processing flow; based on the large language model, arranging network operation and maintenance sub-schemes corresponding to the plurality of subtasks according to the target dependency relationship to obtain the network operation and maintenance scheme.

3. The method of claim 2, wherein, The operation and maintenance task analysis on the network operation and maintenance experience based on the large language model to obtain the plurality of subtasks of the network operation and maintenance task and the target dependency relationship comprises: based on the large language model, disassembling the network operation and maintenance experience to obtain description information of the plurality of subtasks; based on the large language model, performing dependency relationship analysis on the network operation and maintenance experience to obtain the target dependency relationship.

4. The method of claim 3, wherein, The dependency relationship analysis on the network operation and maintenance experience based on the large language model to obtain the target dependency relationship comprises: based on the large language model, analyzing the execution order of the plurality of subtasks in the network operation and maintenance experience; based on the execution order of the plurality of subtasks, determining the target dependency relationship.

5. The method according to any one of claims 1-4, characterized in that, The acquisition of the network operation and maintenance experience described in natural language comprises: acquiring the processing flow through a first input box of a task editing interface, the task editing interface being used by the user to input the network operation and maintenance experience.

6. The method according to any one of claims 1-4, characterized in that, The network operation and maintenance experience further comprises task description information of the network operation and maintenance task, and the acquisition of the network operation and maintenance experience described in natural language comprises: acquiring the processing flow through a first input box of a task editing interface, the task editing interface being used by the user to input the network operation and maintenance experience; acquiring the task description information of the network operation and maintenance task through a second input box of the task editing interface.

7. The method according to any one of claims 1 to 6, characterized in that, After the acquisition of the network operation and maintenance scheme for the network operation and maintenance system to execute, the method further comprises: outputting the network operation and maintenance scheme; in response to a confirmation operation of the network operation and maintenance scheme, associating the network operation and maintenance scheme with task description information of the network operation and maintenance task, the confirmation operation indicating that the network operation and maintenance scheme is confirmed to be used to implement the network operation and maintenance task.

8. The method according to any one of claims 1 to 7, characterized in that, After the acquisition of the network operation and maintenance scheme for the network operation and maintenance system to execute, the method further comprises: acquiring an input dialogue message, the dialogue message comprising a network operation and maintenance intent described in natural language; in response to the network operation and maintenance intent matching the task description information of the network operation and maintenance task, invoking the network operation and maintenance scheme and running the network operation and maintenance scheme in the network operation and maintenance system; output an execution result of the network operation task.

9. The method according to any one of claims 1-8, characterized in that, After the network operation scheme for execution by the network operation system is acquired, the method further includes: receiving network alarm information, the network alarm information indicating an abnormal situation occurring in the network; in response to the abnormal situation matching task description information of the network operation task, invoking the network operation scheme and running the network operation scheme in the network operation system; outputting an execution result of the network operation task.

10. A network operation scheme generation apparatus characterized by comprising: The device includes: a first acquisition unit configured to acquire network operation experience described in natural language, the network operation experience including a processing flow obtained by a user performing a network operation task; a second acquisition unit configured to acquire, based on a large language model and the network operation experience, a network operation scheme for execution by a network operation system, the network operation scheme corresponding to the network operation task.

11. The apparatus of claim 10, wherein, The second acquisition unit includes: an analysis unit configured to analyze, based on the large language model, an execution order of the multiple subtasks in the network operation experience; and an arrangement unit configured to arrange, based on the large language model and the target dependency relationship, network operation sub-schemes corresponding to the multiple subtasks to obtain the network operation scheme.

12. The apparatus of claim 11, wherein, The analysis unit is configured to: analyze, based on the large language model, an execution order of the multiple subtasks in the network operation experience; and determine the target dependency relationship based on the execution order of the multiple subtasks.

13. The apparatus of claim 12, wherein, The first acquisition unit is configured to: acquire the processing flow through a first input box of a task editing interface, the task editing interface being used by the user to input the network operation experience. The first acquisition unit is configured to:

14. The apparatus of any one of claims 10-13, wherein, acquire the processing flow through a first input box of a task editing interface, the task editing interface being used by the user to input the network operation experience; and acquire task description information of the network operation task through a second input box of the task editing interface.

15. The apparatus of any one of claims 10-13, wherein, The device further includes: an output unit configured to output the network operation scheme; and an association unit configured to associate, in response to a confirmation operation on the network operation scheme, the network operation scheme with task description information of the network operation task, the confirmation operation indicating confirmation that the network operation scheme is used to implement the network operation task.

16. The apparatus of any one of claims 10-15, wherein, The device further includes: a third acquisition unit configured to acquire an input dialogue message, the dialogue message including a network operation intent described in natural language. ​ 17. The apparatus of any one of claims 10-16, wherein, ​ ​ The calling unit is configured to, in response to the network operation intention matching task description information of the network operation task, call the network operation scheme and run the network operation scheme in the network operation system. The output unit is configured to output an execution result of the network operation task.

18. The apparatus of any one of claims 10-17, wherein, The apparatus further includes: The receiving unit is configured to receive network alarm information, the network alarm information indicating an abnormal situation occurring in a network. The calling unit is configured to, in response to the abnormal situation matching task description information of the network operation task, call the network operation scheme and run the network operation scheme in the network operation system. The output unit is configured to output an execution result of the network operation task.

Images