Network operation and maintenance method, device and equipment based on large language model and storage medium

Through a large language model, the user's intentions are identified and network operation and maintenance tasks are automatically arranged, and the problems of low operation and maintenance efficiency and high complexity in the existing technology are solved, and the effect of simplifying operation and maintenance processes and improving operation and maintenance efficiency is achieved.

CN118945047APending Publication Date: 2024-11-12HUAWEI TECH CO LTD
View PDF 0 Cites 4 Cited by

Patent Information

Application Number
CN202310957610.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-10
Filing Date
2023-07-31
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The complexity of existing network operation and maintenance systems and insufficient familiarity with administrators lead to low operation and maintenance efficiency. Administrators need to frequently operate and enter instructions to complete operation and maintenance tasks, and the process is complex and difficult.

Method used

The network operation and maintenance method based on the large language model is adopted, and by identifying the operation and maintenance intentions in user conversation messages, automatically orchestrating operation and maintenance tasks, simplifying the operation and maintenance process, reducing operation and maintenance difficulty, and improving operation and maintenance efficiency.

Benefits of technology

There is no need for frequent users to interact, simplify operation and maintenance operation processes, improve network operation and maintenance efficiency, reduce operation and maintenance difficulties, and enhance users' dependence on network operation and maintenance systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945047A_ABST
    Figure CN118945047A_ABST
Patent Text Reader

Abstract

The invention discloses a network operation and maintenance method and device based on a large language model, equipment and a storage medium, and belongs to the technical field of communication. According to the method, the network operation and maintenance intention of the user is recognized from the dialogue message of the user through the large language model, then the operation and maintenance task expected to be executed on the network by the user is established based on the network operation and maintenance intention, and after the operation and maintenance task is executed, the execution result of the operation and maintenance task is provided for the client. In this way, the user only needs to provide the dialogue message in a dialogue mode, multiple interactions with the client side are not needed, the operation process of network operation and maintenance is simplified, and then the network operation and maintenance efficiency can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims priority to Chinese patent application No. 202310525410.7 filed on May 10, 2023, with invention name “A method, device and system for network operation and maintenance”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to a network operation and maintenance method, device, equipment and storage medium based on a large language model. Background Art

[0003] In the related art, multiple network operation and maintenance systems are usually deployed in the network, and the administrator completes the network operation and maintenance work by operating on each network operation and maintenance system. The difficulty and complexity of network operation and maintenance work depends on the functions of the network operation and maintenance system and the administrator's familiarity with the network and the network operation and maintenance system. For example, if the administrator is not familiar enough with the network and the network operation and maintenance system, the difficulty and complexity of network operation and maintenance work will increase, resulting in low network operation and maintenance efficiency. For another example, the administrator needs to perform a large number of operations or input a large number of instructions on the network operation and maintenance system in order to perform operation and maintenance tasks in the network through the network operation and maintenance system. The operation process is complicated, resulting in low network operation and maintenance efficiency. Summary of the invention

[0004] The embodiment of the present application provides a network operation and maintenance method, apparatus, device and storage medium based on a large language model, which can improve the efficiency of network operation and maintenance. The technical solution is as follows:

[0005] On the first aspect, a network operation and maintenance method based on a large language model is provided. In the method, for an input dialogue message, the network operation and maintenance intention of the dialogue message is first determined based on the large language model; then, based on the network operation and maintenance intention, the network operation and maintenance task to be executed is obtained, and then the operation and maintenance task is executed and a dialogue response is output.

[0006] The method identifies the user's network operation and maintenance intention from the user's conversation message through a large language model, and then establishes the network operation and maintenance task that the user expects to perform on the network based on the network operation and maintenance intention. After the network operation and maintenance task is completed, the execution result of the network operation and maintenance task is provided to the client. In this process, the user only needs to provide the conversation message in the form of a conversation, and there is no need to interact with the client multiple times, which simplifies the operation process of network operation and maintenance, thereby improving the efficiency of network operation and maintenance.

[0007] In one possible implementation, the network operation and maintenance intention includes the operation and maintenance task intention and the operation and maintenance scenario intention. On this basis, the above process of obtaining the network operation and maintenance task can be: based on the large language model and the application programming interface corresponding to the operation and maintenance scenario intention, the network operation and maintenance task is orchestrated for the operation and maintenance task intention to obtain task information, wherein the application programming interface here is used to complete the network operation task under the operation and maintenance scenario intention, and the task information is the orchestrated network operation and maintenance task, and the task information indicates the calling process of the application programming interface when executing the network operation and maintenance task.

[0008] Based on the above possible implementation methods, network operation and maintenance tasks are automatically orchestrated through a large language model without the need for manual orchestration by users, which simplifies the network operation and maintenance process, reduces the difficulty of network operation and maintenance, and thus improves the efficiency of network operation and maintenance.

[0009] In one possible implementation, the operation and maintenance task intent includes multiple operation and maintenance task sub-intentions. On this basis, the above-mentioned process of obtaining task information based on the large language model can be: based on the large language model and the application programming interface, network operation and maintenance sub-tasks are respectively arranged for multiple operation and maintenance task sub-intentions to obtain multiple sub-task information; based on the multiple sub-task information, task information of the operation and maintenance task is obtained, wherein the sub-task information is the arranged network operation and maintenance sub-task, and the sub-task information indicates the calling process of the application programming interface when executing the network operation and maintenance sub-task.

[0010] When a network operation and maintenance task includes multiple network operation and maintenance subtasks, it is difficult to manually orchestrate the network operation and maintenance tasks, which requires users to have a high level of understanding of various application program interfaces of the network. Based on the above possible implementation methods, network operation and maintenance tasks are automatically orchestrated through a language model without the need for manual orchestration by users, which simplifies the network operation and maintenance process, reduces the difficulty of network operation and maintenance, and thus improves the efficiency of network operation and maintenance.

[0011] In one possible implementation, the large language model is not local, and the network operation and maintenance tasks are orchestrated by calling a remote large language model. For example, the description information of the application programming interface is first obtained, and then based on the operation and maintenance task intent, the first prompt statement, and the description information of the application programming interface, the task orchestration prompt information is generated, and the task orchestration prompt information is sent to the device running the large language model, and then the task information returned by the device is received.

[0012] Based on the above possible implementation methods, the consumption of local computing resources can be reduced by calling the large language model in other devices to complete the orchestration of network operation and maintenance tasks.

[0013] In a possible implementation, the description information of the application programming interface is obtained from the network management device, for example, an information acquisition request is sent to the network management device, and the description information returned by the network management device is received, wherein the information acquisition request indicates obtaining the description information of the application programming interface.

[0014] Based on the above possible implementation methods, by obtaining the current description information of the application programming interface from the network side, the large language model can orchestrate appropriate network operation and maintenance tasks based on the current description information of the application programming interface, thereby improving the rationality of the orchestrated network operation and maintenance tasks.

[0015] In a possible implementation, the operation and maintenance scenario is intended to be any one of a network planning scenario, a network construction scenario, a network maintenance scenario, a network optimization scenario, a network data query scenario, and a knowledge question and answer scenario.

[0016] Based on the above possible implementation methods, for dialogue messages in various operation and maintenance scenarios, the methods provided in the embodiments of the present application can provide users with final question and answer results, thereby not limiting the operation and maintenance scenarios, and can provide users with operation and maintenance services for various operation and maintenance scenarios, thereby increasing users' dependence on the network operation and maintenance system and improving user stickiness of the network operation and maintenance system.

[0017] In one possible implementation, the network operation and maintenance intention includes a first operation and maintenance task sub-intention and a second operation and maintenance task sub-intention. On this basis, after determining such network operation and maintenance intention, the method also includes the following steps: sending the first operation and maintenance task sub-intention to the first device, and sending the second operation and maintenance task sub-intention to the second device; then, obtaining the execution result of the first network operation and maintenance subtask from the first device, and obtaining the execution result of the second network operation and maintenance subtask from the second device; based on the execution result of the first network operation and maintenance subtask and the execution result of the second network operation and maintenance subtask, outputting the dialogue response.

[0018] Based on the above possible implementation methods, by distributing each operation and maintenance task sub-intention in the operation and maintenance task intent to multiple devices, multiple devices process the operation and maintenance task sub-intention in parallel, thereby improving the processing efficiency of the operation and maintenance task intent and reducing the response time of the dialogue message.

[0019] In a possible implementation, the message processing device is located in the cloud, or the message processing device is located in an operation support system, a network element management system, or a network management system of the network.

[0020] In one possible implementation, the network operation and maintenance intention is determined by calling a large language model. For example, operation and maintenance intention prompt information is first generated based on the dialogue message and the second prompt sentence. The second prompt sentence is used to prompt the large language model to identify the network operation and maintenance intention of the dialogue message, and prompt the large language model to output the identified network operation and maintenance intention; then, the operation and maintenance intention prompt information is sent to the device running the large language model; and the network operation and maintenance intention returned by the device is received.

[0021] Based on the above possible implementation methods, the network operation and maintenance intention of the conversation message is identified through the first language model in other devices, which can reduce the consumption of local computing resources.

[0022] In a possible implementation, other devices are located in the cloud, or the decision-making device is located in an operation support system, a network element management system, or a network management system of the network.

[0023] In a second aspect, a network operation and maintenance device based on a large language model is provided, the device comprising a functional module for executing the method provided by the first aspect or any optional manner of the first aspect.

[0024] In a third aspect, a computer device is provided, the computer device comprising a processor, the processor being configured to execute program code so that the computer device executes to implement the method provided in the first aspect or various optional implementations of the first aspect.

[0025] In a fourth aspect, a computer-readable storage medium is provided, in which at least one program code is stored. The program code is read by a processor so that a computer device executes the method as provided in the first aspect or various optional implementations of the first aspect.

[0026] Based on the implementations provided in the above aspects, this application can also be further combined to provide more implementations. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 It is an architecture diagram of a network operation and maintenance system based on a large language model provided in an embodiment of the present application;

[0028] Figure 2 It is a deployment diagram of a network operation and maintenance system provided in an embodiment of the present application;

[0029] Figure 3 It is a deployment diagram of another network operation and maintenance system provided in an embodiment of the present application;

[0030] Figure 4 It is a deployment diagram of another network operation and maintenance system provided in an embodiment of the present application;

[0031] Figure 5 It is a deployment diagram of another network operation and maintenance system provided in an embodiment of the present application;

[0032] Figure 6 It is a deployment diagram of another network operation and maintenance system provided in an embodiment of the present application;

[0033] Figure 7 It is a deployment diagram of another network operation and maintenance system provided in an embodiment of the present application;

[0034] Figure 8 It is a deployment diagram of another network operation and maintenance system provided in an embodiment of the present application;

[0035] Fig. 9 It is a deployment diagram of another network operation and maintenance system provided in an embodiment of the present application;

[0036] Fig.10 It is a flow chart of a network operation and maintenance method based on a large language model provided in an embodiment of the present application;

[0037] Fig.11 is a schematic diagram of a dialogue interface provided in an embodiment of the present application;

[0038] Fig.12 It is a flow chart of another network operation and maintenance method based on a large language model provided in an embodiment of the present application;

[0039] Fig.13 is a flow chart of another network operation and maintenance method based on a large language model provided in an embodiment of the present application;

[0040] Fig.14 is a schematic diagram of another dialogue interface provided in an embodiment of the present application;

[0041] Fig.15 is a flow chart of another network operation and maintenance method based on a large language model provided in an embodiment of the present application;

[0042] Fig.16 It is a structural diagram of a network operation and maintenance device based on a large language model provided in an embodiment of the present application;

[0043] Fig.17 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to facilitate the understanding of the technical solution proposed in this application, some of the terms involved in this application are explained as follows:

[0045] Large language model (LLM): refers to a computer model that can process and generate natural language. LLM is an artificial intelligence technology based on deep learning. It can predict the next word or sentence by learning the statistical laws and semantic information of language data. LLM is usually composed of multiple neural networks (such as feedforward neural networks and recursive neural networks). Among them, feedforward neural networks are used to extract features from input text, and recursive neural networks are used to model text sequences. By continuously training a large amount of text data, LLM can gradually improve its understanding and prediction capabilities of natural language. With the improvement of LLM capabilities, LLM can be applied to a variety of application fields, such as natural language processing, machine translation, text generation, robotics, machine learning, speech recognition, image processing, etc. Therefore, LLM can also be called a multimodal large language model (MLLM).

[0046] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0047] Figure 1 This is an architecture diagram of a network operation and maintenance system based on a large language model provided in an embodiment of the present application, see Figure 1 The network operation and maintenance system 100 includes a client 10, a message processing device 20, a decision device 30, and a network management device 50 of a network 40, wherein the network 40 generally refers to a device cluster composed of multiple devices, and these multiple devices may be network devices. The network 40 composed of network devices is a communication network for providing communication functions. These multiple devices may also be computer devices, and the network 40 composed of multiple computer devices is a computer device cluster for providing computing functions. These multiple devices may also be storage devices, and the network 40 composed of multiple storage devices is a storage device cluster for providing data storage functions. The network 40 can be deployed in the cloud (private cloud or public cloud), or it may not be deployed in the cloud. Here, the embodiment of the present application does not limit the deployment environment of the network 40.

[0048] The network management device 50 is connected to the network 40. The network management device 50 is used to manage and / or maintain the resources of the network 40, such as hardware resources, software resources, service resources, etc., wherein hardware resources refer to the hardware resources of the network 40, software resources refer to the software resources of the network 40, and service resources refer to the resources of the services provided by the network 40 to the outside, such as computing resources, storage resources, communication resources, etc. Communication resources refer to resources related to the communication of the network 40, such as network bandwidth, network delay, network packet loss, network infrastructure, etc., wherein network infrastructure refers to all hardware and software used to support the organization's network communication. Taking the network 40 as a communication network composed of network devices as an example, the network management device 50 has the management capabilities of planning, new construction, operation and maintenance, network optimization, etc. for the network devices in the network 40.

[0049] The client 10 is used to provide a human-computer interaction interface, receive a dialogue message input by a user (such as an administrator of the network 40) for the network 40, and connect to the message processing device 20 to provide the message processing device 20 with the dialogue message input by the user, and display the dialogue response of the message processing device 20 to the dialogue message on the human-computer interaction interface to realize human-computer dialogue. Among them, the human-computer interaction interface can be an entrance based on question-and-answer interaction, and the user can send question-type information or non-question-type information for the network 40 to the message processing device 20 in a natural language through the human-computer interaction interface. The question-type information or non-question-type information is provided to the message processing device 20 in the form of a dialogue message, and the message processing device 20 responds to the question-type information or non-question-type information.

[0050] The message processing device 20 is a network operation and maintenance assistant in the network operation and maintenance system 100. The message processing device 20 is connected to the client 10, the decision device 30 and the network management device 50. The message processing device 20 is equivalent to the link (or bridge) between the client 10, the decision device 30 and the network management device 50. The message processing device 20 is used to process the dialogue message provided by the client. For the dialogue message provided by the client 10, the large language model in the decision-making device 30 is called to analyze the network operation and maintenance intention of the dialogue message, and the dynamic data on the network 40 side related to the network operation and maintenance intention is obtained from the network management device 50. The dynamic data on the network 40 side of the network operation and maintenance intention is provided to the large language model in the decision-making device 30, and the large language model is called to orchestrate network operation and maintenance tasks for the network operation and maintenance intention, and the network operation and maintenance tasks are sent to the network management device 50. The network management device 50 executes the sent network operation and maintenance tasks to manage and / or maintain the resources of the network 40, and feeds back the execution results of the network operation and maintenance tasks to the message processing device 20. Furthermore, the message processing device 20 provides the execution results of the network operation and maintenance tasks to the client 10 as a dialogue response, and the client 10 displays the execution results in an informationized or graphical manner on the human-computer interaction interface.

[0051] The decision device 30 is a decision maker in the network operation and maintenance system 100. The decision device 30 is used to provide a large language model in the field of network operation and maintenance. Taking the network 40 as a communication network as an example, the large language model is trained based on the training data of the communication network in the field of network operation and maintenance and the basic large language model in the communication field, so that the large language model has the ability to analyze the user intention of the dialogue message in the field of network operation and maintenance (i.e., the network operation and maintenance intention), arrange the network operation and maintenance tasks based on the network operation and maintenance intention, and convert the execution results of the network operation and maintenance tasks into information that the user can understand. Among them, the training data such as the text information involved in the process of the user performing operation and maintenance work on the communication network, the log data of the communication network, the log analysis data, the product code, the work order, etc., the user can understand the information such as the information expressed in natural language, the chart, the recommendation information, the guidance information, the navigation information, etc.

[0052] In some possible implementations, the decision device 30 also has the ability to infer and train a large language model, and the large language model provided by the decision device 30 is inferred and trained by the model service 30. In other possible implementations, the decision device 30 does not have the ability to infer and train a large language model, and the large language model provided by the decision device 30 is inferred and trained by other devices outside the decision device 30, and the large language model is only deployed on the decision device 30.

[0053] Next, taking the network 40 as a communication network as an example, the deployment method of the client 10, the message processing device 20, the decision device 30, the network management device 50, and the process of network operation and maintenance of the network 40 based on the large language model are introduced. For other types of networks 40, the deployment method of the client 10, the message processing device 20, the decision device 30, the network management device 50, and the process of network operation and maintenance of the network 40 based on the large language model can refer to the communication network.

[0054] The client 10 is located in the operation support system (OSS) of the terminal or network 40, the message processing device 20 is located in the cloud, the OSS of the network 40, the element management system (EMS) or the network management system (NMS), the decision-making device 30 is located in the cloud, the OSS, the EMS or the NMS, and the network management device 50 is located in the cloud, the OSS, the EMS or the NMS. Based on this, each of the message processing device 20, the decision-making device 30 and the network management device 50 can be deployed separately in the cloud, the OSS, the EMS or the NMS, or can be deployed in at least one of the cloud, the OSS, the EMS or the NMS in a combined manner.

[0055] Combine the following Figures 2 to 9 The deployment diagram of the network operation and maintenance system shown in the figure introduces the possible deployment methods of each module in the network operation and maintenance system 100 as follows.

[0056] against Figures 2 to 9 In each deployment mode shown, there is at least one client 10, and each client 10 can be deployed on a terminal or OSS. In the case of multiple clients 10, some of the multiple clients 10 may be deployed on a terminal, and another part of the clients 10 may be deployed on an OSS. The multiple clients 10 may also be all deployed on a terminal or all deployed on an OSS. Here, the embodiments of the present application do not limit the deployment location of each client 10.

[0057] like Figure 2In the deployment mode 1 shown, the message processing device 20, the decision device 30 and the network management device 50 are all deployed in the EMS / NMS (representing EMS or NMS). Each client 10 aggregates the session messages received by each client to the message processing device 20. For each session message, the message processing device 20 calls the large language model in the decision device 30 to analyze the network operation and maintenance intention of the session message. Based on the network operation and maintenance intention, the network management device 50 performs network planning, network construction, network maintenance, network optimization or network data query operations on the network 40 (i.e., performs network operation and maintenance tasks on the network 40).

[0058] like Figure 3 In the deployment mode 2 shown, the message processing device 20 and the decision device 30 are both deployed in the OSS, there are multiple EMS / NMS, each EMS / NMS is deployed with at least one network management device 50, and the message processing device 20 is connected to the network management device 50 in each EMS / NMS. Each client 10 aggregates the session messages received by each client to the message processing device 20. For each session message, the message processing device 20 calls the large language model in the decision device 30 to analyze the network operation and maintenance intention of the session message, and selects at least one network management device 50 from multiple network management devices 50 based on the network operation and maintenance intention to perform network operation and maintenance tasks on the network 40.

[0059] like Figure 4 In the deployment mode 3 shown, there are also multiple EMS / NMSs, and at least one message processing device 20 and at least one network management device 50 are deployed in each EMS / NMS. Each message processing device 20 is connected to the network management device 50 in the EMS / NMS. The decision device 30 is deployed in the cloud, and the decision device 30 is connected to the speech processor 20 in each EMS / NMS. Any client 10 sends the received session message to any message processing device 20 in any EMS / NMS. The message processing device 20 calls the large language model in the decision device 30 to analyze the network operation and maintenance intention of the session message. Based on the network operation and maintenance intention, the network operation and maintenance task is performed on the network 40 through the management manager 50 in the EMS / NMS.

[0060] like Figure 5In the deployment mode 4 shown, the message processing device 20 is deployed in the OSS. For example, there is one OSS and at least one message processing device 20. The at least one message processing device 20 can be deployed in the OSS, or there are multiple OSSs and message processing devices 20, and at least one message processing device 20 is deployed in each OSS. The decision device 30 is deployed in the cloud, and the decision device 30 is connected to each message processing device 20 in each OSS, so that multiple message processing devices 20 can share the large language model in the decision device 30. There are also multiple EMS / NMSs, and at least one network management device 50 is deployed in each EMS / NMS, and each network management device 50 is connected to each message processing device 20 in each OSS. Any client 10 sends the received session message to any message processing device 20 in any OSS. The message processing device 20 calls the large language model in the decision device 30 to analyze the network operation and maintenance intention of the session message, and selects at least one network management device 50 from multiple network management devices 50 based on the network operation and maintenance intention to perform network operation and maintenance tasks on the network 40.

[0061] For any of the above deployment modes 1 to 4, the network 40 may be connected to multiple network management devices 50, and the multiple network management devices 50 have the same management authority over the network 40. For example, each network management device 50 can perform network planning, network construction, network maintenance, network optimization, or network data query operations on the network 40. In other deployment modes, the multiple network management devices 50 of the network 40 have different management levels, and the network management devices of different management levels have different management authority over the network 40. For example, the multiple network management devices 50 are divided into network management devices 51 and network management devices 52. The management level of network management device 51 is higher than the management level of network management device 52. Network management device 51 is the upper-level manager of network management device 52, and network management device 52 can have at least one.

[0062] like Figure 6In the deployment mode 5 shown, the network management device 51 is deployed on the OSS, and at least one network management device 52 is deployed in each of the multiple EMS / NMSs. The network management device 51 is connected to multiple network management devices 52, and the multiple network management devices 52 are all connected to the network 40. The message processing device 20 and the decision device 30 are both deployed on the cloud. The message processing device 20 is connected to the network management device 51 and each network management device 52. The session messages of each client 10 are aggregated to the message processing device 20. The message processing device 20 calls the large language model in the decision device 30 to analyze the network operation and maintenance intention of the session message, and arranges the network operation and maintenance tasks for the network operation and maintenance intention. The message processing device 20 sends the network operation and maintenance tasks to the network management device 51. The network management device 51 calls the network management device 52 to perform the network operation and maintenance tasks on the network 40. Alternatively, the message processing device 20 sends the network operation and maintenance tasks to the network management device 52, and the network management device 52 performs the network operation and maintenance tasks on the network 40. Of course, the message processing device 20 may not be connected to each network management device 52. Accordingly, the message processing device 20 performs network operation and maintenance tasks through the network management device 52. The network management device 51 and multiple network management devices 52 may also be deployed in OSS or in EMS / NMS.

[0063] The above deployment mode 5 is illustrated by taking the network management devices 50 of different management levels sharing the same message processing device 20 as an example. In other embodiments, the network management devices 50 of different management levels are respectively configured with a message processing device 20. Taking the network operation and maintenance system 100 including a network management device 51, multiple network management devices 52, multiple message processing devices 20 and multiple decision devices 30 as an example, the multiple message processing devices 20 are divided into a message processing device 21 and multiple message processing devices 22. The message processing device 21 and the network management device 51 have the same management level. The message processing device 21 is configured to the network management device 51. The message processing device 22 and the network management device 52 have the same management level. The multiple message processing devices 22 are respectively configured to one network management device 52, so that the message processing device 21 becomes the upper-level manager of each message processing device 22.

[0064] like Figure 7In the deployment mode 6 shown, a message processing device 21, a decision device 31, and a network management device 51 are deployed in the OSS, and the message processing device 21 is respectively connected to the decision device 31 and the network management device 51. There are multiple EMS / NMSs, and each EMS / NMS is deployed with a message processing device 22, a decision device 32, and a network management device 52, and each message processing device 22 is respectively connected to the decision device 32 and the network management device 52 in the EMS / NMS. The client 10 is connected to the message processing device 21, and the message processing device 21 is also connected to each message processing device 22, and the network management device 51 is connected to each network management device 52. The session messages of each client 10 are aggregated to the message processing device 21. The message processing device 21 calls the large language model in the first decision device 31 to analyze the network operation and maintenance intention of the session message, and sends the network operation and maintenance intention to a message processing device 22. The message processing device 22 calls the large language model in the second decision device 32 in the EMS / NMS where it is located, arranges network operation and maintenance tasks for the network operation and maintenance intention, and sends the network operation and maintenance tasks to the network management device 52. The network management device 52 executes the network operation and maintenance tasks on the network 40. Alternatively, in the case where the network operation and maintenance intention includes multiple operation and maintenance task sub-intentions, the message processing device 21 sends the multiple operation and maintenance task sub-intentions to the message processing devices 22 in different EMS / NMSs respectively. Each message processing device 22 that receives the operation and maintenance task sub-intentions respectively calls the large language model in the second decision device 32 in the EMS / NMS where it is located, arranges network operation and maintenance sub-tasks for the operation and maintenance task sub-intentions received by each, calls the network management device 52 connected to it to execute the network operation and maintenance sub-task on the network 40, and returns the execution result of the network operation and maintenance sub-task to the message processing device 21, so that the message processing device 21 can obtain the execution results of the multiple network operation and maintenance sub-tasks, and based on the execution results of the multiple network operation and maintenance sub-tasks, returns the execution result of the network operation and maintenance task corresponding to the network operation and maintenance intention to the client 10. Alternatively, the message processing device 21 does not send the network operation and maintenance intention to the message processing device 22, calls the large language model in the first decision device 31 to arrange the network operation and maintenance task for the network operation and maintenance intention, and executes the network operation and maintenance task by calling the application programming interface in the network management device 51.

[0065] The above deployment mode 6 is illustrated by taking the example that the message processing devices 20 at different management levels are configured with different large language models. In other embodiments, the message processing devices 20 at different management levels share the same large language model. Figure 8In the deployment mode 7 shown, a decision device 30 is deployed in the cloud, a message processing device 21 and a network management device 51 are deployed in the OSS, and multiple network management devices 52 with the same management level are divided into network management devices 521 and network management devices 522. There are multiple EMS / NMSs, some of which are deployed with message processing devices 22 and network management devices 521, and the other EMS / NMSs are deployed with network management devices 522 but not message processing devices 22. Both the message processing devices 21 and 22 are connected to the decision device 30 to share the large language model in the decision device 30. The session messages of each client 10 are aggregated to the message processing device 21. The message processing device 21 calls the large language model in the decision-making device 30 to analyze the network operation and maintenance intention of the session message. If the network operation and maintenance intention includes multiple operation and maintenance task sub-intentions, the message processing device 21 sends the multiple operation and maintenance task sub-intentions to the message processing devices 22 in different EMS / NMS respectively. Each message processing device 22 that receives the operation and maintenance task sub-intention calls the large language model in the decision-making device 30 respectively, arranges network operation and maintenance sub-tasks for the operation and maintenance task sub-intentions received by each, calls the network management device 521 in the EMS / NMS where it is located to execute the network operation and maintenance sub-task on the network 40, and returns the execution result of the network operation and maintenance sub-task to the message processing device 21, so that the message processing device 21 returns the execution result of the network operation and maintenance task corresponding to the network operation and maintenance intention to the client 10 based on the execution results of the multiple network operation and maintenance sub-tasks. If the network operation and maintenance intent does not include multiple operation and maintenance task sub-intents, the message processing device 21 calls the large language model in the decision device 30 to arrange the network operation and maintenance tasks for the network operation and maintenance intent, and executes the network operation and maintenance tasks by calling the application programming interface in the network management device 521 or 522. For deployment mode 7, in other embodiments, similar to deployment mode 6, each EMS / NMS may also be deployed with a message processing device 22. Accordingly, for deployment mode 6, in other embodiments, similar to deployment mode 7, there may also be a situation where there is no message processing device 22 in the EMS / NMS.

[0066] For any deployment method from deployment method 5 to deployment method 7, the example of dividing multiple network management devices 50 into network management devices of two management levels is used for explanation. In other embodiments, multiple network management devices 50 can also be divided into network management devices of more than two management levels. For network management devices of two adjacent management levels, the network management device with a higher management level is connected to the network management device with a lower management level. Here, the embodiment of the present application does not limit the number of management levels of network management devices. For multi-level network management devices, when the message processing device 20 does not distinguish between management levels (such as deployment method 5), the message processing device 20 can be connected to the network management device of the highest management level in the multi-level network management device, or connected to network management devices at all levels, and perform network operation and maintenance tasks through the network management device 20 connected thereto. When the message processing device 20 distinguishes between management levels (such as deployment method 6 or deployment method 7), the network management device 20 and the message processing device 20 of the same management level are deployed in the same subsystem, and the network management device 20 and the message processing device 20 of the same management level are connected, so that the message processing device 20 calls the network management device 20 of the same management level.

[0067] For any deployment method from deployment method 1 to deployment method 7, it is shown as an example that neither OSS nor EMS / NMS is deployed in the cloud. In other embodiments, at least one of OSS and EMS / NMS in any deployment method can also be deployed in the cloud. Taking deployment method 5 as an example, both OSS and EMS / NMS in deployment method 5 are deployed in the cloud, and the result is Fig. 9 Deployment method 8 is shown.

[0068] Each of the above-mentioned message processing device 20, model processor 30 and network management device 50 can be implemented in the form of hardware, software or a combination of software and hardware. Here, the embodiment of the present application does not limit the implementation method of the message processing device 20, model processor 30 and network management device 50. The message processing device 20, model processor 30 and network management device 50 can be independently integrated in different computer devices, or at least two of the message processing device 20, model processor 30 and network management device 50 can also be integrated in the same computer device. Here, the embodiment of the present application does not limit the integration method of the message processing device 20, model processor 30 and network management device 50.

[0069] Next, for the network operation and maintenance system introduced above, the implementation process of the network operation and maintenance method is introduced as follows.

[0070] Fig.10This is a flow chart of a network operation and maintenance method based on a large language model provided in an embodiment of the present application. The method is applied to any of the network operation and maintenance systems introduced above, and the method includes the following steps.

[0071] 1001. The client displays a dialogue interface in which a dialogue message for the network is input.

[0072] The client is any of the clients 10 described above, and the network is the network 40 described above. The dialogue message for the network indicates the execution of tasks related to network operation and maintenance, and the dialogue message is represented by natural language or structured sentences. Here, the embodiment of the present application does not limit the representation method of the dialogue message. When the dialogue message is represented by natural language, it is convenient for the user to communicate with the network operation and maintenance system in natural language, which reduces the difficulty of the user's network operation and maintenance work.

[0073] The dialogue interface is a human-computer interaction interface provided by the client. For example, Fig.11 A schematic diagram of a dialogue interface provided by an embodiment of the present application is shown, such as Fig.11 As shown, the dialog interface 1100 includes a dialog window 111, and the dialog window 111 is used to input and display dialog messages. Assume that the network includes multiple access points (APs), such as Fig.11 As shown, user A enters a dialog message 11a “Which AP is the busiest today?” in the dialog window 111 . When the client detects the dialog message 11a , it displays the dialog message 11a in the dialog window 1111 .

[0074] Fig.11 The example in which the input dialogue message is a question type message is shown. In other embodiments, the dialogue message is a non-question type message, for example, the dialogue message is "detect whether there is a faulty AP in the network". In addition, Fig.11 The example in which the input dialogue message is text information is used for illustration. In other embodiments, the user may also input a voice dialogue message.

[0075] 1002. The client outputs a network operation and maintenance request to the first message processing device based on the dialogue message, where the network operation and maintenance request indicates a network operation and maintenance intention based on the dialogue message, and performs a network operation and maintenance task on the network.

[0076] The first message processing device is any message processing device connected to the client in the network operation and maintenance system. When the network operation and maintenance system includes one message processing device, the first message processing device is the message processing device. When the network operation and maintenance system includes multiple message processing devices, if the multiple message processing devices do not distinguish between management levels, the first message processing device is any message processing device among the multiple message processing devices. If the multiple message processing devices have different management levels, the first message processing device is the message processing device with the highest management level among the multiple message processing devices (such as Figure 7 or Figure 8 Message processing device 21 in.

[0077] The network operation and maintenance request includes the dialogue message. When the client detects the dialogue message in the dialogue interface, a network operation and maintenance request is generated based on the dialogue message, and the network operation and maintenance request is output to the first message processing device. Accordingly, the first message processing device receives the network operation and maintenance request, and executes the following step 1003 after receiving the network operation and maintenance request.

[0078] 1003. The first message processing device obtains a dialogue message in the network operation and maintenance request, and determines a network operation and maintenance intention based on the first language model and the dialogue message.

[0079] Among them, the network operation intention is the user's intention in network operation identified from the dialogue message, that is, the operation related to the network operation that the user expects to perform (that is, the network operation task). The network operation intention includes the operation task intention and the operation scenario intention. The operation task intention indicates the network operation task that the user expects to perform on the network, and the operation scenario intention refers to the operation scenario of the network operation task that the user expects to perform. Network operation involves a variety of operation scenarios, such as network planning scenarios, network construction scenarios, network maintenance scenarios, network optimization scenarios, network data query scenarios, and knowledge question and answer scenarios. The operation scenario intention is any one of these multiple operation scenarios, among which the network planning scenario refers to the operation scenario related to network planning, the network construction scenario refers to the operation scenario related to network construction, the network optimization scenario refers to the operation scenario related to network optimization, and the network data query scenario refers to the operation scenario of querying network data, such as the configuration data of network equipment, load data, network link data, etc. The knowledge question and answer scenario refers to the operation scenario of asking questions about network operation knowledge.

[0080] The first large language model is a large language model connected to the first message processing device, the first type of language model is deployed on the first message processing device and is run by the first message processing device, or the first large language model is deployed on a decision device (referred to as a first decision device) and is run by the first decision device. In the case where the first large language model is deployed on the first decision device, the first message processing device identifies the network operation and maintenance intent of the dialogue message by calling the first large language model, such as the following steps A1 to A3.

[0081] Step A1: The first message processing device sends operation and maintenance intention prompt information to the first decision-making device, where the operation and maintenance intention prompt information is used to prompt the first language model to recognize the network operation and maintenance intention of the dialogue message.

[0082] The operation and maintenance intention prompt information includes the dialogue message and description information of various operation and maintenance scenarios.

[0083] In one possible implementation, the first message processing device generates operation and maintenance intention prompt information based on the dialogue message and the second prompt statement, and the second prompt statement is used to prompt the large language model to identify the network operation and maintenance intention of the dialogue message, and prompt the large language model to output the identified network operation and maintenance intention. Exemplarily, the second prompt statement is provided by an intention prompt template, and the first message processing device splices the dialogue message and the description information of various operation and maintenance scenarios in the intention prompt template of the large language model to obtain the operation and maintenance intention prompt information. Among them, the intention prompt template is a template for prompting the first large language model to output the network operation and maintenance intention, and the intention prompt template includes a message field, a scenario field and a second prompt statement, the message field is used to store the dialogue message, the scenario field is used to store the description information of various network operation and maintenance scenarios, and the second prompt statement is the template content in the intention prompt template.

[0084] Take the intent prompt template as {User asks: X[]. Which of the following scenarios is this about? Return in digital form, Y[]. What kind of task does the user want to perform? Return in text form} as an example. Assuming that the dialogue message is "Which AP devices are the busiest today?", the network has multiple operation and maintenance scenarios such as network data query, network report viewing, and fault information viewing. The first message processing device fills the dialogue message in the message field X[] of the intent prompt template and fills the description information of these multiple operation and maintenance scenarios in the scenario field Y[] to splice the following operation and maintenance intent prompt information:

[0085] {User asks: Which APs are the busiest today?

[0086] Which of the following scenarios does this apply to? Return as a number.

[0087] 0. Others

[0088] 1. Network query

[0089] 2. View network reports

[0090] 3. Check the fault information.

[0091] What task does the user want to perform? Returns as text.

[0092] After obtaining the operation and maintenance intention prompt information, the first message processing device sends the operation and maintenance intention prompt information to the first decision-making device.

[0093] Step A2: The first decision-making device receives the operation and maintenance intention prompt information, and based on the first language model, performs network operation and maintenance intention recognition on the dialogue message to obtain the network operation and maintenance intention.

[0094] The first decision-making device is a decision-making device to which the first message processing device is connected.

[0095] The first decision-making device inputs the operation and maintenance intention prompt information into the first large language model, and the first large language model performs operation and maintenance scenario intention recognition and operation and maintenance task intention recognition on the dialogue message based on the prompt of the operation and maintenance intention prompt information, and outputs the operation and maintenance scenario intention and operation and maintenance task intention of the dialogue message.

[0096] Still taking the example in step A1 as an example, assuming that the operation and maintenance scenario intention identified by the first largest language model is a network data query scenario, the first largest language model outputs the number "1" and the operation and maintenance task intention "to determine which APs carry more devices during data collection based on the channel usage of each AP."

[0097] Step A3: The first decision-making device outputs the network operation and maintenance intention to the first message processing device, and the first message processing device obtains the network operation and maintenance intention.

[0098] Based on steps A1 to A3, by calling the first language model in the decision-making device to identify the network operation and maintenance intention of the dialogue message, the consumption of local computing resources can be reduced.

[0099] The above steps A1 to A3 are explained by taking calling the first largest language model once to obtain the network operation and maintenance intention as an example. In other embodiments, the first message processing device obtains the network operation and maintenance intention by calling the first largest language model multiple times, such as the following steps B1 to B4.

[0100] Step B1: The first message processing device sends scenario intention prompt information to the first decision-making device, where the scenario intention prompt information is used to prompt the first language model to be called to identify the operation and maintenance scenario intention of the dialogue message.

[0101] Among them, the scenario intention prompt information includes the dialogue message and description information of various operation and maintenance scenarios.

[0102] After obtaining the dialogue message, the first message processing device splices the dialogue message and the description information of multiple operation and maintenance scenarios in the scenario prompt template of the first language model to obtain the scenario intention prompt information. Among them, the scenario intention prompt template is a template used to prompt the first language model to output the operation and maintenance scenario intention. The scenario intention prompt template includes a message field, a scenario field, and a third prompt sentence. The third prompt sentence is the template content in the scenario intention prompt template. The third prompt sentence is used to prompt the first language model to output the operation and maintenance scenario intention of the dialogue message.

[0103] Take the scenario intent prompt template as {User asks: X[]. Which of the following scenarios is this about? Return in digital form, Y[]} as an example. Assuming that the dialogue message is "Which AP devices are the busiest today?", the network has multiple operation and maintenance scenarios such as network data query, network report viewing, and fault information viewing. The first message processing device fills the dialogue message in the message field X[] of the scenario intent prompt template and fills the description information of multiple operation and maintenance scenarios in the scenario field Y[] to splice the following scenario intent prompt information:

[0104] {User asks: Which APs are the busiest today?

[0105] Which of the following scenarios does this apply to? Return as a number.

[0106] 0. Others

[0107] 1. Network query

[0108] 2. View network reports

[0109] 3. Check fault information.

[0110] After obtaining the scene intention prompt information, the first message processing device sends the scene intention prompt information to the first decision-making device.

[0111] Step B2: The first decision-making device receives the scenario intention prompt information, and based on the first large language model, performs operation and maintenance scenario intention recognition on the dialogue message to obtain the operation and maintenance scenario intention, and outputs the operation and maintenance scenario intention to the first message processing device. The first message processing device receives the operation and maintenance scenario intention.

[0112] In a possible implementation, the first language model determines that the operation and maintenance scenario of the dialogue message needs to be identified based on the prompt of the prompt statement in the scenario intention prompt information, and then identifies the operation and maintenance scenario corresponding to the dialogue message based on the association between the learned user question sample and the operation and maintenance scenario, and outputs the scenario classification label of the operation and maintenance scenario corresponding to the dialogue message. Still taking the example in step B1 as an example, assuming that the scenario classification label of the network data query scenario is the number "1", and the operation and maintenance scenario intention identified by the first language model is the network data query scenario, the first language model outputs the number "1".

[0113] The user question samples are the dialogue messages used in the process of training the first language model. Through training, the first language model learns the correlation between the user question samples and the operation and maintenance scenarios. The following is an exemplary introduction to the process of training the first language model to learn the correlation:

[0114] For the convenience of description, the device for training the first language model is called a training device. The training device obtains scenario classification labels for multiple operation and maintenance scenarios. The scenario classification labels refer to an operation and maintenance scenario respectively. For example, each scenario classification label is the number of an operation and maintenance scenario. Different operation and maintenance scenarios have different numbers, that is, the number is the scene identifier. For example, the knowledge question and answer scenario is numbered "1", and the troubleshooting scene is numbered "2".

[0115] For each operation and maintenance scenario, the training device also obtains a query set for the operation and maintenance scenario, which includes multiple user question samples, and the multiple user question samples are dialogue messages related to the operation and maintenance scenario. For example, the query set for the knowledge question and answer scenario includes three user question samples, such as ["What is AP", "What are the characteristics of AP", "How to configure AP"], and another example is that the query set for the troubleshooting scenario includes three user question samples, such as ["Which APs are the busiest today", "How to check the number of AP connections", "What to do if the AP signal is unstable"]. Here, the query set includes three user question samples as an example. In the specific implementation process, the query set includes more than three or less than three user question samples. Here, the embodiment of the present application does not limit the number of user question samples in the query set.

[0116] For each operation and maintenance scenario, the training device adds the scenario classification label of the operation and maintenance scenario to each user question sample in the query set of the operation and maintenance scenario, and obtains multiple input sequences corresponding to the operation and maintenance scenario. Each input sequence includes a user question sample and the scenario classification label of the operation and maintenance scenario. Taking the user question sample "What is AP" as an example, the number "1" in the scenario classification label of the knowledge question and answer scenario is added to the user question sample "What is AP" to obtain an input sequence "What is AP (1)".

[0117] After obtaining the input sequences corresponding to the multiple operation and maintenance scenarios, the training device inputs the input sequences corresponding to the multiple operation and maintenance scenarios into the first language model. The first language model infers the scene classification labels of the user question samples in the multiple input sequences according to the model parameters to obtain the inferred scene classification labels. According to the error between the inferred scene classification labels and the scene classification labels in the input sequence, the model parameters are adjusted so that the error is reduced when the next inference is made according to the adjusted model parameters. By cyclically executing the process of adjusting the model parameters, the model parameters are gradually refined. When the training is completed, the first language model containing the precise model parameters is used to learn the association between the user question samples and the scene classification labels, so that accurate operation and maintenance scene inference can be achieved. According to the scene classification labels of the user question samples in the input sequence, the first language model can infer the corresponding scene classification labels. Thus, appropriate processing procedures are provided for different operation and maintenance scenarios. Since the scene classification labels are used for marking, the problem of the first language model confusing the scene classification labels can also be effectively avoided.

[0118] When the first large language model is used subsequently, such as step B2, after the first large language model outputs the scenario classification label of the dialogue message, the first decision-making device can return the scenario classification label to the first message processing device, and the first message processing device determines the name of the operation and maintenance scenario corresponding to the scenario classification label based on the correspondence between the scenario classification label and the name of the operation and maintenance scenario, thereby determining the operation and maintenance scenario intention of the dialogue message. Alternatively, the first decision-making device determines the name of the operation and maintenance scenario corresponding to the scenario classification label based on the correspondence between the scenario classification label and the name of the operation and maintenance scenario, and returns the name of the operation and maintenance scenario to the first message processing device. In one possible implementation, the correspondence between the scenario classification label and the name of the operation and maintenance scenario can be recorded in a scenario classification dictionary, and the scenario classification label output by the first large language model is decoded through the scenario classification dictionary to map the scenario classification label to the name of the operation and maintenance scenario, thereby determining the name of the operation and maintenance scenario corresponding to the scenario classification label. For example, if the scenario classification label output by the first language model is "1", the name of the decoded operation and maintenance scenario is "Knowledge Question and Answer"; if the scenario classification label output by the first language model is "2", the name of the decoded operation and maintenance scenario is "Troubleshooting".

[0119] Step B3: The first message processing device sends task intention prompt information to the first decision-making device based on the dialogue message, and the task intention prompt information is used to prompt the first language model to identify the operation and maintenance task intent of the dialogue message under the operation and maintenance scenario intent.

[0120] Among them, the task intention prompt information includes the dialogue message and the operation and maintenance scenario intention.

[0121] After obtaining the operation and maintenance scenario intention, the first message processing device splices the dialogue message and the operation and maintenance scenario intention in the task intention prompt template of the first large language model to obtain the task intention prompt information. Among them, the task intention prompt template is a template used to prompt the first large language model to output the operation and maintenance task intention. The task intention prompt template includes a message field, a scenario intention field, and a fourth prompt sentence. The message field is used to store the dialogue message, the scenario intention field is used to store the operation and maintenance scenario intention, and the fourth prompt sentence is the template content in the task intention prompt template. The fourth prompt sentence is used to prompt the first large language model to output the operation and maintenance task intention of the dialogue message under the operation and maintenance scenario intention.

[0122] The task intent prompt template is {Question X[] for the user. What kind of task does the user want to perform in scenario Y[]? Return in text form}. Assuming the dialogue message is "Which AP devices are the busiest today?", and the operation and maintenance scenario intent is the network data query scenario, the first message processing device fills the dialogue message in the message field X[] of the task intent prompt template, and fills the operation and maintenance scenario intent in the scenario intent field Y[], so as to splice the following task intent prompt information:

[0123] {In response to the user's question "Which AP devices are the busiest today?"

[0124] What kind of task does the user want to perform in the network data query scenario? Return as text}.

[0125] After acquiring the task intention prompt information, the first message processing device sends the task intention prompt information to the first decision-making device.

[0126] In other embodiments, for prompt information that includes descriptive information of multiple operation and maintenance scenarios (such as operation and maintenance intention prompt information, scenario intention prompt information, and task intention prompt information), if the first language model has learned the descriptive information of various operation and maintenance scenarios, then the scene fields in the prompt templates corresponding to these prompt information belong to the template content, and when splicing the prompt information, there is no need to splice the descriptive information of multiple operation and maintenance scenarios in the prompt template.

[0127] Step B4: The first decision-making device receives the task intention prompt information, and based on the first large language model, identifies the operation and maintenance task intention of the dialogue message to obtain the operation and maintenance task intention, outputs the operation and maintenance task intention to the first message processing device, and the first message processing device obtains the operation and maintenance task intention.

[0128] For example, the first decision-making device inputs the task intention prompt information into the first large language model, and the first large language model identifies the operation and maintenance task intention under the operation and maintenance scenario intention of the dialogue message based on the prompt of the task intention prompt information, outputs the operation and maintenance task intention, and the first decision-making device sends the operation and maintenance task intention to the first message processing device.

[0129] The first message processing device receives the operation and maintenance scenario intention and the operation and maintenance task intention of the dialogue message, that is, obtains the network operation and maintenance intention of the dialogue message.

[0130] 1004. The first message processing device obtains a network operation and maintenance task based on the network operation and maintenance intention.

[0131] Among them, for the first message processing device, the network operation and maintenance tasks of the network are divided into knowledge question and answer type network operation and maintenance tasks and non-knowledge question and answer type network operation and maintenance tasks. The knowledge question and answer type network operation and maintenance tasks do not require the first message processing device to interact with the network management device, and the non-knowledge question and answer type network operation and maintenance tasks require the first message processing device to interact with the network management device. Based on this, if the operation and maintenance scenario intention of the dialogue message is a knowledge question and answer scenario, the first message processing device determines the operation and maintenance task intention of the dialogue message as a knowledge question and answer type network operation and maintenance task, queries the knowledge base for information that can answer the operation and maintenance task intention, and uses the queried information as the execution result of the network operation and maintenance task.

[0132] If the operation and maintenance scenario intention of the dialogue message is not a knowledge question and answer scenario, the first message processing device obtains a non-knowledge question and answer type network operation and maintenance task based on the network operation and maintenance intention and the first language model. Next, the process of obtaining a non-knowledge question and answer type network operation and maintenance task is introduced as follows.

[0133] For any operation and maintenance scenario other than the knowledge question and answer scenario in multiple operation and maintenance scenarios, the network management device of the network provides at least one application programming interface (API) for the operation and maintenance scenario. The API is used to complete the network operation and maintenance tasks in the operation and maintenance scenario. Different APIs complete different network operation and maintenance tasks. The process of executing network operation and maintenance tasks on the network is the process of calling the API in the operation and maintenance scenario. Based on this, after obtaining the operation and maintenance task intent and the operation and maintenance scenario intent, the first message processing device, based on the first language model and the API corresponding to the operation and maintenance scenario intent, arranges the network operation and maintenance tasks for the operation and maintenance task intent, obtains the task information, and automatically arranges the execution process of the network operation and maintenance tasks through the first language model, without the need for manual arrangement by the user, which simplifies the network operation and maintenance process, reduces the difficulty of network operation and maintenance, and thus can improve the network operation and maintenance efficiency.

[0134] Among them, the task information indicates the calling process of the corresponding API when executing the network operation and maintenance task. The API required to complete the network operation and maintenance task or complete the operation and maintenance task intention is called the first API. The first API may be all APIs corresponding to the operation and maintenance scenario intention, or it may be part of the APIs corresponding to the operation and maintenance scenario intention, that is, there is at least one first API. The task information includes the output parameters of the at least one first API when executing the network operation and maintenance task and the identifier of the at least one first API. In the case of calling multiple first APIs, the task information also includes the calling sequence of multiple first APIs when executing the network operation and maintenance task, or the task information does not include the calling sequence of the first API, and the position of the input parameters / identifiers of each first API in the task information is used to indicate the calling sequence of each first API. The task information is also a calling chain of at least one first API. When the calling chain is completed, the network operation and maintenance task is completed, and the information output by the calling chain is the execution result of the network operation and maintenance task.

[0135] In the case where the first large language model is deployed on the first decision-making device, the first message processing device acquires the task information by calling the first large language model, such as the following steps C1 to C4.

[0136] Step C1: The first message processing device obtains description information of the API corresponding to the operation and maintenance scenario intention from the first network management device.

[0137] The description information of the API includes functional description information and / or detection description information of the API, the functional description information is used to describe the function of the API, and the detection description information is used to describe the network data detected by the API in the network, such as load data of network equipment or network link data, such as bandwidth, latency, channel utilization, etc. The API corresponding to the operation and maintenance scenario intent is each API corresponding to the operation and maintenance scenario intent, or is the first API among the APIs corresponding to the operation and maintenance scenario intent.

[0138] Taking obtaining the description information of each API corresponding to the operation and maintenance scenario intent as an example, the first message processing device sends a first information acquisition request to the first network management device of the network, and the first information acquisition request indicates obtaining the description information of each API corresponding to the operation and maintenance scenario intent, wherein the first network management device is any network management device of the network to which the first message processing device is connected, and the first information acquisition request includes an identifier of the operation and maintenance scenario intent. The first network management device receives the first information acquisition request, and outputs the description information of each API corresponding to the operation and maintenance scenario intent based on the first information acquisition request. For example, the first network management device calls each API corresponding to the operation and maintenance scenario intent based on the first information acquisition request, obtains the description information of each API from each API, and sends the description information of each API corresponding to the operation and maintenance scenario intent to the first message processing device.

[0139] Taking the example of obtaining the description information of the first API corresponding to the operation and maintenance scenario intention, assuming that the operation and maintenance scenario intention corresponds to multiple interface types of APIs, and each interface type has at least one API, the first message processing device first determines the first interface type from the multiple interface types of APIs, and then takes each API of the first interface type as the first API, and obtains the description information of the first API from the first network management device, wherein the first interface type is the interface type to which the API required by the operation and maintenance task intention belongs. For example, the following steps C11 to C13.

[0140] C11. The first message processing device sends interface type prompt information to the first decision-making device based on the dialogue message and the operation and maintenance scenario intention. The interface type prompt information is used to prompt the first large language model to output the interface type required to complete the operation and maintenance task intention of the dialogue message in the operation and maintenance scenario intention.

[0141] The interface type prompt information includes the dialogue message / the operation and maintenance task intention, and the interface prompt information also includes multiple interface types corresponding to the operation and maintenance scenario intention.

[0142] The first message processing device splices the dialogue message and the multiple interface types corresponding to the operation and maintenance scenario intention in the interface prompt template of the first large language model to obtain the interface prompt information. Among them, the interface prompt template is a template for prompting the first large language model to output the interface type required to complete the operation and maintenance task intention in the operation and maintenance scenario intention. The interface prompt template includes a message field, an interface type field and a fifth prompt statement. The message field is used to store the operation and maintenance task intention, the interface type field is used for the multiple interface types corresponding to the operation and maintenance scenario intention, and the fifth prompt statement is the template content in the interface prompt template. The fifth prompt statement is used to prompt the first large language model to output the interface type required to complete the operation and maintenance task intention in the operation and maintenance scenario intention.

[0143] Take the interface prompt template as {To answer the question "{X[]}", which of the following interface types should I choose to use the API? Return in digital form. Y[]} as an example, assuming that the operation and maintenance scenario intention is a network data query scenario, and the network data query scenario corresponds to multiple interface types such as interface types about AP devices, switch devices, and gateway devices. After determining the network data query scenario, the first message processing device fills in query (i.e., the operation and maintenance task intention or dialogue message) in the message field X[] of the interface prompt template, and fills in multiple interface types corresponding to the network data query scenario in the interface type field Y[] to splice out the following interface type prompt information:

[0144] {To answer the question "{query}", from which category should you choose API usage? Return as a number

[0145] 1. About AP equipment

[0146] 2. About switch equipment

[0147] 3. About gateway device}.

[0148] After obtaining the interface type prompt information, the first message processing device sends the interface type prompt information to the first decision device.

[0149] C12. The first decision-making device receives the interface type prompt information, predicts the interface type required to complete the operation and maintenance task intention based on the first large language model, obtains the first interface type, and sends the first interface type to the first message processing device.

[0150] Exemplarily, the first decision-making device inputs the interface type prompt information into the first large language model, and the first large language model determines the first interface type from the multiple interface types corresponding to the operation and maintenance scenario intention based on the prompt of the task intention prompt information, outputs the first interface type, and the first decision-making device sends the first interface type to the first message processing device. Still taking the interface type prompt information in C11 as an example, assuming that the first interface type determined by the first large language model is the interface type of the AP device, the first large language model outputs the number "1", and the first decision-making device returns the interface type "1" to the first dialogue.

[0151] C13. The first message processing device receives the first interface type, and obtains description information of the first API of the first interface type from the first network management device.

[0152] The first message processing device sends a second information acquisition request to the first network management device, the second information acquisition request indicates obtaining the description information of the API of the first interface type corresponding to the operation and maintenance scenario intention, and the second information acquisition request includes the identifier of the operation and maintenance scenario intention and the first interface type. The first network management device receives the second information acquisition request, and outputs the description information of each API corresponding to the first interface type based on the second information acquisition request. For example, the first network management device calls each API of the first interface type corresponding to the operation and maintenance scenario intention based on the second information acquisition request, obtains the description information of each API of the first interface type from each API of the first interface type, sends the description information of each API of the first interface type to the first message processing device, and the first message processing device receives the description information of each API of the first interface type (i.e., the first API).

[0153] The first information acquisition request and the second information acquisition request are different information acquisition requests, both of which are used to obtain the description information of the API of the operation and maintenance scenario intention. Based on the above step C1, by obtaining the description information of the API of the operation and maintenance scenario intention from the network management device, the first language model can orchestrate appropriate network operation and maintenance tasks based on the description information of the API of the operation and maintenance scenario intention, thereby improving the rationality of the orchestrated network operation and maintenance tasks.

[0154] The above step C1 is explained by taking the example of the first message processing device obtaining the description information of the API of the operation and maintenance scenario intention from the network management device. In other embodiments, the first message processing device stores the description information of the API of the operation and maintenance scenario intention. At this time, the first message processing device does not need to obtain the description information of the API corresponding to the operation and maintenance scenario intention from the first message processing device. For example, the first message processing device stores the description information of the API of various operation and maintenance scenarios. If the scenario intention of the dialogue message is the operation and maintenance scenario intention, the description information of the API of the scenario intention is obtained from the description information of the API of the multiple operation and maintenance scenarios stored locally, and there is no need to obtain the detection description information of the API corresponding to the operation and maintenance scenario intention from the first network management device. Therefore, this step C1 is an optional step, and step C1 is represented by a dotted line in the accompanying drawings. In some embodiments, the first message processing device stores the scenario information of each operation and maintenance scenario, and the scenario information of the operation and maintenance scenario includes the scenario description information of the operation and maintenance scenario, the description information of the API, and the prompt template related to the operation and maintenance scenario, so that the first message processing device can obtain this information locally when necessary.

[0155] Step C2: The first message processing device sends task scheduling prompt information to the first decision-making device based on the description information of the API corresponding to the operation and maintenance scenario intention. The task scheduling prompt information is used to prompt the first language model to schedule a network operation and maintenance task for the operation and maintenance task based on the API corresponding to the operation and maintenance scenario intention.

[0156] The task scheduling prompt information includes the operation and maintenance task intent and the description information of the API corresponding to the operation and maintenance scenario intent.

[0157] In a possible implementation, the first message processing device generates the task orchestration prompt information based on the operation and maintenance task intent, the first prompt statement, and the description information of the API corresponding to the operation and maintenance scenario intent, wherein the first prompt statement is used to prompt the large language model to orchestrate the network for the operation and maintenance task intent based on the API corresponding to the operation and maintenance scenario intent, and prompt the large language model to output the task information of the orchestrated network operation and maintenance task. Exemplarily, the first prompt statement is provided by a task orchestration prompt template of the large language model, and the first message processing device splices the operation and maintenance task intent and the description information of the API corresponding to the operation and maintenance scenario intent in the task orchestration prompt template to obtain the task orchestration prompt information. Among them, the task orchestration prompt template is a template for prompting the first large language model to orchestrate a network operation and maintenance task, and the task orchestration prompt template includes a message field, a description field, and a second prompt statement, the message field is used to store the operation and maintenance scenario intent, the description field is used to store the description information of the API corresponding to the operation and maintenance scenario intent, and the second prompt statement is the template content in the task orchestration prompt template.

[0158] Taking the API corresponding to the operation and maintenance scenario intent as an example, assuming that the task scheduling prompt template is {{X[] about these API statements, please tell me which API {Y[]} should call? What parameters need to be passed? Give the answer directly, do not give the analysis process}, the first message processing device fills the query (that is, the operation and maintenance task intent or dialogue message) in the message field X[] of the task scheduling prompt template, and fills the operation and maintenance task intent (that is, the description information of the API corresponding to the operation and maintenance scenario intent) in the description field Y[] to splice the following task scheduling prompt information:

[0159] {{About the API of AP to express the intention of operation and maintenance tasks},

[0160] Which API should {query} call? What parameters should be passed? Give the answer directly, without providing the analysis process}.

[0161] After obtaining the task scheduling prompt information, the first message processing device sends the task scheduling prompt information to the first decision-making device.

[0162] Step C3: The first decision device receives the task scheduling prompt information, and based on the first language model and the API corresponding to the operation and maintenance scenario intention, schedules the network operation and maintenance task for the operation and maintenance task intention to obtain task information.

[0163] The first decision-making device inputs the task scheduling prompt information into the first large language model. The first large language model determines, based on the prompt of the task scheduling prompt information and the description information of the API corresponding to the operation and maintenance scenario intent and the operation and maintenance task intent, each first API in the operation and maintenance scenario intent used to complete the operation and maintenance intent, the calling order of each first API, and the input parameters. Based on the calling order and input parameters of each first API, the execution process of the network operation and maintenance task is scheduled, and task information is output. The task information includes the input parameters and calling order of each API. If the same first API is called multiple times, the task information also includes the calling order of the first API each time it is called.

[0164] In one possible implementation, the operation and maintenance task intention includes multiple operation and maintenance task sub-intentions. Accordingly, the network operation and maintenance task corresponding to the operation and maintenance task intention includes multiple network operation and maintenance sub-tasks. The multiple operation and maintenance task sub-intentions correspond to different network operation and maintenance sub-tasks. The network operation and maintenance sub-tasks are used to complete the corresponding operation and maintenance task sub-intentions.

[0165] In the case where the operation and maintenance task intent includes multiple operation and maintenance task sub-intentions, the first decision-making device, based on the first large language model and the API corresponding to the operation and maintenance scenario intent, respectively arranges network operation and maintenance sub-tasks for multiple network operation and maintenance sub-tasks, obtains multiple sub-task information, and obtains the task information based on the multiple sub-task information. At this time, the task information includes multiple sub-task information, and the sub-task information indicates the calling process of at least one first API when executing the network operation and maintenance sub-task. In the case where the network operation and maintenance sub-task needs to call multiple first APIs, the sub-task information also includes the calling order of the multiple first APIs when executing the network operation and maintenance sub-task. Alternatively, the sub-task information does not include the calling order of the first APIs, and the calling order of each first API is indicated by the position of the input parameters of each first API in the sub-task information. The sub-task information is also a calling chain of at least one first API. When the calling chain is completed, the network operation and maintenance sub-task is executed, and the information output by the calling chain is the execution result of the network operation and maintenance sub-task.

[0166] For example, the first decision-making device inputs the task orchestration prompt information into the first large language model. The first large language model determines the first API required to complete each operation and maintenance task sub-intention, the calling order and input parameters of each first API when completing each operation and maintenance task sub-intention based on the prompt of the task orchestration prompt information, based on the description information of the API corresponding to the operation and maintenance scenario intent and multiple operation and maintenance task sub-intentions. Based on the calling order and the input parameters, multiple sub-task information is generated (to complete the orchestration of network operation and maintenance sub-tasks), and based on the multiple sub-task information, task information is output, and each sub-task information in the task information indicates a network operation and maintenance sub-task.

[0167] When a network operation and maintenance task includes multiple network operation and maintenance subtasks, it is difficult to manually orchestrate the network operation and maintenance task, which requires users to have a high level of understanding of various application program interfaces of the network. By automatically orchestrating network operation and maintenance tasks through the first language model, there is no need for users to manually orchestrate them, which simplifies the network operation and maintenance process, reduces the difficulty of network operation and maintenance, and thus can improve network operation and maintenance efficiency.

[0168] Step C4: The first decision-making device outputs the task information to the first message processing device, and the first message processing device receives the task information.

[0169] The first message processing device receives the task information, that is, obtains the network operation and maintenance task. Based on the above steps C2 to C4, the first language model in the first call decision device is used to complete the arrangement of the network operation and maintenance task, which can reduce the consumption of local computing resources of the first message processing device.

[0170] 1005. The first message processing device executes the network operation and maintenance task and obtains the execution result.

[0171] The first message processing device performs the network operation and maintenance task according to the task information, see Fig.10In the case where a first API is required to complete the network operation and maintenance task, the task information includes input data of the first API. The first message processing device sends a first interface call request to the first network management device based on the input data of the first API. The first interface call request indicates calling the first API to perform the network operation and maintenance task, wherein the first interface call request includes the input data of the first API. After receiving the first interface call request, the first network management device inputs the input data of the first API into the first API and runs the first API. The first API sends a second interface call request to a network device in the network, wherein the second interface call request indicates calling a second API of the network device to obtain the execution result of the network operation and maintenance task, wherein the second API refers to the API between the first network management device and the network device. After receiving the second interface call request, the network device runs the second API according to the second interface call request, obtains the execution result of the network operation and maintenance task, returns the execution result of the network operation and maintenance task to the first API, and the first API outputs the execution result of the network operation and maintenance task. The first network management device sends an interface call response to the first message processing device based on the execution result of the network operation and maintenance task, and the interface call response includes the execution result of the network operation and maintenance task. After receiving the interface call response, the first message processing device obtains the execution result of the network operation and maintenance task from the interface call response.

[0172] In the case where the network operation and maintenance task needs to call multiple first APIs, the first network management device calls multiple first APIs in the first network management device in sequence according to the calling order of each first API in the task information, and uses the data output by the last called first API as the execution result of the network operation and maintenance task. The process of calling each first API can refer to the process of calling a first API above, which will not be repeated here.

[0173] The above is explained by calling a first API in a first network management device when executing a network operation and maintenance task. In other embodiments, the first message processing device executes the network operation and maintenance task by calling the first API in multiple first network management devices. Figure 3 Taking the deployment mode 2 shown as an example, the message processing device 20 in the OSS is the first message processing device, and the network management devices 50 in multiple EMS / NMS are all first network management devices. In the case where the network operation and maintenance task includes multiple network operation and maintenance subtasks, the message processing device 20 calls the first API in different network management devices 50 to execute different task subtasks and obtain the execution results of multiple network operation and maintenance subtasks.

[0174] Exemplarily, the message processing device 20 executes multiple network operation and maintenance subtasks in sequence according to the execution order of the multiple network operation and maintenance subtasks. Taking the execution of any network operation and maintenance subtask as an example, the message processing device 20 executes the operation and maintenance subtask according to the subtask information of the network operation and maintenance subtask. For example, in the case where a first API is required to complete the network operation and maintenance subtask, the task information includes input data of a first API, and the first message processing device sends a third interface call request to a network management device 50 based on the input data of the first API, and the third interface call request indicates calling the first API to execute the network operation and maintenance subtask, wherein the third interface call request includes the input data of the first API. After receiving the third interface call request, the first network management device inputs the input data of the first API into the first API and runs the first API. In the process of running the first API, the network management device 30 sends a fourth interface call request to the network device in the network, and the fourth interface call request indicates calling the second API of the network device to obtain the execution result of the network operation and maintenance subtask. After receiving the fourth interface call request, the network device runs the second API according to the fourth interface call request, obtains the execution result of the network operation and maintenance subtask, returns the execution result of the network operation and maintenance subtask to the first API of the first network management device, and the first API outputs the execution result of the network operation and maintenance subtask. The network management device 50 sends an interface call response to the first message processing device based on the execution result of the network operation and maintenance subtask, and the interface call response includes the execution result of the network operation and maintenance subtask. After receiving the interface call response, the first message processing device obtains the execution result of the network operation and maintenance subtask from the interface call response.

[0175] After obtaining the execution results of multiple network operation and maintenance subtasks, the message processing device 20 obtains the execution result of the network operation and maintenance task based on the execution results of the multiple network operation and maintenance subtasks. For example, the multiple network operation and maintenance subtasks of the network operation and maintenance task may be parallel or serial, and there is no influence between the input data and output data of the multiple parallel network operation and maintenance subtasks. The input data of each network operation and maintenance subtask except the first network operation and maintenance subtask in the multiple serial network operation and maintenance subtasks are the output data of the previous network operation and maintenance subtask. Based on this, in the case where the network operation and maintenance task includes multiple parallel network operation and maintenance subtasks, the message processing device 20 uses the execution results of the multiple network operation and maintenance subtasks as the execution result of the network operation and maintenance task. In the case where the network operation and maintenance task includes multiple network operation and maintenance sub-tasks in series, the first message processing device calls an API in a network management device 50, first executes the first network operation and maintenance sub-task among the multiple network operation and maintenance sub-tasks, uses the execution result of the first network operation and maintenance sub-task as the input data of the second network operation and maintenance sub-task, and then calls the API in the network management device 50 or other network management devices 50 to execute the second network operation and maintenance sub-task, uses the execution result of the second network operation and maintenance sub-task as the input data of the third network operation and maintenance sub-task, and then calls the API in the network management device 50 or other network management devices 50 to execute the third network operation and maintenance sub-task, and so on, until the last network operation and maintenance sub-task is executed, and the execution result of the last network operation and maintenance sub-task is used as the execution result of the network operation and maintenance task. Of course, the network operation and maintenance task may also include multiple parallel network operation and maintenance sub-tasks and multiple serial network operation and maintenance sub-tasks. The message processing device will use the execution results of the multiple parallel network operation and maintenance sub-tasks and the execution result of the last network operation and maintenance sub-task in the multiple serial network operation and maintenance sub-tasks as the execution result of the network operation and maintenance task.

[0176] For each network management device in the operation and maintenance network, the network operation and maintenance task and the network operation and maintenance subtask are both network operation and maintenance tasks to be processed by the first message processing device (referred to as the first network operation and maintenance task). The first interface call request and the third interface call request are both interface call requests received by the network management device, indicating the call to the API of the network management device to execute the first network operation and maintenance subtask. The above is explained by taking the example that the network management device actively returns the execution result of the first network operation and maintenance task to the first message processing device after executing the first network operation and maintenance task. At this time, the interface call request is also a synchronous instruction issued by the first message processing device. In other embodiments, the interface call request issued by the first message processing device to the network management device is an asynchronous instruction. At this time, after the network management device completes the execution of the first network operation and maintenance task according to the interface call request, it does not actively report the execution result of the first network operation and maintenance task to the first message processing device, and waits for the first message processing device to actively query the execution result of the first network operation and maintenance task from the network management device. Here, the embodiment of the present application does not limit the way in which the first message processing device obtains the execution result of the first network operation and maintenance task.

[0177] In this step 1005, the network operation and maintenance task is executed by the first session processor, and there is no need to manually issue operation and maintenance instructions to the network management device, which simplifies the network operation and maintenance process, reduces the difficulty of network operation and maintenance, and thus can improve the network operation and maintenance efficiency.

[0178] After obtaining the execution result of the network operation and maintenance task, the first message processing device sends a dialog response of the dialog message to the client based on the execution result (i.e., step 1006). Alternatively, if the execution result is an execution result expressed in a program language, in order to facilitate the user to understand the execution result of the network operation and maintenance task, the first message processing device converts the execution result of the network operation and maintenance task expressed in the program language into at least one of a natural language, a chart, and a network topology diagram based on the first language model, and the first message processing device sends a dialog response to the client based on the execution result after format conversion.

[0179] Exemplarily, the process of converting the execution result format may be: the first message processing device splices the execution result represented in the program language into a format conversion prompt template to obtain format conversion prompt information, and sends the format conversion prompt information to the first decision-making device, wherein the format conversion prompt information is used to prompt the first large language model to convert the execution result represented in the program language into at least one of natural language, charts, and network topology diagrams. After receiving the format conversion prompt information, the first decision-making device inputs the format conversion prompt information into the first large language model, and the first large language model converts the execution result represented in the program language into at least one of natural language, charts, and network topology diagrams based on the prompt of the format conversion prompt information, and outputs the execution result after format conversion. The first decision-making device returns the converted execution result to the first message processing device.

[0180] 1006. The first message processing device outputs a dialogue response of the dialogue message to the client based on the execution result of the network operation and maintenance task.

[0181] The dialogue response includes the execution result of the network operation and maintenance task and the network operation and maintenance intention, or the dialogue response includes the execution result of the network operation and maintenance task but does not include the network operation and maintenance intention.

[0182] For example, if the semantic similarity between the network operation and maintenance intention and the dialogue message is greater than the similarity threshold, the dialogue message can be used as a network operation and maintenance intention. At this time, the first message processing device sends the execution result of the network operation and maintenance task as a dialogue response to the client. If the semantic similarity between the network operation and maintenance intention and the dialogue message is less than or equal to the similarity threshold, the first message processing device sends the execution result of the network operation and maintenance task and the network operation and maintenance intention as a dialogue response to the client to prompt the user of the network operation and maintenance task corresponding to the execution result of the network operation and maintenance task.

[0183] 1007. The client receives the dialogue response and displays the dialogue response in the dialogue interface.

[0184] by Fig.11 Taking the dialog interface 1100 shown as an example, the dialog window 111 is also used to display the execution result expressed in natural language. The dialog interface 100 also includes an information display window 112. The information display window 112 is used to display the execution result expressed in a chart and / or a network topology diagram. Based on this, after receiving the dialog response, the client displays a reply message 11b in the dialog window 111 according to the dialog response. The reply message 11b includes the text content in the dialog response (such as the network operation and maintenance intention and / or the execution result of the network operation and maintenance task). Fig.11, the reply message 11b includes the network operation and maintenance intention expressed in natural language "We can determine which APs carry more devices in the data acquisition device based on the channel utilization of each AP" and the execution results of the network operation and maintenance tasks expressed in natural language "such as N5-AP-345 (A1 area, 87%), N5-AP-302 (A1 area, 83%), N5-AP-304 (A1 area, 80%)", if the dialogue response also includes the execution results expressed in a chart or network topology, then the execution results expressed in a chart or network topology are displayed in the information display window 112. Still taking 11 as an example, assuming that the dialogue response also includes the execution results expressed in the network topology, the client displays the network topology (global network topology or local network topology) of the network in the information display window 112, and highlights the network devices related to the execution results in the network topology, such as Fig.11 As shown, the method of highlighting the network devices related to the execution result is to display the related network devices in a square frame. Of course, there may be other ways of highlighting, for example, using a color different from other network devices to display the related network devices, or using a specific mark to mark the related network devices. Here, the embodiment of the present application does not limit the method of highlighting the related network devices. By displaying the execution results represented by natural language, charts or network topology in the dialogue interface 1100, it is convenient for users to understand the execution results of the network operation and maintenance tasks.

[0185] In other embodiments, if the execution results expressed in natural language are relatively large, the client can also fold and display the execution results expressed in natural language in the reply message. For example, the client displays part of the execution results and the viewing option b1 in the reply message, and in response to the selection of the viewing option, the client displays the remaining execution results.

[0186] In other embodiments, the information display window 112 can also be linked with the dialog window 111 to display information related to the network. For example, the device icons in the network topology displayed in the information display window 112 also support data query. When the client detects the user's selection operation on any device identifier, the client displays the network data and / or configuration data of the network device indicated by the device icon in the dialog window 111, thereby being able to display richer information to the user.

[0187] In order to clearly display the chart or network topology in the information display window 112, the size of the information display window 112 is larger than the size of the dialogue window 111. The dialogue interface 100 can facilitate human-computer dialogue and graphically display various network information by providing the dialogue window 111 and the information display window 112, so as to display rich information to the user and facilitate the user to understand the displayed information.

[0188] Fig.10 The method provided by the illustrated embodiment uses a large language model to identify the user's network operation and maintenance intention from the user's conversation message, and then establishes the network operation and maintenance task that the user expects to perform on the network based on the network operation and maintenance intention. After the network operation and maintenance task is completed, the execution result of the network operation and maintenance task is provided to the client. In this process, the user only needs to provide the conversation message in the form of a conversation, without having to interact with the client multiple times, which simplifies the operation process of network operation and maintenance, and thus can improve the efficiency of network operation and maintenance. For the conversation messages of various operation and maintenance scenarios, the methods provided by the embodiments of the present application can provide the user with the final question and answer results, so as not to limit the operation and maintenance scenarios, and can provide users with operation and maintenance services for various operation and maintenance scenarios, thereby increasing the user's dependence on the network operation and maintenance system and improving the user stickiness of the network operation and maintenance system.

[0189] Above Fig.10 The illustrated embodiment is explained by taking the example that the dialogue response includes the network operation and maintenance intention and the execution result of the network operation and maintenance task. In other embodiments, the dialogue response also includes the predicted intention. The predicted intention refers to the predicted dialogue intention of the next dialogue message of the current dialogue message. The predicted intention can also be understood as the predicted next action of the user. The next action may be an operation and maintenance action, or it may be a question related to knowledge question and answer. Therefore, the predicted intention may be a network operation and maintenance intention, or it may be a knowledge question and answer intention. There is at least one predicted intention. After obtaining the execution result of the network operation and maintenance task corresponding to the dialogue message, the first message processing device obtains the predicted intention of the dialogue message based on the first language model and the network operation and maintenance intention of the dialogue message.

[0190] In the case where the first large language model is deployed on the first decision-making device, the first message processing device obtains the predicted intent of the dialogue message by calling the first large language model, such as the following steps D1 to D3.

[0191] D1. The first message processing device sends prediction prompt information to the first decision-making device, where the prediction prompt information is used to prompt the first language model to predict the conversation intention of the next conversation message based on the network operation and maintenance intention.

[0192] The prediction prompt information includes the network operation and maintenance intention.

[0193] The first message processing device splices the network operation and maintenance intention in the prediction prompt template of the first large language model to obtain the prediction prompt information. The prediction prompt template is used to prompt the first large language model to predict the conversation intention of the next conversation message. The prediction prompt template includes an intention field and a sixth prompt sentence. The intention field is used to store the network operation and maintenance intention. The sixth prompt sentence is the template content in the prediction prompt template. The sixth prompt sentence is used to prompt the first large language model to predict the conversation intention of the next conversation message.

[0194] Take the prediction prompt template as {For this question {X[]}. What kind of task does the user want to perform next? Return in text form} as an example, assuming that the network operation and maintenance intention is "to determine which APs carry more devices in the data acquisition device based on the channel utilization of each AP", the first message processing device fills the network operation and maintenance intention in the intention field X[] of the prediction prompt template to splice the following prediction prompt information:

[0195] {Regarding the issue of {determining which APs carry more devices in the data acquisition device based on the channel utilization of each AP}.

[0196] What task does the user want to perform next? Return as text}.

[0197] After obtaining the prediction prompt information, the first message processing device sends the prediction prompt information to the first decision-making device.

[0198] D2. The first decision-making device receives the prediction prompt information, and based on the first language model, predicts the conversation intention of the next conversation message of the conversation message to obtain the predicted intention.

[0199] For example, the first decision-making device inputs the prediction prompt information into the first language model, and the first language model predicts the conversation intention of the next conversation message based on the network operation and maintenance intention according to the prompt of the prediction prompt information, and outputs the predicted intention. Still taking the example in step D1 as an example, the two predicted intentions output are "view more busy APs" and "AP tuning".

[0200] D3. The first decision-making device outputs the predicted intent to the first message processing device, and the first message processing device obtains the predicted intent.

[0201] After the first message processing device obtains the predicted intent, it generates a dialogue response based on the execution result of the network operation and maintenance task and at least one of the network operation and maintenance intent, and the predicted intent, and sends the dialogue response to the client. Fig.11As shown, the dialog window 111 also includes a navigation bar 11c. After receiving the dialog response, the client displays the predicted intentions "View more busy APs" and "AP tuning" in the dialog response as recommended navigation options c1 and c2 in the navigation bar 11c, respectively. Accordingly, if the user selects any of the recommended navigation options c1 and c2, in response to the selection operation, the client notifies the first message processing device to process the predicted intention displayed by the recommended navigation option. The user does not need to enter a new dialog message to indicate the next action, which further simplifies the operational process of network operation and maintenance, and can further improve the efficiency of network operation and maintenance.

[0202] In other embodiments, after completing the network operation and maintenance task of the dialogue message, the first message processing device also analyzes the potential network operation and maintenance intention of the dialogue message through the first large language model, and generates a network operation and maintenance task for the potential network operation and maintenance intention (i.e., the relevant network operation and maintenance task of the dialogue message). The potential network operation and maintenance intention is an intention related to the dialogue intention of the dialogue message, which may be a related network operation and maintenance intention or a related knowledge question and answer intention. The relevant network operation and maintenance task is a network operation and maintenance task generated to complete the potential network operation and maintenance intention, and the relevant network operation and maintenance task is related to the network operation and maintenance task of the dialogue message. The first message processing device executes the execution result of the relevant network operation and maintenance task, and adds the execution result of the network operation and maintenance task of the dialogue message and the execution result of the relevant network operation and maintenance task to the dialogue response, so that the client can display the execution result of the network operation and maintenance task and the execution result of the relevant network operation and maintenance task on the dialogue interface, thereby providing users with intelligent execution of network operation and maintenance tasks, which can enhance user experience.

[0203] In other embodiments, in the process of generating a network operation and maintenance task based on the first large language model, if critical information for generating the network operation and maintenance task (such as API input data) is missing, the first message processing device sends a supplementary prompt message to the client, and the supplementary prompt message is used to prompt the user to supplement the critical information. The client displays the supplementary prompt message, and the user can supplement the critical information in the next conversation message. The first message processing device generates the network operation and maintenance task based on the first large language model and the critical information.

[0204] Fig.10 The illustrated embodiment is illustrated by taking the example of the first message processing device obtaining a network operation and maintenance task. In other embodiments, in a network operation and maintenance system with multi-level message processing devices, if the operation and maintenance scenario intent is not a knowledge question and answer scenario and the operation and maintenance task intent includes multiple operation and maintenance task sub-intentions, the first message processing device does not create a network operation and maintenance task, but distributes the multiple operation and maintenance task sub-intentions to the message processing devices at the next management level, and the message processing devices at the next management level complete each operation and maintenance task sub-intention.

[0205] For example, suppose there are multiple message processing devices at the next level of the first message processing device, and the message processing devices at the next level are called second message processing devices. The management levels of the multiple second message processing devices are the same, and the management level of the second message processing devices is lower than that of the first message processing device, that is, the first message processing device is the upper-level manager of the multiple second message processing devices. Figure 7 or Figure 8 For example, the first message processing device is Figure 7 or Figure 8 The message processing device 21 in the embodiment of the present invention, the plurality of second message processing devices are Figure 7 or Figure 8 The message processing device 22 in the example. For example, the operation and maintenance task intent includes a first operation and maintenance task sub-intent and a second operation and maintenance task sub-intent, and the first device and the second device in the plurality of second message processing devices respectively complete the first operation and maintenance task sub-intent and the second operation and maintenance task sub-intent, see Fig.12 The flowchart of another network operation and maintenance method based on a large language model provided in an embodiment of the present application is shown, and the method includes the following steps.

[0206] 1201. The client sends a network operation and maintenance request to the first message processing device, where the network operation and maintenance request indicates to perform a network operation and maintenance task on the network based on the network operation and maintenance intention of the dialogue message.

[0207] Among them, this step 1201 is the same as the above-mentioned step 1002, and here, this step 1201 is not repeated.

[0208] 1202. The first message processing device obtains the dialogue message in the network operation and maintenance request, and determines the network operation and maintenance intention based on the first language model and the dialogue message, where the network operation and maintenance intention includes a first operation and maintenance task sub-intention and a second operation and maintenance task sub-intention.

[0209] Among them, this step 1202 is the same as the above-mentioned step 1003, and here, this step 1202 is not repeated.

[0210] 1203. The first message processing device sends a first operation and maintenance task sub-intent to the first device, and sends a second operation and maintenance task sub-intent to the second device.

[0211] The first device is any one of a plurality of second message processing devices, and the second device is any one of a plurality of second message processing devices except the first device.

[0212] 1204. The first device obtains the first operation and maintenance task sub-intention, and generates a first network operation and maintenance sub-task based on the first operation and maintenance task sub-intention and the second largest language model connected to the first device.

[0213] Among them, the second largest language model connected to the first device is the large language model running in the first device, or the large language model running in the decision-making device. If the large language model running in the second largest language model decision-making device, when the first message processing device and the first device are connected to the same decision-making device, the second largest language model and the first largest language model are the same model, so Figure 8 For example, the first large language model and the second large language model are both large language models in the decision device 30. In the case where the first message processing device and the first device are connected to different decision devices, the second large language model is not the same model as the first large language model. Figure 7 For example, the first large language model is the large language model in the decision device 31, and the second large language model is the large language model in the decision device 32 connected to the first device. At this time, the second large language model and the first large language model are two large language models with related functions.

[0214] When the first message processing device sends the first operation and maintenance task sub-intention to the first device, it also sends the operation and maintenance scenario intent in the network operation and maintenance intent to the first device, so that the second message processing device can orchestrate the network operation and maintenance task (i.e., the first network operation and maintenance sub-task) for the operation and maintenance task sub-intention based on the second largest language model and the API corresponding to the operation and maintenance scenario intent, and obtain the subtask information of the first network operation and maintenance sub-task.

[0215] When the second largest language model is deployed on the second decision-making device, the first device orchestrates the first network operation and maintenance subtask for the first network operation and maintenance sub-intention by calling the second largest language model, such as the following steps E1 to E3.

[0216] Step E1, the first device sends subtask orchestration prompt information to the second decision-making device, where the subtask orchestration prompt information is used to prompt the large language model to orchestrate the network operation and maintenance subtask for the operation and maintenance task sub-intent based on the API corresponding to the operation and maintenance scenario intent, and prompt the large language model to output the subtask information of the orchestrated network operation and maintenance subtask.

[0217] For example, the subtask arrangement prompt information includes the first operation and maintenance task sub-intent and the description information of the API corresponding to the operation and maintenance scenario intent.

[0218] The first device splices the first network intent and the description information of the API corresponding to the operation and maintenance scenario intent in the task scheduling prompt template of the large language model to obtain the subtask scheduling prompt information. The process of splicing the subtask scheduling prompt information is the same as the process of splicing the task scheduling prompt information in step C2. The difference is that when splicing the subtask scheduling prompt information, at least one operation and maintenance task sub-intent is spliced ​​in the message field of the task scheduling prompt template, and when splicing the task scheduling prompt information, the entire operation and maintenance task intent is spliced ​​in the message field of the task scheduling prompt template. After obtaining the subtask scheduling prompt information, the second message processing device sends the subtask scheduling prompt information to the second decision-making device.

[0219] Step E2, the second decision-making device receives the subtask scheduling prompt information, and based on the second largest language model and the API corresponding to the operation and maintenance scenario intent, schedules the first network operation and maintenance subtask for the first operation and maintenance task sub-intent to obtain the first subtask information.

[0220] The second decision-making device inputs the subtask orchestration prompt information into the second largest language model. The second largest language model orchestrates the first network operation and maintenance subtask for the first operation and maintenance task sub-intention based on the description information of the API corresponding to the operation and maintenance scenario intention according to the prompt of the subtask orchestration prompt information, and obtains the first subtask information. The orchestration process, for example, determines the first API required to complete the first operation and maintenance task sub-intention under the operation and maintenance scenario intention, the calling order and input parameters of the first API required to complete the first operation and maintenance task sub-intention, generates the first subtask information based on the calling order and input parameters of the first API required to complete the first operation and maintenance task sub-intention, and the second largest language model outputs the first subtask information.

[0221] Step E3: The second decision-making device outputs the first subtask information to the second message processing device, and the first device receives the first subtask information.

[0222] The first subtask information indicates the first network operation and maintenance subtask, and obtaining the first subtask information is to obtain the first network operation and maintenance subtask.

[0223] 1205. The first device executes the first network operation and maintenance subtask, and outputs the execution result of the first network operation and maintenance subtask to the first message processing device.

[0224] For example, the first device executes the first network operation and maintenance subtask according to the first subtask information. This process is the same as the process in step 1005 in which the message processing device 20 executes the operation and maintenance subtask according to the subtask information of the network operation and maintenance subtask, and will not be repeated here.

[0225] 1206. The second device obtains a second operation and maintenance task sub-intention, and generates a second network operation and maintenance sub-task based on the second operation and maintenance task sub-intention and a second language model connected to the second device.

[0226] Among them, this step 1206 is the same as the above step 1204 and will not be repeated here.

[0227] 1207. The second device executes the second network operation and maintenance subtask, and outputs the execution result of the second network operation and maintenance subtask to the first message processing device.

[0228] Among them, this step 1207 is the same as the above step 1205 and will not be repeated here.

[0229] 1208. The first message processing device receives the execution result of the first network operation and maintenance subtask and the execution result of the second network operation and maintenance subtask.

[0230] The above steps 1205, 1207 and 1208 are explained by taking the example of the first message processing device passively obtaining the execution result of the network operation and maintenance subtask. In other embodiments, the first message processing device may also actively obtain the execution result of the first network operation and maintenance subtask from the first device, and actively obtain the execution result of the second network operation and maintenance subtask from the second device. In this case, there is no need for the first device and the second device to actively send the execution results of the network operation and maintenance subtask.

[0231] 1209. The first message processing device outputs a dialogue response of the dialogue message to the client based on the execution result of the first network operation and maintenance subtask and the execution result of the second network operation and maintenance subtask.

[0232] For example, the first message processing device determines the execution result of the network operation and maintenance task based on the execution result of the first network operation and maintenance subtask and the execution result of the second network operation and maintenance subtask, and outputs a dialogue response to the client based on the execution result of the network operation and maintenance task.

[0233] The process shown in the above steps 1201 to 1209 is illustrated by taking the example that the network operation and maintenance task intent includes two operation and maintenance task sub-intentions. In other embodiments, the network operation and maintenance task intent includes more than two operation and maintenance task sub-intentions. The first message processing device sends the more than two operation and maintenance task sub-intentions to multiple second message processing devices. Each second message processing device can obtain one or more operation and maintenance task sub-intentions, and based on the second largest language model connected to each other, respectively arrange network operation and maintenance sub-tasks for one or more operation and maintenance task sub-intentions, obtain one or more network operation and maintenance sub-tasks, execute at least one network operation and maintenance sub-task, and send at least one network operation and maintenance sub-task to the first message processing module. In this way, the first message processing module can obtain the execution results of the network operation and maintenance sub-tasks corresponding to all operation and maintenance task sub-intentions, and output a dialogue response to the client based on the obtained execution results. When the second message processing device obtains multiple first network operation and maintenance subtasks, it executes the multiple first network operation and maintenance subtasks in sequence according to the execution order of the multiple first network operation and maintenance subtasks. This process is the same as the process in which the message processing device 20 in step 1005 executes the multiple network operation and maintenance subtasks in sequence according to the execution order of the multiple network operation and maintenance subtasks.

[0234] 1210. The client receives the dialogue response and displays the dialogue response in the dialogue interface.

[0235] Among them, this step 1210 is the same as the above-mentioned step 1007, and here, this step 1210 is not repeated.

[0236] Fig.12 The method provided by the embodiment shown can achieve Fig.10 In addition to the beneficial effects brought by the illustrated embodiment, each operation and maintenance task sub-intent in the operation and maintenance task intent is distributed to multiple second message processing devices through the first conversation processor, and the operation and maintenance task sub-intent is processed in parallel by multiple second message processing devices, thereby improving the processing efficiency of the operation and maintenance task intent and reducing the response time of the dialogue message. In addition, the multiple second message processing devices respectively use the second largest language model in the second decision-making device to which they are connected to arrange the network operation and maintenance sub-tasks for the issued operation and maintenance task sub-intent, avoiding task congestion in the first largest language model, further speeding up the processing efficiency of the operation and maintenance task intent and reducing the response time of the dialogue message.

[0237] Above Fig.10 as well as Fig.12 The embodiments shown are all described by taking the example that the first message processing device first obtains the network operation and maintenance intention of the dialogue message, and then arranges the network operation and maintenance tasks based on the network operation and maintenance intention. In other embodiments, the first message processing device completes the identification of the network operation and maintenance intention and the arrangement of the network operation and maintenance tasks at one time based on the first large language model, for example Fig.13The flowchart of another network operation and maintenance method based on a large language model provided in an embodiment of the present application is shown as an example.

[0238] 1301. The user enters a dialogue message “Which AP devices are the busiest today?” on the dialogue interface of the client.

[0239] 1302. The client sends a dialog message “Which AP devices are the busiest today?” to the first message processing device.

[0240] The method of sending the dialogue message may refer to the above step 1002.

[0241] After receiving the dialogue message, the first message processing device enters the stage 1 shown in the following steps 1303 to 1305 to perform scenario intent recognition on the dialogue message to identify the potential intent of the operation and maintenance scenario to which the dialogue message belongs.

[0242] 1303. The first message processing device splices the received dialogue message into the scene intent prompt template to obtain a modified scene intent prompt template (i.e., scene intent prompt information), and sends the modified scene intent prompt template to the first language model to request the first language model to perform scene intent recognition on the dialogue message, wherein the modified scene intent prompt template is as follows:

[0243] {User asks: Which APs are the busiest today?

[0244] Which of the following scenarios does this apply to? Return as a number

[0245]

[0246] 2. View network reports

[0247] 3. Check fault information.

[0248] 1304. The first language model receives the modified scenario intent prompt template, analyzes and infers the user's conversation message based on the modified scenario intent prompt template, determines that "which APs are the busiest today" belongs to the network data query scenario, and returns the network data query scenario in digital form, that is, returns the number "1".

[0249] After determining the network operation and maintenance scenario, the first message processing device matches the specific scenario according to the number "1", and enters phase two shown in steps 1305 to 1312 based on the specific scenario to perform network operation and maintenance task orchestration to implement the execution scenario process.

[0250] 1305. If it is determined that the user's conversation message corresponds to a network data query scenario, the first message processing device splices the description information of the network data query scenario into the interface prompt template to obtain a modified interface prompt template (i.e., interface prompt information), and sends the modified interface prompt template to the first language model, wherein the modified interface prompt template is as follows:

[0251] {To answer the question "{query}", from which category should you choose API usage? Return as a number

[0252] 1. About AP equipment

[0253] 2. About switch equipment

[0254] 3. About gateway device}.

[0255] The query here refers to the conversation message.

[0256] 1306. The first language model receives the modified interface prompt template, analyzes and infers the dialogue message, determines that to answer the dialogue message (ie, the user's question), it is necessary to call the API of the AP device and return "1" in digital form.

[0257] 1307. After receiving the intent response about the API, the first message processing device sends a request for obtaining the API description list of the AP device (i.e., requests to obtain the description information of the API) to the first network management device, and obtains the API description list about the AP device.

[0258] 1308. The first message processing device splices the API description list of the AP device into the task scheduling prompt template to obtain a modified task scheduling prompt template, and sends the modified task scheduling prompt template to the first language model, wherein the modified task scheduling prompt template is as follows:

[0259] {{List of API descriptions about AP}

[0260] Which API should {query} call? What parameters should be passed? Give the answer directly, don't give the analysis process}.

[0261] 1309. After receiving the modified task scheduling prompt template, the first language model determines the specific API that needs to be called (i.e., the first API) and the input parameters of the API that needs to be called, and returns the API call list to the first message processing device, wherein the API call list is the task information, and the API call list includes the identifier of the API that needs to be called and the input parameters.

[0262] 1310. The first message processing device sends an API call message to the first network management device based on the returned API call list to request to call the API. The first network management device returns the API call result to the first message processing device according to the API call list in the API call message, such as returning the TopN busy AP list.

[0263] 1311. The first message processing device splices the returned TopN busy AP list into the reply prompt template to obtain a modified reply prompt template, and sends the modified reply prompt template to the first largest language model to prompt the first largest language model module to give a reply to the dialog message, wherein the modified reply prompt template is as follows:

[0264] {Based on {return}, please provide analysis and summary of {query}}.

[0265] Here, return refers to the API call result: the list of TopN busy APs.

[0266] 1312. After receiving the modified reply prompt template, the first language model generates response information based on the reply prompt template and processes the returned response information (i.e., the operation and maintenance task intention + the execution result of the network operation and maintenance task) to the first dialogue, wherein the response information is as follows:

[0267] {We can use the channel usage of each AP to determine which APs have more devices during data collection. The following are the APs with more connected devices:

[0268] AP03 (SuZhou-A1 region, 87%)

[0269] h1-ap304 (SuZhou-A1 region, 83%)

[0270] szvb6oaphw36 (SuZhou-A1 region, 80%)

[0271] These APs had high channel utilization during the data collection period and can be considered relatively busy.}

[0272] The process shown in steps 1305 to 1312 above is a process of arranging tasks based on the determined operation and maintenance scenario intention, executing one or more network operation and maintenance tasks, and obtaining answer information related to the problem. In other embodiments, the first message processing device also performs stage three shown in steps 1313 to 1318 to perform recommended function navigation for the user.

[0273] 1313. The first message processing device module splices the dialog message query to the category prompt template of the uniform resource locator (URL) to obtain a modified category prompt template, and sends the modified category prompt template to the first language model to prompt the first language model to give recommended navigation information of the user question (i.e., the dialog message), wherein the modified category prompt template is as follows:

[0274] {For the question "{query}", from which category should the URL be selected? Return as a number

[0275] 1. About AP 2. About customer files}.

[0276] 1314. After the first large language model receives the modified category prompt template, based on the modified category prompt template, if it is determined that the user's next question is about AP, it returns 1 in digital form, and the first message processing device receives the response "1" of the large language model.

[0277] 1315. The first message processing device sends a URL acquisition request to the first network management device to request to obtain a URL list about AP devices, and receives response information returned by the first manager for obtaining the URL, wherein the response information includes a URL list about AP devices, wherein the list includes the URL and description information of the URL.

[0278] 1316. The first message processing device splices the returned URL list about the AP device into the prediction prompt template to obtain a modified prediction prompt template, and sends the modified prediction prompt template to the first language model to prompt the first language model to recommend a related URL link (i.e., predicted intent) for the next dialog message. The modified prediction prompt template is as follows:

[0279] {The web URL information related to the problem is as follows:

[0280] {URL list, and description of each URL}

[0281] Which URL does {query} relate to? Give the URL link. The output format is:

[0282] A brief description of this URL:

[0283] URL:}.

[0284] 1317. After receiving the modified prediction prompt template, the first largest language model recommends a related URL for the dialogue intent of the next dialogue message according to the prompt of the modified prediction prompt template. Assuming that the recommended content (i.e., the predicted intent) is "A brief description of this URL: View more details of busy APs. URL: https: / / operation and maintenance task intent", the first largest language model uses the recommended content as response information and returns the response information to the first message processing device, and the first message processing device receives the response information.

[0285] 1318. The first message processing device sends the response information obtained in the above three stages to the first large language model for splicing, or sends the initial response information obtained in the above three stages to the first large language model for splicing, so as to obtain the reply response information (i.e., the dialogue response) expressed in natural language to be returned to the client. For example, the reply response information expressed in natural language returned by the first large language model is as follows:

[0286] {We can determine which APs carry more devices during data collection based on the channel utilization of each AP. The following are the APs with more connected devices:

[0287] AP03 (SZ-A1 region, 87%)

[0288] h1-ap304 (SZ-A1 region, 83%)

[0289] szvb6oaphw36 (SZ-A1 region, 80%)

[0290] These APs had high channel utilization during the data collection period and can be considered to be relatively busy.

[0291] For more details about busy APs, please click here.

[0292] 1319. The first message processing device sends a reply response message to the client, and the client displays the reply response message on the dialogue interface.

[0293] Fig.13 The illustrated embodiment is introduced by taking the example that the recommended navigation information includes the predicted intent "View more busy APs" and the URL related to the task recommendation information. In other embodiments, the predicted intent is not the URL related to the task recommendation information, that is, the URL is an optional option for the predicted intent.

[0294] Above Figures 10 to 13The embodiments shown are all introduced by taking the example of a message processing device (such as the first message processing device and the second message processing device) calling the large language model in the decision-making device (such as the first decision-making device and the second decision-making device). In other embodiments, if the computing resources of the message processing device are sufficient, the large language model can also be deployed in the message processing device. The message processing device completes the method steps completed by the decision-making device based on the large language model based on the local large language model, thereby eliminating the need to call the medium and large language models of other devices, reducing the interaction between the message processing device and other devices. In this case, there is no need to set up a decision-making device in the network operation and maintenance system. Figures 10 to 13 The embodiments shown are all explained by taking the example of a message processing device providing prompt information of a large language model (such as intent prompt information, scenario intent prompt information, task prompt information, interface type prompt information, task scheduling prompt information, format conversion prompt information, prediction prompt information, etc.) to a decision-making device. In other embodiments, the message processing device does not provide prompt information to the decision-making device, but provides the first decision-making device with relevant information spliced ​​into the prompt information (such as conversation messages, network operation and maintenance intentions, etc.), and the decision-making device splices the relevant information into the corresponding prompt template to obtain the prompt information of the large language model, and inputs the prompt information into the large language model.

[0295] The present application involves prompt templates of a large language model (such as intent prompt templates, scenario intent prompt templates, task intent prompt templates, interface prompt templates, task scheduling prompt templates, conversion prompt templates, prediction prompt templates, potential intent prompt templates, etc.), all of which are prompt templates of a large language model, so that the large language model can output the correct result according to the prompt of the prompt template. The above is explained by taking the example of a user conducting a human-computer dialogue with the first message processing device through the dialogue window of the dialogue interface. In other embodiments, the user can also trigger a human-computer dialogue with the first message processing device through the information display window of the dialogue interface. The following is combined with Fig.14 as well as Fig.15 Provide an exemplary introduction.

[0296] like Fig.14 The dialogue interface 1400 shown, when the user triggers the client to open the dialogue interface 1400, the client displays the dialogue interface 1400 in the initial state. In the initial state, the interface 1400 is divided into a dialogue window 1401 and an information display window 1402, wherein the dialogue window 1401 is a human-computer question and answer box, in which real-time human-computer interactive dialogue can be carried out, and the information display window 1402 is a real-time presented chart box, and the elements in the icon box can be selected to trigger the human-computer dialogue, and the status of the elements can also be presented in the chart box based on the dialogue message and dialogue response.

[0297] When the dialog interface 1400 page is in the initial state (e.g., when the dialog interface 1400 is just opened), the information display window 1402 displays detailed network operation and maintenance information such as a network topology diagram, an alarm log list, and a performance statistics diagram. For example, the network topology diagram composed of network elements (i.e., network devices) 1-9 displayed in the information display window 1402 can be triggered by the user. The user can have a human-computer dialogue with the message processing device for the element, such as the network element, alarm, etc. in the information display window 1402, for example Fig.15 The human-computer dialogue flow chart shown in FIG. 1 includes the following steps 1 to 23.

[0298] Step 1: Assume that the client is a browser page, a dialogue interface 1400 is displayed in the browser page, and the user performs a selection operation (such as a click operation or a voice command) on the network element 9 displayed in the network topology diagram.

[0299] Step 2: In response to the selection operation of network element 9, the client pops up a dialogue sub-interface 1403 based on network element 9 at a location associated with network element 9 (such as near network element 9) in the information display window 1402, and caches the network element information of the network element in the browser.

[0300] The network element information of the network element includes the network element identity (ID) and / or the address of the network element. The network element information is cached in the browser so that the subsequent message processing device can conduct a human-computer dialogue with the user for the selected network element according to the network element information.

[0301] Step 3: The user enters information related to network operation and maintenance in dialog box A in the dialogue sub-interface 1403. For example, the user enters the first question in dialog box A, which is a query question: query channel utilization.

[0302] Step 4: The client displays the first question input by the user in the information display window 1402 in the dialogue interface, and sends the question to the message processing device.

[0303] Step 5: The message processing device optimizes the first question, assembles the optimized question into a prompt template, and sends the assembled prompt template to the large language model. The large model determines the operation and maintenance scenario intention, operation and maintenance task intention, and orchestrates the operation and maintenance tasks.

[0304] For example, the message processing device obtains cached network element information from the browser, optimizes the user's question according to the information of the network element, and obtains the optimized question: query the channel utilization of network element 9. In other embodiments, the message processing device does not optimize the question, and splices the question into the operation and maintenance intention prompt template, or the client optimizes the question based on the cached network element information and provides the optimized question to the message processing device, and the message processing device assembles the optimized question into the operation and maintenance intention prompt template.

[0305] Step 6. The large language model recognizes that the operation and maintenance scenario intention of the problem is an API call type problem based on the prompt of the prompt template. The operation and maintenance task intention of the problem is to query the channel utilization of network element 9, and determines that the API (called the first target API) that needs to be called to query the channel utilization is returned to the client. The network operation and maintenance intention and the identifier of the first target API that needs to be called are returned.

[0306] Step 7. After determining the API class call problem, obtain the parameter information of the first target AIP from the network management device, the message processing device associates the web page 9 previously selected by the user in the information display window 1402, obtains the network element information cached after the user first selects the network element from the client, and uses the network element information as the parameter information for filling in the first target API.

[0307] Step 8. The message processing device calls the first target API, queries the channel utilization of network element 9, obtains the query results, assembles the query results into a format conversion prompt template, provides the assembled format conversion prompt template to the large language model, and the large language model converts the query results into a format according to the prompt of the format conversion prompt template, and returns the query results after format conversion as a dialogue response to the client. The large language model sends the dialogue response to the message processing device.

[0308] Step 9: The message processing device sends a dialog response to the client, and the client displays the dialog response in the dialog window 1401 in the dialog interface 1400: It helps you to find out that the channel utilization rate of network element 9 is 87%.

[0309] Step 10: The user continues to input the second question in dialog box A or dialog window 1401: Why is the channel utilization rate high?

[0310] Step 11: The client displays the second question input by the user in the dialog window 1401 and sends the second question to the message processing device.

[0311] Step 12, similar to step 5, the message processing device optimizes the second question, assembles the optimized second question into the prompt template, and sends the assembled prompt template to the large language model, which determines the operation and maintenance scenario intention, operation and maintenance task intention, and orchestrates the operation and maintenance tasks.

[0312] Step 13. The large language model recognizes, based on the prompt of the prompt template, that the operation and maintenance scenario intention of the second question is a knowledge question and answer type question, and the operation and maintenance task intention of the question is the reason for the high channel utilization of network element 9. The large language model sends the network operation and maintenance intention composed of the operation and maintenance scenario intention and the operation and maintenance task intention to the message processing device.

[0313] Step 14: The message processing device splices the network operation and maintenance intention into the knowledge question and answer prompt template, and sends the assembled knowledge question and answer prompt template to the large language model. The large language model outputs the answer to the second question according to the prompt of the knowledge question and answer prompt template, and the large language model returns the answer to the second question to the message processing device.

[0314] Step 15: The message processing device returns to the client, and the client displays the answer in the dialog window 1401: The reason why the channel utilization rate of network element 9 is high is xxxxx.

[0315] Step 16: The user continues to input the third question in dialog box A or dialog window 1401: Optimize.

[0316] Step 17: The client displays the third question input by the user in the conversation window 1401 and sends the third question to the message processing device.

[0317] Step 18, similar to step 5, the message processing device optimizes the third question, assembles the optimized third question into the prompt template, and sends the assembled prompt template to the large language model, which determines the operation and maintenance scenario intention, operation and maintenance task intention, and arranges the operation and maintenance tasks.

[0318] Step 19. The large language model recognizes that the operation and maintenance scenario intention of the third question is a network optimization problem based on the prompt of the prompt template. The operation and maintenance task intention of this problem is to optimize the channel utilization of network element 9, and determines that the API (second target API) for network optimization needs to be called to return the network operation and maintenance intention and the identifier of the first target API that needs to be called to the client.

[0319] Step 20. After determining the network optimization problem, the message processing device obtains the parameter information of the second target AIP from the network management device, associates the web page 9 previously selected by the user in the information display window 1402, obtains the network element information cached after the user first selects the network element from the client, and uses the network element information as the parameter information for filling in the second target API.

[0320] Step 21. After determining that the network optimization problem is a network optimization problem, the message processing device also notifies the client that it is a network optimization problem. Based on the notification, the client displays a dynamic effect on the icon of network element 9 in the information display window 1402 to prompt the network element being optimized, so that it can be dynamically linked with the dialogue message in the dialogue window 1401 to achieve a dynamic effect of linkage.

[0321] Step 22, the message processing device calls the second target API, optimizes the channel utilization of network element 9, obtains the optimization result, assembles it into a format conversion prompt template, provides the assembled format conversion prompt template to the large language model, and the large language model converts the optimization result into a format according to the prompt of the format conversion prompt template. The large language model sends the optimization result after format conversion to the message processing device.

[0322] Step 23, the message processing device sends the optimization result after format conversion to the client, and the client displays the optimization result "√" in the dialogue window 1401 to prompt that the optimization is completed, and cancels the dynamic effect on the icon of network element 9 to restore the icon of network element 9 to its initial state.

[0323] For the above-mentioned dialogue process, the user can select the element to be operated and maintained in the information display window, and then enter simple problem description information in the dialogue message, without the need for the user to enter complex problem description information. In addition, the user can also ask questions continuously for the element selected by the user. The message processing device can obtain the user's specific question by associating the user's operation in the information display window and the output information, and then analyze the network operation and maintenance intention in the specific question with the help of the large language model, arrange the operation and maintenance tasks used to complete the network operation and maintenance intention, and execute the network operation and maintenance tasks. In other embodiments, the dialogue sub-interface 1403 also includes multiple operation and maintenance options, and the operation and maintenance options are used to confirm the type of operation and maintenance tasks performed on the network element (such as threat assessment, network tuning, etc.). The user can also select and confirm the operation and maintenance options without entering the question. In response to the selection and confirmation operation, the client uses the operation and maintenance task type corresponding to the selected operation and maintenance option as the user's question, without the need for user input, thereby further simplifying the user's operation process.

[0324] The above describes the method of the embodiment of the present application, and the following describes the device of the embodiment of the present application. It should be understood that the device and equipment described below have the same inventive concept as the above-mentioned network operation and maintenance method, and can achieve the beneficial effects that can be achieved by the above-mentioned method embodiment. Figure 16 to Figure 17 Describe network operation and maintenance devices and equipment. It should be understood that the technical features described in the method embodiment are also applicable to the following device embodiments.

[0325] Fig.16It is a structural diagram of a network operation and maintenance device based on a large language model, such as Fig.16 The device 1600 shown includes: a determination module 1601, which is used to determine the network operation and maintenance intention based on a large language model and an input dialogue message; an acquisition module 1602, which is used to acquire the network operation and maintenance task based on the network operation and maintenance intention; and an execution module 1603, which is used to execute the network operation and maintenance task and output a dialogue response.

[0326] In one possible implementation, the network operation and maintenance intention includes the operation and maintenance task intention and the operation and maintenance scenario intention. The acquisition module 1602 is used to: based on the large language model and the application programming interface corresponding to the operation and maintenance scenario intention, arrange the network operation and maintenance tasks for the operation and maintenance task intention, and obtain the task information. The application programming interface is used to complete the network operation and maintenance tasks under the operation and maintenance scenario intention. The task information indicates the calling process of the application programming interface when executing the network operation and maintenance task.

[0327] In one possible implementation, the operation and maintenance task intent includes multiple operation and maintenance task sub-intentions, and the acquisition module 1602 is used to: based on the large language model and the application programming interface, respectively arrange the network operation and maintenance sub-tasks for the multiple operation and maintenance task sub-intentions, and obtain multiple sub-task information, wherein the sub-task information indicates the calling process of the application programming interface when executing the network operation and maintenance sub-task; based on the multiple sub-task information, obtain the task information.

[0328] In one possible implementation, the acquisition module 1602 includes: an acquisition unit, used to acquire description information of an application programming interface; a generation unit, used to generate task orchestration prompt information based on the operation and maintenance task intent, a first prompt statement, and the description information of the application programming interface, the first prompt statement being used to prompt the large language model to orchestrate a network operation and maintenance task for the operation and maintenance task intent based on the application programming interface, and prompting the large language model to output task information of the orchestrated network operation and maintenance task; a sending unit, used to send task orchestration prompt information to a device running the large language model; and a receiving unit, used to receive task information returned by the device.

[0329] In a possible implementation, the acquisition unit is used to: send an information acquisition request to the network management device, where the information acquisition request indicates obtaining description information of the application programming interface; and receive the description information returned by the network management device.

[0330] In one possible implementation, the execution module 1603 is used to: send an interface call request to a network management device based on task information, the interface call request indicating calling an application programming interface to perform a network operation and maintenance task; and receive an interface call response returned by the network management device, the interface call response including the execution result of the network operation and maintenance task.

[0331] In one possible implementation, the device 1600 also includes: a sending module, used to send a first operation and maintenance task sub-intention to a first device, and to send a second operation and maintenance task sub-intention to a second device; an acquisition module, also used to obtain the execution result of the first network operation and maintenance subtask from the first device, and to obtain the execution result of the second network operation and maintenance subtask from the second device; an output module, used to output a dialogue response based on the execution result of the first network operation and maintenance subtask and the execution result of the second network operation and maintenance subtask.

[0332] In one possible implementation, the determination module 1601 is used to: generate operation and maintenance intention prompt information based on the dialogue message and the second prompt statement, the second prompt statement is used to prompt the large language model to identify the network operation and maintenance intention of the dialogue message, and prompt the large language model to output the identified network operation and maintenance intention; send the operation and maintenance intention prompt information to the second device running the large language model; receive the network operation and maintenance intention returned by the second device.

[0333] Through the description of the above implementation methods, technical personnel in the relevant field can understand that, for the convenience and simplicity of description, the above-mentioned device 1600 is only illustrated by the division of the above-mentioned functional modules. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0334] Fig.17 The structure diagram of a computer device provided by an embodiment of the present application is shown in FIG. Fig.17 The computer device 1700 shown is configured as any module in the aforementioned network operation and maintenance system (such as a client, a first message processing device, a second message processing device, a first decision device, a second message processing device or a first network management device), such as Fig.17 As shown, the computer device 1700 includes: a bus 1702, a processor 1704, a memory 1706 and a communication interface 1708. The processor 1704, the memory 1706 and the communication interface 1708 communicate through the bus 1702. The computer device 1700 can be a server or a terminal device. It should be understood that the present application does not limit the number of processors and memories in the computer device 1700. The bus 1702 can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.17Only one line is used to represent it, but it does not mean that there is only one bus or one type of bus. Bus 1704 may include a path for transmitting information between various components of computer device 1700 (for example, memory 1706, processor 1704, communication interface 1708). Processor 1704 may include any one or more of processors such as a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP) or a digital signal processor (DSP). Memory 1706 may include volatile memory, such as random access memory (RAM). Memory 1706 may also include non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD) or solid state drive (SSD). The memory 1706 stores executable program codes, and the processor 1704 executes the executable program codes to respectively implement the functions of any module in the aforementioned network operation and maintenance system, thereby realizing the network operation and maintenance method based on the large language model. That is, the memory 1706 stores instructions for executing the network operation and maintenance method based on the large language model. Alternatively, the memory 1706 stores executable program codes, and the processor 1704 executes the executable program codes to realize the network operation and maintenance method based on the large language model executed by any module in the network operation and maintenance system. Taking the computer device 1700 as a message processing device as an example, the processor 1704 executes the executable program codes to realize the network operation and maintenance method based on the large language model executed by the above-mentioned message processing device. The communication interface 1708 uses a transceiver module such as, but not limited to, a network interface card and a transceiver to realize the communication between the computer device 1700 and other devices or communication networks.

[0335] In an exemplary embodiment, a computer-readable storage medium is also provided, such as a memory including a program code, and the program code can be executed by a processor of a computer device to complete the network operation and maintenance method based on a large language model executed by any module in the above-mentioned network operation and maintenance system. For example, the computer-readable storage medium is a non-temporary computer-readable storage medium, such as a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, and an optical data storage device.

[0336] An embodiment of the present application also provides a computer program product or a computer program, which includes a program code, and the program code is stored in a computer-readable storage medium. A processor of a computer device reads the program code from the computer-readable storage medium, and the processor executes the program code, so that the computer device executes the network operation and maintenance method based on the large language model executed by any module in the above-mentioned network operation and maintenance system.

[0337] Among them, the devices, equipment, computer-readable storage media or computer program products provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here.

[0338] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0339] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0340] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0341] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard drives, ROM, RAM, magnetic disks or optical disks.

[0342] In the description of the present application, unless otherwise specified, " / " means "or", for example, A / B can mean A or B. "And / or" in this article is only a kind of association relationship describing the associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, "at least one" means one or more, and "multiple" means two or more. The words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not necessarily limit them. In the present application, the words "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or design schemes. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way. It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data for analysis, stored data, displayed data, etc.) and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the dialogue messages involved in this application are obtained with full authorization. All the above-mentioned optional technical solutions can be combined in any way to form optional embodiments of the present disclosure, and they will not be described one by one here. The above is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application.

Claims

1. A network operation and maintenance method based on a large language model, characterized in that: The method comprises: Determine network operation and maintenance intentions based on the large language model and input conversation messages; Based on the network operation and maintenance intention, obtain a network operation and maintenance task; Execute the network operation and maintenance task and output a dialogue response.

2. The method according to claim 1, characterized in that The network operation and maintenance intention includes an operation and maintenance task intention and an operation and maintenance scenario intention. The obtaining of the network operation and maintenance task based on the network operation and maintenance intention includes: Based on the large language model and the application programming interface corresponding to the operation and maintenance scenario intention, the network operation and maintenance tasks are orchestrated for the operation and maintenance task intention to obtain task information. The application programming interface is used to complete the network operation and maintenance tasks under the operation and maintenance scenario intention, and the task information indicates the calling process of the application programming interface when executing the network operation and maintenance task.

3. The method according to claim 2, characterized in that The operation and maintenance task intent includes a plurality of operation and maintenance task sub-intents, and the application programming interface corresponding to the large language model and the operation and maintenance scenario intent is used to arrange the network operation and maintenance task for the operation and maintenance task intent, and the obtained task information includes: Based on the large language model and the application programming interface, respectively arrange network operation and maintenance subtasks for the multiple operation and maintenance task sub-intentions to obtain multiple subtask information, wherein the subtask information indicates a calling process of the application programming interface when executing the network operation and maintenance subtask; Based on the plurality of subtask information, the task information is acquired.

4. The method according to claim 2, characterized in that: The application programming interface corresponding to the large language model and the operation and maintenance scenario intent is used to arrange the network operation and maintenance task for the operation and maintenance task intent, and the task information obtained includes: Obtaining description information of the application programming interface; Generate task scheduling prompt information based on the operation and maintenance task intention, the first prompt statement and the description information of the application programming interface, wherein the first prompt statement is used to prompt the large language model to schedule a network operation and maintenance task for the operation and maintenance task intention based on the application programming interface, and prompt the large language model to output task information of the scheduled network operation and maintenance task; Sending the task scheduling prompt information to a device running the large language model; Receive the task information returned by the device.

5. The method according to claim 4, characterized in that The obtaining of description information of the application programming interface includes: Sending an information acquisition request to a network management device, wherein the information acquisition request indicates obtaining description information of the application programming interface; Receive the description information returned by the network management device.

6. The method according to any one of claims 2 to 5, characterized in that: The performing of the network operation and maintenance task includes: Based on the task information, sending an interface call request to a network management device, wherein the interface call request indicates calling the application programming interface to perform the network operation and maintenance task; An interface call response returned by the network management device is received, wherein the interface call response includes an execution result of the network operation and maintenance task.

7. The method according to claim 1, characterized in that The network operation and maintenance intention includes a first operation and maintenance task sub-intention and a second operation and maintenance task sub-intention. After determining the network operation and maintenance intention, the method further includes: Sending the first operation and maintenance task sub-intention to the first device, and sending the second operation and maintenance task sub-intention to the second device; Obtaining an execution result of the first network operation and maintenance subtask from the first device, and obtaining an execution result of the second network operation and maintenance subtask from the second device; Based on the execution result of the first network operation and maintenance subtask and the execution result of the second network operation and maintenance subtask, the dialogue response is output.

8. The method according to any one of claims 1 to 7, characterized in that The determining of the network operation and maintenance intention based on the large language model and the input dialogue message includes: Generate operation and maintenance intention prompt information based on the dialogue message and the second prompt sentence, wherein the second prompt sentence is used to prompt the large language model to identify the network operation and maintenance intention of the dialogue message, and prompt the large language model to output the identified network operation and maintenance intention; Sending the operation and maintenance intention prompt information to the device running the large language model; Receive the network operation and maintenance intention returned by the device.

9. A network operation and maintenance device based on a large language model, characterized in that: The device comprises: A determination module is used to determine the network operation and maintenance intention based on the large language model and the input dialogue message; An acquisition module, used to acquire network operation and maintenance tasks based on the network operation and maintenance intention; An execution module is used to execute the network operation and maintenance task and output a dialogue response.

10. The device according to claim 9, characterized in that The network operation and maintenance intention includes operation and maintenance task intention and operation and maintenance scenario intention, and the acquisition module is used to: Based on the large language model and the application programming interface corresponding to the operation and maintenance scenario intention, the network operation and maintenance tasks are orchestrated for the operation and maintenance task intention to obtain task information. The application programming interface is used to complete the network operation and maintenance tasks under the operation and maintenance scenario intention, and the task information indicates the calling process of the application programming interface when executing the network operation and maintenance task.

11. The device according to claim 10, characterized in that The operation and maintenance task intent includes multiple operation and maintenance task sub-intents, and the acquisition module is used to: Based on the large language model and the application programming interface, respectively arrange network operation and maintenance subtasks for the multiple operation and maintenance task sub-intentions to obtain multiple subtask information, wherein the subtask information indicates a calling process of the application programming interface when executing the network operation and maintenance subtask; Based on the plurality of subtask information, the task information is acquired.

12. The device according to claim 10, characterized in that The acquisition module comprises: An acquisition unit, used to acquire description information of the application programming interface; a generating unit, configured to generate task scheduling prompt information based on the operation and maintenance task intent, a first prompt statement, and description information of the application programming interface, wherein the first prompt statement is used to prompt the large language model to schedule a network operation and maintenance task for the operation and maintenance task intent based on the application programming interface, and prompt the large language model to output task information of the scheduled network operation and maintenance task; A sending unit, configured to send the task scheduling prompt information to a device running the large language model; A receiving unit is used to receive the task information returned by the device.

13. The device according to claim 12, characterized in that The acquisition unit is used for: Sending an information acquisition request to a network management device, wherein the information acquisition request indicates obtaining description information of the application programming interface; Receive the description information returned by the network management device.

14. The device according to any one of claims 10 to 13, characterized in that The execution module is used for: Based on the task information, sending an interface call request to a network management device, wherein the interface call request indicates calling the application programming interface to perform the network operation and maintenance task; An interface call response returned by the network management device is received, wherein the interface call response includes an execution result of the network operation and maintenance task.

15. The device according to claim 9, characterized in that The device also includes: A sending module, used to send the first operation and maintenance task sub-intention to the first device, and send the second operation and maintenance task sub-intention to the second device; The acquisition module is further used to acquire the execution result of the first network operation and maintenance subtask from the first device, and acquire the execution result of the second network operation and maintenance subtask from the second device; An output module is used to output the dialogue response based on the execution result of the first network operation and maintenance subtask and the execution result of the second network operation and maintenance subtask.

16. The device according to any one of claims 9 to 15, characterized in that The determination module is used for: Generate operation and maintenance intention prompt information based on the dialogue message and the second prompt sentence, wherein the second prompt sentence is used to prompt the large language model to identify the network operation and maintenance intention of the dialogue message, and prompt the large language model to output the identified network operation and maintenance intention; Sending the operation and maintenance intention prompt information to a second device running the large language model; Receive the network operation and maintenance intention returned by the second device.

17. A computer device, characterized in that: The computer device comprises a processor, and the processor is configured to execute program code so that the computer device performs the method according to any one of claims 1 to 8.

18. A computer-readable storage medium, characterized in that: At least one program code is stored in the storage medium, and the at least one program code is read by the processor to enable the computer device to execute the method according to any one of claims 1 to 8.

Citation Information

Cited By

  • Intelligent network operation and maintenance method and system based on performance analysis and large language model

    CN120602305A

  • Park network automatic operation, maintenance and scheduling system based on multi-region interconnection

    CN122204705A

  • Custom model instructions with language models

    US12430518B2

  • Network operation and maintenance method and apparatus based on large language model, and device and storage medium

    WO2024230262A1