Method, apparatus, device and readable storage medium for application management

Abstract

Embodiments of the present disclosure provide a method, device, equipment and readable storage medium for application management. The method comprises: in response to detecting a question and answer pair generation request for a target application, determining a generation mode corresponding to the question and answer pair generation request; based on data associated with the generation mode, determining a plurality of candidate question and answer pairs, each candidate question and answer pair comprising a question and a corresponding answer; and in response to detecting a determination of at least one question and answer pair in the plurality of candidate question and answer pairs, associating the at least one question and answer pair to the target application, wherein the target application is configured to determine a reply to a user input based on the at least one question and answer pair. In this way, the question and answer pair used in the application can be assisted to be generated or automatically generated, thereby improving the efficiency and accuracy of answering high-frequency questions.

Description

Technical Field

[0001] The exemplary embodiments disclosed herein relate generally to the field of computers, and in particular to methods, apparatus, devices, and readable storage media for application management. Background Technology

[0002] With the development of information technology, various terminal devices can provide people with a variety of services in work and life. Applications providing these services can be deployed on these terminal devices. The terminal devices present relevant content and interact with users through the application's user interface to meet various user needs. In some cases, users may initiate queries within the application. Therefore, improving the quality of the query results provided to users is a key concern. Summary of the Invention

[0003] In a first aspect of this disclosure, an application management method is provided. The method includes: in response to detecting a question-answer pair generation request for a target application, determining a generation pattern corresponding to the question-answer pair generation request; determining a plurality of candidate question-answer pairs based on data associated with the generation pattern, each candidate question-answer pair including a question and a corresponding answer; and in response to detecting the determination of at least one question-answer pair among the plurality of candidate question-answer pairs, associating the at least one question-answer pair with the target application, wherein the target application is configured to determine a response to user input based on the at least one question-answer pair.

[0004] In a second aspect of this disclosure, an application management apparatus is provided, comprising: a generation pattern determination module configured to determine a generation pattern corresponding to a question-answer pair generation request in response to detecting a question-answer pair generation request for a target application; a question-answer pair determination module configured to determine a plurality of candidate question-answer pairs based on data associated with the generation pattern, each candidate question-answer pair including a question and a corresponding answer; and an association module configured to associate at least one question-answer pair with the target application in response to detecting the determination of at least one question-answer pair among the plurality of candidate question-answer pairs, wherein the target application is configured to determine a response to user input based on at least one question-answer pair.

[0005] In a third aspect of this disclosure, an application management method is provided. The method includes: generating at least one candidate question based on a first question in a question-answer pair set, the question-answer pair set being associated with a target application, and the question-answer pairs in the question-answer pair set including a question and a corresponding answer; and in response to detecting confirmation of one or more questions in the generated at least one candidate question, associating a question-answer pair consisting of the confirmed one or more questions, the first question, and a first answer corresponding to the first question with the target application, wherein the target application is configured to determine a response to user input based on the associated question-answer pairs.

[0006] In a fourth aspect of this disclosure, an application management apparatus is provided, comprising: a question generation module configured to generate at least one candidate question based on a first question in a question-answer pair set associated with a target application, wherein the question-answer pairs in the question-answer pair set include a question and a corresponding answer; and an association module configured to, in response to detecting confirmation of one or more of the generated at least one candidate question, associate a question-answer pair consisting of the confirmed one or more questions, the first question, and a first answer corresponding to the first question with the target application, wherein the target application is configured to determine a response to user input based on the associated question-answer pairs.

[0007] In a fifth aspect of this disclosure, an application management method is provided. The method includes: determining at least one candidate question for the target application based on runtime data of the target application; generating a first answer corresponding to the first question based on a first question among the at least one candidate question; and associating a question-answer pair consisting of the first question and the first answer with the target application in response to detecting confirmation of the first question and the first answer, wherein the target application is configured to determine a response to user input based on the associated question-answer pair.

[0008] In a sixth aspect of this disclosure, an application management apparatus is provided, comprising: a question determination module configured to determine at least one candidate question for the target application based on runtime data of the target application; an answer generation module configured to generate a first answer corresponding to the first question based on a first question among the at least one candidate question; and an association module configured to associate a question-answer pair consisting of the first question and the first answer with the target application in response to detecting confirmation of the first question and the first answer, wherein the target application is configured to determine a response to user input based on the associated question-answer pair.

[0009] In a seventh aspect of this disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the electronic device to perform the method of the first aspect, the method of the third aspect, and / or the method of the fifth aspect.

[0010] In an eighth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method of the first aspect, the method of the third aspect, and / or the method of the fifth aspect.

[0011] In the ninth aspect of this invention, a computer program product is provided. This computer program product includes a computer program that, when executed by a processor, implements the method of the first aspect, the method of the third aspect, and / or the method of the fifth aspect.

[0012] It should be understood that the content described in this section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0013] The above and other features, advantages, and aspects of the various embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0014] Figure 1 A schematic diagram of an example environment in which embodiments of the present disclosure can be implemented is shown;

[0015] Figure 2 A block diagram illustrating an application management process according to some embodiments of this disclosure is shown;

[0016] Figure 3 A schematic diagram of a creation interface for a target application according to some embodiments of the present disclosure is shown;

[0017] Figures 4A to 4E A schematic diagram of a question-and-answer management page according to some embodiments of the present disclosure is shown;

[0018] Figure 5A and Figure 5B A schematic diagram of a question-and-answer management page according to other embodiments of this disclosure is shown;

[0019] Figure 6 A schematic structural block diagram of an application management apparatus according to other embodiments of the present disclosure is shown; and

[0020] Figure 7 A block diagram of an electronic device that can implement one or more embodiments of the present disclosure is shown. Detailed Implementation

[0021] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0022] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0023] In this document, unless explicitly stated otherwise, performing a step in response to A does not mean that the step is performed immediately after A, but may include one or more intermediate steps.

[0024] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0025] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, relevant users should be informed of the type, scope of use, and usage scenarios of the information involved in this disclosure through appropriate means in accordance with relevant laws and regulations, and their authorization should be obtained. Among them, relevant users may include any type of rights holder, such as individuals, enterprises, or groups.

[0026] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly inform the user that the requested operation will require obtaining and using the user's information, thereby enabling the relevant user to choose whether to provide information to the software or hardware such as the electronic device, application, server, or storage medium that performs the operation of the technical solution disclosed herein based on the prompt message.

[0027] As an optional but non-restrictive implementation, in response to a user's active request, a prompt message can be sent to the user, such as a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide information to the electronic device.

[0028] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0029] As used in this paper, the term "model" refers to a model that learns the relationship between inputs and outputs from training data, enabling it to generate corresponding outputs for a given input after training. Model generation can be based on machine learning techniques. Deep learning is a machine learning algorithm that uses multiple layers of processing units to process inputs and provide corresponding outputs. A neural network model is an example of a deep learning-based model. In this paper, "model" may also be referred to as a "machine learning model," "learning model," "machine learning network," or "learning network," and these terms are used interchangeably.

[0030] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. Environment 100 relates to an application management platform 110, which can support application creation and / or application execution. In some embodiments, the portion of the application management platform 110 used to support application creation may also be referred to as an application creation portion. In some embodiments, the portion of the application management platform 110 used to support application execution may also be referred to as an application execution portion.

[0031] like Figure 1 As shown, the application creation section provides user 105 with an environment for creating and publishing applications. User 105 can be referred to as the application creation user or creator. In some embodiments, the application creation section can be a low-code platform that provides a collection of tools for application creation. The application creation section can support visual development of various types of applications, allowing developers to skip the manual coding process and accelerate the application development cycle and reduce costs. The application creation section can support any suitable platform for users to develop one or more types of applications, such as a platform based on Application Platform as a Service (aPaaS). Such a platform enables users to efficiently develop applications, enabling operations such as application creation and application function adjustment.

[0032] The application creation component can be deployed locally on user 105's terminal device and / or supported by a server device. For example, user 105's terminal device can run a client with the application creation component, which can support interaction between the user and the application creation component provided by the server. When the application creation component runs locally on the user's terminal device, user 105 can directly interact with the local application creation component using the terminal device. When the application creation component runs on a server device, the server device can provide services to the client running on the terminal device based on the communication connection with the terminal device. The application creation component can present a corresponding interface 130 to user 105 based on user 105's operations, to output and / or receive application creation-related information from user 105.

[0033] In some embodiments, the application creation section may be associated with a corresponding database, which stores the data or information required for the application creation process supported by the application creation section. For example, the database may store the code and description information corresponding to the various functional modules that make up the application. The application creation section can also perform operations such as calling, adding, deleting, and updating the functional modules in the database. The database may also store operations that can be performed on different functional blocks. For example, in a scenario where an application needs to be created, the application creation section can call the corresponding functional blocks from the database to build the application.

[0034] In embodiments of this disclosure, user 105 can create and publish target application 120 as needed in the application creation section. Target application 120 can be published to any suitable application runtime section, as long as the application runtime section can support the operation of target application 120. After publication, target application 120 can be operated by one or more end users 145. End users 145 can be referred to as end users of target application 120. In some embodiments, target application 120 may include or be implemented as digital assistant 122.

[0035] Digital Assistant 122 can be configured to have intelligent dialogue. Figure 1 In the example shown, digital assistant 122 can be integrated into target application 120 as part of target application 120 to assist in task processing within target application 120. In other examples, digital assistant 122 can be configured to run as a standalone application, such as a web application or other type of application. In such examples, digital assistant 122 and target application 120 can be considered as the same application. Digital assistant 122 is provided to assist users with various task processing needs in different applications and scenarios. During interaction with digital assistant 122, the user inputs interactive messages, and digital assistant 122 responds to the user's input by providing reply messages. Typically, digital assistant 122 can support users inputting questions in natural language and performs tasks and provides replies based on its understanding of natural language input and logical reasoning capabilities.

[0036] In some embodiments, the digital assistant 122 can interact with the end user 145 as a contact. For example, the digital assistant 122 can be implemented in an instant messaging (IM) application. The digital assistant 122 can interact with the end user 145 in a one-on-one chat session. In some embodiments, the digital assistant 122 can interact with multiple users in a group chat session that includes multiple users.

[0037] For each end user 145, the client of the application runtime portion can present an interaction window 142 of the target application 120 or digital assistant 122 in the client interface, such as a conversation window with the digital assistant 122. The end user 145 can enter conversation messages in the conversation window, and the target application 120 can determine the response message from the digital assistant 122 based on the created configuration information and present it to the user in the interaction window 142. In some embodiments, depending on the configuration of the target application 120, the interaction messages with the target application 120 can include multimodal messages, such as text messages (e.g., natural language text), voice messages, image messages, video messages, and so on.

[0038] Similar to the application creation component, the application runtime component can be deployed locally on each end user's (145) terminal device and / or supported by a server device. For example, the end user's (145) terminal device can run a client with the application runtime component, which can support interaction between the user and the application runtime component provided by the server. When the application runtime component runs locally on the user's terminal device, the end user (145) can directly interact with the local application runtime component using the terminal device. When the application runtime component runs on a server device, the server device can provide services to the client running on the terminal device based on the communication connection with the terminal device. The application runtime component can present a corresponding application interface to the end user (145) based on the operations performed by the end user (145), outputting and / or receiving application usage-related information from the end user (145).

[0039] In some embodiments, the implementation of at least some functions of the target application 120, and / or the implementation of at least some functions of the digital assistant 122 within the target application 120, may be based on models. During the creation or operation of the target application 120, one or more models 155 may be invoked, such as the capabilities of model 155. In the target application 120, the digital assistant 122 may utilize model 155 to understand user input and provide responses to the user based on the output of model 155.

[0040] During the creation process, the application management platform 110 needs to use model 155 to test the target application 120 to determine whether the running results of the target application 120 meet expectations. During operation, in response to different operation requests from users of the target application 120, the application operation part may need to use model 155 to determine the response results to users.

[0041] Although shown as independent of the application management platform 110, one or more models 155 may run on the application management platform 110 or other remote servers. In some embodiments, model 155 may be a machine learning model, a deep learning model, a learning model, a neural network, etc. In some embodiments, the model may be based on a language model (LM). A language model, by learning from a large corpus, is capable of question answering. Model 155 may also be based on other suitable models.

[0042] The application management platform 110 can run on suitable electronic devices. These electronic devices can be any type of computing-capable device, including terminal devices or server devices. Terminal devices can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. Server devices can include, for example, computing systems / servers, such as mainframes, edge computing nodes, computing devices in cloud environments, and so on. In some embodiments, the management platform 110 can be implemented based on cloud services.

[0043] It should be understood that the structure and function of environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure. For example, although Figure 1 The diagram shows a single user interacting with the application creation section and a single user interacting with the application running section, but in reality, multiple users can access the application management platform 110 to each create a digital assistant, and each digital assistant can be used to interact with multiple users.

[0044] Currently, in some intelligent question-answering scenarios, frequently asked questions (FAQs) can be automatically answered based on manually created and managed databases. For example, in data-driven question-answering scenarios, end users ask questions about data. Answers can be quickly provided based on question-and-answer pairs stored in the FAQ database or on answers automatically generated by a model. However, manually maintaining FAQ databases suffers from poor timeliness and accuracy, and there is a desire to improve the efficiency and accuracy of FAQ generation.

[0045] In embodiments of this disclosure, an improved scheme for application management is provided. In this scheme, in response to detecting a question-answer pair generation request for a target application, a generation pattern corresponding to the question-answer pair generation request is determined; based on data associated with the generation pattern, multiple candidate question-answer pairs are determined, each candidate question-answer pair including a question and a corresponding answer; and in response to detecting the determination of at least one question-answer pair among the multiple candidate question-answer pairs, at least one question-answer pair is associated with the target application, wherein the target application is configured to determine a response to user input based on at least one question-answer pair. In this way, question-answer pairs used in the application can be generated automatically or assisted, expanding the FAQ library. Thus, by utilizing the FAQ library, more online questions can be answered quickly, thereby improving the efficiency and accuracy of answering high-frequency questions.

[0046] The following description, with reference to the accompanying drawings, details some exemplary embodiments of this disclosure. It should be understood that the interfaces shown in the drawings are merely examples, and various interface designs are possible in practice. The various graphic elements in the interface may have different arrangements and different visual representations, one or more elements may be omitted or replaced, and one or more other elements may also be present. Embodiments of this disclosure are not limited in this respect.

[0047] The application creation process described in the embodiments of this disclosure can be implemented on an application management platform, a terminal device with the application management platform installed, and / or a server corresponding to the application management platform. In the examples below, for the sake of discussion, the description is from the perspective of the application management platform, for example... Figure 1 The application management platform 110 is shown. The user interface presented by the application management platform 110 can be displayed via the terminal device of user 105, and the application management platform 110 can receive user input via the terminal device of user 105. In some embodiments of this disclosure, user 105 is the creator, manager, or maintainer of the target application 120. It should be understood that the user interface presented by the application management platform 110 can also be displayed via the terminal device of end user 145, and the application management platform 110 can also receive user input via the terminal device of end user 145. In some embodiments of this disclosure, end user 145 is the end user of the target application 120.

[0048] Figure 2 A block diagram of an application management process 200 according to some embodiments of this disclosure is shown. This application management process can be implemented on an application management platform 110, specifically corresponding to the creation process or subsequent maintenance process of a target application. The following is in conjunction with... Figure 1 To describe Figure 2 The process of application management is shown.

[0049] like Figure 2As shown in box 210, in response to detecting a question-and-answer pair generation request for target application 120, application management platform 110 determines the generation mode corresponding to the request. Examples of generation modes include, but are not limited to, various generation scenarios, such as generating question-and-answer pairs based on operational data, generating question-and-answer pairs based on unstructured documents, etc. Different generation modes may correspond to different question-and-answer pair generation methods and / or rely on different data sources to generate question-and-answer pairs. The generation modes will be described in detail below with reference to the accompanying drawings.

[0050] In box 220, application management platform 110 identifies multiple candidate question-answer pairs based on data associated with the generation pattern.

[0051] Each candidate question-answer pair includes a question and its corresponding answer. A candidate question-answer pair may include one question and one corresponding answer. Different candidate question-answer pairs may include different questions, but correspond to the same answer. In some embodiments, a candidate question-answer pair may also include multiple questions and one corresponding answer.

[0052] In box 230, in response to detecting the determination of at least one question-answer pair among a plurality of candidate question-answer pairs, application management platform 110 associates at least one question-answer pair with target application 120. Target application 120 is configured to determine a response to user input based on the associated question-answer pair.

[0053] For example, after identifying multiple candidate question-answer pairs, the application management platform 110 can perform clustering or filtering based on preset rules, or the user can manually filter them, thereby determining the question-answer pairs suitable for storage in the FAQ library of the target application 120. In this way, question-answer pairs corresponding to FAQs can be automatically generated, improving the efficiency of question-answer pair generation.

[0054] In some embodiments, question-answer pair generation rules can be formulated based on the adoption rate of multiple candidate question-answer pairs or the online question interception rate to improve the accuracy of question-answer pairs generated by the application management platform 110.

[0055] For example, after identifying multiple candidate question-answer pairs, the application management platform 110 can present them to user 105 for further confirmation. Then, the application management platform 110 can receive the question-answer pairs identified by user 105 and store them in the FAQ library of the target application 120. In this way, it can assist users in generating FAQs, improving the efficiency of question-answer pair generation and the accuracy of responding to user input.

[0056] In some embodiments, the application management platform 110 can present multiple candidate question-and-answer pairs and detect edits to one or more of these pairs. For example, the application management platform 110 can present multiple automatically generated candidate question-and-answer pairs to the user 105. The user 105 can edit some or all of these candidate pairs, such as modifying the question description, modifying the answer wording, or deleting the question-and-answer pair. Then, the application management platform 110 can receive the user 105's editing operations and present multiple candidate question-and-answer pairs, including the edited one or more pairs, for the user 105 to further confirm. The application management platform 110 can store the confirmed question-and-answer pairs in the FAQ library of the target application 120. In this way, it can assist users in generating more practical FAQs, thereby further improving the efficiency of question-and-answer pair generation and the accuracy of responding to user input.

[0057] The above process can be used in scenarios where a new FAQ library needs to be created during the creation of the target application, or in scenarios where new or edited question-and-answer pairs need to be added during the maintenance of the target application. Figure 3 A schematic diagram of an interface 300 for creating / editing a target application according to some embodiments of the present disclosure is shown. Interface 300 may include a configuration area 301 and an interaction area 302. In the configuration area 301, the application management platform 110 may also present a data management list related to a dataset. The dataset may include, for example, various uploaded documents, online databases, etc. The application management platform 110 can select a dataset from it to determine a response to a user's question. In the interaction area 302, the application management platform 110 may provide debugging and preview functions to user 105 to simulate the input and response preview of end user 145. For example, in response to user 105's input of "Provide a distribution map of the industries to which XX company belongs," the application management platform 110 may determine the corresponding response content from the selected dataset and display the distribution of the industries to which XX company belongs in the form of a chart.

[0058] In configuration area 301, application management platform 110 can display multiple functional controls related to question-and-answer optimization, such as control 310. Control 310 is, for example, a configuration control for a "fixed question-and-answer database (FAQ)". Application management platform 110 can receive a trigger on this control to enter the question-and-answer pair management page. Question-and-answer pairs can be generated or edited on the question-and-answer pair management page.

[0059] In some embodiments, multiple generation modes are provided for automatically generating question-answer pairs. In a first generation mode instructing generation based on historical interactions, question-answer pairs can be generated based on frequently encountered questions during the operation of the target application, thereby assisting application creators in improving the FAQ capabilities of the target application. In a second generation mode instructing generation of similar questions, questions in the entered question-answer pairs can be generalized, thereby assisting application creators in generating more questions and thus matching more user questions. In a third generation mode based on dataset generation, answerable questions and answers can be automatically generated from one or more selected structured or unstructured documents, thereby assisting application creators in improving the FAQ capabilities of the target application.

[0060] The following will refer to Figures 4A to 5B Provide detailed examples of various generation patterns and how to generate or edit question-and-answer pairs within a specific generation pattern.

[0061] Figures 4A to 4E Schematic diagrams of question-and-answer pair management pages 400A to 400E according to some embodiments of the present disclosure are shown. Question-and-answer pair management pages 400A to 400E can be provided by application management platform 110. Reference will be made below. Figure 1 Describe it.

[0062] In the question-and-answer pair management page 400A, the application management platform 110 presents multiple controls. For example, the "Import" control 402 can be used to import question-and-answer pairs. The "Export All" control 404 can be used to export question-and-answer pairs. The "Create Question-and-Answer Pair" control 406 can be used to add new question-and-answer pairs. In some embodiments, in response to the triggering of the "Create Question-and-Answer Pair" control 406, the application management platform 110 can present a "Smartly Generate Question-and-Answer Pair" card 408. Further, in response to the triggering of the "Smartly Generate Question-and-Answer Pair" card 408, the application management platform 110 can present a pop-up window (not shown) to receive user 105's operation on adding a question-and-answer pair.

[0063] Furthermore, the question-and-answer pair management page 400A also includes a search box control 410 for searching question-and-answer pairs.

[0064] In some embodiments, the question-and-answer pair management page 400A also includes a control 412 to enable / disable or disable the FAQ library. If the FAQ library is enabled, the target application is configured to prioritize matching received user questions against question-and-answer pairs in the FAQ library. If a user question matches a question in a question-and-answer pair, the answer from that pair can be directly output as a response to the user question. If no matching question is found in the FAQ library, the target application is configured to utilize other configured functions, such as using model 155, to generate an answer corresponding to the user question. It can be seen that maintaining more and higher-quality question-and-answer pairs can significantly improve the processing speed and efficiency of the target application for user questions.

[0065] In some embodiments, the application management platform 110 may, in response to a generation pattern indication based on historical interactions, acquire runtime data from the target application 120. The runtime data may be manually imported or automatically acquired (e.g., the application management platform 110's own background runtime logs). Such runtime data may include historical user input from the target application and / or structured or unstructured runtime log information. Further, the application management platform 110 may determine one or more candidate question-answer pairs based on this runtime data.

[0066] As an example, the application management platform 110 can respond to... Figure 4A The triggering of the "Intelligently Generate Question-Answer Pairs" card 408 in the middle will present the following: Figure 4B The pop-up window 422 is shown. Pop-up window 422 includes a scene selection control 424, which can indicate the generation mode for generating question-and-answer pairs based on runtime data.

[0067] If scene selection control 424 is selected, the application management platform 110 can generate question-answer pairs based on a file of frequently asked questions. Furthermore, the application management platform 110 can receive files uploaded by user 105 through control 428. The uploaded files may be, for example, files related to runtime data. Such files include historical user input. The application management platform 110 can use model 155 to analyze these historical user inputs to identify frequently asked questions.

[0068] In some embodiments, the application management platform 110 can identify multiple historical user inputs that occurred during the operation of a target application from runtime data. Based on the frequency of occurrence of the multiple historical user inputs, at least one candidate question is identified. This allows for the identification of high-frequency questions that occur during the operation of the target application from runtime data. In some embodiments, the application management platform 110 can identify at least one candidate question by clustering high-frequency historical user inputs (also called questions) during application operation. For example, the application management platform 110 identifies high-frequency questions and similar questions based on question popularity, and then clusters these questions as candidate questions. Another example is that the application management platform 110 derives questions based on document slicing information of unstructured data, slicing information of structured data, table metadata, metadata of corresponding fields in tables, table and field comments, terminology rules, etc., and then clusters these questions.

[0069] In some embodiments, the application management platform 110 can dynamically generate multiple questions based on the number of logs, document length, and slice information from online operations, and rank these questions by score. The application management platform 110 can identify and present questions that exceed a threshold score, or it can sort the questions by score and present them to the user for selection.

[0070] Continue to refer to Figure 4B The application management platform 110 can respond to the triggering of control 430 and display something like this. Figure 4D The pop-up window 442 is shown. The application management platform 110 can generate frequently recommended questions based on the uploaded files and present them in the pop-up window 442.

[0071] In some embodiments, the application management platform 110 may, in response to detecting confirmation of one or more of the presented candidate questions, generate answers for the confirmed questions to obtain one or more candidate question-answer pairs. In some embodiments, after determining the candidate questions, the application management platform 110 may generate answers corresponding to each candidate question and then present the candidate questions and their corresponding answers to the user for selection.

[0072] For example, the application management platform 110 presents the generated frequently recommended questions in a pop-up window 442. The user 105 can select a portion of these questions for secondary confirmation, thereby improving the accuracy of the generated question-and-answer pairs. In response to the triggering of control 444, the application management platform 110 can generate answers for the selected questions and present them in a pop-up window such as... Figure 4EThe pop-up window 452 is shown. In pop-up window 452, the application management platform 110 presents questions and answers in pairs. After receiving user confirmation, the application management platform 110 can associate the user-confirmed question-and-answer pair with the target application. In some embodiments, the application management platform 110 can support users to modify questions and answers and confirm their addition to the FAQ library.

[0073] In some embodiments, the application management platform 110 can support an offline FAQ generation and execution mechanism. For example, the application management platform 110 can run the process of generating questions or answers in the background. The application management platform 110 can remind the user in the interface that the process will take a certain amount of time, and can refresh the FAQ interface after successful execution. If the process fails, the application management platform 110 can display an error message, allowing the user to initiate a retry.

[0074] In some embodiments, answer generation can be achieved using a machine learning model. In some embodiments, the machine learning model can generate answers to candidate questions based on a dataset (also known as a knowledge base) associated with the target application. In some embodiments, the machine learning model can also generate answers to candidate questions based on runtime data of the target application, since the answers to the candidate questions may be determined and presented to the user during the operation of the target application. In some embodiments, when generating answers to candidate questions as candidate question-answer pairs, feedback information from one or more historical answers corresponding to questions that are the same as or similar to the candidate questions can also be determined from the runtime data. If the feedback information indicates that a certain historical answer is of higher quality, the machine learning model can refer more to that historical answer when generating answers to candidate questions.

[0075] In summary, the application management platform 110 can respond to question-and-answer pair generation requests by presenting a question-and-answer pair management page and a pop-up window for intelligent question-and-answer pair generation. In the pop-up window for intelligent question-and-answer pair generation on the question-and-answer pair management page 400B, the application management platform 110 allows users to select a generation mode (i.e., scenario selection) and import runtime data. In the pop-up window for intelligent question-and-answer pair generation on the question-and-answer pair management page 400D, the application management platform 110 supports summarizing and extracting frequently asked questions. In the pop-up window for intelligent question-and-answer pair generation on the question-and-answer pair management page 400E, the application management platform 110 can generate question-and-answer pairs. In this way, it can provide the ability to discover frequently asked questions online, cluster online questions, identify gaps in the FAQ database, assist in generating or supplementing FAQs, and thus improve the accuracy of answers to frequently asked questions.

[0076] In some embodiments, the application management platform 110 may present a dataset configuration entry in response to a generation mode instruction based on dataset generation. The application management platform 110 may receive at least one dataset through the dataset configuration entry and then generate one or more candidate question-answer pairs based on the at least one dataset.

[0077] As an example, the application management platform 110 can respond to... Figure 4A The triggering of the "Intelligently Generate Question-Answer Pairs" card 408 in the middle will present the following: Figure 4B The pop-up window 422 is shown. Pop-up window 422 includes a scene selection control 426, which can indicate the generation mode for knowledge-based question-and-answer pairs. In other words, the application management platform 110 can automatically mine keywords from the selected knowledge and generate questions and answers.

[0078] If scene selection control 426 is selected, the application management platform 110 can display as follows: Figure 4C The pop-up window 432 is shown. Furthermore, the application management platform 110 can receive data resources for generating question-and-answer pairs in the dataset configuration entry control 434.

[0079] In some embodiments, the application management platform 110 can extract keywords from a given dataset. In response to the detection of confirmation of keywords, the application management platform 110 can generate one or more candidate questions based on the confirmed keywords, and generate answers for each candidate question from one or more datasets to obtain candidate question-answer pairs. In some embodiments, during answer generation, the application management platform 110 can utilize a machine learning model to determine the answers corresponding to the candidate questions based on one or more datasets associated with the target application. This machine learning model can be a model configured in the target application to support question-answering functionality.

[0080] In this way, when accessing unstructured documents, you can choose to automatically generate answerable questions and answers based on the document content, and add them to the FAQ library after user confirmation, thus assisting in the generation of FAQs.

[0081] For example, application management platform 110 can generate candidate questions based on the received data resources used to generate question-answer pairs. The received data resources can be all data resources by default, or data resources specified by the user. Application management platform 110 can present the generated candidate questions to user 105 and generate answers based on the candidate questions filtered by user 105, thus forming a question-answer pair that can be presented to user 105. As another example, application management platform 110 can mine and derive keywords based on the received data resources used to generate question-answer pairs. Application management platform 110 can present automatically generated keywords to user 105. User 105 can select and edit these keywords. Application management platform 110 can generate questions and answers based on the keywords edited by user 105, thus forming a question-answer pair that can be presented to user 105. In some embodiments, application management platform 110 can support users in modifying questions and answers and confirming their addition to the FAQ library.

[0082] This question-and-answer pair generation based on corpus is suitable for FAQ generation during the cold start phase. The application management platform 110 can choose to automatically generate answerable questions and answers based on document content, and add them to the FAQ library after user confirmation, thereby assisting in the completion of FAQ generation.

[0083] As an example, refer to Figure 4E The application management platform 110 presents multiple question-and-answer pairs in a pop-up window 452. In response to a user's selection of a question-and-answer pair, the application management platform 110 can present multiple controls. For example, control 454 supports deleting the question-and-answer pair, control 456 supports editing the question-and-answer pair, and control 458 supports adding the question-and-answer pair to the FAQ library.

[0084] The above is for reference only. Figures 4A to 4E The generation pattern for question-answer pairs based on given data is described below, and will be combined with the following text. Figure 5A and Figure 5B An example of another generation pattern is described, which indicates that generalized questions can be generated based on an existing FAQ library, thereby enriching the diversity of question-answer pairs.

[0085] Figure 5A and Figure 5B Schematic diagrams of question-and-answer management pages 500A and 500B according to other embodiments of this disclosure are shown. Question-and-answer management pages 500A and 500B can be provided by application management platform 110. Reference will be made below. Figure 1 Describe it.

[0086] In some embodiments, the application management platform 110 may, in response to a generation pattern indicating similar question generation, present one or more question-answer pairs (which may be a set or a list of question-answer pairs) associated with the target application 120. The application management platform 110 may, in response to detecting the selection of a question from these question-answer pairs, generate at least one candidate question based on that question. This question may also be referred to as the first question or the initial question. It is expected that the generated at least one candidate question is a variation of the initial question; therefore, the candidate question and the initial question are typically similar and semantically matched, but differ in linguistic expression. This covers various user question formats that may be received during actual application operation. The generated at least one candidate question and its corresponding answer form at least one candidate question-answer pair. In this way, the data already entered into the FAQ database can be generalized to obtain multiple question-answer pairs with one answer for each question, thereby improving the online question interception rate.

[0087] For example, on the question-and-answer pair management page 500A, the application management platform 110 presents associated question-and-answer pairs. User 105 can select one of these pairs. The application management platform 110 can use the selected question-and-answer pair as the initial question to perform a generalization function. The generalization function performs one or more of the following operations on the user-selected question to obtain more candidate difficult questions. Possible operations include, but are not limited to, rewriting the user question (e.g., colloquial rewriting), modifying the sentence structure of the user question, replacing synonyms of the user question, deleting at least part of the user question (e.g., deleting irrelevant sentence components that do not affect the answer), etc. In some embodiments, the application management platform 110 can utilize a machine learning model to generate one or more candidate questions that semantically match the initial question. The machine learning model can be trained to perform various transformations on the initial question to obtain additional semantically matching candidate questions.

[0088] Furthermore, on the question-and-answer pair management page 500A, the application management platform 110 presents a "smart question generation" control 502. In response to the triggering of control 502, the application management platform 110 presents a pop-up window 504 on the question-and-answer pair management page 500B. In the pop-up window 504, the application management platform 110 presents question-and-answer pairs generalized from the initial question.

[0089] In some embodiments, the application management platform 110 may, in response to detecting confirmation of one or more questions among the generated candidate questions, associate the confirmed one or more questions, the initial question, and the initial answer (comprising a question-answer pair) with the target application 120. In this way, user 105 can further filter generalized questions, thereby improving the recall and interception rates of question-answer pairs.

[0090] For example, user 105 can select the question-and-answer pair they wish to adopt from the question-and-answer pairs presented in pop-up window 504, and then trigger control 506. In response to the triggering of control 506, application management platform 110 can add the selected question-and-answer pair to the FAQ library. Application management platform 110 can support the adoption of a single question-and-answer pair or the batch adoption of multiple question-and-answer pairs.

[0091] In summary, according to the embodiments of this disclosure, a question-and-answer pair generation scheme based on multiple generation modes can be provided. Generation modes include, for example, maintaining user-accumulated FAQs in the platform through input or import functions, generalizing a batch of FAQs based on existing FAQs, assisting in the generation of FAQs based on summarized and extracted high-frequency questions, or assisting in the batch generation of FAQs during initialization. Thus, in addition to supporting FAQ management and input, it adds the ability to use models to assist in the generation of FAQs, helping users construct questions and answers generated based on data resources, which can be added to the FAQ library after being adopted.

[0092] In some embodiments, the application management platform 110 can support viewing and maintaining the generated question-and-answer pairs. For example, the generation of question-and-answer pairs is the result of asynchronous execution. After a user submits a task and it is successfully executed, the application management platform 110 can support the user in viewing the results of the question-and-answer pairs, and in further editing and incorporating the results into the online FAQ library. When viewing question-and-answer pairs, associated question-and-answer pairs can be displayed. In some embodiments, these question-and-answer pairs may include a question, an answer, and may also include the knowledge source referenced by the answer, the knowledge fragment referenced by the answer, and / or the generation time of the question-and-answer pair.

[0093] When viewing question-and-answer pairs, various operations are supported, including viewing details and editing (editing the question and / or answer). In some embodiments, individual or batch adoption of adopted and target application-associated question-and-answer pairs can be performed. In some embodiments, individual or batch deletion of adopted and target application-associated question-and-answer pairs can also be performed. In some embodiments, users can also choose to add one or more question-and-answer pairs to a corpus for use by machine learning models when generating answers to user questions.

[0094] Figure 6 A schematic structural block diagram of an application management device 600 according to some embodiments of the present disclosure is shown. The device 600 may be implemented in or included in an application management platform 110, for example. The various modules / components in the device 600 may be implemented by hardware, software, firmware, or any combination thereof.

[0095] As shown in the figure, device 600 includes a generation pattern determination module 610, configured to determine a generation pattern corresponding to a question-and-answer pair generation request in response to detecting a question-and-answer pair generation request for a target application. Device 600 also includes a question-and-answer pair determination module 620, configured to determine a plurality of candidate question-and-answer pairs based on data associated with the generation pattern, each candidate question-and-answer pair including a question and a corresponding answer. Device 600 further includes an association module 630, configured to associate at least one question-and-answer pair with the target application in response to detecting the determination of at least one question-and-answer pair among the plurality of candidate question-and-answer pairs, wherein the target application is configured to determine a response to user input based on at least one question-and-answer pair.

[0096] In some embodiments, the apparatus 600 further includes: a first presentation module configured to present a plurality of candidate question-answer pairs; a detection module configured to detect editing of one or more of the plurality of candidate question-answer pairs; and a second presentation module configured to present a plurality of candidate question-answer pairs, including the edited one or more question-answer pairs, for confirmation.

[0097] In some embodiments, the question-answer pair determination module 620 may also be specifically configured to: in response to a generation mode indication based on the generation of historical interactions, acquire runtime data in the target application, the runtime data including at least historical user input; and determine one or more candidate question-answer pairs based on the runtime data.

[0098] In some embodiments, the question-answer pair determination module 620 may also be specifically configured to: determine at least one candidate question by means of historical user input in clustering run data; and generate an answer to the confirmed one or more questions in response to detecting confirmation of one or more of the at least one candidate question, so as to obtain one or more candidate question-answer pairs.

[0099] In some embodiments, the question-answer pair determination module 620 may also be specifically configured to: in response to a generation mode indicating similar question generation, present a set of question-answer pairs associated with the target application; and in response to detecting a selection of a first question in the set of question-answer pairs, generate at least one candidate question based on the first question, wherein the at least one candidate question generated and the answer corresponding to the first question form at least one candidate question-answer pair.

[0100] In some embodiments, the question-answer pair determination module 620 may also be specifically configured to: in response to detecting confirmation of one or more of the generated at least one candidate questions, associate the confirmed one or more questions, the first question and the first answer, and the question-answer pair with the target application.

[0101] In some embodiments, the question-answer pair determination module 620 may also be specifically configured to: present a dataset configuration entry in response to a generation mode indication based on the generation of a dataset; receive at least one dataset via the dataset configuration entry; and generate one or more candidate question-answer pairs based on at least one dataset.

[0102] In some embodiments, the question-answer pair determination module 620 may further be specifically configured to: extract at least one keyword from at least one dataset; and in response to detecting confirmation of one or more of the at least one keyword, generate one or more candidate questions based on the confirmed one or more keywords; and generate answers corresponding to each of the one or more candidate questions from at least one dataset to obtain one or more candidate question-answer pairs.

[0103] In some embodiments, an application management apparatus includes: a question generation module configured to generate at least one candidate question based on a first question in a question-answer pair set, the question-answer pair set being associated with a target application, and the question-answer pairs in the question-answer pair set including a question and a corresponding answer; and an association module configured to, in response to detecting confirmation of one or more of the generated at least one candidate question, associate a question-answer pair consisting of the confirmed one or more questions, the first question, and a first answer corresponding to the first question with the target application, wherein the target application is configured to determine a response to user input based on the associated question-answer pairs.

[0104] In some embodiments, the question generation module is further configured to generate at least one candidate question by performing at least one item on the first question: rewriting the first question, modifying the sentence structure of the first question, replacing the synonym of the first question, or deleting at least part of the content of the first question.

[0105] In some embodiments, the question generation module is further configured to: utilize a machine learning model to generate at least one candidate question that semantically matches the first question.

[0106] In some embodiments, an application management apparatus includes: a question determination module configured to determine at least one candidate question for a target application based on runtime data of the target application; an answer generation module configured to generate a first answer corresponding to the first question based on the first question among the at least one candidate question; and an association module configured to associate a question-answer pair consisting of the first question and the first answer with the target application in response to detecting confirmation of the first question and the first answer, wherein the target application is configured to determine a response to user input based on the associated question-answer pair.

[0107] In some embodiments, runtime data includes at least one of the following: historical user input for the target application, and runtime log information of the target application.

[0108] In some embodiments, the answer generation module is further configured to: generate a first answer corresponding to the first question based on the first question in response to detecting confirmation of a first question among at least one candidate question.

[0109] In some embodiments, the problem determination module is further configured to: determine multiple historical user inputs that occurred during the operation of the target application from runtime data; and determine at least one candidate problem based on the frequency of occurrence of the multiple historical user inputs.

[0110] Figure 7 A block diagram of an electronic device 700 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that... Figure 7 The electronic device 700 shown is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 7 The illustrated electronic device 700 may include or be implemented as Figure 1 Application management platform 110 or Figure 6 Device 600.

[0111] like Figure 7 As shown, electronic device 700 is in the form of a general-purpose electronic device. Components of electronic device 700 may include, but are not limited to, one or more processors or processing units 710, memory 720, storage device 730, one or more communication units 740, one or more input devices 750, and one or more output devices 760. Processing unit 710 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 720. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 700.

[0112] Electronic device 700 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 700, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 720 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 730 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 700.

[0113] Electronic device 700 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 7 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 720 may include computer program product 725 having one or more program modules configured to perform various methods or actions of various embodiments of this disclosure.

[0114] The communication unit 740 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 700 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 700 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0115] Input device 750 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 760 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 700 can also communicate with one or more external devices (not shown) via communication unit 740 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 700, or with any device that enables electronic device 700 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0116] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0117] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0118] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to create a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they produce means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0119] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0120] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0121] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. An application management method, comprising: In response to detecting a question-answer pair generation request for a target application, a generation mode corresponding to the question-answer pair generation request is determined from multiple candidate generation modes; Based on the data associated with the generation pattern, multiple candidate question-answer pairs are determined, each candidate question-answer pair including a question and a corresponding answer, wherein the generation pattern indicates generation based on historical interactions, and the data associated with the generation pattern includes at least the runtime data of the target application; Present the multiple candidate question-answer pairs; Receive the user's selection of at least one question-answer pair from the plurality of candidate question-answer pairs; as well as The selected at least one question-and-answer pair is associated with the target application, wherein the target application is configured to determine a response to user input based on the at least one question-and-answer pair.

2. The method according to claim 1, further comprising: Present the multiple candidate question-answer pairs; Detect edits to one or more of the multiple candidate question-answer pairs; as well as The plurality of candidate question-answer pairs, including the edited version of the one or more question-answer pairs, are presented for confirmation.

3. The method of claim 1, wherein determining a plurality of candidate question-answer pairs comprises: In response to the generation mode indication based on historical interaction generation, the runtime data of the target application is obtained; as well as One or more candidate question-answer pairs are determined based on the operational data.

4. The method of claim 3, wherein determining one or more candidate question-answer pairs based on the operational data comprises: By clustering historical user inputs in the runtime data, at least one candidate question is identified; as well as In response to the detection of confirmation of one or more of the at least one candidate questions, an answer is generated for the confirmed one or more questions to obtain one or more candidate question-answer pairs.

5. The method of claim 1, wherein in response to the generation pattern indicating the generation of similar questions, the data associated with the generation pattern includes questions associated with the target application, and wherein determining a plurality of candidate question-answer pairs includes: In response to the generation pattern indicating similar questions, a set of question-answer pairs associated with the target application is presented; as well as In response to detecting the selection of a first question in the question-answer pair set, at least one candidate question is generated based on the first question, and the generated at least one candidate question and the answer corresponding to the first question form at least one candidate question-answer pair.

6. The method of claim 5, wherein associating the at least one question-answer pair with the target application comprises: In response to detecting confirmation of one or more of the generated candidate questions, the confirmed one or more questions, the first question and the answer corresponding to the first question, are associated with the target application.

7. The method of claim 1, wherein in response to the generation pattern indicating generation based on a dataset, the data associated with the generation pattern includes at least one dataset, and wherein determining a plurality of candidate question-answer pairs includes: In response to the generation mode instruction, a dataset configuration entry is presented; Receive the at least one dataset via the dataset configuration entry; as well as One or more candidate question-answer pairs are generated based on the at least one dataset.

8. The method of claim 7, wherein generating one or more candidate question-answer pairs based on the at least one dataset comprises: Extract at least one keyword from the at least one dataset; as well as In response to the detection of confirmation of one or more of the at least one keyword, one or more candidate questions are generated based on the confirmed one or more keywords; as well as The answers to the one or more candidate questions are generated from the at least one dataset to obtain the one or more candidate question-answer pairs.

9. An application management method, comprising: Present a set of question-answer pairs associated with the target application, wherein the question-answer pairs in the set include questions and corresponding answers; In response to the selection of the first question in the question-answer pair set, a question generation control is presented; In response to the triggering of the question generation control, at least one candidate question is generated based on the semantics of the first question, wherein the semantics of the first question matches the semantics of the at least one candidate question; as well as In response to detecting confirmation of one or more of the generated candidate questions, a question-answer pair consisting of the confirmed one or more questions, the first question, and the first answer corresponding to the first question is associated with the target application, wherein the target application is configured to determine a response to user input based on the associated question-answer pair.

10. The method of claim 9, wherein generating at least one candidate problem based on the first problem comprises: At least one candidate problem is generated by performing at least one of the following on the first problem: A rewrite of the first question, Modification of the sentence structure for the first question, Replacement of the synonym for the first problem, At least a portion of the content of the first question was deleted.

11. The method of claim 9, wherein generating at least one candidate problem based on the first problem comprises: Using a machine learning model, at least one candidate question that semantically matches the first question is generated.

12. An application management device, comprising: The generation mode determination module is configured to determine the generation mode corresponding to the question-answer pair generation request from a plurality of candidate generation modes in response to detecting a question-answer pair generation request for a target application. The question-answer pair determination module is configured to determine multiple candidate question-answer pairs based on data associated with the generation pattern, each candidate question-answer pair including a question and a corresponding answer, wherein in response to the generation pattern indicating generation based on historical interactions, the data associated with the generation pattern includes at least the runtime data of the target application; The question-answer pair presentation module is configured to present the multiple candidate question-answer pairs; The user selection receiving module is configured to receive the user's selection of at least one question-answer pair among the plurality of candidate question-answer pairs; as well as An association module is configured to associate the selected at least one question-and-answer pair with the target application, wherein the target application is configured to determine a response to user input based on the at least one question-and-answer pair.

13. An application management device, comprising: The question-and-answer pair collection presentation module is configured to present a collection of question-and-answer pairs associated with the target application, wherein the question-and-answer pairs in the collection include questions and corresponding answers; The question generation control presentation module is configured to present a question generation control in response to the selection of a first question in the question-answer pair set; The question generation module is configured to generate at least one candidate question in response to the triggering of the question generation control, based on the semantics of the first question, wherein the semantics of the first question matches the semantics of the at least one candidate question; as well as An association module is configured to, in response to detecting confirmation of one or more of the generated candidate questions, associate a question-answer pair consisting of the confirmed one or more questions, the first question, and the first answer corresponding to the first question, with the target application, wherein the target application is configured to determine a response to user input based on the associated question-answer pair.

14. An electronic device comprising: At least one processing unit; as well as At least one memory is coupled to at least one processing unit and stores instructions for execution by the at least one processing unit, which, when executed by the at least one processing unit, cause the electronic device to perform the method according to any one of claims 1 to 8, or the method according to any one of claims 9 to 11.

15. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 8, or the method according to any one of claims 9 to 11.

16. A computer program product comprising a computer program that, when executed by a processor, implements the method according to any one of claims 1 to 8, or the method according to any one of claims 9 to 11.

Images