Information interaction method and device, equipment and storage medium

By presenting task components, including plugins and scenarios, during the user's interaction with the digital assistant, the problem of insufficient flexibility in user interaction is solved, and the digital assistant achieves a more accurate and efficient assistance effect.

CN119002740APending Publication Date: 2024-11-22BEIJING ZITIAO NETWORK TECH CO LTD +1
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202311551049.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-11-20
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

How can we improve the flexibility of user interaction with digital assistants so that digital assistants can more accurately understand the user's operational objectives and provide more accurate assistance?

Method used

During user interaction with the digital assistant, user actions are guided by presenting elements related to task components, including plugins and scenes, in the session window. For example, interaction efficiency can be improved by selecting controls, shortcuts, and scene setting information through plugins.

Benefits of technology

By guiding users to interact with the digital assistant using task components, the digital assistant can more accurately understand the user's operational purpose, thereby providing more accurate and efficient assistance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119002740A_ABST
    Figure CN119002740A_ABST
Patent Text Reader

Abstract

According to the embodiment of the invention, the method, the device, the equipment and the storage medium are provided. The method comprises the following steps: the terminal equipment presents a first message from a digital assistant in a session window in response to a preset operation associated with the session window of a user and the digital assistant. And the terminal device presents elements related to one or more plug-ins in the first message, wherein each plug-in is configured to execute a corresponding function. In this way, the user can be guided how to use the plug-in to interact with the digital assistant. Furthermore, the digital assistant can more accurately determine the operation purpose of the user so as to give a more accurate result. In this way, the efficiency of assisting the user by the digital assistant can be further improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for information interaction. Background Art

[0002] With the development of information technology, various terminal devices can provide various services to people in work and life. Applications that provide services can be deployed in terminal devices. Terminal devices or applications can provide users with digital assistant functions to assist users in using terminal devices or applications. How to improve the flexibility of interaction between users and digital assistants is a technical issue that needs to be explored at present. Summary of the invention

[0003] In a first aspect of the present disclosure, a method for information interaction is provided. The method includes: in response to a preset operation associated with a conversation window between a user and a digital assistant, presenting a first message from a digital assistant in the conversation window; and presenting elements related to one or more task components in the first message, each task component being configured to perform a corresponding function, wherein the task component includes at least one of a plug-in and a scene.

[0004] In a second aspect of the present disclosure, a device for information interaction is provided. The device includes: a first message presentation module, configured to present a first message from a digital assistant in a conversation window in response to a preset operation associated with a conversation window between a user and a digital assistant; and a task component element presentation module, configured to present elements related to one or more task components in the first message, each task component being configured to perform a corresponding function, wherein the task component includes at least one of a plug-in and a scene.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0010] FIG. 2A to FIG. 2F A schematic diagram showing an example interface according to some embodiments of the present disclosure is shown;

[0011] Figure 3 A flowchart showing an example process for information interaction according to some embodiments of the present disclosure is shown;

[0012] FIG. 4A to FIG. 4D A schematic diagram showing an example interface according to some embodiments of the present disclosure is shown;

[0013] Figure 5 A flowchart showing an example process for information interaction according to some embodiments of the present disclosure is shown;

[0014] FIG. 6A to FIG. 6C A schematic diagram showing an example interface according to some embodiments of the present disclosure is shown;

[0015] Figure 7 A flowchart showing an example process for information interaction according to some embodiments of the present disclosure is shown;

[0016] Figure 8 A flowchart showing an example process for information interaction according to some embodiments of the present disclosure is shown;

[0017] Fig. 9 A schematic structural block diagram showing an apparatus for information interaction according to some embodiments of the present disclosure; and

[0018] Fig.10 A block diagram of an electronic device capable of implementing one or more embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0019] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0020] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0021] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0022] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0023] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0024] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0025] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this article, and any type of embodiment may be included under any section / subsection. In addition, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0026] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0027] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0028] As used herein, the term "model" can learn the association between the corresponding input and output from the training data, so that after the training is completed, the corresponding output can be generated for a given input. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multiple layers of processing units. In this article, "model" may also be referred to as "machine learning model", "machine learning network" or "network", which are used interchangeably in this article. A model may also include different types of processing units or networks.

[0029] As used herein, a "unit", "operating unit" or "subunit" may consist of a machine learning model or network of any suitable structure. As used herein, a group of elements or similar expressions may include one or more such elements. For example, a "group of convolutional units" may include one or more convolutional units.

[0030] Example Environment

[0031] Figure 1 A schematic diagram of an example environment 100 in which an embodiment of the present disclosure can be implemented is shown. In the example environment 100, an office suite 120 is installed in a terminal device 110. A user 140 can interact with the office suite 120 via the terminal device 110 and / or an attached device of the terminal device 110. The office suite 120 can provide the user 140 with the integration of multiple applications or components. These applications can be used as application modules in the office suite 120. The applications integrated in the office suite 120 are sometimes also referred to as "office applications", "office components", "collaborative office platforms", etc. As an example, the applications integrated in the office suite 120 may include, but are not limited to, one or more of the following: a chat application (also referred to as an instant messaging (IM) application), a document application, an audio and video conferencing application, an email application, a calendar application, a schedule application, a task application, and an objective and key result (OKR) application.

[0032] In some embodiments, the office suite 120 can be downloaded as an application and installed on the terminal device 110. In some embodiments, the office suite 120 can also be accessed through other methods, such as through a web page.

[0033] exist Figure 1 In the environment 100, if the office suite 120 is started, the terminal device 110 can present an interface 150 of the office suite 120 to the user 140. The interface 150 is sometimes also referred to as a client interface. The interface 150 may include various interfaces that the office suite 120 can provide, such as a conversation interface for presenting chat content, a video conference interface, a file sharing interface, and the like.

[0034] In some embodiments, the terminal device 110 communicates with the server 130 to provide services for the office suite 120. The terminal device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a television receiver, a radio broadcast receiver, an e-book device, a gaming device, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.). The server 130 can be various types of computing systems / servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0035] It should be understood that the structure and function of each element in the environment 100 are described for exemplary purposes only, and do not imply any limitation on the scope of the present disclosure. For example, the embodiments of the present disclosure can be applied to any suitable one or more applications, and are not limited to office suites.

[0036] As briefly mentioned above, a digital assistant can be provided to the user to help the user complete the target task using a terminal device or application. In an embodiment of the present disclosure, a digital assistant is configured for user 140. The digital assistant can be implemented in any suitable form. In some embodiments, the digital assistant of user 140 can interact with it as a contact of user 140. Such a digital assistant can also correspond uniquely to user 140. In other words, the digital assistant of user 140 can be specific to or exclusive to user 140. If user 140 is an individual or person, such a digital assistant can be regarded as a personal digital assistant. It can be understood that in the embodiment of the present disclosure, the digital assistant is based on the authorization of user 140 to access the data to which permission is granted.

[0037] It should be understood that “uniquely corresponds” or similar expressions in the present disclosure are not intended to limit the digital assistant to be updated accordingly based on the interaction process between the user 140 and the digital assistant.

[0038] In an embodiment of the present disclosure, a digital assistant is used to interact with a user. An interaction window between a user and a digital assistant may be presented in a client interface. As an intelligent assistant, the digital assistant has intelligent dialogue and information processing capabilities. In the interaction window, the user inputs an interactive message, and the digital assistant provides a reply message in response to the user input. The client interface for providing a digital assistant may correspond to a single-function application or a multi-function collaboration platform, such as an office suite or other collaboration platform capable of integrating multiple components.

[0039] The interaction window between the user and the digital assistant may include a conversation window, in which the interaction between the user and the digital assistant may be presented in the form of conversation messages. Alternatively or additionally, the interaction window between the user and the digital assistant may also include a non-conversation window, such as a window in floating window mode, in which the user may trigger the digital assistant to perform corresponding operations by inputting instructions, selecting shortcut instructions, etc.

[0040] In some embodiments, after waking up the digital assistant through a preset application, the user 140 interacts with the digital assistant through a main session. The interaction window corresponding to the main session may be referred to as a main session window. As an example, the preset application may be an IM application in an office suite. In other examples, the preset application may also be other applications or components.

[0041] In some embodiments, the digital assistant can also be awakened and interacted with through other applications other than the preset application. After waking up the digital assistant through these non-preset applications, the user and the digital assistant can interact through a sub-session. The interaction window corresponding to the sub-session can be called a sub-session window. For example, the user can wake up the digital assistant through a page in the document application, and then interact with the digital assistant through a sub-session.

[0042] As briefly described above, terminal devices or applications can provide users with digital assistant functions to assist users in using terminal devices or applications. However, the flexibility of interaction between users and digital assistants is a technical issue that needs to be explored at present.

[0043] In some embodiments, when a user interacts with a digital assistant, the digital assistant can use one or more plug-ins to assist the user. Each plug-in is configured to perform a corresponding function. If the user can select one or more plug-ins before sending a corresponding instruction, it is helpful for the digital assistant to understand the user's operation purpose.

[0044] In some embodiments, in the interaction between the user and the digital assistant, the digital assistant can be enabled to assist the user based on the scene. The scene here refers to a collection of tasks of the same type, that is, one scene corresponds to multiple tasks of the same type. One or more scenes can be respectively configured with corresponding configuration information to perform tasks of the corresponding type. The configuration information of the scene includes at least one of the following: scene setting information, plug-in information. The scene setting information is used to describe information related to the corresponding scene. The plug-in information indicates at least one plug-in used to perform the task in the corresponding scene. As will be discussed below, the configuration information of the scene can also include, for example, an indication of the selected model (the model here is called to determine the reply to the user in the corresponding scene), scene guidance information (the scene guidance information is presented to the user after the corresponding scene is selected), at least one recommended question for the digital assistant (at least one recommended question is presented to the user for selection after the corresponding scene is selected), and so on. In some embodiments, the scene setting information and configuration information of the scene can be completed, for example, in a natural language manner, so that the scene creator can easily constrain the output of the model and configure a variety of scenes.

[0045] The scene setting information of the scene can affect the digital assistant's response to the user to a certain extent, or be used to determine the digital assistant's response to the user. In some embodiments, the scene setting information is used to construct a prompt input to provide to the model used in the corresponding scene. The digital assistant's response to the user is based on the output of the model. The scene setting information of the scene may, for example, include a description of the corresponding type of task, the digital assistant's response style in the scene, the definition of the workflow to be executed in the corresponding scene, the definition of the digital assistant's response format in the corresponding scene, and so on. In some embodiments, the digital assistant will use the model to understand the user input and provide a response to the user based on the output of the model. The model used by the digital assistant can run locally on the terminal device 110 or on a remote server. By using the scene setting information to construct a part of the prompt input of the model, the model can be guided to complete the task to be achieved in the corresponding scene.

[0046] Through the plug-in information of the scene, the plug-in to be used in the corresponding scene can be configured. In some embodiments, in the corresponding scene, during the operation of the plug-in, the plug-in can also call the model to complete the corresponding task. In some embodiments, a plug-in can also call the open interface provided by other applications (for example, documents, calendars, meetings, etc.) to complete the corresponding task, such as modifying documents, creating schedules, summarizing meetings, etc.

[0047] The embodiments of the present disclosure propose an improved scheme for information interaction. According to various embodiments of the present disclosure, if a preset operation associated with a conversation window between a user and a digital assistant is detected, a first message from the digital assistant is presented in the conversation window. Elements related to one or more task components are presented in the first message, each task component is configured to perform a corresponding function, and the task component includes at least one of a plug-in and a scene. In this way, the user can be guided on how to use the task component to interact with the digital assistant. Furthermore, the digital assistant can more accurately determine the user's operation purpose to give more accurate results. In this way, the efficiency of the digital assistant in assisting the user can be further improved.

[0048] Some example embodiments of the present disclosure will be described below with reference to the accompanying drawings. In the embodiments described below, plug-ins are used as examples of task components. However, it should be understood that the aspects described with respect to the plug-ins are also applicable to the scenarios. It should be understood that the pages shown in the accompanying drawings are merely examples, and various page designs may actually exist. The various graphical elements in the page may have different arrangements and different visual representations, one or more of which may be omitted or replaced, and one or more other elements may also exist. The embodiments of the present disclosure are not limited in this respect.

[0049] FIG. 2A to FIG. 2F A schematic diagram of an example interface according to some embodiments of the present disclosure is shown. FIG. 2A to FIG. 2F The terminal device 110 presents a first message from the digital assistant after the user 140 performs a preset operation. In the following, for the convenience of discussion, the terminal device 110 is used to describe FIG. 2A to FIG. 2F , but this is only exemplary.

[0050] In some embodiments, the terminal device 110 presents the first message from the digital assistant in the conversation window in response to a preset operation associated with the conversation window between the user 140 and the digital assistant. In some embodiments, the preset operation may include an operation of opening a new topic in the conversation window. Figure 2A In the interface 201 shown, the user 140 clicks on a new topic control 212 in a conversation window 210. In the following, for ease of discussion, the conversation window is taken as the main conversation window 210 as an example. In this article, a "topic" corresponds to a specific context of interaction. During the interaction process of each topic, the interaction information between the user and the digital assistant will be regarded as context information to assist the digital assistant in determining subsequent conversation messages. In some embodiments, a topic is sometimes also referred to or presented as a theme.

[0051] In one example, after the user 140 clicks the new topic 212 control in the conversation window 210, the terminal device 110 will present the first message from the digital assistant in the conversation window 210, such as Figure 2A , 2B The first message 214 and the first message 224 in the interface shown. The terminal device 110 supports the user 140 to forward the first message 214 and the first message 224, select multiple first messages 214 and the first message 224, and copy the links of the first message 214 and the first message 224, etc. The first message 214 and the first message 224 may include but are not limited to: greetings. Figure 2A , 2B The interface shown is explained as follows: Figure 2A , 2B The functions expressed by the interfaces shown are the same, but the presentation forms are different due to the different types of terminal devices 110.

[0052] In some embodiments, the terminal device 110 presents elements related to one or more plug-ins in the first message. Each plug-in is configured to perform a corresponding function. In some embodiments, the terminal device 110 may present a plug-in selection control in the first message 214. Figure 2A In the interface 201 shown, the terminal device 110 presents a plug-in selection control 215 in the first message 214 in the conversation window 210. Figure 2B In the illustrated interface 203 , the terminal device 110 presents a plug-in selection control 225 in the first message 224 .

[0053] In some embodiments, the elements presented related to one or more plug-ins may be the result of executing a preset task using a plug-in associated with an object of a preset type. FIG. 4A to FIG. 4D An example embodiment of information interaction is described in detail. Alternatively or additionally, in some embodiments, the presented element may be prompt information. FIG. 6A to FIG. 6B An example embodiment of information interaction is described in detail.

[0054] continue FIG. 2A to FIG. 2F , the terminal device 110 presents one or more first shortcut commands recommended in the first message. At this time, since the user 140 has not selected a plug-in, the one or more first shortcut commands recommended are general and not related to the plug-in, and the one or more shortcut commands are triggerable. Figure 2A In the interface shown, the terminal device 110 presents one or more first shortcut instructions 217 recommended in the first message 214. Figure 2B In the interface shown, the terminal device 110 presents one or more recommended first shortcut instructions 227 in the first message 224. The recommended first shortcut instructions 217 are triggerable. For example, the terminal device 110 performs a corresponding operation based on the first shortcut instruction 217 clicked by the user 140, and presents a corresponding result.

[0055] In some embodiments, the recommended first shortcut command 217 includes one or more types. For example, the type of the first shortcut command may be a recommended command generated by a model. User 140 may directly click on this type of shortcut command. For another example, the type of the first shortcut command may be a platform-configured command. After user 140 clicks on this type of shortcut command, terminal device 110 may determine whether the shortcut command has parameters. If it is a shortcut command with parameters, an input box may be presented to user 140. After user 140 completes the information in the input box, the shortcut command is sent to the server. If it is a shortcut command without parameters, user 140 may click on the shortcut command, and the shortcut command will be sent directly to the server.

[0056] In one example, one or more first shortcut instructions are triggerable. After the user 140 clicks on one or more first shortcut instructions presented in the first message 214, the terminal device 110 determines whether the first shortcut instruction is effective. If the first shortcut instruction is in effect, the user 140 can always click to execute the first shortcut instruction regardless of whether there is a subsequent message. If the first shortcut instruction is disabled and the user 140 clicks to send the first shortcut instruction again, the digital assistant will not be able to execute the shortcut instruction, and may reply to the user in the form of a message, for example, to inform the user that the instruction cannot be executed and other instructions can be tried.

[0057] In some embodiments, the terminal device 110 presents a plug-in selection panel in response to a trigger operation on the plug-in selection control. Figure 2C In the interface 202 shown, the terminal device 110 presents a plug-in selection panel 216 in the session window 210 in response to a trigger operation on the plug-in selection control. The plug-in selection panel 216 includes at least a list 216-1 of selectable plug-ins. For example, the list 216-1 of selectable plug-ins may include, but is not limited to, a search plug-in, a calendar plug-in, a document plug-in, a trick plug-in, a table plug-in, and the like. Figure 2D As another example, a plug-in selection panel 226 is shown displayed in the session window 220. Figure 2C , 2D The interface shown is explained as follows: Figure 2C , 2D The functions expressed by the interfaces shown are the same, but the presentation forms are different due to the different types of terminal devices 110.

[0058] In one example, user 140 clicks Figure 2A After selecting the plug-in entry 215, the terminal device 110 will present a selection panel 216 in the session window 210. Then, the user 140 can select at least one plug-in. In some embodiments, the number of selectable plug-ins is related to the machine learning model used.

[0059] In some embodiments, in response to selecting at least one plug-in in the list, the terminal device 110 obtains at least one plug-in selected by the user 140. For example, the user 140 selects at least one plug-in in the list 216-1, the terminal device 110 obtains at least one plug-in in the list 216-1 selected by the user 140, and performs a corresponding operation.

[0060] In some embodiments, the terminal device 110 may present identification information of at least one plug-in selected by the user 140 in the first message. Figure 2E In the interface 205 shown, after the user 140 selects at least one plug-in in the list 216-1, such as a search plug-in, a calendar plug-in, a table plug-in, etc., the terminal device 110 presents identification information of the search plug-in 215-1, the calendar plug-in 215-2, the table plug-in 215-3, etc. in the first message 214. Figure 2F In the interface 206 shown, after the user 140 selects at least one plug-in in the list 226-1, such as a calendar plug-in, a table plug-in, etc., the terminal device 110 presents the identification information of the calendar plug-in 225-1, the table plug-in 225-2, etc. in the first message 224. Figure 2E , Figure 2F The interface shown is explained as follows: Figure 2E , 2F The functions expressed by the interfaces shown are the same, but the presentation forms are different due to the different types of terminal devices 110.

[0061] In some embodiments, the terminal device 110 may present the identification information of at least one plug-in selected by the user 140 in the third message, that is, present the identification information in a new message. After the user 140 selects at least one plug-in in the list 216-1, such as a search plug-in, a calendar plug-in, a table plug-in, etc., the terminal device 110 presents the identification information of the search plug-in 215-1, the calendar plug-in 215-2, the table plug-in 215-3, etc. in the third message. The third message may be a third message generated by the digital assistant based on the plug-in selected by the user 140. The third message may be composed of the plug-ins selected by the user.

[0062] In one example, the plug-in selection panel 216 also includes a plug-in search area. Figure 2C As shown, the terminal device further provides a plug-in search area 216 - 2 in the plug-in selection panel 216 , and the plug-in search area is used to search for plug-ins.

[0063] In some embodiments, the terminal device 110 presents a second message from the digital assistant in the conversation window 210, such as Figure 2E , 2FIn the interface shown, the terminal device 110 presents a second message 218 and a second message 228 from the digital assistant in the conversation window 210. After the user 140 selects at least one plug-in, the user is prompted in the second message that the plug-in has been selected and the selected plug-in can be used.

[0064] In some embodiments, the terminal device 110 presents one or more recommended second shortcut instructions in the second message 218. The one or more second shortcut instructions are triggerable and, after being triggered, are suitable for at least one plug-in to perform related operations. Figure 2E In the interface shown in FIG. 1 , after the user 140 selects at least one plug-in, the terminal device 110 presents one or more recommended second shortcut instructions 219 in the second message 218. Figure 2F In the interface shown, after the user 140 selects at least one plug-in, the terminal device 110 presents one or more recommended second shortcut instructions 229 in the second message 228. In one example, since the second message is a message to which the terminal device 110 replies after the user 140 selects the plug-in, the one or more second shortcut instructions 219 presented in the second message are operations related to the execution of at least one plug-in.

[0065] Figure 3 FIG. 3 is a flowchart of an example process 300 for information interaction according to some embodiments of the present disclosure. Figure 3 , and combined with FIG. 2A to FIG. 2F It is described that after the user 140 performs a preset operation, the terminal device 110 presents a first message from the digital assistant, and then the user 140 selects a plug-in on the first message returned by the digital assistant.

[0066] In box 310, user 140 clicks on the new topic control. Based on user 140 clicking on the new topic, terminal device 110 can open a new context of the digital assistant, that is, terminal device 110 can decouple the context before user 140 clicks on the new topic from the context after. After terminal device 110 receives and presents the first message in conversation window 210 based on user 140 clicking on the new topic, user 140 can select a plug-in, user 140 can ignore the second shortcut command and directly send a free command, user 140 can select the first shortcut command, user 140 can reply to the free command, and user 140 can click on the new topic again.

[0067] The following will describe that after the terminal device 110 receives and presents the first message in the conversation window 210 based on the user 140 clicking on the new topic, the user 140 can select a plug-in, and the terminal device performs a corresponding operation based on the plug-in selected by the user.

[0068] In box 311, after the user 140 clicks on the new topic, the digital assistant responds with a first message 214. The first message 214 supports the user 140 to select at least one plug-in, or supports the user to select one or more first shortcut instructions. The first message 214 may include three parts, such as Figure 2A In the illustrated interface 201 , the first message 214 includes: a greeting message, one or more first shortcut instructions 217 , and an entry 215 for the user 140 to select at least one plug-in.

[0069] In block 312, after user 140 selects a plug-in and clicks OK, the plug-in cannot be modified again. Figure 2C As shown, the user 140 selects the plug-in entry 215 by clicking, and the terminal device 110 presents a selection panel 216 in the session window 210. The selection panel 216 includes a list 216-1 of selectable plug-ins. The user 140 clicks a plug-in in the list 216-1 of selectable plug-ins and clicks to confirm, which cannot be modified after confirmation.

[0070] In block 313, after user 140 selects the plug-in and confirms, a second message from the digital assistant may be received. Figure 2E As shown, the terminal device 110 presents the second message 218 in the conversation window 210. The second message 218 supports the user 140 to select the second shortcut command, such as Figure 2E As shown, the second message 218 includes a second shortcut instruction 219 .

[0071] In one example, since the second shortcut command 219 is generated after the user 140 selects and confirms the plug-in, the second shortcut command 219 is related to the plug-in selected and confirmed by the user. For example, when the user selects a search plug-in, a calendar plug-in, or a table plug-in, the second shortcut command 219 is to search for recent messages, schedule a meeting, or generate a table.

[0072] In box 314, the second shortcut command 219 includes but is not limited to multiple types, for example, the second shortcut command generated by the model supports the user 140 to click and send directly; the second shortcut command configured by the terminal device 110 supports the user 140 to click and determine whether it has parameters. For shortcut commands with parameters, the user 140 can click to enter the box and send after completing the information. For shortcut commands without parameters, the user can click to send directly. In box 315, the digital assistant executes the second shortcut command selected by the user.

[0073] In box 316, after the user 140 clicks the new topic, the first message presented in the conversation window 210 is received. The first message supports the user 140 to select a plug-in, and the user 140 will receive the second message after selecting the plug-in. The second message supports the user 140 to select a second shortcut command, but the user 140 can ignore the second shortcut command and directly send a free command. Then, the terminal device 110 executes the capability corresponding to the plug-in.

[0074] In box 318 , after the user 140 clicks on the new topic, the terminal device 110 can receive and present the first message in the conversation window 210 , and the first message supports the user to select the first shortcut instruction 217 .

[0075] In box 319, the first shortcut command 217 includes but is not limited to multiple types. For example, the first shortcut command 217 generated by the model supports the user 140 to click and send directly; the first shortcut command 217 configured by the terminal device 110 supports the user 140 to click and determine whether it has parameters. For shortcut commands with parameters, the user 140 can click to enter the box and send after completing the information. For shortcut commands without parameters, the user 140 can click to send directly. In box 320, the digital assistant performs the corresponding operation of the first shortcut command 217 based on the first shortcut command 217 selected by the user 140.

[0076] In box 321, after the user 140 clicks on the new topic and receives the first message from the digital assistant, the user can choose to reply with a free instruction. For example, the user 140 continues to reply with historical information. In box 322, the terminal device 110 performs its corresponding operation based on the free instruction of the user 140.

[0077] In box 323, user 140 clicks on the new topic. In box 324, after user 140 clicks on the new topic again, terminal device 110 determines whether user 140 has sent a message. If user 140 has sent a message, it returns to box 310. If user 140 has not sent a message, in box 325, user 140 may receive the first message of the digital assistant. In box 326, user 140 may continue to select a plug-in or select a first shortcut command through the first message.

[0078] The above describes that the preset operation is an operation of opening a new topic in a conversation window. Alternatively or additionally, in some embodiments, the preset operation may include receiving a user input indicating a preset type object in a conversation window between the user and the digital assistant. In this embodiment, the terminal device 110 can use the result of the plug-in associated with the preset type object to execute the preset task in the first message. The preset type object can be an object of any appropriate type, such as a document of a specific type, a multimedia file, and the like. In some embodiments, the preset type object can be a portable document format (PDF) file. Accordingly, the plug-in associated with the preset type object can be a PDF plug-in. The preset task can be any appropriate task that the plug-in can perform, such as summarizing a document.

[0079] FIG. 4A to FIG. 4D Schematic diagram of an example interface according to some embodiments of the present disclosure is shown. In the following, for the convenience of discussion, the terminal device 110 is used to describe FIG. 4A to FIG. 4D , but this is only exemplary.

[0080] In some embodiments, the terminal device 110 presents the result of executing the preset task using the plug-in associated with the preset type object in the first message. The preset type object includes a portable document format PDF file, and thus, the terminal device 110 can present summary information of the PDF file generated using the PDF plug-in in the first message. Figure 4A In the interface 401 shown, the user 140 sends a PDF file 412 to the digital assistant via the conversation window 210. Figure 4B In the illustrated interface 402, the terminal device 110 presents a first message 410 in the conversation window 210. The first message 410 displays summary information of a PDF file 412 generated by using a PDF plug-in.

[0081] In some embodiments, the terminal device 110 may present one or more third shortcut instructions recommended in the first message. Figure 4B In the interface 402 shown, the terminal device 110 presents one or more third shortcut commands 416 recommended in the first message of the conversation window 210. The one or more third shortcut commands 416 can be triggered by the user 140, and the third shortcut commands are associated with a preset type object. For example, the PDF file 412 sent by the user 140 to the digital assistant. In this case, the recommended shortcut command 415 is associated with the PDF file 412.

[0082] Figure 4C , Figure 4D The interface shown is for the case where the terminal device 110 is a mobile terminal. Figure 4CAs shown, the user can select a file to be sent in the conversation window 220. When the user sends a PDF file, the terminal device 110 presents a message 430, which displays a summary of the content of the PDF file and recommended shortcut instructions.

[0083] Figure 5 A flowchart of an example process for information interaction according to some embodiments of the present disclosure is shown. FIG. 4A to FIG. 4D The process 500 is described as follows. In block 510, the user 140 sends a preset type object. The preset type object may include but is not limited to a PDF file, a document file, a form file, etc. The present disclosure does not limit this.

[0084] In box 510, user 140 sends a preset type object to the digital assistant. In box 512, terminal device 110 automatically selects a plug-in associated with the preset type object, such as a PDF plug-in; creates a new topic and clears the context before receiving the PDF file; and presents a message including the result of executing the preset task and one or more third shortcut instructions 416.

[0085] In box 514, the user can continue to ask questions about the content in the preset type object based on the plug-in capabilities of the preset type object. For example, the one or more third shortcut instructions presented may include a shortcut instruction of "summarize this PDF in sections" and a shortcut instruction of "how many pictures are there in this document". The user 140 can click on one or more third shortcut instructions. For example, if the user 140 clicks on the shortcut instruction of "summarize this PDF in sections", the terminal device 110 will present the result corresponding to "summarize this PDF in sections" based on the reply of the digital assistant.

[0086] FIG. 6A to FIG. 6B A schematic diagram of an example interface according to some embodiments of the present disclosure is shown. FIG. 6A to FIG. 6B The description is as follows: after the user 140 performs a preset operation, the terminal device 110 presents a first message from the digital assistant, and then the terminal device 110 presents prompt information in the first message. In the following, for the convenience of discussion, the description of 6A to 6B is based on the perspective of the terminal device 110. Figure 6B , but this is only exemplary. In the following, for the convenience of discussion, the session window may be a sub-session window 620 .

[0087] In some embodiments, the terminal device 110 responds to a preset operation associated with the conversation window 610 between the user and the digital assistant, and presents the first message from the digital assistant in the conversation window 620. The preset operation may include, but is not limited to: triggering the conversation window 620 via the first application, or receiving user input in the conversation window 620 triggered by the first application. The first application may be any application, such as office software, communication application, search application, etc.

[0088] In some embodiments, the terminal device 110 may present prompt information in the first message. The prompt information indicates the default selected plug-in for the first application. In some embodiments, in response to the user 140 triggering the shortcut command, the terminal device 110 uses the default selected plug-in to execute the task corresponding to the shortcut command. Fig. 6A In the illustrated interface 601, the terminal device 110 presents prompt information 622 in the first message 614 in the conversation window 620. In this example, the first application may be a form application, and the prompt information 622 indicates that the form plug-in has been selected for the user.

[0089] In some embodiments, the terminal device 110 may present a plug-in selection control in the first message for the user to freely select a plug-in. In such an embodiment, the user may select a plug-in to be used according to actual needs, instead of a default plug-in or as an addition to a default plug-in.

[0090] In some embodiments, the terminal device 110 also presents in the first message: information about tasks that can be performed by the first application. For example, the first application can be a document application. Accordingly, the information about tasks that can be performed by the first application can be, for example, "I can help you summarize the document or ask questions based on the document content."

[0091] In some embodiments, the terminal device 110 also presents in the first message: the result of executing the task related to the first application. Fig. 6A In the interface 601 shown, the terminal device 110 presents a result 623 of executing a task related to the first application in a conversation window 620. In this example, a pie chart or insight information is presented.

[0092] In some embodiments, the terminal device 110 further presents in the first message: a shortcut command executable for the first application. Fig. 6A In the interface 601 shown, the terminal device 110 can present shortcut instructions 624 that can be used for the table application in the first message 214 in the conversation window 620.

[0093] In some embodiments, the terminal device 110 further presents in the first message: a recommended query related to the first application. The terminal device 110 may present the recommended further query in the first message 214 in the conversation window 620 .

[0094] Figure 6B The interface 602 shown is for a mobile terminal of the terminal device 110. The terminal device 110 presents a message 635 and a recommended shortcut command 636 in a conversation window 632.

[0095] Figure 7 FIG. 7 is a flowchart of an example process 700 for information interaction according to some embodiments of the present disclosure. FIG. 6A to FIG. 6B Describe the example process 700. In block 710, based on the user 140 clicking the digital assistant corresponding control 612, the terminal device 110 opens a conversation window 620. The conversation window 620 may be a sub-conversation window.

[0096] In box 712, the terminal device 110 automatically selects the default plug-in and presents the first message. The terminal device 110 presents the prompt information 622 in the first message. For example, when the first application is a document, the prompt information 622 may be: "We are collaborating with you in XX document. I think you automatically selected the document plug-in." In box 714, the user 140 may view the summary information of the currently opened page.

[0097] In box 716, user 140 selects the shortcut command recommended in the first message. In box 718, user 140 may ignore the recommended shortcut command and send a free command instead. In box 720, terminal device 110 or digital assistant performs corresponding operations according to the free command sent by user 140 or the selected shortcut command.

[0098] In block 722, the user 140 clicks the new topic button in the conversation window 620, and the terminal device 110 performs subsequent operations. The subsequent operations performed by the terminal device are consistent with the operations performed after the user clicks the new topic above, and will not be described here.

[0099] In some embodiments, one or more of the above messages may be presented in the form of a message card. For example, messages 214, 224, 218, 228, 410, 430, 614, etc. may be in the form of a message card. A message card may be an interface component including content and operations. Compared with messages in plain text form, the form of a message card may allow the message to carry richer content, such as icons, files, charts, forms, controls, etc. In this way, users can be better guided to interact with the digital assistant to improve the efficiency of assistance.

[0100] In some embodiments, the user may be supported to view or reopen historical topics between the user and the digital assistant. Exemplarily, an entry control for one or more topics may be presented in the first message, where the one or more topics are historical topics between the user and the digital assistant.

[0101] refer to Figure 6C Describe an example. Figure 6C The interface 605 shown includes a conversation window 650 between the user and the digital assistant. A first message 651 from the digital assistant is displayed in the conversation window 650. In the first message 651, entry controls for one or more scenarios are presented, such as an entry control 652 for the "content creation" scenario. The entry control can be used to enable the corresponding scenario.

[0102] In the first message 651, entry controls 653, 653, and 655 for topics are also presented. By triggering these entry controls, the user can view or reopen historical topics. For example, by triggering entry control 655, the user can view all historical topics with the digital assistant. Note that all historical topics described here can be all historical topics within a period of time. For another example, by triggering entry control 653, the user can view or reopen topic A. In some embodiments, the entry control can also present the occurrence time or the last update time of the corresponding topic. Figure 6C As shown, the occurrence time or the last update time of topic A was yesterday.

[0103] Several example operations are described above with reference to the terminal device 110. It should be understood that this is merely exemplary, and some or all of these operations may be performed by a digital assistant.

[0104] Example Process

[0105] Figure 8 FIG. 8 is a flowchart of a process 800 for information interaction according to some embodiments of the present disclosure. The process 800 may be implemented at the terminal device 110. Figure 1 Process 800 is described.

[0106] In box 810, the terminal device 110 presents a first message from the digital assistant in the conversation window in response to a preset operation associated with the conversation window between the user and the digital assistant.

[0107] In block 820, the terminal device presents elements related to one or more task components in the first message, each task component being configured to perform a corresponding function. The task component includes at least one of a plug-in and a scenario.

[0108] In some embodiments, the preset operation includes an operation of opening a new topic in a conversation window, and presenting elements related to one or more task components in the first message includes: presenting a task component selection control in the first message, or presenting a task component selection control and prompt information for task component selection in the first message.

[0109] In some embodiments, presenting elements related to one or more task components in the first message further includes: presenting one or more recommended first shortcut instructions in the first message, where the one or more shortcut instructions are triggerable.

[0110] In some embodiments, presenting elements related to one or more task components in the first message also includes: in response to a trigger operation on a task component selection control, presenting a task component selection panel, the task component selection panel including at least a list of selectable task components; and in response to a selection of at least one task component in the list, obtaining at least one task component selected by the user.

[0111] In some embodiments, identification information of at least one task component selected by the user is presented in the first message or in the third message.

[0112] In some embodiments, a task component search area is provided in the task component selection panel for searching for task components.

[0113] In some embodiments, a second message from the digital assistant is presented in the conversation window; and one or more recommended second shortcut instructions are presented in the second message, wherein the one or more second shortcut instructions are triggerable and suitable for at least one task component to perform related operations after being triggered.

[0114] In some embodiments, process 800 also includes: the preset operation includes receiving user input indicating a preset type object in a session window, and presenting elements related to one or more task components in the first message includes: in the first message, presenting the result of performing the preset task using the task component associated with the preset type object.

[0115] In some embodiments, the preset type object includes a portable document format PDF file, and the presentation result includes: in the first message, presenting summary information of the PDF file generated by using the PDF task component.

[0116] In some embodiments, in the first message, one or more recommended third shortcut instructions are presented, and the one or more third shortcut instructions are triggerable and associated with a preset type object.

[0117] In some embodiments, the preset operation includes: triggering a session window via a first application, or receiving user input in a session window triggered via the first application, and presenting elements related to one or more task components in a first message includes at least one of the following: presenting prompt information in the first message, the prompt information indicating the task component selected by default for the first application, or presenting a task component selection control in the first message.

[0118] In some embodiments, the first message also presents at least one of the following: information about tasks executable by the first application, results of executing tasks related to the first application, shortcut instructions executable by the first application, or recommended queries related to the first application.

[0119] In some embodiments, in response to triggering a shortcut command, a default selected task component is used to execute a task corresponding to the shortcut command.

[0120] In some embodiments, the scene is configured with configuration information, and the configuration information includes at least one of the following: scene setting information and plug-in information, wherein the scene setting information is used to describe information related to the corresponding scene, and the plug-in information indicates at least one plug-in used to perform a task in the corresponding scene.

[0121] In some embodiments, process 800 also includes: presenting entry controls for one or more topics in the first message, the one or more topics being historical topics between the user and the digital assistant.

[0122] In some embodiments, the messages are presented in the form of message cards.

[0123] Example devices and equipment

[0124] Fig. 9 A schematic structural block diagram of an apparatus 900 for information interaction according to some embodiments of the present disclosure is shown. The apparatus 900 may be implemented as or included in a terminal device 110. Each module / component in the apparatus 900 may be implemented by hardware, software, firmware, or any combination thereof.

[0125] As shown in the figure, the device 900 includes a first message presentation module 910, which is configured to present a first message from the digital assistant in the conversation window in response to a preset operation associated with the conversation window between the user and the digital assistant. The device 900 also includes a task component element presentation module 920, which is configured to present elements related to one or more task components in the first message, each task component is configured to perform a corresponding function, wherein the task component includes at least one of a plug-in and a scene. .

[0126] In some embodiments, the preset operation includes an operation of opening a new topic in a conversation window, and the first message presentation module 910 is further configured to: present a task component selection control in the first message, or present a task component selection control and prompt information for task component selection in the first message.

[0127] In some embodiments, the first message presentation module 910 is further configured to present one or more recommended first shortcut instructions in the first message, and the one or more shortcut instructions are triggerable.

[0128] In some embodiments, the task component element presentation module 920 is further configured to: in response to a triggering operation on a task component selection control, present a task component selection panel, the task component selection panel including at least a list of selectable task components; and in response to a selection of at least one task component in the list, obtain at least one task component selected by the user.

[0129] In some embodiments, identification information of at least one task component selected by the user is presented in the first message or in the third message.

[0130] In some embodiments, a task component search area is provided in the task component selection panel for searching for task components.

[0131] In some embodiments, the device 900 also includes: a second message presentation module, configured to present a second message from the digital assistant in the conversation window; and a second shortcut instruction presentation module, configured to present one or more recommended second shortcut instructions in the second message, the one or more second shortcut instructions being triggerable and suitable for at least one task component to perform related operations after being triggered.

[0132] In some embodiments, the preset operation includes receiving user input indicating a preset type object in the conversation window, and the first message presentation module 910 is further configured to present, in the first message, a result of performing a preset task using a task component associated with the preset type object.

[0133] In some embodiments, the preset type object includes a portable document format PDF file, and the first message presenting module 910 is further configured to: present summary information of the PDF file generated by using the PDF task component in the first message.

[0134] In some embodiments, the device 900 further includes: a third shortcut instruction presentation module configured to present one or more recommended third shortcut instructions in the first message, where the one or more third shortcut instructions are triggerable and associated with a preset type of object.

[0135] In some embodiments, the preset operation includes: triggering a session window via the first application, or receiving user input in a session window triggered via the first application, and the first message presentation module 910 is further configured to perform at least one of the following: presenting prompt information in the first message, the prompt information indicating the task component selected by default for the first application, or presenting a task component selection control in the first message.

[0136] In some embodiments, the first message also presents at least one of the following: information about tasks executable by the first application, results of executing tasks related to the first application, shortcut instructions executable by the first application, or recommended queries related to the first application.

[0137] In some embodiments, the device 900 further includes a task execution module configured to execute the task corresponding to the shortcut instruction using a default selected task component in response to triggering the shortcut instruction.

[0138] In some embodiments, the scene is configured with configuration information, and the configuration information includes at least one of the following: scene setting information and plug-in information, wherein the scene setting information is used to describe information related to the corresponding scene, and the plug-in information indicates at least one plug-in used to perform a task in the corresponding scene.

[0139] In some embodiments, the first message presentation module 910 is further configured to present entry controls for one or more topics in the first message, where the one or more topics are historical topics between the user and the digital assistant.

[0140] In some embodiments, the messages are presented in the form of message cards.

[0141] Fig.10 1 shows a block diagram of an electronic device 1000 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Fig.10 The electronic device 1000 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Fig.10 The electronic device 1000 shown can be used to implement Figure 1 terminal device 110.

[0142] like Fig.10As shown, the electronic device 1000 is in the form of a general electronic device. The components of the electronic device 1000 may include, but are not limited to, one or more processors or processing units 1010, a memory 1020, a storage device 1030, one or more communication units 1040, one or more input devices 1050, and one or more output devices 1060. The processing unit 1010 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 1020. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 1000.

[0143] The electronic device 1000 typically includes a plurality of computer storage media. Such media may be any accessible media that is accessible to the electronic device 1000, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1020 may be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1030 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data and may be accessed within the electronic device 1000.

[0144] The electronic device 1000 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig.10 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. Memory 1020 may include a computer program product 1025 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0145] The communication unit 1040 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 1000 can be implemented in a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 1000 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0146] The input device 1050 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 1060 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 1000 may also communicate with one or more external devices (not shown) through the communication unit 1040 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 1000, or communicate with any device that allows the electronic device 1000 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0147] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0148] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0149] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0150] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0151] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0152] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. An information interaction method, comprising: In response to a preset operation associated with a conversation window between a user and a digital assistant, presenting a first message from the digital assistant in the conversation window; as well as Presenting in the first message elements related to one or more task components, each task component being configured to perform a corresponding function; The task component includes at least one of a plug-in and a scene.

2. The method according to claim 1, wherein the preset operation comprises an operation of opening a new topic in the conversation window, and presenting elements related to one or more task components in the first message comprises: presenting a task component selection control in the first message, or A task component selection control and prompt information for task component selection are presented in the first message.

3. The method according to claim 1, further comprising: One or more first recommended shortcut instructions are presented in the first message, and the one or more shortcut instructions are triggerable.

4. The method according to claim 2, further comprising: In response to a triggering operation on the task component selection control, presenting a task component selection panel, the task component selection panel at least including a list of selectable task components; as well as In response to a selection of at least one task component in the list, at least one task component selected by the user is obtained.

5. The method according to claim 4, wherein: The identification information of the at least one task component selected by the user is presented in the first message or in the third message. The method according to claim 4 , wherein a task component search area is provided in the task component selection panel for searching for task components.

7. The method according to claim 4, further comprising: presenting a second message from the digital assistant in the conversation window; as well as One or more recommended second shortcut instructions are presented in the second message, wherein the one or more second shortcut instructions are triggerable and are suitable for the at least one task component to perform related operations after being triggered.

8. The method according to claim 1, wherein the preset operation comprises receiving a user input indicating a preset type object in the conversation window, and presenting elements related to one or more task components in the first message comprises: In the first message, a result of executing a preset task using a task component associated with the preset type object is presented.

9. The method according to claim 8, wherein the preset type object comprises a portable document format PDF file, and presenting the result comprises: In the first message, summary information of the PDF file generated by using the PDF task component is presented.

10. The method according to claim 8, further comprising: In the first message, one or more recommended third shortcut instructions are presented, and the one or more third shortcut instructions are triggerable and associated with the preset type object.

11. The method according to claim 1, wherein the preset operation comprises: The session window is triggered via the first application, or a user input is received in the session window triggered via the first application, and Presenting elements related to one or more task components in the first message includes at least one of the following: In the first message, prompt information is presented, the prompt information indicating a task component selected by default for the first application, or In the first message, a task component selection control is presented.

12. The method according to claim 11, wherein the first message further includes at least one of the following: information about tasks that can be performed by the first application, the result of performing a task associated with the first application, a shortcut command executable for the first application, or Recommended queries related to the first application.

13. The method according to claim 11, further comprising: In response to triggering the shortcut command, the task corresponding to the shortcut command is executed using the default selected task component.

14. The method according to claim 1, wherein: The scene is configured with configuration information, and the configuration information includes at least one of the following: scene setting information and plug-in information, wherein the scene setting information is used to describe information related to the corresponding scene, and the plug-in information indicates at least one plug-in used to perform a task in the corresponding scene.

15. The method according to claim 1, further comprising: An entry control for one or more topics is presented in the first message, wherein the one or more topics are historical topics between the user and the digital assistant.

16. The method according to any one of claims 1-15, wherein the message is presented in the form of a message card.

17. A device for information interaction, comprising: A first message presenting module, configured to present a first message from the digital assistant in the conversation window in response to a preset operation associated with the conversation window between the user and the digital assistant; as well as a task component element presentation module, configured to present elements related to one or more task components in the first message, each task component being configured to perform a corresponding function, The task component includes at least one of a plug-in and a scene.

18. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 16 when executed by the at least one processing unit.

19. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 16.

Citation Information

Patent Citations

  • Service recommendation method and device with intelligent assistant

    CN113268498A

  • Method for adaptively generating card, terminal equipment and server

    CN113761427A

  • Intelligent generation and recommendation method and system for RPA process and guide course

    CN116009827A

  • Electronic device and control method therefor

    US20200143017A1