Information interaction method and device, equipment and storage medium

By providing operational controls associated with the scene in the interaction window between the user and the digital assistant, it solves the problem that users have difficulty exploring and using the digital assistant scenario, and improves interaction efficiency and flexibility.

CN119002738APending Publication Date: 2024-11-22BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311549974.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-11-20
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

In the prior art, the interaction between users and digital assistants is inefficient, making it difficult for users to explore and use digital assistants. The traditional interaction methods are complex, resulting in excessive and unclear information input by users, affecting interaction flexibility and efficiency.

Method used

In the interaction window between the user and the digital assistant, in response to the selection of a set of scenes, the operation controls associated with the scene are provided, the scene is configured to perform specific tasks, simplify user operations, and reduce interaction complexity.

Benefits of technology

Through scene-based interaction methods, users can lower the threshold for using digital assistants, simplify operations, and improve the interaction efficiency and flexibility between users and digital assistants.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119002738A_ABST
    Figure CN119002738A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides an information interaction method and device, equipment and a storage medium. In the method for information interaction, in an interaction window of a user and a digital assistant, in response to the fact that a first scene in a set of scenes is selected for interaction of the user and the digital assistant, at least one first operation control associated with the first scene is provided in the interaction window, at least one scene in the group of scenes is configured to execute tasks related to the corresponding scene, and the at least one first operation control is respectively configured to trigger corresponding operations for interaction. In this manner, an operational control associated with the scene may be presented. The digital assistant can execute an operation corresponding to the operation control in response to the received triggering operation on the operation control. The difficulty and complexity of interaction between the user and the digital assistant are reduced, and the interaction efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for information interaction. Background Art

[0002] With the rapid development of Internet technology, the Internet has become an important platform for people to obtain and share content. Users can access the Internet through terminal devices to enjoy various Internet services. The terminal device presents the corresponding content through the user interface of the application and interacts with the user and provides services to the user. Therefore, the colorful interactive interface of the application is an important means to improve the user experience. With the development of information technology, various terminal devices can provide various services to people in work and life. For example, applications that provide services can be deployed in terminal devices. Terminal devices or applications can provide users with digital assistant functions to assist users in using terminal devices or applications. How to improve the flexibility of interaction between users and digital assistants is a technical problem to be explored at present. Summary of the invention

[0003] In a first aspect of the present disclosure, a method for information interaction is provided. The method comprises: in an interaction window between a user and a digital assistant, in response to a first scene in a group of scenes being selected for interaction between the user and the digital assistant, providing at least one first operation control associated with the first scene in the interaction window, wherein at least one scene in the group of scenes is configured to perform a task related to the corresponding scene, and the at least one first operation control is respectively configured to trigger a corresponding operation for interaction.

[0004] In a second aspect of the present disclosure, a device for information interaction is provided. The device includes: a control presentation module configured to provide at least one first operation control associated with the first scene in an interaction window between a user and a digital assistant, in response to a first scene in a group of scenes being selected for interaction between the user and the digital assistant, wherein at least one scene in the group of scenes is configured to perform a task related to the corresponding scene, and the at least one first operation control is respectively configured to trigger a corresponding operation for interaction.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0010] Figure 2 A schematic diagram showing an example client interface of an interactive window according to some embodiments of the present disclosure;

[0011] Figure 3 A schematic diagram showing an example interface for scene selection according to some embodiments of the present disclosure;

[0012] Figure 4A A schematic diagram showing an example client interface of an interactive window in an example scenario according to some embodiments of the present disclosure;

[0013] Figure 4B A schematic diagram showing an example interface for file selection according to some embodiments of the present disclosure;

[0014] Figure 4C A schematic diagram showing an example client interface of an interactive window in an example scenario according to some embodiments of the present disclosure;

[0015] Figure 5A A schematic diagram showing an example client interface of an interactive window in an example scenario according to some embodiments of the present disclosure;

[0016] Figure 5B A schematic diagram showing an example interface for image selection according to some embodiments of the present disclosure;

[0017] Figure 5C A schematic diagram showing an example client interface of an interactive window in an example scenario according to some embodiments of the present disclosure;

[0018] Fig. 6A and Figure 6BA schematic diagram showing an example client interface of an interactive window in an example scenario according to some embodiments of the present disclosure;

[0019] Fig. 7A and Figure 7B A schematic diagram showing an example client interface of an interactive window in an example scenario according to some embodiments of the present disclosure;

[0020] Fig. 8A A schematic diagram showing an example client interface of an interactive window in an example scenario according to some embodiments of the present disclosure;

[0021] Figure 8B A schematic diagram showing an example interface for presenting a shortcut command list according to some embodiments of the present disclosure is shown;

[0022] Figure 8C A schematic diagram showing an example client interface of an interactive window in an example scenario according to some embodiments of the present disclosure;

[0023] Fig. 9 A flowchart of a process for information interaction according to some embodiments of the present disclosure is shown;

[0024] Fig.10 A block diagram showing an apparatus for information interaction according to some embodiments of the present disclosure; and

[0025] Fig.11 A block diagram of an electronic device in which one or more embodiments of the present disclosure may be implemented is shown. DETAILED DESCRIPTION

[0026] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0027] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0028] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0029] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0030] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the types, scopes of use, usage scenarios, etc. of the information involved in the present disclosure should be informed to relevant users and their authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations. The relevant users may include any type of right holders, such as individuals, enterprises, and groups.

[0031] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can independently choose whether to provide information to software or hardware such as an electronic device, application, server or storage medium that executes the operation of the technical solution of the present disclosure based on the prompt message.

[0032] As an optional but non-limiting implementation, in response to receiving an active request from a relevant user, a prompt message is sent to the relevant user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to select "agree" or "disagree" to provide information to the electronic device.

[0033] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0034] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In the example environment 100, a digital assistant 120 and an application 125 are installed in a terminal device 110. A user 140 can interact with the digital assistant 120 and the application 125 via the terminal device 110 and / or an attached device of the terminal device 110.

[0035] In some embodiments, the digital assistant 120 and the application 125 can be downloaded and installed on the terminal device 110. In some embodiments, the digital assistant 120 and the application 125 can also be accessed through other means, such as through a web page. Figure 1In the environment 100 , in response to the application 125 being started, the terminal device 110 can present the interface 150 of the digital assistant 120 and the application 125 .

[0036] Applications 125 include, but are not limited to, one or more of the following: chat applications (also known as instant messaging applications), document applications, audio and video conferencing applications, email applications, task applications, calendar applications, objectives and key results (OKR) applications, etc. Figure 1 A single application is shown in the figure, but in fact, multiple applications can be installed on the terminal device 110. In some embodiments, the application 125 may include a multi-functional collaboration platform, such as an office collaboration platform (also called an office suite) that can provide integration of multiple types of applications or components to facilitate people to carry out office work, communication and other activities. In the multi-functional collaboration platform, people can start different applications or components as needed to complete corresponding information processing, sharing, communication, etc.

[0037] The application 125 may provide a content entity 126. The content entity 126 may be a content instance created by the user 140 or other users on the application 125. For example, depending on the type of the application 125, the content entity 126 may be a document (e.g., a word document, a pdf document, a presentation, a spreadsheet document, etc.), an email, a message (e.g., a conversation message on an instant messaging application), a calendar, a schedule, a task, an audio, a video, an image, etc.

[0038] In some embodiments, the digital assistant 120 can be provided by a separate application, or can be integrated into an application 120 that can provide content entities. The application for providing the client interface of the digital assistant can correspond to a single-function application or a multi-function collaboration platform, such as an office suite or other collaboration platform that can integrate multiple components. In some embodiments, the digital assistant 120 supports the use of plug-ins. Each plug-in can provide one or more functions of the application. Such plug-ins include, but are not limited to, one or more of the following: search plug-ins, contact plug-ins, message plug-ins, document plug-ins, table plug-ins, mail plug-ins, calendar plug-ins, schedule plug-ins, task plug-ins, and the like.

[0039] The digital assistant 120 is an intelligent assistant of the user, which has intelligent dialogue and information processing capabilities. In an embodiment of the present disclosure, the digital assistant 120 is used to interact with the user 140 to assist the user 140 in using a terminal device or application. An interaction window with the digital assistant 120 may be presented in the client interface. In the interaction window, the user 140 can communicate with the digital assistant 120 by inputting natural language to instruct the digital assistant to assist in completing various tasks, including operations on the content entity 126.

[0040] In some embodiments, the digital assistant 120 can be included in the contact list of the current user 140 in the office suite as a contact of the user 140, or included in the information flow of the chat component. In some embodiments, the user 140 has a corresponding relationship with the digital assistant 120. For example, the first digital assistant corresponds to the first user, the second digital assistant corresponds to the second user, and so on. In some embodiments, the first digital assistant can correspond uniquely to the first user, the second digital assistant can correspond uniquely to the second user, and so on. That is, the first digital assistant of the first user can be specific to or exclusive to the first user. For example, in the process of the first digital assistant providing assistance or service to the first user, the first digital assistant can use its historical interaction information with the first user, the data authorized by the first user that it can access, and the current interaction context with the first user. If the first user is an individual or an individual, the first digital assistant can be regarded as a personal digital assistant. It can be understood that in the disclosed embodiments, the first digital assistant is based on the authorized access to the data to which the permission is granted by the first user. It should be understood that "uniquely corresponding" or similar expressions in the present disclosure are not intended to limit the first digital assistant to be updated accordingly based on the interaction process between the first user and the first digital assistant. Of course, depending on actual application needs, the digital assistant 120 does not have to be specific to the current user 140, but can be a general digital assistant.

[0041] In some embodiments, multiple interaction modes between the user 140 and the digital assistant 120 can be provided, and the multiple interaction modes can be flexibly switched. When a certain interaction mode is triggered, the corresponding interaction area is presented to facilitate the interaction between the user 140 and the digital assistant 120. The user 140 and the digital assistant 120 interact in different ways in different interaction modes, so that it can be flexibly adapted to the interaction needs in different application scenarios.

[0042] In some embodiments, information processing services specific to user 140 can be provided based on historical interaction information between user 140 and digital assistant 120 and / or a data range specific to user 140. In some embodiments, historical interaction information of user 140 interacting with digital assistant 120 in multiple interaction modes can be stored in association with user 140. In this way, in one interaction mode (any one or a designated one of the interaction modes) among the multiple interaction modes, digital assistant 120 can provide services to user 140 based on historical interaction information stored in association with user 140.

[0043] The digital assistant 120 can be called or awakened by an appropriate method (e.g., shortcut keys, buttons, or voice) to present an interaction window with the user 140. By selecting the digital assistant 120, the interaction window with the digital assistant 120 can be opened. The interaction window may include interface elements for information interaction, such as an input box, a message list, a message bubble, and the like. In other embodiments, the digital assistant 120 can be awakened through an entry control or menu provided in a page, or by inputting a preset instruction.

[0044] In some embodiments, the interaction window between the digital assistant 120 and the user 140 may include a conversation window, such as a conversation window in an instant messaging application or an instant messaging module of a target application. In some embodiments, the interaction window between the digital assistant 120 and the user 140 may include a floating window corresponding to the digital assistant.

[0045] In some embodiments, the digital assistant 120 may support an interactive mode of a conversation window, also referred to as a conversation mode. In this interactive mode, a conversation window between the user 140 and the digital assistant 120 is presented, in which the user 140 and the digital assistant 120 interact through conversation messages. In the conversation mode, the digital assistant 120 may perform tasks according to the conversation messages in the conversation window.

[0046] In some embodiments, the conversation mode between the user 140 and the digital assistant 120 can be called or awakened by an appropriate method (e.g., a shortcut key, a button, or voice) to present a conversation window. By selecting the digital assistant 120, a conversation window with the digital assistant 120 can be opened. The conversation window may include interface elements for information interaction, such as an input box, a message list, a message bubble, and the like.

[0047] In some embodiments, the digital assistant 120 may support an interactive mode of a floating window (or floating window), also referred to as a floating window mode. When the floating window mode is triggered, an operation panel (also referred to as a floating window) corresponding to the digital assistant 120 is presented, and the user 140 may issue instructions to the digital assistant 120 based on the operation panel. In some embodiments, the operation panel may include at least one candidate shortcut instruction. Alternatively or additionally, the operation panel may include an input control for receiving instructions. In floating window mode, the digital assistant 120 may perform tasks according to instructions issued by the user 140 through the operation panel.

[0048] In some embodiments, the floating window mode of the user 140 and the digital assistant 120 can also be called or awakened by an appropriate method (e.g., a shortcut key, a button, or voice) to present the corresponding operation panel. In some embodiments, the awakening of the digital assistant 120 can be supported in a specific application, such as a document application, to provide interaction in the floating window mode. In some embodiments, in order to trigger the floating window mode to present the operation panel corresponding to the digital assistant 120, an entry control for the digital assistant 120 can be presented in the application interface. In response to detecting a trigger operation for the entry control, it can be determined that the floating window mode is triggered, and the operation panel corresponding to the digital assistant 120 is presented in the target interface area.

[0049] In some embodiments described below, for ease of discussion, the interaction window between the user and the digital assistant is mainly taken as an example of a conversation window.

[0050] In some embodiments, the terminal device 110 communicates with the server 130 to provide services for the digital assistant 120 and the application 125. The terminal device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a television receiver, a radio broadcast receiver, an e-book device, a gaming device, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.). The server 130 can be various types of computing systems / servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0051] It should be understood that the structure and function of the various elements in the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0052] As briefly mentioned above, digital assistants can assist users in using terminal devices or applications. Some applications can provide integrated functions of different plug-ins. In addition to being able to have free conversations with digital assistants, users can also use natural language instructions to enable digital assistants to use different plug-ins to complete some more complex business-related operations related to the application, such as creating documents, inviting schedules, creating tasks, etc. However, since most users cannot explore the use scenarios of digital assistants through interaction with digital assistants, it is necessary to provide users with targeted guidance. In addition, traditionally, users often need to enter corresponding information to instruct digital assistants to perform different tasks in different scenarios. When the operation is more complicated or the description of the operation is more complicated, the information that the user needs to enter will be correspondingly more. In addition, there are also cases where the instructions entered by the user are not clear enough, resulting in the digital assistant being unable to clarify the corresponding operation. This will affect the interaction efficiency between the user and the digital assistant and make the interactive function of the digital assistant less flexible.

[0053] According to some embodiments of the present disclosure, an improved scheme for information interaction is proposed. In an embodiment of the present disclosure, in an interaction window between a user and a digital assistant, in response to a first scene in a group of scenes being selected for interaction between the user and the digital assistant, at least one first operation control associated with the first scene is provided in the interaction window. At least one scene in a group of scenes is configured to perform a task related to the corresponding scene, and at least one first operation control is respectively configured to trigger a corresponding operation for interaction.

[0054] In general solutions, users can usually only communicate with digital assistants by selecting plug-ins, but this requires users to have a certain level of cognition, know which plug-ins should be selected in what kind of task scenarios, and need to manually select the plug-ins to be used. According to an embodiment of the present disclosure, by providing scenario-based interaction, the user's entry threshold for using digital assistants is lowered, and the user's operation is simplified. Furthermore, in an embodiment of the present disclosure, in the interaction based on a specific scenario, operation controls associated with a specific scenario can also be presented. In response to receiving a trigger operation on the operation control, an operation corresponding to the operation control can be performed. This helps to reduce the difficulty and complexity of the interaction between the user and the digital assistant and improve the efficiency of the interaction.

[0055] Some example embodiments of the present disclosure will be described in detail below with reference to examples of the accompanying drawings.

[0056] As described above, in an embodiment of the present disclosure, a digital assistant is used to interact with a user. An interaction window between a user and a digital assistant may be presented in a client interface. The interaction window between a user and a digital assistant may include a conversation window, in which the interaction between the user and the digital assistant may be presented in the form of a conversation message. Alternatively or additionally, the interaction window between a user and a digital assistant may also include other types of windows, such as a window in a floating window mode, in which a user may trigger the digital assistant to perform a corresponding operation by inputting instructions, selecting shortcut instructions, and the like. As an intelligent assistant, a digital assistant has intelligent dialogue and information processing capabilities. In the interaction window, a user inputs an interactive message, and the digital assistant provides a reply message in response to the user input. The client interface for providing a digital assistant may correspond to a single-function application or a multi-function collaboration platform, such as an office suite or other collaboration platform capable of integrating multiple components.

[0057] In some embodiments, the terminal device 110 may present a conversation window between a user and one or more other users. Here, the conversation window between the user and one other user may be, for example, a single chat window between user A and user B, and the conversation window between the user and multiple other users may be, for example, a group chat window between user A and a group of other users. The user may interact with at least one other user by sending and / or receiving messages in the conversation window. The terminal device 110 may, for example, determine the content of the message to be sent by the user in response to detecting the text entered by the user in the input box. The terminal device 110 may also, for example, collect the user audio in response to detecting the user's triggering operation on the audio space. The terminal device 110 may determine the audio or the text content corresponding to the audio as the content of the message to be sent by the user. It should be noted that the operations performed by the aforementioned terminal device 110 and the operations performed by the terminal device 110 described later may be specifically performed by relevant applications installed on the terminal device 110.

[0058] In the conversation window, the user can input a message through an input box or through other appropriate means (e.g., voice), and the digital assistant can provide a reply message based on the input message and in combination with relevant knowledge. The message in the conversation window is usually a conversation message. Such a conversation message can be regarded as part of a topic.

[0059] In this article, a "topic" corresponds to a specific context of an interaction. During the interaction process of each topic, the interaction information between the user and the digital assistant will be regarded as context information to assist the digital assistant in determining subsequent conversation messages. In some embodiments, a topic is sometimes also referred to or presented as a theme.

[0060] Figure 2 A schematic diagram of an example client interface 200 showing an interactive window according to some embodiments of the present disclosure. Figure 2 The client interfaces shown in the following figures can all be implemented at the terminal device 110. Figure 1 describe Figure 2 And examples of other figures that follow.

[0061] In the conversation window between the user and at least one other user, the terminal device 110 (for example, an instant messaging application installed on the terminal device 110, or a suite application integrated with an instant messaging application installed on the terminal device 110) can present a trigger control for a digital assistant (for example, a first digital assistant) in response to detecting a preset input in the input box of the conversation window. In some embodiments, the launch portal of the instant messaging application and / or the information stream (feed) of the instant messaging application can be presented in the interface 200 (not shown in the figure). In response to the user selecting any contact or any group in the information stream of the instant messaging application, the terminal device 110 can present a corresponding conversation window in the interface 200. For example, in response to the user waking up the digital assistant through a preset operation (for example, selecting a digital assistant from a contact list), the terminal device 110 can present a conversation window (also called the main conversation window) in which the user interacts with the digital assistant (that is, the XX assistant in the figure) in the interface 200.

[0062] In some embodiments, the terminal device 110 may present a new topic guidance message in the conversation window where the user interacts with the digital assistant in response to a new topic opening operation. This new topic guidance message may include, for example, at least one scene and / or at least one historical topic in the conversation between the user and the digital assistant. Regarding the new topic opening operation, in some embodiments, in response to the digital assistant being called up, the terminal device 110 may receive a new topic opening operation by default, open a new topic in the conversation window, and present a new topic guidance message in the conversation window. In some embodiments, if there is historical interaction information or historical topics between the user and the digital assistant before, in response to the digital assistant being called up, the terminal device 110 may present part of the historical interaction information or historical topics in the conversation window. Alternatively or additionally, in some embodiments, in response to the digital assistant being called up, the terminal device 110 may not have any message in the main conversation window.

[0063] In some embodiments, the conversation window may include an input box, and the terminal device 110 may, for example, receive user input through the input box. The terminal device 110 may determine that a new topic opening operation has been received in response to detecting that the user input is a user input indicating the opening of a new topic. In some embodiments, the conversation window may also include a control for opening a new topic. The terminal device 110 may, for example, determine that a new topic opening operation has been received in response to detecting a triggering operation on the control (e.g., a click operation, a long press operation, a double-click operation, etc.). The terminal device 110 may then open a new topic in the conversation window and present a new topic guidance message in the conversation window. Figure 2 As shown, in some embodiments, in response to the digital assistant being called up, the terminal device 110 may present a new topic guide message 202 in the interface 200 by default. In some embodiments, the interface 200 may also include a control 205 for opening a new topic. The terminal device 110 may present the new topic guide message 202 in the interface 200 in response to detecting a triggering operation on the control 205. In some embodiments, the terminal device 110 may also present the new topic guide message by presenting a message card.

[0064] The terminal device 110 may present at least one scenario (e.g., the scenario "calendar assistant", the scenario "enterprise dialogue", and the scenario "content creation") in the new topic guidance message 202. The scenario here refers to a collection of tasks of the same type, that is, one scenario corresponds to multiple tasks of the same type. One or more scenarios may be respectively configured with corresponding configuration information to perform tasks of the corresponding type. For ease of understanding, the scenarios used in the interaction between the user and the digital assistant are briefly introduced.

[0065] The configuration information of the scene includes at least one of the following: scene setting information, plug-in information. The scene setting information is used to describe information related to the corresponding scene. The scene setting information of the scene can affect the digital assistant's reply to the user to a certain extent, or be used to determine the digital assistant's reply to the user. In some embodiments, the scene setting information is used to construct a prompt word (prompt) input to provide to the model used in the corresponding scene. The digital assistant's reply to the user is based on the output of the model. The scene setting information of the scene may, for example, include a description of the corresponding type of task, the reply style of the digital assistant in the scene, the definition of the workflow to be executed in the corresponding scene, the definition of the reply format of the digital assistant in the corresponding scene, and so on. In some embodiments, the digital assistant will understand the user input with the help of the model and provide a reply to the user based on the output of the model. The model used by the digital assistant can run locally on the terminal device 110 or on a remote server. By using the scene setting information to construct a part of the prompt word input of the model, the model can be guided to complete the task to be implemented in the corresponding scene. In some embodiments, the model can be a machine learning model, a deep learning model, a learning model, a neural network, etc. In some embodiments, the model can be based on a language model (LM). The language model can acquire question-answering capabilities by learning from a large amount of corpus. The model can also be based on other appropriate models.

[0066] The plug-in information indicates at least one plug-in for performing the task in the corresponding scenario. Through the plug-in information of the scenario, the plug-in to be used in the corresponding scenario can be configured. In some embodiments, in the corresponding scenario, during the operation of the plug-in, the plug-in can also call the model to complete the corresponding task. In some embodiments, a plug-in can also call the open interface provided by other applications (for example, documents, calendars, meetings, etc.) to complete the corresponding task, such as modifying documents, creating schedules, summarizing meetings, etc.

[0067] In some embodiments, the configuration information of the scene may also include a scene name, description information of the scene, and the like. In some embodiments, the terminal device 110 may provide a message card to the user in the conversation window, and at least part of a set of scenes may be presented in the message card. The terminal device 110 may present the scene name and / or description information of the scene of the corresponding scene in association with the scene in the message card. For example, the user may select a scene that meets his or her needs based on the scene name and / or description information of the scene presented in the message card.

[0068] In some embodiments, the configuration information of the scene may also include, but is not limited to: the selected model (the model here is called to determine the response to the user in the corresponding scene), scene guidance information (the scene guidance information is presented to the user after the corresponding scene is selected), at least one recommended question for the digital assistant (at least one recommended question is presented to the user for selection after the corresponding scene is selected), any combination of one or more of the foregoing, and the like. The scene guidance information may, for example, be descriptive information about a task instance that can be performed in the scene. In some embodiments, the scene setting information and configuration information of the scene may be configured, for example, in a natural language manner, so that the scene creator can easily constrain the output of the model and configure a variety of scenes.

[0069] In some embodiments, the configuration information of the scene may also indicate at least one operation control associated with the scene. As will be described in detail below, at least one operation control associated with the scene may be presented to the user when the scene is selected for interaction, so as to facilitate the user to perform interaction with the digital assistant in the corresponding scene. That is to say, during the scene creation process, at least one operation control associated with the corresponding scene may be configured by the scene creator. In some embodiments, the scene setting information and configuration information of the scene may be configured by the scene creator in a natural language manner, for example. In this way, the scene creator can easily constrain the output of the model and configure a variety of scenes.

[0070] In some embodiments, the terminal device 110 may also present a scene viewing entry 201 in the interface 200 and / or a scene viewing entry 203 in the new topic guide message 202, and the terminal device 110 may present more scenes in response to detecting a trigger operation on the scene viewing entry 201 and / or the scene viewing entry 203. For example, in order to ensure the simplicity of the main conversation window, in the case of including multiple scenes, the terminal device 110 may only present part of the scenes in the new topic guide message 202, and in response to detecting a trigger operation on the scene viewing entry 201 or the scene viewing entry 203, present more selectable scenes. For example, in response to detecting a trigger operation on the scene viewing entry 201 or the scene viewing entry 203, the terminal device 110 may present the following: Figure 3 Interface 300 is shown.

[0071] like Figure 3As shown, multiple scenes and scene creation portals 301 are presented in the interface 300. For example, a user can create a scene by triggering the scene creation portal 301. For example, the terminal device 110 can determine that a scene creation operation is received in response to detecting a trigger operation on the scene creation portal 301, and provide a page for creating a target scene (sometimes also referred to as a "first page"). The terminal device 110 can obtain the target configuration information of the target scene via the first page. The target configuration information can at least indicate at least one operation control associated with the target scene. The terminal device 110 can then create a target scene based on the acquired target configuration information in response to receiving a creation confirmation operation. As mentioned above, the configuration information of the target scene includes one or more of the scene setting information, plug-in information, an indication of the selected model, scene guidance information, at least one recommended question for the digital assistant, and at least one operation control associated with the scene. Therefore, the user can define the target configuration information of the target scene by himself via the first page, so that the terminal device 110 creates a target scene that matches the user's needs based on the target configuration information input by the user. For example, the user can define at least one target operation control associated with the target scene by himself via the first page. The terminal device 110 may determine at least one target operation control of the target scene based on the user input.

[0072] In some embodiments, the terminal device 110 may also present at least one historical topic in the new topic guide message 202. For example, the terminal device 110 may determine all historical topics in the conversation between the user and the digital assistant as at least one historical topic included in the new topic guide message, that is, the terminal device 110 may present all historical topics in the new topic guide message. In some embodiments, in order to ensure the simplicity of the interface, the at least one historical topic included in the new topic guide message 202 may also include only a predetermined number of recent historical topics. This predetermined number may be preset by the user and / or relevant backend staff, for example. Exemplarily, if the predetermined number is 3 and there are 5 historical topics, the terminal device 110 may determine the 3 most recent historical topics that are closest to the current moment based on the update time of each of the 5 historical topics. The terminal device 110 may determine the 3 most recent historical topics as at least one historical topic included in the new topic guide message 202. It can be understood that if the number of historical topics is less than the predetermined number, the terminal device 110 may determine all historical topics as at least one historical topic included in the new topic guide message 202.

[0073] For example, the terminal device 110 may determine that a selection of the first scene is received in response to receiving a selection operation for a certain scene (e.g., the first scene) in at least one scene presented in the new topic guide message 202. The terminal device 110 may then perform user interaction with the digital assistant in the new topic based at least on the configuration information of the first scene. For example, the terminal device 110 may also determine that a selection of the first historical topic is received in response to receiving a selection operation for a certain historical topic (e.g., the first historical topic) in at least one historical topic presented in the new topic guide message 202. The terminal device 110 may then present a first topic area corresponding to the first topic. The first topic area includes conversation messages related to the first topic in the first conversation.

[0074] In some embodiments, the terminal device 110 may also present at least one operation control in a conversation window (e.g., a conversation window in the interface 200). Each operation control may be triggered to perform an operation associated with the interaction between the user and the digital assistant, such as an operation corresponding to the input during the interaction. It is understood that the terminal device 110 may present the operation control at any position in the conversation window, and the present disclosure does not limit the specific presentation position / area of ​​the operation control. In some embodiments, when no scene is selected for the interaction between the user and the digital assistant, the interaction window includes one or more predetermined operation controls. The predetermined operation control may be, for example, an operation control pre-set by a user or a relevant staff member (e.g., a creator of a digital assistant and / or an application). The predetermined operation control may also be an operation control determined by the terminal device 110 based on the historical interaction between the user and the digital assistant. The terminal device 110 may provide at least one first operation control associated with the first scene in a group of scenes in response to the first scene in the group of scenes being selected for the interaction between the user and the digital assistant. The "first scene" here refers to any scene selected for interaction in a group of scenes. At least one of the scenarios is configured to perform a task related to the corresponding scenario, and at least one first operation control is respectively configured to trigger a corresponding operation for interaction. It should be noted that the predetermined operation control and the operation control corresponding to the scenario here include an operation control (such as a system component) that can be provided by the terminal device 110, or a specific operation control developed and / or defined by the user.

[0075] Regarding the specific manner of providing at least one first operation control, in some embodiments, if the first scene is selected for the user's interaction with the digital assistant, the terminal device 110 may place at least one first operation control before at least one predetermined operation control in the interactive window. The at least one predetermined operation control here may be all predetermined operation controls of one or more predetermined operation controls included in the interactive window. Exemplarily, if the terminal device 110 presents three predetermined operation controls in the session window when no scene is selected, and the configuration information of the first scene indicates two first operation controls associated with the first scene, then when the first scene is selected, the terminal device 110 may place the two first operation controls corresponding to the first scene before the three predetermined operation controls in the interactive window. That is, the terminal device 110 switches from presenting three predetermined operation controls to presenting five operation controls, and these five operation controls include two first operation controls and three predetermined operation controls. Alternatively or additionally, the at least one predetermined operation control here may also be a partial predetermined operation control of one or more predetermined operation controls included in the interactive window. Exemplarily, if the terminal device 110 presents three predetermined operation controls in the conversation window when no scene is selected, and the configuration information of the first scene indicates two first operation controls associated with the first scene, then when the first scene is selected, the terminal device 110 can place the two first operation controls corresponding to the first scene between the first predetermined operation control and the second predetermined operation control in the interaction window. In this case, the two first operation controls are placed before the two predetermined operation controls and after the one predetermined operation control in the interaction window. Note that the specific numbers of operation controls listed here and below are examples only.

[0076] In some embodiments, if the sum of the number of one or more predetermined operation controls and the number of at least one first operation control is large, the terminal device 110 may only present a few operation controls that are ranked first. Exemplarily, if the terminal device 110 presents 3 predetermined operation controls in the session window when no scene is selected, and the configuration information of the first scene indicates 3 first operation controls associated with the first scene, then the sum of the number of one or more predetermined operation controls and the number of at least one first operation control is 6. In order to ensure the simplicity of the session window, the terminal device 110 may only present the top 3 operation controls of the 6 operation controls. The terminal device 110 may present the other 3 operation controls of the 6 operation controls in response to detecting a sliding operation or any other appropriate operation. In some embodiments, the terminal device 110 may determine that the ranking of at least one first operation control is high to give priority to presenting at least one first operation control.

[0077] In some embodiments, if the first scene is selected for the user's interaction with the digital assistant, the terminal device 110 may also replace at least one of the one or more predetermined operation controls with at least one first operation control. Exemplarily, if the terminal device 110 presents three predetermined operation controls in the session window when no scene is selected, and the configuration information of the first scene indicates two first operation controls associated with the first scene, then when the first scene is selected, the terminal device 110 may replace two of the three predetermined operation controls with two first operation controls corresponding to the first scene. That is, the terminal device 110 switches from presenting three predetermined operation controls to presenting two first operation controls and one predetermined operation control. In some embodiments, the terminal device 110 may also replace at least one of the one or more predetermined operation controls with only part of the operation controls in at least one first operation control. For example, if the terminal device 110 presents three predetermined operation controls in the session window when no scene is selected, and the configuration information of the first scene indicates two first operation controls associated with the first scene, then when the first scene is selected, the terminal device 110 can replace one of the three predetermined operation controls with one of the two first operation controls corresponding to the first scene. That is, the terminal device 110 switches from presenting three predetermined operation controls to presenting one first operation control and two predetermined operation controls.

[0078] In some embodiments, the terminal device 110 may present an operation bar (also referred to as a function island, island, operation island, etc.) in the conversation window. The terminal device 110 may present at least one operation control in the operation bar that can be used for the user to interact with the digital assistant. For the convenience of description, the following exemplary description is given by taking at least one operation control (such as one or more predetermined operation controls, at least one first operation control associated with the first scene, etc.) being presented in the operation bar as an example. When no scene is selected for the user to interact with the digital assistant, the terminal device 110 may present one or more predetermined operation controls (sometimes also referred to as default operation controls) in the operation bar. For example, Figure 2As shown, the interface 200 may be an interface in which no scene is selected for the user's interaction with the digital assistant. The terminal device 110 may present an operation bar 210 in the interface 200, and may present one or more predetermined operation controls (e.g., predetermined operation controls 211, predetermined operation controls 212, and predetermined operation controls 213) in the operation bar 210. The terminal device 110 may, for example, in response to detecting a trigger operation on the predetermined operation control 211, obtain any appropriate type of data item (e.g., text, image, video, etc.) input by the user. The terminal device 110 may, for example, in response to detecting a trigger operation on the predetermined operation control 212, obtain user audio. The device 110 may, for example, in response to detecting a trigger operation on the predetermined operation control 213, present an input panel, and obtain text information input by the user via the input panel.

[0079] In response to the first scene being selected for the user's interaction with the digital assistant, the terminal device 110 may present at least one first operation control associated with the first scene in the operation bar. Due to the limited size of the operation bar, the terminal device 110 may replace at least one predetermined operation control among one or more predetermined operation controls in the operation bar with at least one first operation control. In some embodiments, in order to ensure the convenience of the user's operation in the scene, the terminal device 110 may preferentially replace at least one predetermined operation control in the front of the operation bar with the operation control corresponding to the scene. For example, if there is only one first operation control, the terminal device 110 may replace the first predetermined operation control in the operation bar with the first operation control.

[0080] The terminal device 110 can then respond to the triggering operation of the first operation control in at least one first operation control in the interactive window (for example, in the operation bar of the interactive window) to perform the operation corresponding to the first operation control. FIG. 4A to FIG. 8C To describe specific examples of the subsequent interactions and the situation where some example scenarios are selected, the terminal device 110 replaces one or more predetermined operation controls in the operation bar with one or more operation controls associated with the selected scenarios. The description of these examples is only to facilitate understanding of the example embodiments of the present disclosure, and these specific scenarios and the specific operation controls given are all examples.

[0081] In some embodiments, at least one first operation control associated with the first scene may include an input control for inputting information of a corresponding type. Taking the selected first scene as the scene "content understanding" as an example, the terminal device 110 can determine that the scene "content understanding" is only associated with one operation control based on the configuration information of the scene "content understanding". The operation control can be, for example, an input control for receiving information of a file type. For the convenience of description, the following will also be described exemplarily by taking the example that the selected scene is only associated with one operation control. The terminal device 110 can select from the displayed scene such as Figure 2 The interface 200 shown switches to present the following Figure 4A The interface 400A shown in FIG. 400A. The operation bar 410 in the interface 400A may correspond to the operation bar 210 in the interface 200. The operation bar 410 presents an operation control 411 corresponding to the scenario "content understanding" and two predetermined operation controls. The operation control 411 may be, for example, an input control for receiving information of a file type (also referred to as a file). In response to receiving a trigger operation on the operation control 411, the terminal device 110 may present a Figure 4B Interface 400B is shown.

[0082] At least one file may be presented in the interface 400B. The terminal device 110 may also present more files in response to detecting a sliding operation (e.g., an upward sliding operation, a downward sliding operation, etc.) in the interface 400B. In some embodiments, the terminal device 110 may also present a search entry 420 in the interface 400B. In response to receiving a user input through the search entry 420, the terminal device 110 queries for files that match the user input, and presents the queried files in the interface 400B. In some embodiments, if no file matching the user input is found, the terminal device 110 may also present a prompt message in the interface 400B to indicate that no file has been found.

[0083] For example, the terminal device 110 may determine that a user input including at least one file is received in response to detecting a selection operation on at least one file in the interface 400B. The terminal device 110 may switch back to presenting the conversation window between the user and the digital assistant. For example, the terminal device 110 may present the following: Figure 4C The interface 400C shown. Figure 4CAs shown, the terminal device 110 may present an input panel in the interface 400C. The input panel includes an input box 430. The terminal device 110 may present at least one received file (that is, at least one file selected by the user in the interface 400B) in the input box 430. The terminal device 110 may also present a cancel control associated with at least one file (the file and the cancel control may be, for example, in a one-to-one correspondence). For example, if the terminal device 110 receives only one file, file 401, the terminal device 110 may present a cancel control 402 associated with the file 401. In response to receiving a selection operation on the cancel control 402, the terminal device 110 may delete the file 401 in the input box 430, that is, delete the received file 401. The terminal device 110 may receive user input via the input box 430. In the case where the received file is presented in the input box 430, the terminal device 110 may receive an instruction input by the user indicating an operation on the file via the input box 430. The terminal device 110 may also present a recommended instruction for the received file in the input box 430, for example. The recommended instruction may be pre-set by the user and / or relevant staff, or may be determined by the terminal device 110 itself. The terminal device 110 may present the control 403 in the input box 430. In response to detecting a trigger operation on the control 403, the terminal device 110 may perform an operation on the received file based on the recommended instruction in the input box 430. For example, the terminal device 110 may present a recommended instruction "Summarize the outline of the document" in the input box 430. In response to detecting a trigger operation on the control 403, the terminal device 110 may perform an operation on the file 401 based on the recommended instruction "Summarize the outline of the document".

[0084] Taking the first scene selected as the scene "image processing" as an example, the terminal device 110 can determine that the scene "image processing" is associated with only one operation control based on the configuration information of the scene "image processing". The operation control can also be an input control for receiving information about the file type. The terminal device 110 can select the scene "image processing" from the display. Figure 2 The interface 200 shown switches to present the following Figure 5A The interface 500A shown in FIG. 5A is a diagram of an operation bar 510 in the interface 500A. The operation bar 510 may correspond to the operation bar 210 in the interface 200. The operation bar 510 presents an operation control 511 corresponding to the scene "image processing" and two predetermined operation controls. The operation control 511 may be, for example, an input control for receiving information of an image type (also referred to as an image). In response to receiving a trigger operation on the operation control 511, the terminal device 110 may present a Figure 5B Interface 500B is shown.

[0085] At least one image may be presented in the interface 500B. The terminal device 110 may also present more images in response to detecting a sliding operation in the interface 500B. For example, the terminal device 110 may determine that a user input including the at least one image is received in response to detecting a selection operation on at least one image in the interface 500B. In order to prevent the user from accidentally touching, in some embodiments, the terminal device 110 may also present an operation control 520 in the interface 500B. After the terminal device 110 receives a selection operation on at least one image, it determines that a user input including the at least one image is received only when a trigger operation on the operation control 520 is received.

[0086] The terminal device 110 may switch back to presenting the conversation window between the user and the digital assistant. For example, the terminal device 110 may present the following Figure 5C Interface 500C shown. Figure 5C As shown, the terminal device 110 can present an input panel in the interface 500C. The input panel includes an input box 530. The terminal device 110 can present at least one received image (that is, at least one image selected by the user in the interface 500B) in the input box 530. The terminal device 110 can also present a cancel control associated with at least one image (the image and the cancel control can be, for example, in a one-to-one correspondence). In response to receiving a selection operation for the cancel control, the terminal device 110 can delete the corresponding image in the input box 530. The terminal device 110 can receive user input via the input box 530. In the case where the received image is presented in the input box 530, the terminal device 110 can receive an instruction input by the user indicating an operation for the image via the input box 530. The terminal device 110 can also present a recommended instruction for the received image in the input box 530, for example. Similarly, the recommended instruction can be preset by the user and / or relevant staff, or can be determined by the terminal device 110 itself. The terminal device 110 can present the control 501 in the input box 530. In response to detecting a trigger operation on the control 501, the terminal device 110 may perform an operation on the received image based on the recommended instruction in the input box 530. For example, the terminal device 110 may present a recommended instruction "Describe these pictures" in the input box 530. In response to detecting a trigger operation on the control 501, the terminal device 110 may perform an operation on the received image based on the recommended instruction "Describe these pictures".

[0087] In some embodiments, at least one first operation control associated with the first scenario may also include a shortcut command control for triggering a shortcut command for interacting with the digital assistant in the first scenario. The shortcut command here may be pre-set by the user and / or relevant staff, or may be determined by the terminal device 110 itself.

[0088] Taking the first selected scene as the scene "schedule management" as an example, the terminal device 110 can determine that the scene "schedule management" is associated with only one operation control based on the configuration information of the scene "schedule management". The operation control can be, for example, a shortcut command control for triggering a shortcut command for interacting with the digital assistant in the scene "schedule management". The terminal device 110 can select from the display such as Figure 2 The interface 200 shown switches to present the following Fig. 6A Interface 600A shown. The operation bar 610 in interface 600A may correspond to the operation bar 210 in interface 200. The operation bar 610 presents an operation control 611 corresponding to the scene “schedule management” and two predetermined operation controls. The operation control 611 may, for example, be a shortcut command control for triggering a shortcut command for interacting with a digital assistant under the scene “schedule management”. The terminal device 110 may determine, in response to receiving a trigger operation on the operation control 611, that a shortcut command for interacting with a digital assistant under the scene “schedule management” has been received.

[0089] The terminal device 110 may switch back to presenting the conversation window between the user and the digital assistant. For example, the terminal device 110 may present the following Figure 6B Interface 600B shown. Figure 6B As shown, the terminal device 110 can present an input panel in the interface 600B. The input panel includes an input box 620. The terminal device 110 can present the received shortcut command (i.e., the command "help me create a schedule") in the input box 620. The terminal device 110 can also present prompt information related to the shortcut command in the input box 620. For example, the terminal device 110 can present the prompt information "You can @specify participants" in the input box 620. The terminal device 110 can perform corresponding operations based on the received shortcut command and the text entered by the user based on the prompt information.

[0090] Taking the first selected scene as the scene "task management" as an example, the terminal device 110 can determine that the scene "task management" is associated with only one operation control based on the configuration information of the scene "task management". The operation control can be, for example, a shortcut command control for triggering a shortcut command for interacting with the digital assistant in the scene "task management". The terminal device 110 can select from the display such as Figure 2 The interface 200 shown switches to present the following Fig. 7AInterface 700A shown. The operation bar 710 in interface 700A may correspond to the operation bar 210 in interface 200. The operation bar 710 presents an operation control 711 corresponding to the scene "task management" and two predetermined operation controls. The operation control 711 may, for example, be a shortcut command control for triggering a shortcut command for interacting with a digital assistant under the scene "task management". The terminal device 110 may determine that a shortcut command for interacting with a digital assistant under the scene "task management" has been received in response to receiving a trigger operation on the operation control 711.

[0091] The terminal device 110 may switch back to presenting the conversation window between the user and the digital assistant. For example, the terminal device 110 may present the following Figure 7B Interface 700B shown. Figure 7B As shown, the terminal device 110 can present an input panel in the interface 700B. The input panel includes an input box 720. The terminal device 110 can present the received shortcut instruction (i.e., the instruction "help me create a task") in the input box 720. The terminal device 110 can also present prompt information related to the shortcut instruction in the input box 720. For example, the terminal device 110 can present the prompt information "you can describe the content" in the input box 720. The terminal device 110 can perform corresponding operations based on the received shortcut instruction and the text entered by the user based on the prompt information.

[0092] In some embodiments, at least one first operation control associated with the first scenario may also include a shortcut command list control for triggering a shortcut command list for interacting with the digital assistant in the first scenario. Similarly, the shortcut command list here may be pre-set by the user and / or relevant staff, or may be determined by the terminal device 110 itself.

[0093] Taking the first scene selected as the scene "painting" as an example, the terminal device 110 can determine that the scene "painting" is associated with only one operation control based on the configuration information of the scene "painting". The operation control can be, for example, a shortcut command list control for triggering a shortcut command list for interacting with the digital assistant in the scene "painting". The terminal device 110 can select from the list presented as follows: Figure 2 The interface 200 shown switches to present the following Fig. 8A Interface 800A shown. The operation bar 810 in interface 800A may correspond to the operation bar 210 in interface 200. The operation bar 810 presents an operation control 811 corresponding to the scene "painting" and two predetermined operation controls. The operation control 811 may, for example, be a shortcut command list control for triggering a shortcut command list for interacting with a digital assistant under the scene "painting". In response to receiving a trigger operation on the operation control 811, the terminal device 110 may present a shortcut command list for interacting with a digital assistant under the scene "painting".

[0094] The terminal device 110 may present, for example, Figure 8B Interface 800B shown. Interface 800B may present a shortcut command list 820 for interacting with a digital assistant in the scene "painting", and the shortcut command list 820 includes at least one shortcut command. For example, the terminal device 110 may determine that the one or more shortcut commands are received in response to detecting a selection operation on one or more shortcut commands in interface 800B.

[0095] In response to receiving one or more shortcut instructions, the terminal device 110 may switch back to presenting the conversation window between the user and the digital assistant. Figure 8C The interface 800C shown. Figure 8C As shown, the terminal device 110 can present an input panel in the interface 800C. The input panel includes an input box 830. The terminal device 110 can present the received shortcut command (for example, the command "style 1") in the input box 830. The terminal device 110 can also present prompt information related to the shortcut command in the input box 830. For example, the terminal device 110 can present the prompt information "XX object" in the input box 830. The terminal device 110 can perform corresponding operations based on the received shortcut command and the text entered by the user based on the prompt information.

[0096] It can be understood that the at least one first operation control associated with the first scene may include one or more of the input controls for corresponding types of information input, shortcut control, and shortcut list control described above. The present disclosure does not limit the at least one first operation control associated with the first scene.

[0097] In some embodiments, in addition to responding to the new topic guide message 202 and / or in Figure 3 In addition to receiving a selection of the first scene in the interface 300 shown and providing at least one first operation control associated with the first scene in the interactive window (that is, in addition to interacting in a new topic), the terminal device 110 can also switch the presentation of at least one first operation control based on the user's operation in the current topic.

[0098] In some embodiments, in any topic (e.g., the first topic), the terminal device 110 can perform interaction with the user in the conversation window between the user and the digital assistant based on the currently selected scene (e.g., the first scene) in the first topic. Specifically, the digital assistant in the terminal device 110 can analyze the conversation message from the user in the conversation window based on the configuration information of the first scene, and present a reply message to the conversation message from the user in the conversation window. The digital assistant can, for example, understand the user input with the help of a model, and provide a reply to the user based on the output of the model.

[0099] In some embodiments, the terminal device 110 may also determine whether the type of task corresponding to the current scene matches the task indicated by the conversation message from the user (it may also be referred to as determining whether the current scene matches the conversation message). Taking the case of receiving the first conversation message of the user in the first scene as an example, the terminal device 110 may, for example, determine the first task type corresponding to the first scene based on the configuration information of the first scene, and then determine whether the task indicated by the first conversation message matches the first task type. In the case where the task indicated by the first conversation message does not match the type of task corresponding to the first scene (it may also be referred to as the first conversation message does not match the first scene), the terminal device 110 may further perform intent recognition based on the configuration information of other scenes and the first conversation message of the user to determine a suitable scene (e.g., the second scene). For example, the terminal device 110 may directly switch to the second scene after determining the second scene matching the first conversation message in response to the first conversation message not matching the first scene. The terminal device 110 may, for example, also present scene switching guide information in the conversation window. The scene switching guide information is used to indicate switching from the first scene to the second scene to perform the task indicated by the first conversation message. For example, the terminal device 110 may present a switching entry for the second scene in the scene switching guide information. The terminal device 110 may switch from the first scene to the second scene in response to detecting a triggering operation on the switching entry.

[0100] Alternatively or additionally, the terminal device 110 may also directly present the scene selection control in the session window. The terminal device 110 may, for example, present at least one scene in response to detecting a trigger operation on the scene selection control. The terminal device 110 may further switch from the first scene to the second scene in response to receiving a selection operation on one of the at least one scenes (e.g., the second scene).

[0101] In response to switching from the first scene to the second scene, the terminal device 110 may replace at least one first operation control associated with the first scene with at least one second operation control associated with the second scene in the session window. Exemplarily, if the first scene is selected, the terminal device 110 presents 1 first operation control and 2 predetermined operation controls in the session window, then in response to switching from the first scene to the second scene, the terminal device 110 may switch the first operation control to the second operation control. For example, the terminal device 110 may switch to presenting 1 second operation control and 2 predetermined operation controls in the session window.

[0102] Since there is a situation where the number of at least one first operation control and the number of at least one second operation control are not equal, in some embodiments, if the number of at least one first operation control is less than the number of at least one second operation control, the terminal device 110 can replace at least one predetermined operation control with one or more extra second operation controls so that at least one second operation control associated with the second scene is presented in the session window. For example, if the number of first operation controls is 1 and the number of second operation controls is 2, the terminal device 110 can replace the first operation control with one second operation control and replace one predetermined operation control with another second operation control.

[0103] In some embodiments, if the number of at least one first operation control is greater than the number of at least one second operation control, the terminal device 110 may replace at least one first operation control with at least one second operation control, and replace the remaining one or more first operation controls with at least one other predetermined operation control. For example, if the number of first operation controls is 2 and the number of second operation controls is 1, the terminal device 110 may replace one first operation control with one second operation control, and replace another first operation control with one of the at least one predetermined operation controls previously replaced by the first operation control.

[0104] In some embodiments, when the first scene is selected, the terminal device 110 can also detect the first task instance in the first scene initiated by the user in the interaction between the user and the digital assistant, and provide at least one operation control associated with the first task instance in the interaction window. The terminal device 110 can, for example, analyze the conversation message (e.g., the first conversation message) from the user to determine the first task instance indicated by the first conversation message, and determine at least one operation control associated with the first task instance. The terminal device 110 can, for example, replace at least one first operation control associated with the first scene with at least one operation control associated with the first task instance in the interaction window. The terminal device 110 can also, for example, present at least one operation control associated with the first task instance while presenting at least one first operation control. Similar to the scene switching, the terminal device 110 can also replace at least one operation control associated with the first task instance previously presented with at least one operation control associated with the second task instance in response to detecting the second task instance in the first scene initiated by the user.

[0105] In summary, according to various embodiments of the present disclosure, during the interaction between a user and a digital assistant, an operation control associated with a scene may be presented. The digital assistant may, in response to receiving a trigger operation on the operation control, perform an operation corresponding to the operation control. This helps to reduce the difficulty and complexity of the interaction between the user and the digital assistant and improve the efficiency of the interaction.

[0106] It should be understood that some embodiments of the present disclosure are described above in conjunction with the specific examples in the drawings, but these specific examples do not limit the scope of the embodiments of the present disclosure. The described embodiments can also be implemented in various other variations.

[0107] It should be understood that Figures 2 to 8C The interface shown is only an example interface, and various interface designs may exist in practice. The various graphical elements in the interface may have different arrangements and different visual representations, one or more of which may be omitted or replaced, and one or more other elements may also exist. The embodiments of the present disclosure are not limited in this respect.

[0108] Fig. 9 FIG. 9 is a flowchart of a process 900 for information interaction according to some embodiments of the present disclosure. The process 900 may be implemented at the terminal device 110. Figure 1 Process 900 is described.

[0109] In box 910, in the interaction window between the user and the digital assistant, in response to a first scene in a group of scenes being selected for interaction between the user and the digital assistant, the terminal device 110 provides at least one first operation control associated with the first scene in the interaction window, wherein at least one scene in the group of scenes is configured to perform a task related to the corresponding scene, and the at least one first operation control is respectively configured to trigger a corresponding operation for interaction.

[0110] In some embodiments, at least one scene in a group of scenes is configured with configuration information, and the configuration information includes at least one of the following: scene setting information and plug-in information, wherein the scene setting information is used to describe information related to the corresponding scene, and the plug-in information indicates at least one plug-in used to perform a task in the corresponding scene.

[0111] In some embodiments, providing at least one first operation control associated with a first scene in the interaction window includes: in response to the first scene being selected for user interaction with the digital assistant, placing the at least one first operation control before at least one predetermined operation control in the interaction window.

[0112] In some embodiments, the interaction window includes one or more predetermined operation controls when no scene is selected for interaction between the user and the digital assistant, and wherein providing at least one first operation control associated with the first scene in the interaction window includes: in response to the first scene being selected for interaction between the user and the digital assistant, replacing at least one of the one or more predetermined operation controls with at least one first operation control.

[0113] In some embodiments, at least one first operation control associated with the first scene includes at least one of the following: an input control for inputting information of a corresponding type, a shortcut control for triggering shortcut commands for interacting with the digital assistant in the first scene, and a shortcut list control for triggering a shortcut command list for interacting with the digital assistant in the first scene.

[0114] In some embodiments, process 900 further includes: in response to switching from the first scene to the second scene, replacing at least one first operation control associated with the first scene with at least one second operation control associated with the second scene in the interactive window.

[0115] In some embodiments, the configuration information of the first scene indicates at least one first operation control associated with the first scene.

[0116] In some embodiments, process 900 further includes: in response to a triggering operation on a first operation control of at least one first operation control in the interactive window, executing an operation corresponding to the first operation control.

[0117] In some embodiments, process 900 also includes: when the first scenario is selected, detecting a first task instance in the first scenario initiated by the user in the interaction between the user and the digital assistant; and providing at least one operation control associated with the first task instance in the interaction window.

[0118] In some embodiments, process 900 also includes: in response to receiving a scene creation operation, providing a first page for creating a target scene; obtaining target configuration information of the target scene via the first page, the target configuration information indicating at least one operation control associated with the target scene; and in response to receiving a creation confirmation operation, creating the target scene based on the obtained target configuration information.

[0119] Fig.10 A block diagram of an apparatus 1000 for information interaction according to some embodiments of the present disclosure is shown. The apparatus 1000 may be implemented in or included in a terminal device 110, for example. Each module / component in the apparatus 1000 may be implemented by hardware, software, firmware, or any combination thereof.

[0120] As shown in the figure, the device 1000 includes a control presentation module 1010, which is configured to provide at least one first operation control associated with the first scene in the interaction window between the user and the digital assistant, in response to a first scene in a group of scenes being selected for interaction between the user and the digital assistant, wherein at least one scene in the group of scenes is configured to perform a task related to the corresponding scene, and at least one first operation control is respectively configured to trigger a corresponding operation for interaction.

[0121] In some embodiments, at least one scene in a group of scenes is configured with configuration information, and the configuration information includes at least one of the following: scene setting information and plug-in information, wherein the scene setting information is used to describe information related to the corresponding scene, and the plug-in information indicates at least one plug-in used to perform a task in the corresponding scene.

[0122] In some embodiments, the control presentation module 1010 is further configured to: in response to the first scene being selected for user interaction with the digital assistant, place at least one first operation control before at least one predetermined operation control in the interaction window.

[0123] In some embodiments, the interaction window includes one or more predetermined operation controls when no scenario is selected for user interaction with the digital assistant, and the control presentation module 1010 is further configured to: in response to a first scenario being selected for user interaction with the digital assistant, replace at least one of the one or more predetermined operation controls with at least one first operation control.

[0124] In some embodiments, at least one first operation control associated with the first scene includes at least one of the following: an input control for inputting information of a corresponding type, a shortcut control for triggering shortcut commands for interacting with the digital assistant in the first scene, and a shortcut list control for triggering a shortcut command list for interacting with the digital assistant in the first scene.

[0125] In some embodiments, the device 1000 also includes: a control replacement module, configured to replace at least one first operation control associated with the first scene with at least one second operation control associated with the second scene in the interactive window in response to switching from the first scene to the second scene.

[0126] In some embodiments, the configuration information of the first scene indicates at least one first operation control associated with the first scene.

[0127] In some embodiments, the device 1000 further includes: an operation execution module configured to execute an operation corresponding to the first operation control in response to a triggering operation on a first operation control of at least one first operation control in the interactive window.

[0128] In some embodiments, the device 1000 also includes: a task detection module, configured to detect a first task instance in a first scenario initiated by a user in the interaction between the user and the digital assistant when the first scenario is selected; and a control providing module, configured to provide at least one operation control associated with the first task instance in the interaction window.

[0129] In some embodiments, the device 1000 also includes: a page providing module, configured to provide a first page for creating a target scene in response to receiving a scene creation operation; an information acquisition module, configured to acquire target configuration information of the target scene via the first page, the target configuration information indicating at least one operation control associated with the target scene; and a scene creation module, configured to create a target scene based on the acquired target configuration information in response to receiving a creation confirmation operation.

[0130] It should be understood that one or more steps in the above method can be performed by a suitable electronic device or a combination of electronic devices. Such an electronic device or a combination of electronic devices may include, for example, Figure 1 The server 130, the terminal device 110 and / or the combination of the server 130 and the terminal device 110.

[0131] Fig.11 1 shows a block diagram of an electronic device 1100 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Fig.11The electronic device 1100 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Fig.11 The electronic device 1100 shown can be used to implement Figure 1 The terminal device 110 and / or Fig.10 The device 1000 is shown.

[0132] like Fig.11 As shown, the electronic device 1100 is in the form of a general electronic device. The components of the electronic device 1100 may include, but are not limited to, one or more processors or processing units 1110, a memory 1120, a storage device 1130, one or more communication units 1140, one or more input devices 1150, and one or more output devices 1160. The processing unit 1110 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 1120. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 1100.

[0133] The electronic device 1100 typically includes a plurality of computer storage media. Such media may be any available media accessible to the electronic device 1100, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1120 may be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1130 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data and may be accessed within the electronic device 1100.

[0134] The electronic device 1100 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig.11 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. Memory 1120 may include a computer program product 1125 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0135] The communication unit 1140 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 1100 can be implemented in a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 1100 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0136] The input device 1150 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 1160 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 1100 may also communicate with one or more external devices (not shown) through the communication unit 1140 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 1100, or communicate with any device that allows the electronic device 1100 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0137] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0138] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0139] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0140] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0141] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0142] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A method for information interaction, include: In an interaction window between a user and a digital assistant, in response to a first scene in a group of scenes being selected for interaction between the user and the digital assistant, at least one first operation control associated with the first scene is provided in the interaction window, At least one scene in the group of scenes is configured to perform a task related to the corresponding scene, and the at least one first operation control is respectively configured to trigger a corresponding operation for the interaction.

2. The method according to claim 1, in, At least one scene in the group of scenes is configured with configuration information, and the configuration information includes at least one of the following: scene setting information and plug-in information, wherein the scene setting information is used to describe information related to the corresponding scene, and the plug-in information indicates at least one plug-in used to perform a task in the corresponding scene.

3. The method according to claim 1, wherein at least one first operation control associated with the first scene is provided in the interactive window include: In response to the first scene being selected for the user's interaction with the digital assistant, the at least one first operation control is placed before at least one predetermined operation control in the interaction window.

4. The method according to claim 1, wherein the interaction window includes one or more predetermined operation controls when no scenario is selected for the user's interaction with the digital assistant, and wherein at least one first operation control associated with the first scenario is provided in the interaction window include: In response to the first scenario being selected for the user's interaction with the digital assistant, at least one predetermined operation control among the one or more predetermined operation controls is replaced with the at least one first operation control.

5. The method according to claim 1, wherein the at least one first operation control associated with the first scene comprises at least one of the following: Input controls for entering information of the corresponding type, A shortcut command control, used to trigger a shortcut command for interacting with the digital assistant in the first scenario, A shortcut command list control, used to trigger a shortcut command list for interacting with the digital assistant in the first scenario.

6. The method according to claim 1, further comprising: include: In response to switching from the first scene to the second scene, the at least one first operation control associated with the first scene is replaced with at least one second operation control associated with the second scene in the interactive window. 7 . The method according to claim 1 , wherein the configuration information of the first scene indicates the at least one first operation control associated with the first scene.

8. The method according to claim 1, further comprising: include: In response to a triggering operation on a first operation control among the at least one first operation control in the interactive window, an operation corresponding to the first operation control is executed.

9. The method according to claim 1, further comprising: include: In the case where the first scenario is selected, detecting a first task instance under the first scenario initiated by the user in the interaction between the user and the digital assistant; as well as At least one operation control associated with the first task instance is provided in the interactive window.

10. The method according to claim 1, further comprising: include: In response to receiving a scene creation operation, providing a first page for creating a target scene; Acquire, via the first page, target configuration information of the target scene, the target configuration information indicating at least one operation control associated with the target scene; as well as In response to receiving the creation confirmation operation, the target scene is created based on the acquired target configuration information.

11. A device for information interaction, include: a control presentation module configured to, in an interaction window between a user and a digital assistant, in response to a first scene in a group of scenes being selected for interaction between the user and the digital assistant, provide at least one first operation control associated with the first scene in the interaction window; At least one scene in the group of scenes is configured to perform a task related to the corresponding scene, and the at least one first operation control is respectively configured to trigger a corresponding operation for the interaction.

12. An electronic device, include: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 10 when executed by the at least one processing unit.

13. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 10.

Citation Information

Patent Citations

  • A terminal control method and device

    CN109684006A

  • Method for adaptively generating card, terminal equipment and server

    CN113761427A