Method and device for session interaction, equipment and storage medium

Abstract

The embodiment of the invention provides a session interaction method and device, equipment and a storage medium. The method includes receiving a user's selection of one or more target digital assistants in a target session, the one or more target digital assistants being not members of the target session, and the members of the target session including a plurality of digital assistants; presenting a first message sent by the user in the target session; and presenting one or more reply messages for the first message sent by the one or more target digital assistants, respectively. Therefore, the user can select the digital assistant which does not belong to the session to reply the message sent by the user, so that the convenience of interaction between the user and the digital assistant is improved.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for conversation interaction. Background Art

[0002] With the development of information technology, various terminal devices can provide various services to people in work and life. Applications that provide services can be deployed in terminal devices. Terminal devices or applications can provide users with digital assistant functions to assist users in using terminal devices or applications. How to improve the flexibility of interaction between users and digital assistants is a technical issue that needs to be explored at present. Summary of the invention

[0003] In a first aspect of the present disclosure, a method for conversation interaction is provided. The method includes: receiving a user's selection of one or more target digital assistants in a target conversation, the one or more target digital assistants are not members of the target conversation, and the members of the target conversation include multiple digital assistants; presenting a first message sent by the user in the target conversation; and presenting one or more reply messages to the first message respectively sent by the one or more target digital assistants.

[0004] In a second aspect of the present disclosure, a device for conversation interaction is provided. The device includes: a selection receiving module configured to receive a user's selection of one or more target digital assistants in a target session, the one or more target digital assistants are not members of the target session, and the members of the target session include multiple digital assistants; a message presenting module configured to present a first message sent by the user in the target session; and a reply message presenting module configured to present one or more reply messages to the first message respectively sent by the one or more target digital assistants.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0010] FIG. 2A to FIG. 2F A schematic diagram showing an example interface for conversation interaction according to some embodiments of the present disclosure is shown;

[0011] FIG. 3A to FIG. 3E A schematic diagram showing an example interface for conversation interaction according to other embodiments of the present disclosure;

[0012] FIG. 4A to FIG. 4C A schematic diagram showing an example interface for conversation interaction according to yet other embodiments of the present disclosure;

[0013] FIG. 5A to FIG. 5C A schematic diagram showing an example interface for adding a digital assistant according to some embodiments of the present disclosure is shown;

[0014] 6A to 6F A schematic diagram showing an example interface for conversation interaction according to some embodiments of the present disclosure is shown;

[0015] Figure 7 A flowchart showing a process of conversation interaction according to some embodiments of the present disclosure is shown;

[0016] Figure 8 A block diagram showing an apparatus for conversation interaction according to some embodiments of the present disclosure; and

[0017] Fig. 9 A block diagram of a device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0018] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0019] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0020] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0021] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0022] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0023] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0024] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this article, and any type of embodiment may be included under any section / subsection. In addition, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0025] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0026] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0027] As briefly mentioned above, people are collaborating more and more with language model robots, and people are expanding the boundaries of their capabilities by talking to digital assistants. Currently, users can interact with digital assistants in a conversation between the user and a single digital assistant (for example, a one-on-one chat). Users can also interact with digital assistants in a conversation between the user and multiple digital assistants (for example, a group chat). However, in the above methods, the digital assistant is required to be a member of the conversation. Accordingly, in the conversation between the user and the digital assistant, the system determines the matching digital assistant based on the user's intent to reply to the user's message.

[0028] In view of this, an embodiment of the present disclosure proposes an improved scheme for conversation interaction. According to various embodiments of the present disclosure, a user's selection of one or more target digital assistants in a target conversation is received, and the one or more target digital assistants are not members of the target conversation; a first message sent by the user in the target conversation is presented; and one or more reply messages to the first message respectively sent by the one or more target digital assistants are presented. Thus, the user can select a digital assistant that is not in the conversation to reply to the message it sent, thereby improving the convenience of the user's interaction with the digital assistant.

[0029] Example Environment

[0030] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In the example environment 100, an application 120 is installed in a terminal device 110. A user 140 can interact with the application 120 via the terminal device 110 and / or an attached device of the terminal device 110.

[0031] In some embodiments, application 120 may be any suitable application that can provide query services. Figure 1 In the environment 100, if the application 120 is active, the terminal device 110 can present a page 150 of the application 120. The page 150 can include various pages that the application 120 can provide, such as a session interaction page, a query page, a search page, a search result presentation page, and the like.

[0032] In some embodiments, the terminal device 110 communicates with the server 130 to provide the service of the application 120. The terminal device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication systems (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio broadcast receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface for the user (such as "wearable" circuits, etc.). The server 130 can be various types of computing systems / servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0033] It should be understood that the structure and function of the various elements in the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0034] Some example embodiments of the present disclosure will continue to be described with reference to the accompanying drawings. It should be understood that the pages shown in the accompanying drawings are merely examples, and various page designs may actually exist. The various graphic elements in the page may have different arrangements and different visual representations, one or more of which may be omitted or replaced, and one or more other elements may also exist. The embodiments of the present disclosure are not limited in this respect. In addition, hereinafter, the example embodiments will be described primarily with respect to the terminal device 110. It should be understood that the actions described with respect to the terminal device 110 may be performed by the application 120 on the terminal device 110, or may be performed by the application 120 in collaboration with its service end (e.g., server 130).

[0035] The following references FIG. 2A to FIG. 2F , FIG. 3A to FIG. 3E ,as well as FIG. 4A to FIG. 4C Three examples describe the process of the present disclosure for conversation interaction. FIG. 2A to FIG. 2F Schematic diagrams of example interfaces 200A to 200F for conversation interaction according to some embodiments of the present disclosure are shown. FIG. 3A to FIG. 3E Schematic diagrams of example interfaces 300A to 300E for conversation interaction according to other embodiments of the present disclosure are shown. FIG. 4A to FIG. 4C Schematic diagrams of example interfaces 400A to 400C for conversation interaction according to yet other embodiments of the present disclosure are shown.

[0036] In some embodiments, terminal device 110 receives a user's selection of one or more target digital assistants in a target session. In some embodiments, one or more digital assistants are not members of the target session, and the target session includes multiple digital assistants. In some examples, user 140 can select one or more digital assistants that are not members of the target session in the target session (e.g., a session between user 140 and a preset digital assistant) to reply to a message sent by user 140.

[0037] In some embodiments, the terminal device 110 may receive the user's selection of one or more digital assistants in the target session in the following manner. The terminal device 110 presents a selection control for at least one digital assistant in the interface of the target session. Then, the terminal device 110 receives a trigger operation for the corresponding selection control of one or more target digital assistants in the at least one digital assistant.

[0038] like Figure 2A In the example interface 200A shown, the terminal device 110 presents a selection control 212 for assistant A, a selection control 213 for assistant B, a selection control 214 for assistant C, a selection control 215 for assistant D, and the like in the interface of the target session. In some examples, the terminal device 110 may also present a selection control 212 for assistant A, a selection control 213 for assistant B, a selection control 214 for assistant C, and the like in the operation bar 211 included in the interface of the target session. For the selection controls 212 for assistant A, 213 for assistant B, 214 for assistant C, 215 for assistant D, and the like presented by the terminal device 110, the user 140 may click on the above selection controls to select one or more target digital assistants.

[0039] In some embodiments, if the terminal device 110 receives a trigger operation for a selection control corresponding to one or more target digital assistants, the corresponding selection control of the one or more target digital assistants may be presented in a predetermined style. In some examples, when the terminal device 110 supports the user 140 to select one or more digital assistants, if the user 140 clicks the selection control of assistant A and the selection control of digital assistant B, assistant A and assistant B are in the selected state, and the send button is activated. FIG. 2A to FIG. 2B In the example interfaces 200A to 200B shown, if the terminal device 110 receives that the user 140 clicks on the selection control 212 of assistant A and the selection control 213 of assistant B, the selection control 212 of assistant A and the selection control 213 of assistant B are highlighted. For example, the selection control 212 and the selection control 213 are filled with different colors or patterns.

[0040] In other examples, when the terminal device 110 supports the user 140 to select a digital assistant, if the user 140 clicks the selection control of assistant A, assistant A is in the selection state, and the send button of the input box 321 is activated. FIG. 3A to FIG. 3B In the example interfaces 300A to 300B shown, if the terminal device 110 receives an instruction from the user 140 to click on the selection control 312 of assistant A, the selection control 312 of assistant A may be presented in the input box 321.

[0041] In some embodiments, user 140 can cancel the selected target digital assistant at any time, and the canceled target digital assistant will no longer reply to the message of user 140. Figure 2B to Figure 2C In the example interfaces 200B to 200C shown, if the user 140 clicks the close control 221 for assistant B, the selection of assistant B is canceled. Figure 3B In the example interface 300B shown, if the user 140 clicks the close control 322 regarding assistant A, the selection of assistant A is canceled.

[0042] In some embodiments, when user 140 selects one or more target digital assistants, if the user clicks the input box, terminal device 110 only presents identification information of one or more target digital assistants in the area above the input box. Figure 2D In the example interface 200D shown, when the user 140 selects assistant A and assistant B, if the user 140 clicks the input box 241 , the terminal device 110 presents the identification information of assistant A and assistant B in the upper area 245 of the input box 241 .

[0043] In some embodiments, after the user 140 selects one or more target digital assistants, the terminal device 110 may display prompt information in the input box included in the interface of the target session. For example, if the terminal device 110 selects a digital assistant for the user 140, the prompt information that may be displayed may be “Say to XX assistant…” If the terminal device 110 selects two digital assistants for the user 140, the prompt information that may be displayed may be “Say to XX assistant and XXX assistant…” If the terminal device 110 selects multiple digital assistants for the user 140, the prompt information that may be displayed may be “Say to XX assistant, XXX assistant, etc…” If the name of the digital assistant selected by the user 140 is long, the prompt information that may be displayed by the terminal device 110 may be “Say to XX assistant, XXX…” Figure 2B As shown, if the user 140 selects assistant A and assistant B, the terminal device 110 displays "Send to assistant A and assistant B..." in the input box 223. Figure 3B As shown, if the user 140 selects assistant A, the terminal device 110 displays "Send to assistant A" or "Say to assistant A" in the input box 321.

[0044] In some embodiments, the terminal device 110 presents the first message sent by the user in the target session. In some embodiments, the terminal device 110 may present the first message sent by the user in the target session in the following manner. The terminal device 110 receives user input for one or more target digital assistants. Subsequently, for a send operation input by the user, the terminal device 110 presents the user input and the mention information of the one or more target digital assistants as the first message.

[0045] In some examples, after selecting one or more target digital assistants, user 140 can enter a message in the input box. Then, if the terminal device 110 receives a message from user 140 clicking the send button to send the message entered by the user 140, the mention information for one or more digital assistants (for example, @XX assistant) and the message entered by the user in the input box are presented in the interface of the target session. In some embodiments, the mention information of one or more digital assistants presented by the terminal device 110 in the interface of the target session may be: the mention information automatically generated by the terminal device 110 after receiving the message from user 140 clicking the send button. In some embodiments, the terminal device 110 may display the mention information at the forefront of the first message.

[0046] like FIG. 2D to FIG. 2E In the example interfaces 200D to 200E shown, after selecting Assistant A and Assistant B, the user 140 can enter a message 242 in the input box. Then, if the terminal device 110 receives a message 251 from the user 140 clicking the send button 221 to send the message 242 entered by the user 140, the message 251 is presented in the interface of the target session. The message 251 includes the mention information 254 "@Assistant A @Assistant B" automatically generated by the terminal device 110 and the message 242 entered by the user 140.

[0047] like FIG. 3C to FIG. 3D In the example interfaces 300C to 300D shown, after selecting assistant A, user 140 can enter a message 332 in input box 321. Then, if terminal device 110 receives a message 332 input by user 140 by clicking the send button, the message 341 is presented in the interface of the target session. Message 341 includes the mention information 343 "@assistant A" automatically generated by terminal device 110 and the message 322 input by user 140.

[0048] In some embodiments, the mention information is presented in the first message in a preset style, and the preset style is associated with the number of one or more target digital assistants. The terminal device 110 may present the mention information for one or more target digital assistants in a preset style. In some examples, the terminal device 110 may present the mention information in an eye-catching style, such as bold text and bold ordinary text. In some examples, if the user 140 selects a digital assistant, the terminal device 110 may present the mention information about the digital assistant at the forefront of the first message. If the user 140 selects multiple digital assistants, the terminal device 110 may present multiple mention information about the multiple digital assistants at the forefront of the first message.

[0049] In some embodiments, the terminal device 110 may also present the first message sent by the user in the target session in another manner as follows: If the terminal device 110 receives the user's selection of one or more target digital assistants among the at least one digital assistant, the terminal device 110 presents the first message respectively mentioning the one or more target digital assistants.

[0050] In some examples, after user 140 selects one or more target digital assistants, terminal device 110 automatically sends a message mentioning one or more target digital assistants. If one target digital assistant is selected, one mention message is sent. If multiple target digital assistants are selected, multiple mention messages are sent. Figures 4A to 4C In the example interfaces 400A to 400C shown, after the user 140 clicks on the selection control 412 of assistant A to select assistant A from the selection controls corresponding to at least one assistant, the terminal device 110 presents message 421 in the interface of the target session, and message 421 includes the mention information "@A assistant" for assistant A. After the user 140 clicks on the selection control 412 of assistant A and the selection control 413 of assistant B to select assistant A and assistant B from the selection controls corresponding to at least one assistant, the terminal device 110 presents message 431 and message 433 in the interface of the target session. Message 431 includes the mention information "@A assistant" for assistant A, and message 433 includes the mention information "@B assistant" for assistant B. In this way, the response of the digital assistant can be quickly obtained.

[0051] In some embodiments, user 140 clicks the close control of the target digital assistant to cancel the selected state of the target digital assistant, but the sent message is not withdrawn. Clicking the same target digital assistant again will not repeat the sending until the user exits the interface of the current session. If the user enters again after exiting, the sending will be triggered again. Figure 4CIn the example interface 400C shown, if the user 140 clicks on the close control 435 of assistant B to cancel the selection state of assistant B, the sent message 433 will not be withdrawn. If assistant B is selected again, message 433 will not be sent repeatedly until the user exits the interface of the current session.

[0052] In some embodiments, the terminal device 110 presents one or more reply messages to the first message respectively issued by one or more digital assistants. In some examples, the terminal device 110 presents one or more reply messages respectively issued by one or more target digital assistants to the first message issued in the target session. Figure 2E In the example interface 200E shown, for the message 251 "@A assistant @B assistant what kind of person are you", the terminal device 110 presents a reply message 252 sent by assistant A and a reply message 253 sent by assistant B. Figure 3D In the example interface 300D shown, in response to the message 341 “@A assistant what kind of person are you”, the terminal device 110 presents a reply message 342 sent by A assistant.

[0053] In some embodiments, the terminal device 110 presents one or more first reply messages to a first message mentioning one or more target digital assistants, including corresponding introduction information for the one or more target digital assistants. It is understandable that in the case where the first message only includes the mention information for the one or more target digital assistants, the reply message to the first message includes the introduction information for the one or more target digital assistants.

[0054] like Figure 4B In the example interface 400B shown, when the user 140 selects assistant A, the terminal device 110 presents a reply message 422 issued by assistant A to introduce assistant A in response to the message 421 "@assistant A". Figure 4C In the example interface 400C shown, when the user 140 selects assistant A and assistant B, the terminal device 110 presents a reply message 432 issued by assistant A to introduce assistant A in response to message 431 "@assistant A". Then, in response to message 433 "@assistant B", the terminal device 110 presents a reply message 434 issued by assistant B to introduce assistant B.

[0055] The following will continue to refer to FIG. 5A to FIG. 5C Describes receiving a user selection of one or more digital assistants based on a trigger to add a portal. FIG. 5A to FIG. 5C Schematic diagrams of example interfaces 500A to 500C for adding a digital assistant according to some embodiments of the present disclosure are shown.

[0056] In some embodiments, the terminal device 110 presents an add entry for adding a digital assistant in the interface of the target session. In some embodiments, the add entry (sometimes also referred to as a "summon entry") is used to pull the digital assistant used to reply to the message into the target session. It is understandable that the currently added digital assistant is not a member of the target session. Figure 5A In the example interface 500A shown, the terminal device 110 can present an add entry 512 on the interface of the target session.

[0057] In some embodiments, if the terminal device 110 detects a trigger operation for adding an entry, it presents assistant information related to at least one candidate digital assistant. Figure 5B In the example interface 500B shown, if the user 140 clicks the add entry 512, the terminal device 110 presents a floating layer 521 including assistant information related to at least one candidate digital assistant. In some embodiments, the floating layer 521 also includes a search box 522, and the user 140 can search for the digital assistant he needs based on the search box 522.

[0058] In some embodiments, the terminal device 110 may determine the candidate digital assistants based on one or more interaction messages in the target session, and / or the digital assistant selected by the user in the target session. In some examples, the terminal device 110 may recommend candidate digital assistants to the user 140 based on the content of the interaction between the user 140 and the digital assistant in the target session. For example, the configuration information of the recommended candidate digital assistant matches the theme of the interactive content. Alternatively or additionally, if the user has previously selected a digital assistant to temporarily participate in the session, the digital assistant may be further recommended based on the user's previous selection.

[0059] In some embodiments, upon receiving a digital assistant addition operation for a target session, the terminal device 110 may present an interactive window of the target session in the first interface area. The terminal device 110 may also present assistant information of multiple candidate digital assistants in another interface area that is at least partially different from the first interface area. In some examples, if a digital assistant addition indication is detected (for example, a control to add a digital assistant is triggered), the terminal device 110 may display the interactive window of the target session and the assistant recommendation page (which may include assistant information of multiple candidate digital assistants) in split screen. For example, depending on the screen size and / or orientation of the terminal device 110, the interactive window and the assistant recommendation page may be presented in the upper and lower halves of the user interface, respectively, or may be presented in the left and right halves of the user interface, respectively.

[0060] In some embodiments, the terminal device 110 may also present a search entry in the second interface area for searching for a digital assistant from a plurality of candidate digital assistants. That is, a search entry for a digital assistant may be included in the assistant recommendation page. Thus, the user 140 may search for a digital assistant to add to the target session through the search entry.

[0061] In some embodiments, assistant information of multiple candidate digital assistants is presented in the second interface area according to the grouping of the multiple candidate digital assistants. The terminal device 110 can also group multiple candidate digital assistants, and then present the assistant information corresponding to each group of digital assistants after grouping in the second interface area. As an example, the grouping criteria may include whether the configuration information of the digital assistants is similar, such as the digital assistants in the same group have similar functions. As another example, the grouping criteria may include whether the functions of the digital assistants are associated with the same topic, such as the digital assistants in the same group are all related to travel. Thus, the terminal device 110 clusters and displays multiple candidate digital assistants.

[0062] Then, the terminal device 110 receives a selection of a candidate digital assistant from at least one candidate digital assistant to determine the selected candidate digital assistant as at least a part of one or more target digital assistants. The user 140 selects one or more candidate digital assistants from at least one candidate digital assistant to pull the selected one or more candidate digital assistants into the target session. Figures 5B to 5C In the example interfaces 500B to 500C shown, the user 140 can select E assistant from A assistant, B assistant, C assistant, D assistant, E assistant, and the like digital assistants to pull E assistant into the target conversation for replying to the first message.

[0063] In some embodiments, the identification information of the selected candidate digital assistant is presented in the preset interface area of ​​the target session to indicate that the selected candidate digital assistant joins the target session. In some examples, if the identification information of the candidate digital assistant selected by user 140 from at least one candidate digital assistant has been presented in the preset interface area (sometimes also referred to as the "action bar"), the terminal device 110 sets the candidate digital assistant to be in a selected state. If the identification information of the candidate digital assistant selected by user 140 from at least one candidate digital assistant is not presented in the preset interface area, the terminal device 110 presents the identification information of the candidate digital assistant in the preset interface area.

[0064] In other embodiments, if the identification information of the digital assistant included in the preset interface area reaches the preset capacity, the terminal device 110 removes the identification information of at least one digital assistant that has been presented from the preset interface area. Then, the terminal device 110 adds the identification information of the selected candidate digital assistant to the preset interface area.

[0065] In some examples, if the identification information of the candidate digital assistant selected by the user 140 from the at least one candidate digital assistant is not presented in the preset interface area, and the capacity of the preset interface area is full, the terminal device 110 removes the identification information of the at least one digital assistant that has been presented from the preset interface area. Subsequently, the terminal device 110 presents the identification information of the candidate digital assistant in the preset interface area. Figures 5A to 5C In the example interfaces 500A to 500C shown, when the preset capacity of the operation bar 511 includes the identification information of the call entrance, the identification information of assistant A, the identification information of assistant B, the identification information of assistant C, and the identification information of assistant D, if the user 140 selects assistant E from at least one candidate digital assistant, the terminal device 110 will remove the identification information of assistant D, and then add the identification information 531 of assistant E to the operation bar 511.

[0066] In some embodiments, the currently added digital assistant may be presented at the top of the operation bar and in a selected state. In some examples, if the selected state of the currently added digital assistant is canceled, the identification information of the currently added digital assistant is still presented in the operation bar.

[0067] The following will continue to refer to 6A to 6F Describes receiving a user's selection of one or more target digital assistants in a target session when the user enters a mention (e.g., "@"). 6A to 6F Schematic diagrams of example interfaces 600A to 600F for conversation interaction according to some embodiments of the present disclosure are shown.

[0068] In some embodiments, the target session includes an input box. Fig. 6A In the example interface 600A shown, the target session includes an input box 611. If the terminal device 110 detects user input in the input box, it presents at least one matching digital assistant that matches the user input, and the user input includes the mention information. In some examples, in a scenario where the user has selected and / or not selected one or more target digital assistants, if the terminal device 110 detects user input mention information in the input box, it presents at least one matching digital assistant that matches the user input.

[0069] like Figures 6A to 6E In the example interfaces 600A to 600E shown, if the terminal device 110 detects that the user 140 clicks the input box 611, a keyboard pops up for the user 140 to enter a message. After the user 140 enters the message 622, if he continues to enter @, the terminal device 110 presents a selection box 632 in the interface of the target conversation. The selection box 632 presented by the terminal device 110 includes identification information of the target digital assistant for recommendation.

[0070] Subsequently, if the terminal device 110 detects that the user 140 continues to input @zh, the terminal device 110 presents a selection box 632 in a loading state. According to the input @zh641 of the user 140, the terminal device 110 presents in the selection box 632 the identification information of Zhang assistant, the identification information of Zi assistant, Zhou XX, Zhan XX, etc., which are used to recommend assistants matching the user input.

[0071] In some embodiments, the terminal device 110 receives a selection of a matching digital assistant from at least one matching digital assistant, and determines the selected matching digital assistant as at least a part of the one or more target digital assistants. Figures 6E to 6F In the example interfaces 600E to 600F shown, the user 140 can select "Zhang Assistant" from the identification information of Zhang Assistant, the identification information of Zi Assistant, Zhou XX, Zhan XX, etc. recommended by the terminal device 110. The terminal device 110 determines "Zhang Assistant" as part of one or more target digital assistants based on the selection of the user 140.

[0072] Accordingly, when the user 140 clicks the selection control 652 of the target digital assistant selected by the user 140, the message "@XXX" input by the user 140 disappears. Fig. 6F In the example interface 600F shown, when the user 140 clicks the selection control 652 of Assistant Zhang, the message 641 “@zh” input by the user 140 disappears and becomes message 661.

[0073] In some embodiments, when the terminal device 110 supports the user 140 to select a digital assistant, after receiving the target digital assistant selected by the user 140, the terminal device 110 replaces the target digital assistant that is already in the selected state with the target digital assistant selected by the user 140. When the terminal device 110 supports the user 140 to select one or more digital assistants, after receiving the target digital assistant selected by the user 140, the terminal device 110 determines the target digital assistant selected by the user 140 as part of the one or more target digital assistants.

[0074] In some embodiments, the terminal device 110 receives a second message sent by the user in the target session. If one or more target digital assistants are in a selected state, the terminal device 110 presents one or more reply messages for the second message respectively issued by one or more target digital assistants. It is understandable that if the user 140 does not cancel the selected state of one or more target digital assistants and continues to send the second message, the terminal device 110 presents one or more reply messages for the second message respectively issued by one or more target digital assistants.

[0075] In some embodiments, if the terminal device 110 detects that the user cancels the selection of one or more target digital assistants, it receives a third message sent by the user in the target session. Accordingly, the terminal device 110 presents one or more reply messages to the third message issued by the preset digital assistant in the target session. It can be understood that after the user 140 cancels the selected state of one or more target digital assistants, if the third message continues to be sent, the terminal device 110 presents one or more reply messages to the third message issued by the preset digital assistant. In some embodiments, the preset digital assistant is a member of the target session.

[0076] like Figures 2E to 2F In the example interfaces 200E to 200F shown, after the user 140 cancels the selected state of assistant A and assistant B, the user continues to input a message in the input box 261, and when the message is sent, the terminal device 110 presents a reply message to the message sent by the preset digital assistant. In some embodiments, the preset digital assistant is a member of the target session. FIG. 3D to FIG. 3E In the example interfaces 300D to 300E shown, after the user 140 cancels the selected state of assistant A, the user continues to input a message in the input box 316, and when the message is sent, the terminal device 110 presents a reply message to the message sent by the preset digital assistant. In some embodiments, the preset digital assistant is a member of the target session.

[0077] In summary, users can choose a digital assistant that is not part of the conversation to reply to the message it sent, thereby improving the convenience of the user's interaction with the digital assistant.

[0078] Example Process

[0079] Figure 7 FIG. 7 is a flowchart of a process 700 for session interaction according to some embodiments of the present disclosure. The process 700 may be implemented at the terminal device 110. Figure 1 Process 700 is described.

[0080] In box 710, the terminal device 110 receives a user's selection of one or more target digital assistants in a target session, the one or more target digital assistants are not members of the target session, and the members of the target session include multiple digital assistants.

[0081] In block 720 , the terminal device 110 presents the first message sent by the user in the target conversation.

[0082] In box 730, the terminal device 110 presents one or more reply messages to the first message respectively issued by one or more target digital assistants.

[0083] In some embodiments, process 700 also includes: in response to receiving a digital assistant add operation for a target session, presenting an interaction window of the target session in a first interface area; and presenting assistant information of multiple candidate digital assistants in a second interface area, the second interface area being at least partially different from the first interface area.

[0084] In some embodiments, the second interface area includes a search portal for searching for a digital assistant from a plurality of candidate digital assistants.

[0085] In some embodiments, assistant information of multiple candidate digital assistants is presented in the second interface area according to the grouping of the multiple candidate digital assistants.

[0086] In some embodiments, process 700 also includes: determining multiple candidate digital assistants based on at least one of: one or more interaction messages in the target session, or a digital assistant selected by the user in the target session; and presenting assistant information of multiple candidate digital assistants for selecting one or more target digital assistants.

[0087] In some embodiments, receiving a user's selection of one or more target digital assistants in a target session includes: presenting a selection control for at least one digital assistant in an interface of the target session; and receiving a trigger operation for a corresponding selection control of one or more target digital assistants in the at least one digital assistant.

[0088] In some embodiments, process 700 also includes: in response to a trigger operation, presenting corresponding selection controls of one or more target digital assistants in a predetermined style.

[0089] In some embodiments, presenting a first message sent by a user in a target conversation includes: receiving user input for one or more target digital assistants; and in response to a sending operation for the user input, presenting the user input and mention information for the one or more target digital assistants as the first message.

[0090] In some embodiments, the mention information is presented in the first message in a preset style, and the preset style is associated with the number of one or more target digital assistants.

[0091] In some embodiments, presenting a first message sent by a user in a target conversation includes: in response to selection of one or more target digital assistants from at least one digital assistant, presenting a first message that respectively mentions the one or more target digital assistants, and one or more first reply messages respectively include corresponding introductory information for the one or more target digital assistants.

[0092] In some embodiments, receiving a user's selection of one or more target digital assistants in a target session includes: presenting an add entry for adding a digital assistant in an interface of the target session; in response to a triggering operation on the add entry, presenting assistant information related to at least one candidate digital assistant; and receiving a selection of a candidate digital assistant from at least one candidate digital assistant to determine the selected candidate digital assistant as at least a part of one or more target digital assistants.

[0093] In some embodiments, identification information of the selected candidate digital assistant is presented in a preset interface area of ​​the target session to indicate that the selected candidate digital assistant joins the target session.

[0094] In some embodiments, process 700 also includes: in response to the identification information of the digital assistants included in the preset interface area reaching a preset capacity, removing the identification information of at least one digital assistant that has been presented from the preset interface area; and adding the identification information of the selected candidate digital assistant to the preset interface area.

[0095] In some embodiments, the target session includes an input box, and receiving a user selection of one or more target digital assistants in the target session includes: in response to detecting user input in the input box, presenting at least one matching digital assistant that matches the user input, the user input including mention information; and receiving a selection of a matching digital assistant from at least one matching digital assistant, with the selected matching digital assistant being determined as at least a part of the one or more target digital assistants.

[0096] In some embodiments, process 700 also includes: receiving a second message sent by the user in the target conversation; and in response to one or more target digital assistants being in a selected state, presenting one or more reply messages to the second message respectively sent by one or more target digital assistants.

[0097] In some embodiments, process 700 also includes: receiving a third message issued by the user in the target session in response to deselecting one or more target digital assistants; and presenting one or more reply messages to the third message issued by a preset digital assistant in the target session.

[0098] Example devices and equipment

[0099] Figure 8 A schematic structural block diagram of an apparatus 800 for conversation interaction according to some embodiments of the present disclosure is shown. The apparatus 800 may be implemented as or included in a terminal device 110. Each module / component in the apparatus 800 may be implemented by hardware, software, firmware, or any combination thereof.

[0100] As shown in the figure, the device 800 includes a selection receiving module 810, which is configured to receive a user's selection of one or more target digital assistants in a target session, the one or more target digital assistants are not members of the target session, and the members of the target session include multiple digital assistants. The device 800 also includes a message presentation module 820, which is configured to present a first message sent by the user in the target session. The device 800 also includes a reply message presentation module 830, which is configured to present one or more reply messages to the first message respectively sent by one or more target digital assistants.

[0101] In some embodiments, the device 800 also includes an interface area presentation module, which is configured to present an interaction window of the target session in a first interface area in response to receiving a digital assistant addition operation for the target session; and present assistant information of multiple candidate digital assistants in a second interface area, and the second interface area is at least partially different from the first interface area.

[0102] In some embodiments, the second interface area includes a search portal for searching for a digital assistant from a plurality of candidate digital assistants.

[0103] In some embodiments, assistant information of multiple candidate digital assistants is presented in the second interface area according to the grouping of the multiple candidate digital assistants.

[0104] In some embodiments, the device 800 also includes a digital assistant determination module, which is configured to target one or more interactive messages in a target session, or a digital assistant selected by a user in a target session; and present assistant information of multiple candidate digital assistants for selecting one or more target digital assistants.

[0105] In some embodiments, the selection receiving module 810 is also configured to present selection controls for at least one digital assistant in the interface of the target session; and receive trigger operations for corresponding selection controls of one or more target digital assistants among the at least one digital assistant.

[0106] In some embodiments, the device 800 also includes a control presentation module configured to present corresponding selection controls of one or more target digital assistants in a predetermined style in response to a trigger operation.

[0107] In some embodiments, the message presentation module 820 is also configured to receive user input for one or more target digital assistants; and in response to a sending operation for the user input, present the user input and mention information for the one or more target digital assistants as a first message.

[0108] In some embodiments, the mention information is presented in the first message in a preset style, and the preset style is associated with the number of one or more target digital assistants.

[0109] In some embodiments, the message presentation module 820 is also configured to present a first message that respectively mentions one or more target digital assistants in response to selection of one or more target digital assistants among the at least one digital assistant, and one or more first reply messages respectively include corresponding introductory information for the one or more target digital assistants.

[0110] In some embodiments, the selection receiving module 810 is also configured to present an add entry for adding a digital assistant in the interface of the target session; in response to a trigger operation on the add entry, present assistant information related to at least one candidate digital assistant; and receive a selection of a candidate digital assistant from at least one candidate digital assistant to determine the selected candidate digital assistant as at least a part of one or more target digital assistants.

[0111] In some embodiments, identification information of the selected candidate digital assistant is presented in a preset interface area of ​​the target session to indicate that the selected candidate digital assistant joins the target session.

[0112] In some embodiments, the device 800 also includes an identification information adding module, which is configured to remove the identification information of at least one digital assistant that has been presented from the preset interface area in response to the identification information of the digital assistants included in the preset interface area reaching a preset capacity; and add the identification information of the selected candidate digital assistant to the preset interface area.

[0113] In some embodiments, the target session includes an input box, and the selection receiving module 810 is also configured to, in response to detecting user input in the input box, present at least one matching digital assistant that matches the user input, the user input including mention information; and receive a selection of a matching digital assistant from at least one matching digital assistant, so that the selected matching digital assistant is determined as at least a part of one or more target digital assistants.

[0114] In some embodiments, the reply message presentation module 830 is also configured to receive a second message issued by the user in the target conversation; and in response to one or more target digital assistants being in a selected state, present one or more reply messages for the second message respectively issued by one or more target digital assistants.

[0115] In some embodiments, the reply message presentation module 830 is also configured to receive a third message issued by the user in the target session in response to deselecting one or more target digital assistants; and present one or more reply messages to the third message issued by a preset digital assistant in the target session.

[0116] Fig. 9A block diagram of an electronic device 900 is shown in which one or more embodiments of the present disclosure may be implemented. It should be understood that Fig. 9 The electronic device 900 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Fig. 9 The electronic device 900 shown can be used to implement Figure 1 terminal device 110 or server 130.

[0117] like Fig. 9 As shown, the electronic device 900 is in the form of a general electronic device. The components of the electronic device 900 may include, but are not limited to, one or more processors or processing units 910, a memory 920, a storage device 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. The processing unit 910 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 920. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 900.

[0118] The electronic device 900 typically includes a plurality of computer storage media. Such media can be any accessible media that can be obtained by the electronic device 900, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 920 can be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory) or some combination thereof. The storage device 930 can be a removable or non-removable medium, and can include a machine-readable medium, such as a flash drive, a disk, or any other medium, which can be used to store information and / or data and can be accessed within the electronic device 900.

[0119] The electronic device 900 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig. 9 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. Memory 920 may include a computer program product 925 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0120] The communication unit 940 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 900 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 900 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0121] The input device 950 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 960 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 900 may also communicate with one or more external devices (not shown) through the communication unit 940 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 900, or communicate with any device that allows the electronic device 900 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0122] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0123] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0124] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0125] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0126] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0127] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A conversation interaction method, comprising: Receiving a user selection of one or more target digital assistants in a target session, the one or more target digital assistants not being members of the target session, and the members of the target session including a plurality of digital assistants; Presenting a first message sent by the user in the target conversation; as well as Present one or more reply messages to the first message respectively issued by the one or more target digital assistants.

2. The method according to claim 1, further comprising: In response to receiving a digital assistant add operation for the target session, Presenting an interactive window of the target session in the first interface area; as well as Assistant information of multiple candidate digital assistants is presented in a second interface area, and the second interface area is at least partially different from the first interface area.

3. The method according to claim 2, wherein the second interface area includes a search portal for searching for a digital assistant from among the multiple candidate digital assistants.

4. The method according to claim 2, wherein the assistant information of the multiple candidate digital assistants is presented in the second interface area according to the grouping of the multiple candidate digital assistants.

5. The method according to claim 1, further comprising: Multiple candidate digital assistants are determined based on at least one of the following: One or more interactive messages in the target session, or a digital assistant selected by the user in the target session; as well as The assistant information of the multiple candidate digital assistants is presented for selecting the one or more target digital assistants.

6. The method of claim 1, wherein receiving a user's selection of one or more target digital assistants in a target session comprises: Presenting a selection control for at least one digital assistant in an interface of the target session; as well as Receive a trigger operation on corresponding selection controls of one or more target digital assistants among the at least one digital assistant.

7. The method according to claim 6, further comprising: In response to the trigger operation, corresponding selection controls of the one or more target digital assistants are presented in a predetermined style.

8. The method according to claim 6, wherein presenting the first message sent by the user in the target conversation comprises: receiving user input directed to the one or more target digital assistants; as well as In response to a send operation for the user input, present the user input and the mention information of the one or more target digital assistants as the first message.

9. The method of claim 8, wherein the mention information is presented in the first message in a preset style, and the preset style is associated with the number of the one or more target digital assistants.

10. The method according to claim 6, wherein presenting the first message sent by the user in the target conversation comprises: In response to selection of one or more target digital assistants among the at least one digital assistant, presenting the first message referring to the one or more target digital assistants, respectively, and The one or more first reply messages respectively include corresponding introduction information for the one or more target digital assistants.

11. The method of claim 1 , wherein receiving a user selection of one or more target digital assistants in a target session comprises: Presenting an adding entry for adding a digital assistant in the interface of the target session; In response to a triggering operation on the adding entry, presenting assistant information related to at least one candidate digital assistant; as well as Receive a selection of a candidate digital assistant from the at least one candidate digital assistant to determine the selected candidate digital assistant as at least a portion of the one or more target digital assistants.

12. A method according to claim 11, wherein the identification information of the selected candidate digital assistant is presented in a preset interface area of ​​the target session to indicate that the selected candidate digital assistant joins the target session.

13. The method according to claim 11, further comprising: In response to the identification information of the digital assistants included in the preset interface area reaching a preset capacity, removing the identification information of at least one digital assistant that has been presented from the preset interface area; as well as Add the identification information of the selected candidate digital assistant to the preset interface area.

14. The method of claim 1, wherein the target session includes an input box, and receiving a user selection of one or more target digital assistants in the target session includes: In response to detecting user input in the input box, presenting at least one matching digital assistant that matches the user input, the user input including the mention information; as well as A selection of a matching digital assistant from the at least one matching digital assistant is received, with the selected matching digital assistant being determined as at least a portion of the one or more target digital assistants.

15. The method according to claim 1, further comprising: receiving a second message sent by the user in the target session; as well as In response to the one or more target digital assistants being in a selected state, one or more reply messages to the second message respectively issued by the one or more target digital assistants are presented.

16. The method according to claim 1, further comprising: In response to deselecting the one or more target digital assistants, receiving a third message from the user in the target conversation; as well as Present one or more reply messages to the third message issued by a preset digital assistant in the target conversation.

17. A device for conversation interaction, comprising: a selection receiving module configured to receive a user's selection of one or more target digital assistants in a target session, the one or more target digital assistants being not members of the target session, and the members of the target session including a plurality of digital assistants; a message presenting module, configured to present a first message sent by the user in the target session; as well as The reply message presentation module is configured to present one or more reply messages to the first message respectively issued by the one or more target digital assistants.

18. An electronic device, comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 16 when executed by the at least one processing unit.

19. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 16.

Images