Method and apparatus for information interaction, and device and storage medium

Abstract

According to the embodiments of the present disclosure, provided are a method and apparatus for information interaction, and a device and a storage medium. The method for information interaction comprises: in response to detecting a preset input in an input box of a dialogue window of a first user, presenting a trigger control for a first digital assistant, wherein the dialogue window comprises a private-chat window for the first user and a second user or a group-chat window for the first user and a group of users; and in response to a preset operation for the trigger control, presenting an interaction region for the first user and the first digital assistant, such that the first user performs interaction with the first digital assistant. In this way, in a dialogue between users, the users can efficiently complete diversified operations by means of interaction with a digital assistant.

Description

Method, device, equipment and storage medium for information interaction

[0001] This application claims priority to the Chinese invention patent application entitled “Methods, devices, equipment and storage media for information interaction” and application number 2023111101236, filed on August 30, 2023, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for information interaction. Background Art

[0003] With the development of information technology, various terminal devices can provide people with various services in work and life. For example, terminal devices can be deployed with applications that provide services. Terminal devices or applications can provide users with digital assistant-like functions to assist users in using the terminal device or application. Users can complete various operations through various interactions with digital assistants.

[0004] Summary of the Invention

[0005] In a first aspect of the present disclosure, a method for information interaction is provided. The method comprises: in response to detecting a preset input in an input box of a conversation window of a first user, presenting a trigger control for a first digital assistant, where the conversation window includes a single chat window between the first user and a second user or a group chat window between the first user and a group of users; and in response to a preset operation on the trigger control, presenting an interaction area between the first user and the first digital assistant for the first user to interact with the first digital assistant.

[0006] In a second aspect of the present disclosure, a method for information interaction is provided. The method comprises: in response to detecting a selection operation on multiple messages in a conversation window of a first user, presenting an operation bar for the multiple messages, the operation bar including a trigger control for a first digital assistant; and in response to a preset operation on the trigger control, sending an instruction corresponding to the trigger control to the first digital assistant.

[0007] In a third aspect of the present disclosure, a method for information interaction is provided. The method includes: in a conversation window of a first user, if a forwarding operation on one or more messages in the conversation window is detected, presenting a forwarding panel; and providing a trigger control for a first digital assistant in the forwarding panel, wherein a preset operation on the trigger control triggers interaction between the first user and the first digital assistant.

[0008] In a fourth aspect of the present disclosure, a device for information interaction is provided. The device includes: a trigger control presentation module configured to present a trigger control for a first digital assistant in response to detecting a preset input in an input box of an instant messaging session window of a first user, where the instant messaging session window includes a single chat window between the first user and a second user or a group chat window between the first user and a group of users; and an interaction area presentation module configured to present an interaction area between the first user and the first digital assistant in response to a preset operation on the trigger control, for the first user to interact with the first digital assistant.

[0009] In a fifth aspect of the present disclosure, a device for information interaction is provided. The device includes: an operation bar presentation module configured to, in response to detecting a selection operation on multiple messages in a conversation window of a first user, present an operation bar for the multiple messages, the operation bar including a trigger control for a first digital assistant; and an instruction triggering module configured to, in response to a preset operation on the trigger control, send an instruction corresponding to the trigger control to the first digital assistant.

[0010] In a sixth aspect of the present disclosure, a device for information interaction is provided. The device includes: a forwarding panel presentation module configured to present a forwarding panel in a conversation window of a first user upon detecting a forwarding operation on one or more messages in the conversation window; and a trigger control provision module configured to provide a trigger control for a first digital assistant in the forwarding panel, wherein a preset operation on the trigger control triggers interaction between the first user and the first digital assistant.

[0011] In a seventh aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect, the method of the second aspect, or the method of the third aspect.

[0012] In an eighth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect, the method of the second aspect, or the method of the third aspect.

[0013] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0015] FIG1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0016] 2A to 2D illustrate schematic diagrams of example client interfaces according to some embodiments of the present disclosure;

[0017] 3A-3B illustrate schematic diagrams of example client interfaces according to some embodiments of the present disclosure;

[0018] 4A-4B illustrate schematic diagrams of example client interfaces according to some embodiments of the present disclosure;

[0019] 5A-5B illustrate schematic diagrams of example client interfaces according to some embodiments of the present disclosure;

[0020] 6A to 6C illustrate schematic diagrams of example client interfaces according to some embodiments of the present disclosure;

[0021] FIG7 shows a flowchart of a process for information interaction according to some embodiments of the present disclosure;

[0022] FIG8 shows a flowchart of a process for information interaction according to some embodiments of the present disclosure;

[0023] FIG9 shows a flowchart of a process for information interaction according to some embodiments of the present disclosure;

[0024] FIG10 shows a schematic structural block diagram of an apparatus for information interaction according to some embodiments of the present disclosure;

[0025] FIG11 shows a schematic structural block diagram of an apparatus for information interaction according to some embodiments of the present disclosure;

[0026] FIG12 shows a schematic structural block diagram of an apparatus for information interaction according to some embodiments of the present disclosure; and

[0027] FIG13 illustrates a block diagram of an electronic device in which one or more embodiments of the present disclosure may be implemented. DETAILED DESCRIPTION

[0028] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0029] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below.

[0030] Herein, unless explicitly stated otherwise, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0031] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0032] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the information involved in this disclosure should be informed to relevant users and authorization should be obtained from relevant users in an appropriate manner in accordance with relevant laws and regulations. Relevant users can include any type of right holders, such as individuals, enterprises, and groups.

[0033] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can independently choose whether to provide information to the software or hardware such as the electronic device, application, server or storage medium that executes the operation of the technical solution of the present disclosure based on the prompt message.

[0034] As an optional but non-limiting implementation, in response to receiving an active request from a relevant user, a prompt message may be sent to the relevant user in the form of a pop-up window, in which the prompt message may be presented in text form. Furthermore, the pop-up window may also include a selection control for the user to select "agree" or "disagree" to provide information to the electronic device.

[0035] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0036] As used herein, the term "model" can learn the association between corresponding inputs and outputs from training data, so that after training is completed, corresponding outputs can be generated for given inputs. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multiple layers of processing units. A neural network model is an example of a model based on deep learning. In this article, "model" may also be referred to as "machine learning model", "learning model", "machine learning network" or "learning network", and these terms are used interchangeably in this article.

[0037] 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In the example environment 100, an application 120 is installed in a terminal device 110. A user 140 can interact with the application 120 via the terminal device 110 and / or a device attached to the terminal device 110.

[0038] In some embodiments, application 120 can be downloaded and installed on terminal device 110. In some embodiments, application 120 can also be accessed through other means, such as through a webpage. In environment 100 of FIG1 , when application 120 is launched, terminal device 110 can present an interface 150 of application 120. Interface 150 can include various user interfaces provided by application 120. Interface 150 is sometimes also referred to as a client interface.

[0039] Application 120 includes, but is not limited to, one or more of the following: a chat application (also known as an instant messaging application), a document application, an audio and video conferencing application, an email application, a task application, an objectives and key results (OKR) application, and the like. Application 120 supports the use of plug-ins. Such plug-ins include, but are not limited to, one or more of the following: a search plug-in, a contact plug-in, a message plug-in, a document plug-in, a table plug-in, an email plug-in, a calendar plug-in, a schedule plug-in, a question-and-answer plug-in, and the like. In some embodiments, application 120 may include a multi-functional collaboration platform, such as an office collaboration platform (also known as an office suite) that can provide integration of various types of applications or components to facilitate people's office work, communication, and other activities. In the multi-functional collaboration platform, people can start different applications or components as needed to complete corresponding information processing, sharing, communication, and the like.

[0040] In some embodiments, the terminal device 110 communicates with the server 130 to enable the supply of services to the application 120. The terminal device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.). The server 130 can be various types of computing systems / servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0041] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.

[0042] As briefly mentioned above, digital assistants can assist users in using terminal devices or applications. Some applications can provide integrated functions of different plug-ins. Traditionally, in addition to being able to have free conversations with digital assistants, users can also use natural language instructions to enable digital assistants to use different plug-ins to complete some more complex business-related operations related to the application, such as creating documents, inviting schedules, creating tasks, etc. The conversation between the user and the digital assistant and the issuance of instructions are often implemented in the interaction window between the user and the digital assistant, and the operations completed by the digital assistant are often targeted at specific documents or specific tasks. It is expected that the digital assistant can be connected to the conversation so that the digital assistant can provide services to the user in the conversation.

[0043] According to some embodiments of the present disclosure, an improved scheme for information interaction is proposed. In an embodiment of the present disclosure, in response to detecting a preset input in an input box of a conversation window of a first user, a trigger control for a first digital assistant is presented, the conversation window including a single chat window between the first user and a second user or a group chat window between the first user and a group of users; and in response to a preset operation on the trigger control, an interaction area between the first user and the first digital assistant is presented for the first user to interact with the first digital assistant. In this way, in response to detecting that a user enters a preset input in the input box of the conversation window, the digital assistant can be triggered so that the user can interact with the digital assistant in the conversation.

[0044] According to some embodiments of the present disclosure, an improved scheme for information interaction is proposed. In an embodiment of the present disclosure, in response to detecting a selection operation on multiple messages in a conversation window of a first user, an operation bar for the multiple messages is presented, the operation bar including a trigger control for a first digital assistant; and in response to a preset operation on the trigger control, an instruction corresponding to the trigger control is sent to the first digital assistant. In this way, in response to detecting a user selection operation on multiple messages in the conversation window, the digital assistant can be triggered so that the user can interact with the digital assistant in the conversation.

[0045] According to some embodiments of the present disclosure, an improved scheme for information interaction is proposed. In an embodiment of the present disclosure, in a conversation window of a first user, if a forwarding operation is detected for one or more messages in the conversation window, a forwarding panel is presented; and a trigger control for a first digital assistant is provided in the forwarding panel, and a preset operation on the trigger control triggers the first user's interaction with the first digital assistant. In this way, in response to detecting a preset operation of the trigger control in the forwarding panel by the user, the digital assistant can be triggered so that the user can interact with the digital assistant during forwarding.

[0046] Some example embodiments of the present disclosure will be described in detail below with reference to examples in the accompanying drawings.

[0047] As mentioned above, in an embodiment of the present disclosure, a digital assistant is used to interact with a user. In some embodiments, a user can trigger the digital assistant to perform corresponding operations by entering instructions in an interactive window with the digital assistant (such as a floating window or any other appropriate form of window), selecting a shortcut instruction, etc. As an intelligent assistant, the digital assistant has intelligent dialogue and information processing capabilities. In the interactive window, the user enters an interactive message, and the digital assistant provides a reply message in response to the user input. The client interface for providing a digital assistant can correspond to a single-function application or a multi-function collaboration platform, such as an office suite or other collaboration platform that can integrate multiple components.

[0048] In some embodiments, multiple interaction modes between the user and the digital assistant can be provided, and flexible switching between the multiple interaction modes can be achieved. When a certain interaction mode is triggered, a corresponding interaction area is presented to facilitate interaction between the user and the digital assistant. The user interacts with the digital assistant in different ways under different interaction modes, which can be flexibly adapted to the interaction needs in different application scenarios.

[0049] In some embodiments, the digital assistant can be included as a contact of the user in the current user's contact list in the office suite, or included in the information flow of the chat component. In some embodiments, the user and the digital assistant have a corresponding relationship. For example, the first digital assistant corresponds to the first user, the second digital assistant corresponds to the second user, and so on. In some embodiments, the first digital assistant can uniquely correspond to the first user, the second digital assistant can uniquely correspond to the second user, and so on. That is, the first digital assistant of the first user can be specific to or exclusive to the first user. For example, in the process of the first digital assistant providing assistance or services to the first user, the first digital assistant can utilize its historical interaction information with the first user, the data authorized by the first user that it can access, the current interaction context with the first user, etc. If the first user is an individual or person, the first digital assistant can be regarded as a personal digital assistant. It can be understood that in the disclosed embodiments, the first digital assistant accesses the data to which it is granted permission based on the authorization of the first user. It should be understood that "uniquely corresponding" or similar expressions in this disclosure are not intended to limit the first digital assistant to being updated accordingly based on the interaction process between the first user and the first digital assistant.

[0050] In some embodiments, information processing services specific to the user can be provided based on historical interaction information between the user and the digital assistant and / or a data range specific to the user. In some embodiments, historical interaction information of the user interacting with the digital assistant in multiple interaction modes can be stored in association with the user. In this way, in one interaction mode (any or a specified interaction mode) of the multiple interaction modes, the digital assistant can provide services to the user based on the historical interaction information stored in association with the user.

[0051] In some embodiments, the terminal device 110 can present a conversation window between a user (also known as the current user, also referred to as the first user, such as user 140) and one or more other users. Here, the conversation window between the user and one other user can be, for example, a single chat window between user A and user B, and the conversation window between the user and multiple other users can be, for example, a group chat window between user A and a group of other users. The user can interact with at least one other user by sending and / or receiving messages in the conversation window. For example, the terminal device 110 can determine the content of the message to be sent by the user in response to detecting the text entered by the user in the input box. For example, the terminal device 110 can also collect the user audio in response to detecting the user's triggering operation on the audio space. The terminal device 110 can determine the audio or the text content corresponding to the audio as the content of the message to be sent by the user. It should be noted that the operations performed by the aforementioned terminal device 110 and the operations performed by the terminal device 110 described subsequently can be specifically performed by relevant applications installed on the terminal device 110.

[0052] 2A to 2D illustrate schematic diagrams of an example client interface 201 according to some embodiments of the present disclosure. The client interface 201 may be implemented at the terminal device 110. The examples of FIG. 2A to FIG. 2D are described below with reference to FIG.

[0053] In a conversation window between a user and at least one other user, the terminal device 110 (for example, an instant messaging application installed on the terminal device 110, or a suite application integrated with an instant messaging application installed on the terminal device 110) can present a trigger control for a digital assistant (for example, a first digital assistant) in response to detecting a preset input in the input box of the conversation window. As shown in FIG2A , the startup entry of the instant messaging application is presented in area 230 of the interface 201, and the information stream (feed) of the instant messaging application is presented in area 220 of the interface 201. In response to the user selecting any contact or any group in the information stream of the instant messaging application, the terminal device 110 can present a corresponding conversation window in area 210 of the interface 201. For example, in response to the user selecting discussion group A, the terminal device 110 presents a group chat window corresponding to discussion group A in area 210 of the interface 201.

[0054] The conversation window includes an input box 212. In response to detecting a preset input in the input box 212, the terminal device 110 may present a trigger control 214 for the digital assistant. In some embodiments, the preset input may include, for example, a contact mention symbol (e.g., an @ symbol). It is understood that the preset input may also include any other appropriate symbol or text, and this disclosure is not limited thereto.

[0055] For example, the terminal device 110 may determine that a preset input has been detected in response to detecting the symbol "@" in the input box 212. The terminal device 110 may then present a trigger control 214 for the digital assistant while presenting other contacts that may be mentioned in the conversation window. In some embodiments, the terminal device 110 may display the trigger control for the digital assistant separately from other contacts that may be mentioned in the conversation window. For example, the trigger control for the digital assistant may be displayed in a fixed position (e.g., displayed at the top), highlighted, displayed with a border, etc.

[0056] In response to detecting a preset operation on trigger control 214, terminal device 110 may present an interaction area 240 between the user and the digital assistant, as shown in FIG2B , for the user to interact with the digital assistant. For example, terminal device 110 may at least partially overlay interaction area 240 on input box 212 of the conversation window. In this case, as shown in FIG2B , at least a portion of interaction area 240 will be displayed at the display location of input box 214 without displaying input box 214.

[0057] It should be noted that if, before the preset input is detected in the input box 212, there is other content input by the user in the input box 212, for example, the input box 212 contains the content "XXXXXXX@", where "@" is the preset input, then in response to detecting the preset input, the terminal device 110 presents the trigger control 214 and then presents the interactive area 240, while the terminal device 110 can retain the content in the input box 212. That is, although the input box 212 is covered by the interactive area 240, the content therein does not change, and the input box 212, for example, still contains the content "XXXXXXX@".

[0058] In some embodiments, the interactive area 240 includes at least one shortcut command. The at least one shortcut command here includes at least one of summarizing unread messages in the conversation window, summarizing messages in the conversation window within a predetermined time period, summarizing messages of a specific user in the conversation window, adjusting the message input by the first user, and explaining specific terms mentioned in the message in the conversation window. Exemplarily, as shown in FIG2B , the interactive area 240 includes a shortcut command "Summarize missed messages." In some embodiments, in response to detecting a selection operation (e.g., a click operation) of any shortcut command, the digital assistant will perform the operation corresponding to the shortcut command.

[0059] In some embodiments, the interactive area 240 also includes an input control 242 for receiving instructions. When the interactive area 240 is presented in the conversation window, the input control 242 is activated. The digital assistant can perform corresponding operations based on the user input received in the input control 242. For example, if the user input is a question, the digital assistant can answer the question. If the user input is an instruction, the digital assistant can perform the operation corresponding to the instruction.

[0060] In some embodiments, if content generated by the digital assistant according to the user's instructions is presented in the interactive area 240, the terminal device 110 may present at least one shortcut instruction for the content in the interactive area 240. The at least one shortcut instruction here may, for example, include at least an insert instruction (for inputting the content into the conversation window as a user's message), a copy instruction (for copying the content), and an adjustment instruction (for instructing the digital assistant to adjust the content). Exemplarily, as shown in Figures 2B and 2C, in response to detecting a selection operation on the shortcut instruction "Summarize missed messages" shown in Figure 2B, the digital assistant generates summary content 244 based on the shortcut instruction. In response to presenting the summary content 244 in the interactive area 240, the terminal device 110 may present the shortcut instruction by presenting at least one operation control corresponding to the at least one shortcut instruction in the interactive area 240. The terminal device 110 may determine that a corresponding shortcut instruction is detected in response to detecting a selection operation on any operation control in at least one operation space, and then execute the operation corresponding to the shortcut instruction. For example, in response to detecting receipt of a selection operation on the "Insert" operation control, the terminal device 110 may determine that an insert instruction has been detected, and then execute an operation of inputting the summary content 244 as the user's message into the conversation window. For example, as shown in FIG2D , the terminal device 110 may present the summary content 244 in FIG2C in the input control 242 to input the summary content 244 as the user's message into the conversation window.

[0061] In some embodiments, terminal device 110 can also cancel the presentation of interaction area 240 in response to a user operation. For example, in response to detecting a selection of the "Exit" control shown in FIG. 2C , terminal device 110 cancels the presentation of interaction area 240. For example, if terminal device 110 is a PC, terminal device 110 can close interaction area 240 in response to a click on the close control of interaction area 240, or in response to selecting the ESC shortcut key. If terminal device 110 is a mobile device, terminal device 110 can close interaction area 240 in response to a pull-down operation on the interaction area. It is understood that terminal device 110 can also cancel the presentation of interaction area 240 in response to other operations. These examples are merely examples and do not limit the specific operations. Furthermore, in response to the cancellation of the presentation of interaction area 240, terminal device 110 can present the input box 212 of the conversation window. In this case, it can be understood that terminal device 110 cancels the presentation of the interaction area that overlays input box 212.

[0062] In some embodiments, in order to further enhance the user experience, the terminal device 110 can directly delete the preset input from the input box 212 without manual operation by the user. For example, if the terminal device 110 previously presented a trigger control 214 for the digital assistant in response to receiving a preset input (such as the symbol "@"). The terminal device 110 presents the interactive area 240 in response to the selection operation of the trigger control 214 (at this time, in response to the selection operation of the trigger control, the terminal device 110 can, for example, present an input such as "@digital assistant" in the input box 212). Finally, in response to the interaction area 240 being canceled, the terminal device 110 can present the input box 212 and delete the preset input (that is, the symbol "@") from the input box 212 (if an input such as "@digital assistant" was previously presented, the terminal device 212 can delete the input from the input box 212).

[0063] A user can switch from one conversation window to another. For example, a user can switch from a group chat window corresponding to discussion group A to a single chat window with contact A. In some embodiments, if the conversation window is switched to another window or the conversation window is closed when the interaction area 240 is presented, the interaction area 240 continues to be presented when the conversation window is presented again, and the interaction information in the interaction area 240 remains unchanged. For example, as shown in Figure 2C, the interaction area 240 includes summary content 244. If the user switches to another window or the current conversation window is closed at this time, the terminal device 110 can continue to present the interaction area 240 including the summary content 244 when the conversation window is presented again. It will be understood that the newly presented conversation window does not include the interaction area 240. In response to detecting a preset input in the input box of the new conversation window, the terminal device 110 presents the trigger control of the digital assistant.

[0064] In this way, in response to detecting that the user enters a preset input in the input box of the conversation window, the digital assistant can be triggered so that the user can interact with the digital assistant in the conversation.

[0065] 3A and 3B show schematic diagrams of an example client interface 301 according to some embodiments of the present disclosure. The client interface 301 may be implemented at the terminal device 110. The examples of FIG. 3A and FIG. 3B are described below with reference to FIG. 1 .

[0066] Multiple messages can be presented in a conversation window between a user and at least one other user. In response to detecting a selection operation on multiple messages in the user's conversation window, terminal device 110 can present an action bar for the multiple messages. As shown in FIG3A , the instant messaging application is presented in area 330 of interface 301, and the information stream is presented in area 320 of interface 301. In response to the user selecting any contact or any group in the instant messaging application, terminal device 110 can present the corresponding conversation window in area 310 of interface 301.

[0067] In response to detecting a selection operation on multiple messages in the conversation window, terminal device 110 presents an operation bar 312 for the multiple messages. The selection operation here can be, for example, a click operation, a long press operation, etc. Operation bar 312 includes at least a trigger control for the digital assistant. In response to a preset operation on the trigger control, terminal device 110 sends a command corresponding to the trigger control to the digital assistant.

[0068] In some embodiments, a trigger control for the digital assistant in the operation bar can be used to indicate the presentation of an interaction area with the digital assistant. Similar to the examples described in Figures 2A to 2D above, the interaction area can be at least partially superimposed on the operation bar 312. The interaction area may include at least one shortcut instruction, and an input control for receiving instructions. At least one shortcut instruction may, for example, include summarizing unread messages in the conversation window, summarizing messages in the conversation window within a predetermined time period, summarizing messages of a specific user in the conversation window, adjusting messages input by the first user, and explaining at least one of the specific terms mentioned in the message in the conversation window. In response to detecting a selection operation (such as a click operation) on any shortcut instruction, the digital assistant will perform an operation corresponding to the shortcut instruction.

[0069] In some embodiments, since the user may desire to summarize multiple messages, to improve the efficiency of this operation, this trigger control can also be used to directly instruct the digital assistant to summarize the multiple messages. As shown in Figure 3B, the operation bar 312 includes at least a trigger control 314 for the digital assistant, which is used to instruct the digital assistant to summarize the multiple messages.

[0070] In some embodiments, as shown in FIG3B , in response to a selection operation on a trigger control 314 in an operation bar 312, the terminal device 110 may present an interactive area 340 containing content generated by the digital assistant based on a user's instruction (e.g., an instruction corresponding to the trigger control 314). The terminal device 110 may present at least one shortcut instruction for the content in the interactive area 340. The at least one shortcut instruction here may, for example, include at least an insert instruction (for inputting the content into a conversation window as a user's message), a copy instruction (for copying the content), and an adjustment instruction (for instructing the digital assistant to adjust the content). The terminal device 110 may, for example, present a shortcut instruction by presenting at least one operation control corresponding to the at least one shortcut instruction in the interactive area 340. The terminal device 110 may, in response to detecting a selection operation on any operation control in at least one operation space, determine that a corresponding shortcut instruction has been detected, and then execute an operation corresponding to the shortcut instruction. For example, the terminal device 110 may, in response to detecting a selection operation on the operation control "Insert", determine that an insert instruction has been detected, and then execute an operation to input the summarized content into the conversation window as a user's message.

[0071] In some embodiments, the terminal device 110 may also cancel the presentation of the interactive area 340 in response to a user operation. Exemplarily, in response to detecting a selection operation on the operation control "Exit" shown in FIG3B , the terminal device 110 cancels the presentation of the interactive area 340. Exemplarily, if the terminal device 110 is a PC terminal, the terminal device 110 may, for example, respond to receiving a click operation on the close control of the interactive area 340, or a selection operation on the shortcut key ESC, to close the interactive area 340. If the terminal device 110 is a mobile terminal, the terminal device 110 may, for example, respond to detecting a pull-down operation on the interactive area and close the interactive area 340. It will be understood that the terminal device 110 may also cancel the presentation of the interactive area 340 in response to other operations. Only some examples are shown here, and they do not constitute a limitation on specific operations.

[0072] Similarly, if the session window is switched to another window or the session window is closed when the interaction area is presented, when the session window is presented again, the terminal device 110 can continue to present the interaction area, and the interaction information in the interaction area remains unchanged.

[0073] In this way, in response to detecting a user's selection operation on multiple messages in the conversation window, the digital assistant can be triggered so that the user can interact with the digital assistant in the conversation.

[0074] 4A and 4B show schematic diagrams of an example client interface 401 according to some embodiments of the present disclosure. The client interface 401 may be implemented at the terminal device 110. The examples of FIG. 4A and FIG. 4B are described below with reference to FIG.

[0075] Multiple messages can be presented in a conversation window between a user and at least one other user. In response to detecting a selection operation on multiple messages in the user's conversation window, the terminal device 110 can present an operation bar for the multiple messages. As shown in FIG4A , the instant messaging application is presented in area 430 of interface 401, and the information stream is presented in area 420 of interface 401. In response to the user selecting any contact or any group in the instant messaging application, the terminal device 110 can present the corresponding conversation window in area 410 of interface 401. The conversation window includes multiple messages. The terminal device 110 detects a forwarding operation on one or more messages in the conversation window and presents a forwarding panel 440. The forwarding operation here can be, for example, a selection operation on the forwarding control in the operation bar 312 shown in FIG3A .

[0076] The forwarding panel 440 may include, for example, a forwarding object display area 442, a forwarding content display area 444, and a message input area 446. The forwarding object display area 442 is used to display the forwarded contact, that is, the object to which the user wishes to forward the content. The forwarding content display area 444 is used to display at least a portion of the forwarded content or a summary or identification of the forwarded content. Exemplarily, when only one message is forwarded, the forwarding content display area 444 may be used to display at least a portion of the message, and when multiple messages are forwarded, the forwarding content display area may be used to display a summary or identification of the multiple messages. The message input area 446 is used to present the user's message for the forwarded content, which will be forwarded to the forwarded contact together with the forwarded content.

[0077] In some embodiments, a trigger control for the digital assistant may also be provided in the forwarding panel 440. This trigger control may, for example, be provided in the message input area 446 of the forwarding panel 440. As shown in FIG4A , a trigger control 447 is presented in the message input area 446. The trigger control 447 may, for example, be used to instruct the digital assistant to summarize one or more forwarded messages. In some embodiments, this trigger control may also, for example, be used to indicate the presentation of an interaction area with the digital assistant. In this case, the name of the trigger control may, for example, be "Digital Assistant" instead of "Add Summary."

[0078] The terminal device 110 triggers the user's interaction with the digital assistant in response to a preset operation on the trigger control 447. In some embodiments, as shown in Figures 4A and 4B, in response to detecting the preset operation on the trigger control 447 in Figure 4A, the terminal device 110 can trigger the digital assistant to summarize the forwarded one or more messages and present the summary results returned by the digital assistant in the message input area 446 of the forwarding panel as shown in Figure 4B.

[0079] In this way, in response to detecting a user's preset operation of a trigger control in a forwarding panel, the digital assistant can be triggered so that the user can interact with the digital assistant when forwarding.

[0080] 5A and 5B are schematic diagrams of an example client interface 501 according to some embodiments of the present disclosure. The client interface 501 may be implemented at the terminal device 110. The examples of FIG. 5A and FIG. 5B are described below with reference to FIG. 1 .

[0081] Multiple messages can be presented in a conversation window between a user and at least one other user. In response to detecting a selection operation on multiple messages in the user's conversation window, terminal device 110 can present an operation bar for the multiple messages. As shown in FIG5A , the instant messaging application is presented in area 530 of interface 501, and the information stream is presented in area 520 of interface 501. In response to the user selecting any contact or any group in the instant messaging application, terminal device 110 can present the corresponding conversation window in area 510 of interface 501.

[0082] In some embodiments, in response to a user joining a session (e.g., a user joining a group chat), the terminal device 110 may present a summary instruction for the digital assistant in the session window corresponding to the session. This summary instruction may be used to instruct the digital assistant to summarize the historical messages in the group chat window. As shown in FIG5A , a summary instruction (e.g., “Let the digital assistant help you summarize”) may be included in a system message 511 in the group chat window. In some embodiments, as shown in FIG5B , in response to detecting a triggering operation for a summary instruction, the terminal device 110 may present an interaction area between the user and the digital assistant, and present the result of the summary of the historical messages in the interaction area.

[0083] In this way, in response to detecting that a user has newly joined the conversation, a summary instruction can be presented to the user. In response to a trigger operation on the summary instruction, the digital assistant can be triggered so that the user can interact with the digital assistant when forwarding.

[0084] 6A and 6C are schematic diagrams of an example client interface 601 according to some embodiments of the present disclosure. The client interface 601 may be implemented at the terminal device 110. The examples of FIG. 6A to FIG. 6C are described below with reference to FIG.

[0085] Multiple messages can be presented in a conversation window between a user and at least one other user. In response to detecting a selection operation on multiple messages in the user's conversation window, terminal device 110 can present an operation bar for the multiple messages. As shown in FIG6A , the instant messaging application is presented in area 630 of interface 601, and the information stream is presented in area 620 of interface 601. In response to the user selecting any contact or any group in the instant messaging application, terminal device 110 can present the corresponding conversation window in area 610 of interface 601.

[0086] In some embodiments, in response to the presence of unread messages in the user's conversation window, the terminal device 110 may present a summary instruction for the digital assistant at a preset position in the conversation window. The summary instruction is used to instruct the digital assistant to summarize the unread messages. In some embodiments, as shown in Figure 6A, the terminal device 110 may present a summary instruction 611 at a position corresponding to the prompt for the unread messages. Alternatively or additionally, in some embodiments, as shown in Figure 6B, the terminal device 110 may also present a summary instruction 612 for the digital assistant when the number of unread messages reaches a preset threshold. The preset threshold here may be, for example, pre-set by the user, or determined by the digital assistant based on historical messages. In some embodiments, as shown in Figure 6C, in response to detecting a trigger operation for the summary instruction, the terminal device 110 may present an interaction area 640 between the user and the digital assistant, and present the results of the summary of historical messages in the interaction area 640.

[0087] In this way, in response to detecting that there are unread messages, a summary instruction can be presented to the user. In response to a triggering operation on the summary instruction, the digital assistant can be triggered so that the user can interact with the digital assistant when forwarding.

[0088] In the examples described in Figures 2A to 6C above, regarding the specific way in which the user interacts with the digital assistant, in some embodiments, in the interaction area, the user and the digital assistant interact at least with the message in the conversation window (for example, including the message content and message type, etc.) as the context. In some embodiments, in the interaction area, the user and the digital assistant can also interact with at least one of the information related to the chat user involved in the conversation window (for example, the user name, the time of sending the message, the reply chain, etc.) and the configuration information of the conversation window (for example, the name of the conversation window, description information, etc.) as the context. Exemplarily, if the user wants the digital assistant to summarize the messages in the conversation window, the digital assistant needs to obtain the messages in the conversation window, the information related to the chat user involved in the conversation window, and the configuration information of the conversation window. The digital assistant can, for example, provide these contents as context to a trained model and obtain output for these contents from the model, which output can, for example, be a summary of the messages in the conversation window. This model can, for example, be a trained language model (LM), a large language model (LLM), and the like.

[0089] In some embodiments, in the scenario where at least one message is selected and interaction with the digital assistant is triggered, the digital assistant only obtains the at least one message selected by the user, information related to the chat users involved in the conversation window, and configuration information of the conversation window, and provides this information as context to the model. In some embodiments, in the scenario where at least one message is forwarded and interaction with the digital assistant is triggered, the digital assistant can obtain the at least one message selected by the user to be forwarded, information related to the chat users involved in the conversation window, and configuration information of the conversation window, and provide this information as context to the model. In the scenario where the user newly joins a conversation and interaction with the digital assistant is triggered, the digital assistant obtains historical messages in the conversation for a predetermined time period (e.g., within 1 month), information related to the chat users involved in the conversation window, and configuration information of the conversation window, and provides this information as context to the model. In the scenario where the user receives an unread message and interacts with the digital assistant, the digital assistant obtains at least one unread message of the user in the conversation, the message currently displayed in the conversation window, information related to the chat users involved in the conversation window, and configuration information of the conversation window, and provides this information as context to the model. In this way, the digital assistant can provide different information to the model based on different scenarios to obtain output corresponding to this information from the model.

[0090] In some embodiments, if the user is dissatisfied with the content generated by the digital assistant, the user can also choose to delete the content. For example, the terminal device 110 can delete the content generated by the digital assistant (for example, the summary result of the message) displayed in the interactive area in response to a delete operation (for example, clicking the shortcut key "R"). In some embodiments, the user can also choose to suspend output when the summary content has not been fully output, that is, to instruct the digital assistant not to continue generating new content, but the generated content will be retained in the interactive area. For example, when the content has not been fully generated (for example, when the digital assistant has only summarized part of the content), the terminal device 110 can respond to the suspend output operation (for example, clicking the exit key "ESC") to instruct the digital assistant not to generate new content, and the content displayed in the interactive area is part of the complete summary content that should be displayed. In some embodiments, if the digital assistant has not generated content when the suspend output operation is detected, the terminal device 110 instructs the digital assistant that it does not need to generate content. In this way, users can operate on the content generated by the digital assistant based on their own needs, which can improve the user experience when interacting with the digital assistant.

[0091] To sum up, according to the various embodiments of the present disclosure, in the chat window between a user and other users, the user is supported to select a digital assistant to process messages in the conversation in different scenarios, so that the user can efficiently complete various operations through interaction with the digital assistant.

[0092] It should be understood that some embodiments of the present disclosure are described above with reference to the specific examples in the accompanying drawings, but these specific examples shown in the drawings do not limit the scope of the embodiments of the present disclosure. The described embodiments can also be implemented in various other variations.

[0093] 7 shows a flow chart of a process 700 for information interaction according to some embodiments of the present disclosure. The process 700 may be implemented at the terminal device 110. For ease of discussion, the process 700 will be described with reference to the environment 100 of FIG. 1 .

[0094] In box 710, the terminal device 110 presents a trigger control for the first digital assistant in response to detecting a preset input in the input box of the conversation window of the first user, and the conversation window includes a single chat window between the first user and the second user or a group chat window between the first user and a group of users.

[0095] In box 720, the terminal device 110 presents an interaction area between the first user and the first digital assistant in response to a preset operation on the trigger control, for the first user to interact with the first digital assistant.

[0096] In some embodiments, in the interaction area, the first user interacts with the first digital assistant at least in the context of a message in the conversation window.

[0097] In some embodiments, in the interaction area, the first user and the first digital assistant also interact with each other in the context of at least one of the following: information related to the chat users involved in the conversation window, and configuration information of the conversation window.

[0098] In some embodiments, the preset input includes a contact mention symbol.

[0099] In some embodiments, presenting the trigger control for the first digital assistant includes: in response to the contact mention symbol, displaying the trigger control for the first digital assistant separately from other contacts that may be mentioned in the conversation window.

[0100] In some embodiments, the interaction area includes at least one of the following: at least one shortcut command, and an input control for receiving commands; wherein the at least one shortcut command in the interaction area includes at least one of the following: summarizing unread messages in the conversation window, summarizing messages in the conversation window within a predetermined time period, summarizing messages of a specific user in the conversation window, adjusting the message input by the first user, and explaining specific terms mentioned in the message in the conversation window.

[0101] In some embodiments, process 700 further includes: in response to the interaction area being canceled from being presented, presenting an input box of the conversation window, and deleting the preset input from the input box.

[0102] In some embodiments, process 700 further includes: if the session window is switched to another window or the session window is closed while the interaction area is being presented, when the session window is presented again, the interaction area continues to be presented, and the interaction information in the interaction area remains unchanged.

[0103] In some embodiments, process 700 also includes: if content generated by the first digital assistant according to the instructions of the first user is presented in the interaction area, at least one shortcut instruction for the content is presented in the interaction area, wherein the at least one shortcut instruction includes one or more of the following: an insert instruction for entering the content as a message of the first user into the conversation window, a copy instruction for copying the content, and an adjustment instruction for instructing the first digital assistant to adjust the content.

[0104] In some embodiments, process 700 also includes: in response to the first user joining the first conversation, presenting a summary instruction for the first digital assistant in the first conversation window corresponding to the first conversation, the summary instruction being used to instruct the first digital assistant to summarize historical messages in the first group chat window.

[0105] In some embodiments, the summary instruction is included in a system message in the first group chat window.

[0106] In some embodiments, process 700 also includes: in response to the presence of unread messages in the conversation window of the first user, presenting a summary instruction for the first digital assistant at a preset position of the conversation window, wherein the summary instruction is used to instruct the first digital assistant to summarize the unread messages.

[0107] In some embodiments, presenting summary instructions for the first digital assistant includes one or more of the following: presenting summary instructions at a location corresponding to a prompt for unread messages; presenting summary instructions for the first digital assistant when the number of unread messages reaches a preset threshold.

[0108] In some embodiments, process 700 also includes: in response to detecting a selection operation on multiple messages in the conversation window of the first user, presenting an operation bar for the multiple messages, the operation bar including a trigger control for the first digital assistant, the trigger control being used to instruct the first digital assistant to summarize the multiple messages; and in response to a preset operation on the trigger control, displaying the summary result of the first digital assistant.

[0109] In some embodiments, process 700 also includes: in response to detecting a forwarding operation on one or more messages in the conversation window of the first user, presenting a forwarding panel; and providing a trigger control for the first digital assistant in the forwarding panel, wherein a preset operation on the trigger control triggers the interaction between the first user and the first digital assistant.

[0110] In some embodiments, process 700 triggers controls to be provided in the message input area of ​​the forwarding panel.

[0111] In some embodiments, process 700 also includes: in response to detecting a preset operation on a trigger control, triggering the first digital assistant to summarize the one or more forwarded messages; and presenting the results of the summary returned by the first digital assistant in the message input area of ​​the forwarding panel.

[0112] 8 shows a flow chart of a process 800 for information interaction according to some embodiments of the present disclosure. The process 800 may be implemented at the terminal device 110. For ease of discussion, the process 800 will be described with reference to the environment 100 of FIG. 1 .

[0113] In box 810, in response to detecting a selection operation on multiple messages in the conversation window of the first user, the terminal device 110 presents an operation bar for the multiple messages, and the operation bar includes a trigger control for the first digital assistant.

[0114] In box 820, the terminal device 110 sends an instruction corresponding to the trigger control to the first digital assistant in response to the preset operation of the trigger control.

[0115] In some embodiments, the trigger control is used to instruct the first digital assistant to summarize multiple messages; or, the trigger control is used to instruct the presentation of an interaction area with the first digital assistant.

[0116] In some embodiments, in the interaction area, the first user interacts with the first digital assistant in the context of the selected multiple messages.

[0117] In some embodiments, the interaction area includes at least one of the following: at least one shortcut command, and an input control for receiving the command.

[0118] In some embodiments, process 800 further includes: if the session window is switched to another window or the session window is closed while the interaction area is being presented, when the session window is presented again, the interaction area continues to be presented, and the interaction information in the interaction area remains unchanged.

[0119] In some embodiments, process 800 also includes: if content generated by the first digital assistant according to the instructions of the first user is presented in the interaction area, at least one shortcut instruction for the content is presented in the interaction area, wherein the at least one shortcut instruction includes one or more of the following: an insert control for entering the content as a message of the first user into the conversation window, a copy control for copying the content, and an adjustment control for instructing the first digital assistant to adjust the content.

[0120] In some embodiments, the conversation window includes a single chat window between the first user and the second user or a group chat window between the first user and a group of users.

[0121] 9 shows a flow chart of a process 900 for information interaction according to some embodiments of the present disclosure. The process 900 may be implemented at the terminal device 110. For ease of discussion, the process 900 will be described with reference to the environment 100 of FIG. 1 .

[0122] In block 910 , the terminal device 110 presents a forwarding panel in the conversation window of the first user if a forwarding operation on one or more messages in the conversation window is detected.

[0123] In box 920, the terminal device 110 provides a trigger control for the first digital assistant in the forwarding panel, and the preset operation of the trigger control triggers the interaction between the first user and the first digital assistant.

[0124] In some embodiments, a trigger control is provided in the message input area of ​​the forwarding panel.

[0125] In some embodiments, process 900 also includes: in response to detecting a preset operation on a trigger control, triggering the first digital assistant to summarize the one or more forwarded messages; and presenting the results of the summary returned by the first digital assistant in the message input area of ​​the forwarding panel.

[0126] In some embodiments, the conversation window includes a single chat window between the first user and the second user or a group chat window between the first user and a group of users.

[0127] Figure 10 shows a schematic structural block diagram of an apparatus 1000 for information interaction according to some embodiments of the present disclosure. Apparatus 1000 may be implemented as or included in a terminal device 110. Each module / component in apparatus 1000 may be implemented by hardware, software, firmware, or any combination thereof.

[0128] Device 1000 includes a trigger control presentation module 1010 configured to present a trigger control for a first digital assistant in response to detecting a preset input in an input box of an instant messaging session window of a first user, where the instant messaging session window includes a single chat window between the first user and a second user or a group chat window between the first user and a group of users. Device 1000 also includes an interaction area presentation module 1020 configured to present an interaction area between the first user and the first digital assistant in response to a preset operation on the trigger control, for the first user to interact with the first digital assistant.

[0129] In some embodiments, in the interaction area, the first user interacts with the first digital assistant at least in the context of a message in the conversation window.

[0130] In some embodiments, in the interaction area, the first user and the first digital assistant also interact with each other in the context of at least one of the following: information related to the chat users involved in the conversation window, and configuration information of the conversation window.

[0131] In some embodiments, the preset input includes a contact mention symbol.

[0132] In some embodiments, the trigger control presentation module 1010 is further configured to: in response to a contact mention symbol, display the trigger control of the first digital assistant separately from other contacts that may be mentioned in the conversation window.

[0133] In some embodiments, the interaction area includes at least one of the following: at least one shortcut command, and an input control for receiving commands; wherein the at least one shortcut command in the interaction area includes at least one of the following: summarizing unread messages in the conversation window, summarizing messages in the conversation window within a predetermined time period, summarizing messages of a specific user in the conversation window, adjusting the message input by the first user, and explaining specific terms mentioned in the message in the conversation window.

[0134] In some embodiments, the apparatus 1000 further includes: a presentation cancellation module configured to present an input box of the conversation window in response to the interaction area being canceled from presentation, and to delete the preset input from the input box.

[0135] In some embodiments, the device 1000 also includes: a first continued presentation module, which is configured to continue presenting the interaction area when the session window is presented again if the interaction area is switched from the session window to other windows or the session window is closed when the interaction area is presented, and the interaction information in the interaction area remains unchanged.

[0136] In some embodiments, the device 1000 also includes: a first shortcut instruction presentation module, configured to present at least one shortcut instruction for the content in the interaction area if content generated by the first digital assistant according to the instructions of the first user is presented in the interaction area, wherein the at least one shortcut instruction includes one or more of the following: an insert instruction for inputting the content into the conversation window as a message of the first user, a copy instruction for copying the content, and an adjustment instruction for instructing the first digital assistant to adjust the content.

[0137] In some embodiments, the device 1000 also includes: a first instruction presentation module, configured to present a summary instruction for the first digital assistant in a first session window corresponding to the first session in response to the first user joining the first session, the summary instruction being used to instruct the first digital assistant to summarize historical messages in the first group chat window.

[0138] In some embodiments, the summary instruction is included in a system message in the first group chat window.

[0139] In some embodiments, the device 1000 also includes: a second instruction presentation module, configured to present a summary instruction for the first digital assistant at a preset position of the conversation window in response to the presence of unread messages in the conversation window of the first user, the summary instruction being used to instruct the first digital assistant to summarize the unread messages.

[0140] In some embodiments, the second instruction presentation module includes one or more of the following: a third instruction presentation module, configured to present summary instructions at a position corresponding to the prompt of unread messages; a fourth instruction presentation module, configured to present summary instructions for the first digital assistant when the number of unread messages reaches a preset threshold.

[0141] In some embodiments, the device 1000 also includes: a first presentation module, configured to present an operation bar for the multiple messages in response to detecting a selection operation on multiple messages in the conversation window of the first user, the operation bar including a trigger control for the first digital assistant, the trigger control being used to instruct the first digital assistant to summarize the multiple messages; and a first result display module, configured to display the summary results of the first digital assistant in response to a preset operation on the trigger control.

[0142] In some embodiments, the device 1000 also includes: a second presentation module, configured to present a forwarding panel in response to detecting a forwarding operation on one or more messages in the conversation window of the first user; and a first trigger module, configured to provide a trigger control for the first digital assistant in the forwarding panel, and a preset operation on the trigger control triggers the interaction between the first user and the first digital assistant.

[0143] In some embodiments, device 1000 trigger controls are provided in the message input area of ​​the forwarding panel.

[0144] In some embodiments, the device 1000 also includes: a second trigger module, configured to trigger the first digital assistant to summarize the one or more forwarded messages in response to detecting a preset operation on the trigger control; and a fourth presentation module, configured to present the summary results returned by the first digital assistant in the message input area of ​​the forwarding panel.

[0145] 11 shows a schematic structural block diagram of an apparatus 1100 for information interaction according to some embodiments of the present disclosure. Apparatus 1100 may be implemented as or included in a terminal device 110. Each module / component in apparatus 1100 may be implemented by hardware, software, firmware, or any combination thereof.

[0146] Device 1100 includes an operation bar presentation module 1110 configured to, in response to detecting a selection operation on multiple messages in a conversation window of a first user, present an operation bar for the multiple messages, the operation bar including a trigger control for a first digital assistant. Device 1100 also includes an instruction triggering module 1120 configured to, in response to a preset operation on the trigger control, send an instruction corresponding to the trigger control to the first digital assistant.

[0147] In some embodiments, the trigger control is used to instruct the first digital assistant to summarize multiple messages; or, the trigger control is used to instruct the presentation of an interaction area with the first digital assistant.

[0148] In some embodiments, in the interaction area, the first user interacts with the first digital assistant in the context of the selected multiple messages.

[0149] In some embodiments, the interaction area includes at least one of the following: at least one shortcut command, and an input control for receiving the command.

[0150] In some embodiments, the device 1100 also includes: a second continuation presentation module, which is configured to continue presenting the interaction area when the session window is presented again if the interaction area is switched from the session window to other windows or the session window is closed when the interaction area is presented, and the interaction information in the interaction area remains unchanged.

[0151] In some embodiments, the device 1100 also includes: a second shortcut instruction presentation module, configured to present at least one shortcut instruction for the content in the interaction area if content generated by the first digital assistant according to the instructions of the first user is presented in the interaction area, wherein the at least one shortcut instruction includes one or more of the following: an insert control for inputting the content into the conversation window as a message of the first user, a copy control for copying the content, and an adjustment control for instructing the first digital assistant to adjust the content.

[0152] In some embodiments, the conversation window includes a single chat window between the first user and the second user or a group chat window between the first user and a group of users.

[0153] Figure 12 shows a schematic structural block diagram of an apparatus 1200 for information interaction according to some embodiments of the present disclosure. Apparatus 1200 may be implemented as or included in terminal device 110. Each module / component in apparatus 1200 may be implemented by hardware, software, firmware, or any combination thereof.

[0154] Apparatus 1200 includes a forwarding panel presentation module 1210 configured to present a forwarding panel in a conversation window of a first user upon detecting a forwarding operation on one or more messages in the conversation window. Apparatus 1200 also includes a trigger control provision module 1220 configured to provide a trigger control for the first digital assistant in the forwarding panel, wherein a preset operation on the trigger control triggers interaction between the first user and the first digital assistant.

[0155] In some embodiments, a trigger control is provided in the message input area of ​​the forwarding panel.

[0156] In some embodiments, the device 1200 also includes: a third trigger module, configured to trigger the first digital assistant to summarize the one or more forwarded messages in response to detecting a preset operation on the trigger control; and a fifth presentation module, configured to present the results of the summary returned by the first digital assistant in the message input area of ​​the forwarding panel.

[0157] In some embodiments, the conversation window includes a single chat window between the first user and the second user or a group chat window between the first user and a group of users.

[0158] The units and / or modules included in the device 1000 / 1100 / 1200 can be implemented in various ways, including software, hardware, firmware or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units and / or modules in the device 1000 / 1100 / 1200 can be implemented at least in part by one or more hardware logic components. As an example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0159] It should be understood that one or more steps in the above method can be performed by an appropriate electronic device or combination of electronic devices. Such electronic device or combination of electronic devices may include, for example, the server 130, the terminal device 110, and / or the combination of the server 130 and the terminal device 110 in FIG. 1 .

[0160] FIG13 shows a block diagram of an electronic device 1300 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 1300 shown in FIG13 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 1300 shown in FIG13 may be used to implement the terminal device 110 of FIG1 .

[0161] As shown in FIG13 , electronic device 1300 is a general-purpose electronic device. Components of electronic device 1300 may include, but are not limited to, one or more processors or processing units 1310, memory 1320, storage device 1330, one or more communication units 1340, one or more input devices 1350, and one or more output devices 1360. Processing unit 1310 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 1320. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to enhance the parallel processing capabilities of electronic device 1300.

[0162] The electronic device 1300 typically includes a plurality of computer storage media. Such media can be any available media accessible to the electronic device 1300, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1320 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1330 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 1300.

[0163] The electronic device 1300 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 13 , a disk drive for reading from or writing to a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 1320 may include a computer program product 1325 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0164] The communication unit 1340 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 1300 can be implemented as a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 1300 can operate in a networked environment using a logical connection to one or more other servers, a network personal computer (PC), or another network node.

[0165] Input device 1350 may be one or more input devices, such as a mouse, keyboard, or trackball. Output device 1360 may be one or more output devices, such as a display, a speaker, or a printer. Electronic device 1300 may also communicate with one or more external devices (not shown) via communication unit 1340, as needed. External devices such as storage devices, display devices, and the like may also be used to communicate with one or more devices that allow a user to interact with electronic device 1300, or with any device that allows electronic device 1300 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0166] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0167] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0168] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0169] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0170] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0171] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for information interaction, comprising: In response to detecting a preset input in an input box of a conversation window of a first user, presenting a trigger control for a first digital assistant, wherein the conversation window includes a single chat window between the first user and a second user or a group chat window between the first user and a group of users; as well as In response to a preset operation on the trigger control, an interaction area between the first user and the first digital assistant is presented for the first user to interact with the first digital assistant.

2. The method according to claim 1, wherein in the interaction area, the first user interacts with the first digital assistant at least in the context of a message in the conversation window.

3. The method according to claim 1, wherein in the interaction area, the first user and the first digital assistant also interact with each other in the context of at least one of the following: information related to the chat users involved in the conversation window, and configuration information of the conversation window. The method of claim 1 , wherein the preset input comprises a contact mention symbol.

5. The method of claim 4, wherein presenting a trigger control for the first digital assistant comprises: In response to the contact mention symbol, the trigger control of the first digital assistant will be displayed separately from other contacts that can be mentioned in the conversation window.

6. The method according to claim 1, wherein the interactive area includes at least one of the following: at least one shortcut command, and an input control for receiving a command; The at least one shortcut command in the interactive area includes at least one of the following: summarizes the unread messages in the conversation window, summarizing the messages in the conversation window within a predetermined time period, summarizes the messages for a particular user in the conversation window, an adjustment to the message input by the first user, Explain specific terms mentioned in messages in the conversation window.

7. The method according to claim 1, further comprising: In response to the interaction area being canceled from being presented, the input box of the conversation window is presented, and the preset input is deleted from the input box.

8. The method according to claim 1, further comprising: If the session window is switched to another window or the session window is closed when the interaction area is presented, the interaction area continues to be presented when the session window is presented again, and the interaction information in the interaction area remains unchanged.

9. The method according to claim 1, further comprising: If content generated by the first digital assistant according to the instruction of the first user is presented in the interaction area, at least one shortcut instruction for the content is presented in the interaction area, The at least one shortcut command includes one or more of the following: inserting instructions, used to input the content into the conversation window as a message of the first user, Copy instructions for copying said content, and An adjustment instruction is used to instruct the first digital assistant to adjust the content.

10. The method according to claim 1, further comprising: In response to the first user joining the first conversation, a summary instruction for the first digital assistant is presented in a first conversation window corresponding to the first conversation, and the summary instruction is used to instruct the first digital assistant to summarize historical messages in the first group chat window. The method of claim 10 , wherein the summary instruction is included in a system message of the first group chat window.

12. The method according to claim 1, further comprising: In response to the presence of unread messages in the conversation window of the first user, a summary instruction for the first digital assistant is presented at a preset position in the conversation window, wherein the summary instruction is used to instruct the first digital assistant to summarize the unread messages.

13. The method of claim 12, wherein presenting summary instructions for the first digital assistant comprises one or more of: Presenting the summary instruction at a position corresponding to the prompt of the unread message; When the number of unread messages reaches a preset threshold, summary instructions for the first digital assistant are presented.

14. The method according to claim 1, further comprising: In response to detecting a selection operation on a plurality of messages in the conversation window of the first user, presenting an operation bar for the plurality of messages, the operation bar including a trigger control for the first digital assistant, the trigger control being used to instruct the first digital assistant to summarize the plurality of messages; as well as In response to a preset operation on the trigger control, the summary results of the first digital assistant are displayed.

15. The method according to claim 1, further comprising: In response to detecting, in the conversation window of the first user, a forwarding operation on one or more messages in the conversation window, presenting a forwarding panel; as well as A trigger control for the first digital assistant is provided in the forwarding panel, and a preset operation of the trigger control triggers the interaction between the first user and the first digital assistant.

16. The method of claim 15, wherein the trigger control is provided in a message input area of ​​the forwarding panel.

17. The method according to claim 15, further comprising: In response to detecting a preset operation on the trigger control, triggering the first digital assistant to summarize the one or more forwarded messages; as well as The summarized results returned by the first digital assistant are presented in the message input area of ​​the forwarding panel.

18. A method for information interaction, comprising: In response to detecting a selection operation on a plurality of messages in a conversation window of a first user, presenting an operation bar for the plurality of messages, the operation bar including a trigger control for a first digital assistant; as well as In response to a preset operation on the trigger control, an instruction corresponding to the trigger control is sent to the first digital assistant.

19. The method according to claim 18, wherein: The trigger control is used to instruct the first digital assistant to summarize the multiple messages; or, The trigger control is used to indicate the presentation of an interaction area with the first digital assistant.

20. The method according to claim 19, wherein in the interaction area, the first user interacts with the first digital assistant in the context of the selected plurality of messages.

21. The method according to claim 19, wherein the interactive area includes at least one of the following: at least one shortcut command, and an input control for receiving a command.

22. The method of claim 19, further comprising: If the session window is switched to another window or the session window is closed when the interaction area is presented, the interaction area continues to be presented when the session window is presented again, and the interaction information in the interaction area remains unchanged.

23. The method of claim 19, further comprising: If content generated by the first digital assistant according to the instruction of the first user is presented in the interaction area, at least one shortcut instruction for the content is presented in the interaction area, The at least one shortcut command includes one or more of the following: inserting a control for inputting the content into the conversation window as a message of the first user, a copy control, for copying said content, and An adjustment control is used to instruct the first digital assistant to adjust the content.

24. The method according to claim 18, wherein the conversation window comprises a single chat window between the first user and the second user or a group chat window between the first user and a group of users.

25. A method for information interaction, comprising: In the conversation window of the first user, if a forwarding operation on one or more messages in the conversation window is detected, presenting a forwarding panel; as well as A trigger control for the first digital assistant is provided in the forwarding panel, and a preset operation of the trigger control triggers the interaction between the first user and the first digital assistant.

26. The method of claim 25, wherein the trigger control is provided in a message input area of ​​the forwarding panel.

27. The method of claim 25, further comprising: In response to detecting a preset operation on the trigger control, triggering the first digital assistant to summarize the one or more forwarded messages; as well as The summarized results returned by the first digital assistant are presented in the message input area of ​​the forwarding panel.

28. The method according to claim 25, wherein the conversation window comprises a single chat window between the first user and the second user or a group chat window between the first user and a group of users.

29. A device for information interaction, comprising: a trigger control presentation module, configured to present a trigger control for the first digital assistant in response to detecting a preset input in an input box of an instant messaging session window of a first user, wherein the instant messaging session window includes a single chat window between the first user and a second user or a group chat window between the first user and a group of users; as well as An interaction area presentation module is configured to present an interaction area between the first user and the first digital assistant in response to a preset operation on the trigger control, so as to enable the first user to interact with the first digital assistant.

30. A device for information interaction, comprising: An operation bar presenting module, configured to present an operation bar for a plurality of messages in a conversation window of a first user in response to detecting a selection operation on the plurality of messages in the conversation window, wherein the operation bar includes a trigger control for the first digital assistant; as well as The instruction trigger module is configured to send an instruction corresponding to the trigger control to the first digital assistant in response to a preset operation on the trigger control.

31. A device for information interaction, comprising: A forwarding panel presentation module is configured to present a forwarding panel in a conversation window of a first user if a forwarding operation on one or more messages in the conversation window is detected; as well as A trigger control providing module is configured to provide a trigger control for the first digital assistant in the forwarding panel, and a preset operation of the trigger control triggers the interaction between the first user and the first digital assistant.

32. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform the method according to any one of claims 1 to 17, the method according to any one of claims 18 to 24, or the method according to any one of claims 25 to 28.

33. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 17, the method according to any one of claims 18 to 24, or the method according to any one of claims 25 to 28.

Images