Information processing methods, apparatus, equipment and storage media

Abstract

According to embodiments of this disclosure, a method, apparatus, device, and storage medium for information processing are provided. The method includes displaying a first interaction window with the digital assistant in response to an operation that invokes a digital assistant on a first page; displaying at least one first interaction message between the user and the digital assistant in the first interaction window; and displaying the at least one first interaction message in an aggregated form as a first message record in a main session window of the user's interaction with the digital assistant. Thus, the interaction messages between the user and the digital assistant can be uniformly recorded and thus traced back, which is beneficial for providing users with an efficient assistance experience.

Description

Technical Field

[0001] The exemplary embodiments disclosed herein generally relate to the field of computers, and more particularly to methods, apparatus, devices and computer-readable storage media for information processing. Background Technology

[0002] With the development of information technology, various terminal devices can provide people with a variety of services in work and life. For example, terminal devices can be equipped with applications that provide services. Terminal devices or their applications can provide assistant functions to help users complete tasks. How to make such assistant functions better serve users is a current technical problem being explored. Summary of the Invention

[0003] In a first aspect of this disclosure, an information processing method is provided. The method includes: in response to an operation that invokes a digital assistant on a first page, displaying a first interaction window with the digital assistant; displaying at least one first interaction message between the user and the digital assistant in the first interaction window; and displaying the at least one first interaction message in an aggregated form as a first message record in a main session window of the user's interaction with the digital assistant.

[0004] In a second aspect of this disclosure, an information processing method is provided. The method includes: opening a target page through interaction between a user and a digital assistant in a main session window; displaying an interaction window with the digital assistant in response to an operation that invokes the digital assistant on the target page; and displaying contextual information related to the target page from the main session window in the interaction window.

[0005] In a third aspect of this disclosure, an apparatus for information processing is provided. The apparatus includes: a first display module configured to display a first interaction window with the digital assistant in response to an operation that invokes a digital assistant on a first page; a second display module configured to display at least one first interaction message between the user and the digital assistant in the first interaction window; and a third display module configured to display, in an aggregated form, a first message record in a main session window of the user's interaction with the digital assistant.

[0006] In a fourth aspect of this disclosure, an apparatus for information processing is provided. The apparatus includes: an opening module configured to open a target page through interaction between a user and a digital assistant in a main session window; a fourth display module configured to display an interaction window with the digital assistant in response to an operation that invokes the digital assistant on the target page; and a fifth display module configured to display contextual information related to the target page from the main session window in the interaction window.

[0007] In a fifth aspect of this disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the methods of the first or second aspect.

[0008] In a sixth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program that can be executed by a processor to implement the methods of the first or second aspect.

[0009] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0011] Figure 1 A schematic diagram of an example environment in which embodiments of the present disclosure can be implemented is shown;

[0012] Figure 2 A schematic diagram of an example interface of the main session window according to some embodiments is shown;

[0013] Figure 3 A schematic diagram of an example interface for opening a page and invoking a sub-interactive window on the page, according to some embodiments, is shown;

[0014] Figure 4A A schematic diagram of an example interface for opening a page via a main session window, according to some embodiments, is shown.

[0015] Figure 4B The following are illustrations based on some embodiments of the passage. Figure 4A An example of an interface diagram showing how an interactive window is invoked in a page opened in this way;

[0016] Figure 5 A schematic diagram of an example interface is shown, according to some embodiments, of interactive messages in a unified sub-interaction window within a main session window;

[0017] Figure 6 A schematic diagram of an example interface showing an interaction message log of multiple sub-interaction windows in a main session window, according to some embodiments;

[0018] Figure 7 A schematic diagram of an interface is shown as an example of displaying a record of interactive messages in the same page opened at different times in a main session window, according to some embodiments.

[0019] Figure 8 The diagram illustrates an example of an interface schematic showing an interactive message log in a sub-interactive window containing two topics in a main session window, according to some embodiments.

[0020] Figure 9 A schematic diagram of an example interface showing an interactive message log in a floating window mode of an interactive window displayed in a main session window, according to some embodiments;

[0021] Figure 10 A flowchart illustrating an information processing procedure according to some embodiments is shown;

[0022] Figure 11 Another flowchart illustrating an information processing procedure according to some embodiments is shown;

[0023] Figure 12 A block diagram of an apparatus for information processing according to some embodiments is shown;

[0024] Figure 13 A block diagram of another apparatus for information processing according to some embodiments is shown;

[0025] Figure 14 A block diagram of an apparatus capable of implementing several embodiments of the present disclosure is shown. Detailed Implementation

[0026] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0027] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0028] In this document, unless explicitly stated otherwise, performing a step in response to A does not mean that the step is performed immediately after A, but may include one or more intermediate steps.

[0029] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0030] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, relevant users should be informed of the type, scope of use, and usage scenarios of the information involved in this disclosure through appropriate means in accordance with relevant laws and regulations, and authorization should be obtained from the relevant users. Among them, relevant users may include any type of rights holder, such as individuals, enterprises, and groups.

[0031] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly inform the user that the requested operation will require obtaining and using the user's information, thereby enabling the relevant user to choose whether to provide information to the software or hardware such as the electronic device, application, server, or storage medium that performs the operation of the technical solution disclosed herein based on the prompt message.

[0032] As an optional but non-restrictive implementation, in response to a user's active request, a prompt message can be sent to the user, such as a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide information to the electronic device.

[0033] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0034] Figure 1A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In this example environment 100, an office suite 120 is installed on a terminal device 110. A user 140 can interact with the office suite 120 via the terminal device 110 and / or an attached device to the terminal device 110. The office suite 120 is capable of providing the user 140 with the integration of multiple components. These components can be component modules within the office suite 120. The components integrated in the office suite 120 are sometimes referred to as "office applications," "office components," "collaborative office platforms," ​​etc. As an example, the components integrated in the office suite 120 may include, but are not limited to, one or more of the following: chat components (also known as instant messaging (IM) components), document components, audio and video conferencing components, email components, calendar components, scheduling components, task components, and goal and key results (OKR) components.

[0035] In some embodiments, the office suite 120 can be downloaded and installed as an application on the terminal device 110. In some embodiments, the office suite 120 can also be accessed in other ways, such as through a web page.

[0036] exist Figure 1 In environment 100, if office suite 120 is started, terminal device 110 can present the interface 150 of office suite 120 to user 140. Interface 150 is sometimes also called client interface. Interface 150 can include various interfaces provided by office suite 120, such as a chat interface, a video conferencing interface, a file sharing interface, etc.

[0037] In some embodiments, terminal device 110 communicates with server 130 to provide services to office suite 120. Terminal device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, terminal device 110 can also support any type of user-facing interface (such as "wearable" circuitry). Server 130 can be any type of computing system / server capable of providing computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, etc.

[0038] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure. For example, embodiments of this disclosure can be applied to any suitable one or more applications, and are not limited to office suites.

[0039] As briefly mentioned above, digital assistants can be provided to users to help them complete target tasks using terminal devices or applications.

[0040] In embodiments of this disclosure, a digital assistant is configured for user 140. The digital assistant can be implemented in any suitable form. In some embodiments, user 140's digital assistant can interact with user 140 as a contact. Such a digital assistant can also uniquely correspond to user 140. In other words, user 140's digital assistant can be specific to or exclusive to user 140. For example, in providing assistance or services to user 140, the digital assistant can utilize its historical interaction information with user 140, the data authorized by user 140 that it can access, its current conversation content with the user, etc. If user 140 is an individual, such a digital assistant can be considered a personal digital assistant. It is understood that in embodiments of this disclosure, the digital assistant accesses data with granted permissions based on user 140's authorization.

[0041] It should be understood that the terms "unique correspondence" or similar expressions in this disclosure are not intended to limit the digital assistant to be updated accordingly based on the interaction process between user 140 and the digital assistant.

[0042] In some embodiments, the digital assistant can be implemented in a single component or application, such as an IM component. In some embodiments, the digital assistant can be implemented in multiple components. For example, these components can be different components of an office suite or collaborative work platform. In some embodiments, the digital assistant can be implemented directly in the terminal device 110 without being attached to any application. In this embodiment, the digital assistant provides assistance to the user 140 in the form of a contact.

[0043] To enable digital assistants to provide users with an efficient assistance experience, embodiments of this disclosure propose an information processing scheme. According to various embodiments of this disclosure, the main interaction window presented after waking the digital assistant on a preset page is the main interaction window. In embodiments of this disclosure, this main interaction window is typically in session mode and can therefore also be referred to as the main session window. When the digital assistant is woken up on a page other than the preset page, an interaction window corresponding to that page is presented (which can also be described as a sub-interaction window in embodiments of this disclosure), and the interaction message records in the sub-interaction window can be displayed in the main session window. Thus, the interaction messages between the user and the digital assistant can be uniformly recorded and thus traced back, which is beneficial for providing users with an efficient assistance experience.

[0044] To more clearly describe the embodiments of this disclosure, some exemplary embodiments of this disclosure will continue to be described below with reference to the accompanying drawings. In the following description, an office suite is primarily used as an example scenario, but this is merely exemplary and not intended to limit the scope of this disclosure. Digital assistants can be implemented in any other application or scenario, and are not limited to office suites.

[0045] As mentioned above, in this embodiment of the disclosure, the interactive window presented after waking up the digital assistant on the preset page is the main session window. In some embodiments, the preset page can be a page of a preset component or application. As an example, the preset component or application can be an IM component in an office suite. Accordingly, the preset page can be a page of the IM component in the office suite. In other examples, the preset component or application can also be other applications or components.

[0046] In some embodiments, the digital assistant can be invoked in various ways on the preset page mentioned above to present the main session window. For example, the digital assistant can be invoked and interacted with via a search. For instance, user 140 can enter keywords related to the digital assistant (such as the digital assistant's name or nickname) in the search box. In response, options related to the digital assistant can be presented as search results. User 140 can then invoke the digital assistant and initiate an interaction window by clicking on the option. As another example, the digital assistant can be invoked through a contact list or address book. For example, contact options corresponding to the digital assistant can be presented in the contact interface. In this way, a stable entry point for the digital assistant can be provided, allowing user 140 to conveniently invoke the digital assistant when needed.

[0047] refer to Figure 2 This describes an example of a main session window in an office suite. The terminal device presents an office suite interface 200. This interface 200 includes a navigation bar 230 displaying entry controls for multiple components and access points for multiple pages. Selecting these entry controls and access points activates the corresponding component or page for browsing or operation. In this example, the chat component is activated. Accordingly, the interface 200 presents the chat component's feed page 210, i.e., the session entry list. Among these, the user interacts with the digital assistant (… Figure 2 The conversation entry 211 for "XX Assistant" is displayed on the information flow page 210. Users can click on the conversation entry 211 for "XX Assistant" to bring up the interactive window 220. In this example, the interactive window 220 is the main conversation window between the user and the digital assistant.

[0048] In this disclosure, the digital assistant can also be in the contact list, and the user can open the main conversation window with the digital assistant by triggering the digital assistant in the contact list.

[0049] In the examples above and below, the digital assistant is shown with the name "XX Assistant," but it should be understood that this is merely exemplary and not intended to limit the scope of this disclosure. In embodiments of this disclosure, the digital assistant can have any suitable name, and the user can customize the name of the digital assistant.

[0050] In this embodiment of the disclosure, after waking up the digital assistant on a page other than the preset page mentioned above, a corresponding interactive window can also be presented. In this embodiment of the disclosure, such an interactive window can also be referred to as a sub-interactive window.

[0051] In some embodiments, the components or applications containing the main session window and the pages containing the sub-interaction windows may belong to different components or applications. For example, the main session window may be a component that contains an IM component, allowing the user to invoke the digital assistant, which in turn presents the main session window. The page containing the sub-interaction windows may be a document page, allowing the user to invoke the digital assistant, which in turn presents the sub-interaction windows within the document page.

[0052] In some embodiments, when a user wakes up the digital assistant from another page, the presented sub-interaction window may not contain context information, i.e., it may not contain the user's historical interaction messages with the digital assistant. In other embodiments, when a user wakes up the digital assistant from another page, the presented sub-interaction window may contain the user's historical interaction messages with the digital assistant.

[0053] As an example, see reference Figure 3 This describes an example of an interactive window in an office suite. The terminal device presents an office suite interface 300. This interface 300 includes a navigation bar 330, which displays entry controls for multiple components and access points for multiple pages. Selecting these entry controls and access points activates the corresponding component or page for browsing or operation. In this example, interface 300 presents an open document page 310, which can be viewed as follows: Figure 3As shown, the document can be opened via the document tab in the lower half of the navigation bar 330, the document component entry in the upper half of the navigation bar 330, a document link sent in the conversation window, or a search results page, etc. This disclosure does not impose any limitations on these methods. On the document page 310, options or controls 311 related to the digital assistant are presented. The user can click the control 311 to activate the digital assistant and present the interaction window 320. In this example, the interaction window 320 is a sub-interaction window. Alternatively or additionally, the interaction window 320 may not display contextual information. For example, the interaction window 320 may only display the prompt message "Start collaborating with you - based on AAAA". Furthermore, the user can interact with the digital assistant through the interaction window 320. The interaction window 320 may display interaction messages (as indicated by the dashed box 321).

[0054] In some embodiments, the sub-interaction windows may include contextual information. In some embodiments, other pages (such as documents, calendars, tasks, meetings, approvals, project management, customer relationship management, etc.) can also be opened through the main session window displayed in the aforementioned preset page, thereby waking up the digital assistant on those other pages and presenting the corresponding sub-interaction windows. Alternatively or additionally, in this triggering scenario, contextual information is displayed in the sub-interaction windows. For example, the contextual information may be the contextual information associated with the opened page in the main session window, such as dialogue messages associated with that page.

[0055] As an example, see reference Figure 4A and Figure 4B The terminal device displays the interface of the office suite. This interface includes a main chat window 420 invoked from the information flow page 410 of the chat component. The main chat window 420 contains a document 421. When the user opens the document 421, the corresponding document interface 430 is displayed. The document interface 430 presents options or controls 431 related to the digital assistant. (Reference) Figure 4B Users can click on control 431 in the document interface 430 to activate the digital assistant and present the interactive window 440. Alternatively or additionally, the interactive window 440 may display contextual information, such as the message presented before "Start collaborating with you - based on research in the XX field" in the interactive window 440. Furthermore, users can interact with the digital assistant through the interactive window 440. The interactive window 440 may display interactive messages (as indicated by the dashed box 441).

[0056] In some embodiments, the main session window may open before or after the sub-interaction windows. This disclosure does not limit the order in which the main session window and the sub-interaction windows open.

[0057] In some embodiments, the interactive messages in the sub-interaction windows are displayed in an aggregated form in the main session window.

[0058] As an example, refer to Figure 3 and Figure 5 The interactive messages in the interactive window 320 presented in interface 300 (as indicated by dashed box 321) are displayed in aggregated message records (as indicated by dashed box 510) in the main session window 220 presented in interface 500. Here, aggregated form can mean that the message records in interactive window 320 are displayed in a centralized manner, for example, in the position indicated by dashed box 510, where no other messages are inserted.

[0059] In some embodiments of this disclosure, the digital assistant can be activated on multiple different pages other than the preset page mentioned above, and corresponding sub-interaction windows can be presented. These sub-interaction windows activated on these multiple different pages are independent of each other. In this case, the interaction message records of the multiple sub-interaction windows can be displayed in an aggregated form in the main session window. These multiple interaction message records are independent of each other. Thus, when a user opens multiple pages, or opens multiple pages, the user can activate the digital assistant on different pages and present corresponding interaction windows for interaction. This enables the interaction between the user and the digital assistant on multiple pages to proceed without interference. As an example, see reference... Figure 6 The terminal device displays the office suite interface 600. The main session window 220 in this interface 600 displays the interaction message records 610 corresponding to the user's interaction messages in the interaction window 440 (as indicated by the dashed box 441) and the interaction message records 620 corresponding to the user's interaction messages in the interaction window 320 (as indicated by the dashed box 321).

[0060] In some embodiments of this disclosure, the display position or display order of multiple independent interactive message records can be determined based on the start or end time of the corresponding sub-interaction window. For example, it can be determined based on the time when the corresponding sub-interaction window is invoked or the time when the first interactive message is displayed. The timing of the display of interactive message records in the main session window will be detailed below.

[0061] For ease of distinction, in this embodiment, other pages are referred to as the first page and the second page, and the interaction message records in the first page and the second page are referred to as the first interaction message record and the second interaction message record. For example, document page 310 can be referred to as the first page, and interaction window 320 can be referred to as the first interaction window. Document page 430 can be referred to as the second page, and interaction window 440 can be referred to as the second interaction window.

[0062] In some embodiments of this disclosure, the first page and the second page may belong to different applications or components. For example, the first page may be a page of a document application, and the second page may be a page of another application different from the document application (e.g., calendar, task, meeting, approval, or project management applications).

[0063] In some embodiments, the first page and the second page may belong to the same client or different clients.

[0064] In some embodiments, the first page and the second page can be different pages belonging to the same application or component. For example, the first page and the second page can both belong to a document application, such as... Figure 3 Page 310 and Figure 4A , Figure 4B Page 430 in the document application belongs to the document application, but it is a page of a different document.

[0065] In some embodiments, the first page and the second page may correspond to the same page opened at different times. In this case, each time the page is opened, the corresponding interactive window can be activated. Furthermore, the interactive messages in the interactive windows presented by the pages opened at different times can be displayed independently in the main session window.

[0066] For example, a user can open the document "XX Field Research" multiple times and interact with the digital assistant. For instance, the first time a user opens the document, the digital assistant is activated on that page, and a corresponding interactive window appears. The interaction messages in this window can be consolidated into the main chat window. The second time the user opens the document, the digital assistant is activated again on that page, and the corresponding interactive window appears. Again, the interaction messages in this window can be consolidated into the main chat window.

[0067] For example, refer to Figure 7 In interface 700, the main session window 220 displays the interaction message records 710 and 720 generated after the user opens the document "XX Field Survey" at different times and interacts with it through the corresponding interaction window.

[0068] In some embodiments, taking the first message record corresponding to the first page as an example, the first message record includes two or more topics, and different topics are isolated by a preset identifier.

[0069] For example, see reference. Figure 4B The interactive window 440 displays a control 442 for creating new topics. If the user triggers this control 442 in the interactive window 440 to create a new topic, then, accordingly, refer to... Figure 8The interaction message record 810 corresponding to the document page 430 displayed in the main session window 220 contains the newly created topic 820. Furthermore, it is isolated from previous topics by the identifier 812 indicating that a new topic has been started.

[0070] The following section uses the first message record corresponding to the first page as an example to introduce some implementation forms of the first message record.

[0071] In some embodiments of this disclosure, the first message record may include first indication information, which indicates that the first message record is associated with a first page. In this way, different message records can be distinguished by different indication information. When message records from multiple different sub-interaction windows are unified into a main session window, it facilitates user differentiation of message records from different sub-interaction windows.

[0072] For example, Figure 5 System messages 511 and 512 in the system messages. Figure 8 System messages 811 and 814 can both be considered as examples of first instruction information.

[0073] In some embodiments, the first indication information may be a system message. This system message can be used to indicate the corresponding first message record. The form of this system message may differ from the interactive messages sent by session members.

[0074] Alternatively or additionally, the first indication information may be located at the beginning of the first message record. For example, such as... Figure 8 The first instruction information 811 in the message record 810 can be located at the beginning of the message record 810.

[0075] Alternatively or additionally, the first indication information may include a dividing line to isolate the first message record from preceding message records. For example, refer to... Figure 8 Message record 810 and message record 830 are separated by a separator line 813.

[0076] Alternatively or additionally, the first instruction information may include an entry control for the first page. For example, it could be such as... Figure 8 This could be control 816 or a document link, etc. In response to this entry control being triggered, the first page is opened. In some embodiments, the first page may be opened as a new tab.

[0077] Alternatively or additionally, the first instruction information may include identification information of the first page. For example, Figure 8 The document identifier shown is 817.

[0078] Alternatively or additionally, the first indication information may include controls for expanding and collapsing the first message record. For example, such as... Figure 8 The "collapse" control shown is 815.

[0079] In some embodiments of this disclosure, the first message record can be expanded and collapsed. For example, the first message record can be expanded or collapsed by triggering control 815. Expanding and collapsing here can also be understood as hiding and expanding. When the first message record is collapsed, only the first instruction information can be displayed, while the interactive messages contained in the first message record are hidden. When the first message record is expanded, it can be displayed in the form of a topic or tiled expansion. In the case of message records in multiple sub-session windows, i.e., multiple message records, these multiple message records can be expanded or collapsed independently. For example, the first message record can be expanded, while the second message record can be hidden. In some embodiments, the first message record is displayed in a collapsed manner in the main session window by default. Users can also customize how the first message record is displayed in a collapsed or expanded manner.

[0080] For example, still refer to Figure 8 After the "collapse" control 815 is triggered, the terminal device switches from interface 800 to interface 840. In interface 840, the "Message Records" 810 is collapsed, and the "collapse" control 815 is switched to the "expand" control 841. Furthermore, if the "expand" control 841 is triggered, the message records 810 are expanded, and the display format of the message records 810 shown in interface 800 can be switched.

[0081] In some embodiments of this disclosure, a start prompt message is displayed at the beginning of the first message record, and an end prompt message is displayed at the end of the first message record.

[0082] For example, such as Figure 5 As shown, message record 510 displays the start message "Start collaborating with you based on AAAA" at the beginning and the end message "End collaborating with you based on AAAA" at the end.

[0083] In some embodiments of this disclosure, there are various situations in which at least one interactive message from a sub-interaction window can be displayed as a message record in an aggregated form in the main session window.

[0084] The following text will continue to use the first message record in the first interactive window displayed on the first page as an example to introduce when the first message record is displayed in the main session window.

[0085] In some embodiments, a placeholder message may be displayed first in the main session window. Then, at least one interactive message may be aggregated and displayed together with the placeholder message.

[0086] In some embodiments, upon detecting an action to invoke the digital assistant on the first page, a placeholder message is displayed in the main session window in response. Furthermore, at least one first interaction message is aggregated and displayed together with the placeholder message. The at least one first interaction message may be displayed at the location indicated by the placeholder message after the interaction in the first interaction window has ended, or it may be displayed in real time at the location indicated by the placeholder message.

[0087] In some embodiments, the placeholder message may be the first instruction information mentioned above.

[0088] In some embodiments, after the first interactive window is invoked, in response to the first message sent in the first interactive window, a placeholder message may be displayed in the main session window. Furthermore, at least one first interactive message and the placeholder message may be displayed together.

[0089] In some embodiments, after the interaction in the first interactive window ends, the first message record can also be displayed in the main session window in response to the end of the interaction in the first interactive window. For example, the end of the interaction in the first interactive window can be the closing of the first interactive window or the closing of the first page.

[0090] The above example uses the first message record in the first interactive window. It's understandable that the display timing of different message records can be consistent or independent. That is, the display timing of different message records can be the same or different. Users can configure this as needed.

[0091] The above explanation uses a session-mode interactive window as an example. In some embodiments, the first interactive window can also be a floating-window interactive window. When the first interactive window is a floating-window interactive window, the strategy for synchronizing the interactive messages in it to the main session window is the same as described above, and will not be repeated here.

[0092] In some embodiments, when the first interaction window is a session-mode interaction window, a floating-window interaction window with the digital assistant can be further invoked on the first page. Then, the first interaction information between the user and the digital assistant in the floating-window interaction window is unified into the first interaction window. In some embodiments, the interaction information in the floating-window interaction window can be synchronized to the first interaction window in real time. In some embodiments, the timing for unifying the interaction information in the floating-window interaction window to the first interaction window can be when the floating-window interaction window is closed; in response to the closure of the floating-window interaction window, the first interaction information between the user and the digital assistant in the floating-window interaction window is synchronized to the first interaction window. The interaction information in the first interaction window is then synchronized to the main session window.

[0093] In some embodiments, the first interaction information may include all interaction messages generated by the user and the digital assistant in the floating window interaction window.

[0094] In some embodiments, the first interaction information may further include summary information of the interaction between the user and the digital assistant in the floating window mode interaction window; or, result information of the interaction between the user and the digital assistant in the floating window mode interaction window.

[0095] As an example, see reference Figure 9 Users can invoke a floating interactive window 911 for interacting with the digital assistant from the first page 910. Users can then interact with the digital assistant through this floating interactive window 911. For example, users can input interactive commands in the floating interactive window 911 or use preset shortcuts provided by the digital assistant, such as "summarize," "insert," "edit," and "delete," to instruct the digital assistant to perform the target operation. In response to the user's input shortcuts or interactive commands, the digital assistant can perform the corresponding operation on the first page 910. The results of this operation may not be displayed in the floating interactive window 911, but rather in the conversational interactive window 920. For example, summary information and result information of the interactions occurring in the floating interactive window, such as "changed this image," "continue writing this paragraph," and "summarize this paragraph," can be displayed in the conversational interactive window 920.

[0096] Furthermore, the first interaction information in the floating window mode is further displayed in the main session window. That is, the first message record in the main session window includes the first interaction information. (Still referencing...) Figure 9 The main session window 220 displays the first interaction information 921. It is understood that the session mode interaction window 920 can include more interaction information. Correspondingly, the main session window 220 can also include more interaction information.

[0097] In some embodiments of this disclosure, different solutions can be combined with each other. For example, Figure 9 The interactive message 921 shown can be expanded or collapsed.

[0098] The above description, with reference to the accompanying drawings, illustrates example interfaces for setting up and interacting with a digital assistant. It should be understood that the various interfaces, interface elements, text, etc., described above are exemplary and not intended to limit the scope of this disclosure. Furthermore, it should be understood that the various embodiments described above can be implemented individually or in combination.

[0099] Figure 10A flowchart of an information processing method 1000 according to some embodiments is shown. Method 1000 can be implemented at a terminal device 110. Reference is made below. Figure 1 Description method 1000.

[0100] In box 1010, terminal device 110 responds to the operation of activating the digital assistant on the first page by displaying the first interactive window with the digital assistant.

[0101] In box 1020, terminal device 110 displays at least one first interaction message between the user and the digital assistant in the first interaction window.

[0102] In box 1030, terminal device 110 displays at least one first interaction message in an aggregated form as a first message record in the main session window where the user interacts with the digital assistant.

[0103] In some embodiments of this disclosure, method 1000 further includes displaying a second interaction window with the digital assistant in response to an operation that invokes the digital assistant on a second page. At least one second interaction message between the user and the digital assistant is displayed in the second interaction window. And in the main session window, the at least one second interaction message is displayed in an aggregated form as a second message record; the first message record and the second message record are displayed independently of each other in the main session window.

[0104] In some embodiments of this disclosure, the first page and the second page are pages belonging to different applications; or the first page and the second page are different pages belonging to the same application; or the first page and the second page correspond to the same page opened on different occasions.

[0105] In some embodiments of this disclosure, the first message record includes first indication information, which is used to indicate that the first message record is associated with a first page.

[0106] In some embodiments of this disclosure, the first indication information includes one or more of the following: the first indication information is a system message; the first indication information is located at the beginning of the first message record; the first indication information includes a dividing line; the first indication information includes an entry control for the first page; the first indication information includes identification information of the first page; or the first indication information includes controls for expanding and collapsing the first message record.

[0107] In some embodiments of this disclosure, the first message record can be expanded and collapsed.

[0108] In some embodiments of this disclosure, the first message record includes two or more topics, and different topics are isolated from each other by a preset identifier.

[0109] In some embodiments of this disclosure, a start prompt message is displayed at the beginning of the first message record, and an end prompt message is displayed at the end of the first message record.

[0110] In some embodiments of this disclosure, displaying at least one first interaction message in an aggregated form as a first message record in the main session window where the user interacts with the digital assistant includes: in response to an operation that invokes the digital assistant on a first page, displaying a placeholder message in the main session window, and aggregating and displaying at least one first interaction message together with the placeholder message; or, after the first interaction window is invoked, in response to the first message sent in the first interaction window, displaying a placeholder message in the main session window, and aggregating and displaying at least one first interaction message together with the placeholder message; or, in response to the end of the interaction in the first interaction window, displaying the first message record in the main session window.

[0111] In some embodiments of this disclosure, the first interactive window is a session-mode interactive window or a floating-window interactive window.

[0112] In some embodiments of this disclosure, the first interaction window is a session mode interaction window, and method 1000 further includes: activating a floating window mode interaction window with a digital assistant on a first page; synchronizing the first interaction information between the user and the digital assistant in the floating window mode interaction window to the first interaction window; wherein the first message record of the main session window includes the first interaction information.

[0113] In some embodiments of this disclosure, the first interaction information includes: summary information of the interaction between the user and the digital assistant in the floating window mode interaction window; or, result information of the interaction between the user and the digital assistant in the floating window mode interaction window.

[0114] In some embodiments of this disclosure, synchronizing the first interaction information between the user and the digital assistant in the floating window mode interaction window to the first interaction window includes: synchronizing the first interaction information between the user and the digital assistant in the floating window mode interaction window to the first interaction window in response to the floating window mode interaction window being closed.

[0115] In some embodiments of this disclosure, the application where the main session window is located and the application where the first page is located are different applications.

[0116] In some embodiments of this disclosure, the first page is opened through interaction between the user and the digital assistant in the main session window, and the first interactive window displays contextual information related to the first page in the main session window.

[0117] Figure 11A flowchart of an information processing method 1100 according to some embodiments is shown. Method 1100 can be implemented at a terminal device 110. Reference is made below. Figure 1 Description method 1100.

[0118] In box 1110, terminal device 110 opens the target page through the interaction between the user and the digital assistant in the main session window.

[0119] In box 1120, terminal device 110 responds to the operation of activating the digital assistant on the target page by displaying an interaction window with the digital assistant.

[0120] In box 1130, terminal device 110 displays context information related to the target page from the main session window in the interactive window.

[0121] In some embodiments of this disclosure, the interactive window is a session-mode interactive window.

[0122] In some embodiments of this disclosure, the method further includes: displaying at least one interaction message between the user and the digital assistant in an interaction window; and displaying at least one interaction message as an aggregated message record in the main session window.

[0123] It should be understood that, without departing from the spirit of process 1100, one or more steps, features, characteristics, or combinations thereof described in the above example information processing procedure may also be appropriately incorporated into this process. This disclosure will not elaborate further on this.

[0124] Figure 12 A schematic structural block diagram of an apparatus 1200 for information processing according to certain embodiments of the present disclosure is shown. The apparatus 1200 may be implemented as or included in a terminal device 110. The various modules / components in the apparatus 1200 may be implemented by hardware, software, firmware, or any combination thereof.

[0125] The device 1200 includes a first display module 1210 configured to display a first interactive window with the digital assistant in response to an operation that invokes the digital assistant on a first page.

[0126] The device 1200 also includes a second display module 1220 configured to display at least one first interaction message between the user and the digital assistant in a first interaction window.

[0127] The device 1200 also includes a third display module 1230, configured to display at least one first interaction message in an aggregated form as a first message record in the main session window where the user interacts with the digital assistant.

[0128] In some embodiments of this disclosure, the device 1200 further includes a first display module 1210, which is also configured to display a second interaction window with the digital assistant in response to an operation that invokes the digital assistant on a second page. The second display module 1220 is further configured to display at least one second interaction message between the user and the digital assistant in the second interaction window. The third display module 1230 is further configured to display at least one second interaction message in an aggregated form as a second message record in the main session window; the first message record and the second message record are displayed independently of each other in the main session window.

[0129] In some embodiments of this disclosure, the first page and the second page are pages belonging to different applications; or the first page and the second page are different pages belonging to the same application; or the first page and the second page correspond to the same page opened on different occasions.

[0130] In some embodiments of this disclosure, the first message record includes first indication information, which is used to indicate that the first message record is associated with a first page.

[0131] In some embodiments of this disclosure, the first indication information includes one or more of the following: the first indication information is a system message; the first indication information is located at the beginning of the first message record; the first indication information includes a dividing line; the first indication information includes an entry control for the first page; the first indication information includes identification information of the first page; or the first indication information includes controls for expanding and collapsing the first message record.

[0132] In some embodiments of this disclosure, the first message record can be expanded and collapsed.

[0133] In some embodiments of this disclosure, the first message record includes two or more topics, and different topics are isolated from each other by a preset identifier.

[0134] In some embodiments of this disclosure, a start prompt message is displayed at the beginning of the first message record, and an end prompt message is displayed at the end of the first message record.

[0135] In some embodiments of this disclosure, the third display module 1230 is further configured to, in response to an operation that invokes a digital assistant on the first page, display a placeholder message in the main session window and aggregate at least one first interaction message with the placeholder message for display; or, after the first interaction window is invoked, in response to the first message sent in the first interaction window, display a placeholder message in the main session window and aggregate at least one first interaction message with the placeholder message for display; or, in response to the end of the interaction in the first interaction window, display a first message record in the main session window.

[0136] In some embodiments of this disclosure, the first interactive window is a session-mode interactive window or a floating-window interactive window.

[0137] In some embodiments of this disclosure, the first interaction window is a session-mode interaction window, and the device 1200 further includes a synchronization module configured to invoke a floating-window-mode interaction window with the digital assistant on the first page; and to synchronize the first interaction information between the user and the digital assistant in the floating-window-mode interaction window to the first interaction window. The first message record of the main session window includes the first interaction information.

[0138] In some embodiments of this disclosure, the first interaction information includes: summary information of the interaction between the user and the digital assistant in the floating window mode interaction window; or, result information of the interaction between the user and the digital assistant in the floating window mode interaction window.

[0139] In some embodiments of this disclosure, the synchronization module is also configured to synchronize the first interaction information between the user and the digital assistant in the floating window mode interaction window to the first interaction window in response to the floating window mode interaction window being closed.

[0140] In some embodiments of this disclosure, the application where the main session window is located and the application where the first page is located are different applications.

[0141] In some embodiments of this disclosure, the first page is opened through interaction between the user and the digital assistant in the main session window, and the first interactive window displays contextual information related to the first page in the main session window.

[0142] Figure 13 A schematic structural block diagram of an apparatus 1300 for information processing according to certain embodiments of the present disclosure is shown. The apparatus 1300 may be implemented as or included in a terminal device 110. The various modules / components in the apparatus 1300 may be implemented by hardware, software, firmware, or any combination thereof.

[0143] Device 1300 includes an opening module 1310 configured to open a target page through user interaction with a digital assistant in a main session window.

[0144] The device 1300 also includes a fourth display module 1320, configured to display an interactive window with the digital assistant in response to an action that invokes the digital assistant on a target page.

[0145] The device 1300 also includes a fifth display module 1330, configured to display contextual information related to the target page in the main session window in an interactive window.

[0146] In some embodiments, the interactive window is a session-mode interactive window.

[0147] In some embodiments, the fourth display module 1320 is further configured to display at least one interaction message between the user and the digital assistant in an interaction window; and the fifth display module 1330 is further configured to display at least one interaction message in an aggregated form as a message record in the main session window.

[0148] Figure 14 A block diagram of an electronic device 1400 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that... Figure 14 The electronic device 1400 shown is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 14 The electronic device 1400 shown can be used to achieve Figure 1 Terminal device 110 or server 130.

[0149] like Figure 14 As shown, electronic device 1400 is in the form of a general-purpose electronic device. Components of electronic device 1400 may include, but are not limited to, one or more processors or processing units 1410, memory 1420, storage device 1430, one or more communication units 1440, one or more input devices 1450, and one or more output devices 1460. Processing unit 1410 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 1420. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 1400.

[0150] Electronic device 1400 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 1400, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 1420 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 1430 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 1400.

[0151] Electronic device 1400 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 14As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 1420 may include computer program product 1425 having one or more program modules configured to perform various methods or actions of various embodiments of this disclosure.

[0152] The communication unit 1440 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 1400 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 1400 can operate in a networked environment using logical connections to one or more other servers, networked personal computers (PCs), or another network node.

[0153] Input device 1450 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 1460 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 1400 can also communicate with one or more external devices (not shown) via communication unit 1440 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 1400, or with any device that enables electronic device 1400 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0154] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0155] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0156] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0157] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0158] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0159] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. An information processing method, comprising: In response to an action that invokes the digital assistant on the first page, a first interactive window with the digital assistant is displayed; Display at least one first interaction message between the user and the digital assistant in the first interaction window; In the main session window where the user interacts with the digital assistant, the at least one first interaction message is displayed in an aggregated form as a first message record; In response to the operation of activating the digital assistant on the second page, a second interactive window with the digital assistant is displayed; At least one second interaction message between the user and the digital assistant is displayed in the second interaction window; as well as In the main session window, the at least one second interaction message is displayed in an aggregated form as a second message record. The main session window is an interactive window that is presented when the digital assistant is woken up on a preset page, and the preset page is different from the first page and the second page. The first message record and the second message record are displayed independently in the main session window.

2. The method according to claim 1, wherein, The first page and the second page belong to different applications; or The first page and the second page are different pages belonging to the same application; or The first page and the second page correspond to the same page being opened on different occasions.

3. The method according to claim 1, wherein, The first message record includes first indication information, which is used to indicate that the first message record is associated with the first page.

4. The method of claim 3, comprising one or more of the following: The first indication information is a system message; The first indication information is located at the beginning of the first message record; The first indication information includes a dividing line; The first instruction information includes the entry control of the first page; The first indication information includes the identification information of the first page; or The first instruction information includes controls for expanding and collapsing the first message record.

5. The method according to claim 1, wherein, The first message record can be expanded and collapsed.

6. The method according to claim 1, wherein, The first message record includes two or more topics, and different topics are isolated by preset identifiers.

7. The method according to claim 1, wherein, A start prompt is displayed at the beginning of the first message record, and an end prompt is displayed at the end of the first message record.

8. The method according to claim 1, wherein, In the main session window where the user interacts with the digital assistant, displaying the at least one first interaction message in an aggregated form as a first message record includes: In response to the operation of activating the digital assistant on the first page, a placeholder message is displayed in the main session window, and the at least one first interaction message is aggregated and displayed together with the placeholder message; or, After the first interactive window is invoked, in response to the first message sent in the first interactive window, a placeholder message is displayed in the main session window, and the at least one first interactive message and the placeholder message are displayed together; or, In response to the end of the interaction in the first interactive window, the first message record is displayed in the main session window.

9. The method according to claim 1, wherein, The first interactive window is either a session-mode interactive window or a floating-window interactive window.

10. The method according to claim 1, wherein, The first interactive window is a session-mode interactive window, and the method further includes: In the first page, a floating window for interaction with the digital assistant is invoked; Synchronize the first interaction information between the user and the digital assistant in the floating window mode interaction window to the first interaction window; The first message record of the main session window includes the first interaction information.

11. The method according to claim 10, wherein, The first interactive information includes: Summary information of the interactions between the user and the digital assistant in the floating window mode interaction window; or, The result information of the interaction between the user and the digital assistant in the floating window mode interaction window.

12. The method according to claim 10, wherein, Synchronizing the first interaction information between the user and the digital assistant in the floating window mode interaction window to the first interaction window includes: In response to the floating window mode interaction window being closed, the first interaction information between the user and the digital assistant in the floating window mode interaction window is synchronized to the first interaction window.

13. The method according to claim 1, wherein, The application in which the main session window is located is a different application from the application in which the first page is located.

14. The method of claim 1, wherein the first page is opened through interaction between the user and the digital assistant in the main session window, and the first interaction window displays contextual information related to the first page in the main session window.

15. An information processing method, comprising: The target page is opened through the interaction between the user and the digital assistant in the main session window, wherein the main session window is an interactive window that is presented after the digital assistant is woken up on a preset page, and the preset page is different from the target page; In response to the operation of activating the digital assistant on the target page, an interaction window with the digital assistant is displayed; as well as The interactive window displays context information related to the target page from the main session window, including dialogue messages related to the target page.

16. The method of claim 15, wherein the interactive window is a session-mode interactive window.

17. The method of claim 16, further comprising: At least one interaction message between the user and the digital assistant is displayed in the interactive window; as well as In the main session window, the at least one interactive message is displayed as a message record in an aggregated form.

18. An apparatus for information processing, comprising: The first display module is configured to display a first interaction window with the digital assistant in response to an operation that invokes the digital assistant on a first page, and to display a second interaction window with the digital assistant in response to an operation that invokes the digital assistant on a second page. The second display module is configured to display at least one first interaction message between the user and the digital assistant in the first interaction window, and at least one second interaction message between the user and the digital assistant in the second interaction window; The third display module is configured to display the at least one first interaction message in an aggregated form as a first message record in the main session window where the user interacts with the digital assistant; The first display module is also configured to display a second interaction window with the digital assistant in response to an operation that invokes the digital assistant on the second page; The second display module is also configured to display at least one second interaction message between the user and the digital assistant in the second interaction window; as well as The third display module is further configured to display the at least one second interactive message as a second message record in an aggregated form within the main session window. The main session window is an interactive window that is presented when the digital assistant is woken up on a preset page, and the preset page is different from the first page and the second page. The first message record and the second message record are displayed independently in the main session window.

19. An apparatus for information processing, comprising: The module is configured to open a target page through user interaction with a digital assistant in a main session window, wherein the main session window is an interactive window that is presented after the digital assistant is woken up on a preset page, and the preset page is different from the target page; The fourth display module is configured to display an interaction window with the digital assistant in response to an operation that invokes the digital assistant on the target page. as well as The fifth display module is configured to display context information related to the target page in the main session window in the interaction window, the context information including dialogue messages related to the target page.

20. An electronic device, comprising: At least one processing unit; as well as At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 14 or any one of claims 15 to 17 when executed by the at least one processing unit.

21. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 14 or any one of claims 15 to 17.

Images