Method, device, equipment and storage medium for information processing

Abstract

Embodiments of this disclosure provide a method, apparatus, device, and storage medium for information processing. The method includes: presenting an interaction area between a first user and the first digital assistant corresponding to a triggered interaction mode among multiple interaction modes of a first digital assistant; wherein the interaction method between the first user and the first digital assistant differs under different interaction modes. This enables diverse interactions between the user and the digital assistant and allows for flexible switching between different interaction modes as needed.

Description

Technical Field

[0001] The exemplary embodiments disclosed herein generally relate to the field of computers, and more particularly to methods, apparatus, devices and computer-readable storage media for information processing. Background Technology

[0002] With the rapid development of internet technology, the internet has become a crucial platform for people to access and share content. Users can access the internet through terminal devices to enjoy various internet services. Terminal devices present relevant content and facilitate interaction with users through application user interfaces, providing services as well. Therefore, rich and varied application interfaces are an important means of enhancing user experience. With the development of information technology, various terminal devices can provide various services to people in work and life. For example, applications that provide services can be deployed on terminal devices. Terminal devices or applications can provide users with digital assistant functions to assist them in using the terminal devices or applications. How to improve the flexibility of user interaction with digital assistants is a technical issue that needs to be explored. Summary of the Invention

[0003] In a first aspect of this disclosure, an information processing method is provided. The method includes: based on an interaction mode triggered among multiple interaction modes of a first digital assistant, presenting an interaction area between a first user and the first digital assistant corresponding to the triggered interaction mode; wherein the interaction method between the first user and the first digital assistant is different under different interaction modes.

[0004] In a second aspect of this disclosure, an apparatus for information processing is provided. The apparatus includes: an interactive presentation module configured to present an interaction area between a first user and the first digital assistant corresponding to a triggered interaction mode among multiple interaction modes of a first digital assistant; wherein the interaction method between the first user and the first digital assistant differs under different interaction modes.

[0005] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the electronic device to perform the method of the first aspect.

[0006] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. A computer program is stored on the medium, which can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the description in this section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0008] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram of an example environment in which embodiments of the present disclosure can be implemented is shown;

[0010] Figures 2A to 2D A schematic diagram of an example client interface for a user's multi-interaction mode with a digital assistant according to some embodiments of the present disclosure is shown;

[0011] Figures 3A to 3F A schematic diagram of an example client interface for a user's multi-interaction mode with a digital assistant according to some embodiments of the present disclosure is shown;

[0012] Figures 4A to 4B A schematic diagram illustrating an example of an interaction history of other interaction modes in a first interaction mode according to some embodiments of the present disclosure is shown;

[0013] Figures 5A to 5H A schematic diagram of an example entry control for a digital assistant in a second interaction mode according to some embodiments of the present disclosure is shown;

[0014] Figure 6 A flowchart of a process for information processing according to some embodiments of the present disclosure is shown;

[0015] Figure 7 Block diagrams of an apparatus for information processing according to some embodiments of the present disclosure are shown; and

[0016] Figure 8 An electronic device in which one or more embodiments of the present disclosure may be implemented is shown. Detailed Implementation

[0017] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0018] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0019] In this document, unless explicitly stated otherwise, performing a step in response to A does not mean that the step is performed immediately after A, but may include one or more intermediate steps.

[0020] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0021] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, relevant users should be informed of the type, scope of use, and usage scenarios of the information involved in this disclosure through appropriate means in accordance with relevant laws and regulations, and authorization should be obtained from the relevant users. Among them, relevant users may include any type of rights holder, such as individuals, enterprises, and groups.

[0022] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly inform the user that the requested operation will require obtaining and using the user's information, thereby enabling the relevant user to choose whether to provide information to the software or hardware such as the electronic device, application, server, or storage medium that performs the operation of the technical solution disclosed herein based on the prompt message.

[0023] As an optional but non-restrictive implementation, in response to a user's active request, a prompt message can be sent to the user, such as a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide information to the electronic device.

[0024] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0025] Figure 1A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In this example environment 100, a multi-functional collaboration platform 120 is installed in a terminal device 110. A user 140 can interact with the multi-functional collaboration platform 120 via the terminal device 110 and / or an attached device to the terminal device 110. The multi-functional collaboration platform 120, such as an office collaboration platform (also known as an office suite), can provide the integration of various types of functions or components to facilitate people's office work, communication, and other activities. In the multi-functional collaboration platform 120, people can activate different functions or components as needed to complete corresponding information processing, sharing, communication, etc.

[0026] The multi-functional collaboration platform 120 can provide users 140 with the integration of multiple components. These components can be component modules within the multi-functional collaboration platform 120. The components integrated into the multi-functional collaboration platform 120 are sometimes also referred to as "applications," "components," etc. Such components include, but are not limited to, office-related components, tool-related components, etc. As an example, the components integrated into the multi-functional collaboration platform 120 may include, but are not limited to, one or more of the following: chat components (also known as instant messaging components), document components, audio and video conferencing components, email components, calendar components, scheduling components, task components, goal and key results (OKR) components, etc. It is understood that various other types of components can also be integrated into the office suite.

[0027] In some embodiments, the multi-functional collaboration platform 120 can be downloaded and installed as an application on the terminal device 110. In some embodiments, the multi-functional collaboration platform 120 can also be accessed in other ways, such as through a web page.

[0028] exist Figure 1 In environment 100, if the multi-functional collaboration platform 120 is started, the terminal device 110 can display the interface 150 of the multi-functional collaboration platform 120. Interface 150 may include various user interfaces provided by the multi-functional collaboration platform 120. Interface 150 is sometimes also referred to as the client interface.

[0029] In some embodiments, terminal device 110 communicates with server 130 to provide services to multifunctional collaboration platform 120. Terminal device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, terminal device 110 can also support any type of user-facing interface (such as "wearable" circuitry). Server 130 can be various types of computing systems / servers capable of providing computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, etc.

[0030] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0031] While some multi-functional collaboration platforms offer integration capabilities for different components, their intelligence is insufficient. Many components (e.g., documents, spreadsheets, appointments, meeting summaries) still rely on manual processing and lack automatic generation and collaboration capabilities. However, manual information processing is inefficient, involves repetitive tasks, and is prone to errors. Many scenarios require searching, understanding, and organizing massive amounts of data, further increasing the difficulty of manual processing. Moreover, manual work is time-consuming in areas such as data searching and reading documents or meeting minutes, and inefficient and error-prone in scenarios involving summarizing, writing and calculating text, reading comprehension, cross-language searching, and cross-component content interaction.

[0032] To enhance intelligence, some multi-functional collaboration platforms integrate digital assistant-like features for user interaction. However, current use cases for digital assistants are limited, and effectively utilizing them has a high barrier to entry. The trigger paths for some digital assistant functions are lengthy, making it difficult to achieve efficient interaction across various task scenarios.

[0033] According to embodiments of this disclosure, an improved scheme for information processing is proposed. In embodiments of this disclosure, based on the triggered interaction modes among multiple interaction modes of a first digital assistant, the interaction area between the first user and the first digital assistant corresponding to the triggered interaction mode is presented; wherein the interaction method between the first user and the first digital assistant differs under different interaction modes. Therefore, diversified interactions between the user and the digital assistant can be realized, and flexible switching between different interaction modes can be achieved as needed.

[0034] Some exemplary embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.

[0035] As described above, in the embodiments of this disclosure, a digital assistant is used for interaction with a user. As an intelligent assistant, the digital assistant possesses intelligent dialogue and information processing capabilities. The digital assistant performs operations in response to user-inputted instructions. The client interface used to provide the digital assistant can correspond to a single-function application or a multi-functional collaboration platform, such as an office suite or other collaboration platforms capable of integrating multiple components.

[0036] In the embodiments of this disclosure, multiple interaction modes for users and digital assistants are provided, and users can flexibly switch between these modes. When a certain interaction mode is triggered, a corresponding interaction area is presented to facilitate interaction between the user and the digital assistant. The interaction methods between the user and the digital assistant differ in different interaction modes, thus flexibly adapting to the interaction needs of different application scenarios.

[0037] In some embodiments, a digital assistant may act as a user's contact, included in the current user's contact list within the office suite, or included in the message stream of a chat component. In some embodiments, a correspondence exists between a user and a digital assistant. For example, a first digital assistant corresponds to a first user, a second digital assistant corresponds to a second user, and so on. In some embodiments, a first digital assistant may uniquely correspond to a first user, a second digital assistant may uniquely correspond to a second user, and so on. That is, a first digital assistant for a first user may be specific to or exclusive to the first user. For example, in providing assistance or services to the first user, the first digital assistant may utilize its historical interaction information with the first user, the data authorized by the first user that it can access, and its current interaction context with the first user. If the first user is an individual, the first digital assistant may be considered a personal digital assistant. It is understood that in the disclosed embodiments, the first digital assistant accesses data with granted permissions based on the first user's authorization.

[0038] It should be understood that the terms "unique correspondence" or similar expressions in this disclosure are not intended to limit the first digital assistant to being updated accordingly based on the interaction process between the first user and the first digital assistant.

[0039] In some embodiments, information processing services specific to the first user can be provided based on the first user's historical interaction information with the first digital assistant and / or a data range specific to the first user. In some embodiments, the historical interaction information of the first user interacting with the first digital assistant in multiple interaction modes can all be associated with the first user and stored. Thus, in one of the multiple interaction modes (any or a designated interaction mode), the first digital assistant can provide services to the first user based on the historical interaction information stored associated with the first user.

[0040] This increases the freedom of interaction between the first user and the first digital assistant. For example, when a user interacts with a traditional assistant, the user typically needs to clearly and explicitly express their information processing needs according to certain requirements. Conversely, by considering historical interaction information and / or user-specific data ranges, embodiments of this disclosure enable users to express their information processing needs in a freer and more concise manner without affecting the quality of the information processing services obtained. Furthermore, this approach can also improve the accuracy of information processing by the first digital assistant. Based on this example implementation, a "unique correspondence" can be established between the first user and the first digital assistant.

[0041] In some embodiments, the first interaction mode among multiple interaction modes may include a session window-based interaction mode, also referred to as a session mode. When the first interaction mode is triggered, a session window is presented between the first user and the first digital assistant, in which the first user and the first digital assistant interact through session messages. In the first interaction mode, the first digital assistant can perform tasks based on the session messages in the session window.

[0042] In some embodiments, a first interaction mode (i.e., conversation mode) between the first user and the first digital assistant can be invoked or activated by an appropriate means (e.g., a shortcut key, a button, or voice) to present a conversation window. A conversation window with the first digital assistant can be opened by selecting the first digital assistant. The conversation window may include interface elements for information interaction, such as input boxes, message lists, message bubbles, etc.

[0043] In some embodiments, the second interaction mode among multiple interaction modes may include a panel-based interaction mode. When the second interaction mode is triggered, a panel corresponding to the first digital assistant is presented, and the first user can issue commands to the first digital assistant based on the panel. In some embodiments, the panel may include at least one candidate shortcut command. Alternatively or additionally, the panel may include input controls for receiving commands. In some embodiments, the panel may be presented as a floating window; therefore, the second interaction mode is also referred to as a floating window mode in this disclosure. In the second interaction mode, the first digital assistant can perform tasks according to commands issued by the first user through the panel.

[0044] In some embodiments, the second interaction mode (i.e., floating window mode) between the first user and the first digital assistant can also be invoked or activated by an appropriate means (e.g., shortcut keys, buttons, or voice) to present the corresponding operation panel. In some embodiments, to trigger the second interaction mode to present the operation panel corresponding to the first digital assistant, an entry control for the first digital assistant can be presented in the target interface area. In response to detecting a trigger operation on the entry control, it can be determined that the second interaction mode has been triggered, and the operation panel corresponding to the first digital assistant is presented in the target interface area. There can be various ways to trigger the second interaction mode, which will be discussed in more detail below.

[0045] In some embodiments, two or more interaction modes can be triggered simultaneously. When the triggered interaction modes include two or more, the interaction areas corresponding to the first user and the first digital assistant for each of the two or more interaction modes can be displayed simultaneously in the first user's client interface. Thus, different interaction modes can be used to interact with the first digital assistant in different interaction areas of the same client interface.

[0046] For ease of understanding, the following explanation will refer to the accompanying drawings and use the first and second interaction modes as examples.

[0047] Figures 2A to 2D A schematic diagram of an example client interface showing multiple interaction modes between a user and a digital assistant according to some embodiments of the present disclosure is shown. A first interaction mode is triggered, and a session window between a first digital assistant (“XX Assistant”) and a first user (“User A”) is presented in area 210 of the client interface 200. Figure 2AIn the example, the first digital assistant can be considered one of the first user's contacts and is presented in the instant messaging component's information stream. The first user can enter a conversation window by selecting the first digital assistant. Furthermore, the client interface 200 can correspond to a multi-functional collaboration platform that integrates multiple different types of components. Area 230 of the client interface 200 displays access icons for multiple components; selecting these icons allows users to launch the corresponding component in the multi-functional collaboration platform for operation.

[0048] It should be understood that Figures 2A to 2D The following figures only show examples of interactive areas; other interactive areas may also be provided. Furthermore, the various specific information, icons, etc., given in these figures are merely examples and not intended to limit the scope of the embodiments of this disclosure.

[0049] In the conversation window of region 210, the first user can input messages via input box 212 or other appropriate means (e.g., voice), and the first digital assistant can provide a response message based on the input message and relevant knowledge. Messages in the conversation window are typically conversational messages. In embodiments of this disclosure, conversational messages in the conversation window between the first user and the first digital assistant (e.g., conversational messages in the conversation window) can be associated with corresponding content in multiple components (e.g., a multi-functional collaboration platform or office suite). In some embodiments, the multiple components can be multiple components supported by the multi-functional collaboration platform corresponding to the client interface.

[0050] As an example, multiple components include, but are not limited to, one or more of the following: instant messaging components, document components, audio / video conferencing components, email components, calendar components, schedule components, task components, goal and key results (OKR) components, etc. The content associated with a session message can be in text, image, audio, video format, or any other suitable format. Figure 2A In the example, the conversation message entered by the first user instructs the creation of a document, and the conversation message replied by the first digital assistant provides the document that the first digital assistant automatically created based on the first user's input.

[0051] In some embodiments, within a session window, the content of the component associated with each session message can be partially or entirely included in the session message, for example, Figure 2A The conversation message provided by the first digital assistant displays a portion of the target document in the document component (i.e., a thumbnail of the target document). In some embodiments, the conversation message may include an access path or entry point for the content of the associated component, such as a link, a view icon, etc., thereby allowing access to the associated content.

[0052] In some embodiments, content associated with a session message can be presented automatically or based on user triggering (e.g., a user selecting a document in a session message) in another area of ​​the client interface. Specifically, a session window between the first user and the first digital assistant can be presented in a first area of ​​the client interface, and target content can be presented in a second area of ​​the client interface. The target content is associated with the first session message in the session window and can be content provided by a first component of the multifunctional collaboration platform. The second area can display an operable interface provided by the first component, including the target content. In this way, various operational capabilities provided by the first component can be supported in the second area.

[0053] like Figure 2A As shown, a session window is presented in area 210 of the client interface 200, and the target document in the document component associated with the session message is presented in area 220 of the client interface 200. Area 220 may include the document page of the document component. Note that in Figure 2A The accompanying drawings illustrate, for example, that the first area containing the session window and the second area containing the target content are arranged side-by-side. In other embodiments, the first and second areas, as well as other areas in the client interface, can be arranged in other ways as needed. For example, the second area can be presented on the left and the first area on the right in the client interface. Alternatively, the first and second areas can be arranged vertically, and so on.

[0054] In some embodiments, the target content displayed in the second area can change as the conversation messages in the conversation window change. Since multiple conversation messages in the conversation window with the first digital assistant can be associated with content in one or more components, the target content in the second area displayed in the conversation window can also automatically change as the conversation messages change. Specifically, the first digital assistant updates the target content in the second area based on message interactions with the first user in the conversation window, such as continuing to write a document according to the first user's instructions. In some embodiments, the target content displayed in the second area can change as the first user makes a selection operation in the conversation window. That is, the first user can control the target content displayed in the second area as needed. For example, the first user may want to maintain the display of a document associated with a previous conversation message, even if subsequent conversation messages in the conversation window may have been associated with content from other documents or other components. The first user's selection operation is, for example, a click operation, a specific message entered in the conversation window, etc.

[0055] In some embodiments, another interaction mode of the first digital assistant can also be triggered in the area where the target content is displayed. Specifically, such as Figure 2AAs shown, after selecting a portion 214 of the target document within area 220, a menu 216 can be displayed, including the entry control for the first digital assistant, namely the "XX Assistant" control 218. By triggering the "XX Assistant" control 218, the following can be displayed: Figure 2B The operation panel 222 is shown. The operation panel 222 may include multiple candidate shortcut commands 226 and input controls 224 for receiving commands. Figure 2B In the example, the input control 224 for receiving instructions can be an input box for receiving text input. In other examples, alternatively or additionally, the input control for receiving instructions may also include other input controls for receiving voice input, image input, and / or video input.

[0056] like Figure 2B As shown, in the client interface 200, the interaction area corresponding to the first interaction mode (i.e., dialogue mode) and the interaction area corresponding to the second interaction mode (i.e., floating window mode) are presented simultaneously. The first user can interact with the first digital assistant in either area as needed.

[0057] In some embodiments, in the second interaction mode, the operation panel corresponding to the first digital assistant can be displayed in the target interface area corresponding to the target content. For example, in Figure 2B In this example, the operation panel 222 is presented in the area 220 corresponding to the target document. In this example, the operation panel 222 is presented as a floating window.

[0058] It should be understood that the accompanying drawings use a document as an example of target content for illustration. In other embodiments, the target content may also include any other suitable content that the platform can process, including but not limited to audio, video, images, emails, calendars, schedules, tasks, etc. All of this content can be adjusted using the first digital assistant in any interaction mode.

[0059] In some embodiments, in the second interaction mode, one or more candidate shortcuts in the operation panel can be determined based on various appropriate methods to facilitate user selection for processing target content. In some embodiments, candidate shortcuts can be determined based on at least a portion of the target content, for example, based on at least a selected portion of the target content. Thus, the provided candidate shortcuts are particularly suitable for processing that portion of the content. Figure 2BAs shown, the candidate shortcuts provided in the operation panel 222 include refining, summarizing, abbreviating, translating, continuing, and analyzing advantages and disadvantages of the selected portion. In some embodiments, candidate shortcuts can be determined based on historical processing operations of the target content, or on interaction-related information concerning the target content in interaction modes other than the second interaction mode. By considering the historical context of the target content, the user's processing needs for the target content can be better understood, providing more suitable shortcuts, avoiding the time required for the user to input instructions, and improving processing efficiency.

[0060] In some embodiments, in the second interaction mode, based on the detected target instruction for the target content, a processing result for the target instruction is determined. The target instruction includes a shortcut instruction triggered from at least one candidate shortcut instruction, or an instruction received through an input control. The target content is adjusted based on the processing result. In some embodiments, in the second interaction mode, the processing result may also be presented in an operation panel. In response to detecting user confirmation of the processing result, the target content is adjusted based on the processing result. For example, if in Figure 2B The system detected a trigger on the "Continue Writing" option of the candidate shortcut commands in the operation panel, such as... Figure 2C As shown, the operation panel 222 displays the continuation content 242, and also displays shortcut commands 244 for the continuation content 242, including "abbreviation," "insert," "redo," and "delete." If the "insert" command is triggered, i.e., user confirmation is detected, then the continuation content 242 is inserted into the target document, as shown. Figure 2D As shown.

[0061] Figures 2B to 2D This explanation uses the triggering of shortcut commands in the operation panel under the second interactive mode as an example. In other examples, commands input by the first user through the input control 224 in the operation panel can also be detected. Through the input control, the first user can input any command as needed. The first digital assistant can be used to understand the user's input command and determine the corresponding processing result to adjust the target content. The candidate shortcut command or the user's input command can be a processing requirement for at least a part of the target content, or a processing requirement for the entire target content; the scope of the embodiments disclosed herein is not limited.

[0062] In some embodiments, in the second interaction mode, after adjusting the target content based on the processing result, an undo control for the adjustment can also be provided. For example, the undo control can be associatedly displayed near the adjusted portion of the target content, or at any appropriate location. If a trigger on the undo control is detected, the adjustment to the target content can be undone. Figure 2DAs shown, after inserting continuation content 242, an undo control 252 is also provided so that the user can undo the insertion operation.

[0063] In some embodiments, for certain instructions or all instructions, the processing results may not be displayed in the operation panel. Instead, the target content can be adjusted directly based on the processing results. This allows the first user to quickly and directly see the processing results. If the user is not satisfied with the processing results, they can undo the adjustments to the target content by issuing subsequent instructions or using the provided undo control.

[0064] In some embodiments, the first interaction mode (i.e., dialogue mode) and the second interaction mode (i.e., floating window mode) allow users to perform different interactions as needed. For example, in application scenarios requiring retrieval, analysis, summarization, data extraction, and layout optimization, the first user can engage in multiple rounds of dialogue with the first digital assistant in the first interaction mode to complete information processing tasks. In the following scenarios, if it is necessary to modify, polish, continue, or abbreviate a certain part of the target content, the first user can wake up the first digital assistant at a certain location in the target content to perform information processing tasks in the second interaction mode. In this way, users can conveniently and quickly interact with the first digital assistant in different scenarios, on different interfaces, or in different areas as needed to complete information processing operations with the help of the first digital assistant. It should be understood that in any interaction mode, the first user can issue instructions to the first digital assistant in any appropriate manner. These instructions can be overall processing requirements for a single piece of content or multiple pieces of content (e.g., analysis, summarization, layout), or specific processing requirements for a specific part of the content (e.g., polishing, modification, abbreviation, etc.). The embodiments of this disclosure do not limit the specific instructions in different interaction modes.

[0065] exist Figures 2A to 2D The example illustrates how the interactive areas corresponding to the first and second interaction modes are simultaneously displayed when both modes are triggered. In other embodiments, interactive areas corresponding to different interaction modes can also be displayed on different client interfaces. Figures 3A to 3F A schematic diagram of an example client interface for a user's multi-interaction mode with a digital assistant, according to some embodiments of the present disclosure, is shown. Figure 3A In the middle, the first interaction mode (i.e., dialogue mode) is triggered, and the conversation window corresponding to the first user and the first digital assistant is presented in the client interface 300.

[0066] In some cases, the first user triggers the presentation of the target content, for example, by clicking on session message 310 in the session window, which then presents... Figure 3BThe client interface 302 is shown. The target document is presented in client interface 302. In client interface 302, the first user can trigger a second interaction mode with the first digital assistant in an appropriate manner. For example... Figure 3C As shown, by selecting a portion of the target document 320, a menu 322 is displayed, which includes the entry control for the first digital assistant, namely the "XX Assistant" control 324. Triggering control 324 displays... Figure 3D The operation panel 330 is shown. The operation panel 330 may include multiple candidate shortcut commands 332 and input controls 334 for receiving commands. If in Figure 3D The system detected a trigger on the "Continue Writing" option of the candidate shortcut commands in the operation panel, such as... Figure 3E As shown, the operation panel 330 displays the continuation content 342, and also displays shortcut commands 344 for the continuation content 342, including "Insert," "Regenerate," and "Continue Dialogue." If the "Insert" command is triggered, i.e., user confirmation is detected, then the continuation content 342 is inserted into the target document, as shown. Figure 3F As shown.

[0067] The above discussion covered the interaction between the first user and the first digital assistant under different interaction modes. Besides dialogue mode and floating window mode, other interaction modes or methods between the first user and the first digital assistant may also exist.

[0068] As mentioned earlier, the historical interaction information of the first user interacting with the first digital assistant in multiple interaction modes can be associated with the first user and stored. Thus, in any of the multiple interaction modes, the first digital assistant can provide services to the first user based on the historical interaction information stored with the first user. In some embodiments, in the first interaction mode, when the first digital assistant performs a task based on the session message in the session window, it uses the interaction information between the first user and the first digital assistant in other interaction modes (excluding the first interaction mode) as context. Similarly, in some embodiments, in the second interaction mode, when the first digital assistant performs a task based on the instructions issued by the first user through the operation panel, it uses the interaction information between the first user and the first digital assistant in other interaction modes (excluding the second interaction mode) as context. In other words, the first digital assistant supports interaction with the first user in different triggering scenarios through different interaction methods, but the historical interaction information in different interaction modes can be considered together as the context for subsequent task processing, regardless of the interaction mode in which the subsequent task processing is triggered. This significantly improves the intelligence of the first digital assistant and its uniqueness to the first user, enabling the first digital assistant to provide the user with processing results that meet their needs.

[0069] Considering that the first interaction mode is a session mode, where the session window typically records historical interaction information, in some embodiments, interaction-related information between the first user and the first digital assistant in other interaction modes besides the first interaction mode can also be presented in the session window corresponding to the first interaction mode. Thus, the interaction status between the first user and the first digital assistant in multiple interaction modes can be recorded in the session window. In some embodiments, the interaction-related information presented in the session window may include descriptions of operations performed in other interaction modes, such as indications of commands issued by the first user in other interaction modes, and / or indications of the execution results of the first digital assistant in response to those commands, etc.

[0070] Specifically, if a target instruction from the first user for the target content is detected in the second interaction mode, and the processing result for the target instruction is determined, then the target message can be presented in the session window corresponding to the first interaction mode, and the target message at least indicates the processing result.

[0071] In some embodiments, the target message presented in the conversation window includes a first conversation message corresponding to the first user and a second conversation message corresponding to the first digital assistant. The first conversation message indicates the target instruction, and the second conversation message indicates the processing result. In this way, interaction-related information under other interaction modes (e.g., the second interaction mode) can be presented in the form of one or more rounds of conversation between the first user and the first digital assistant.

[0072] Figure 4A A schematic diagram illustrating an example of an interaction history of other interaction modes in a first interaction mode according to some embodiments of the present disclosure is shown. Figure 4A As shown, in area 410 of the client interface 400, a conversation window corresponding to the first user and the first digital assistant in the first interaction mode is displayed. The conversation message 412 corresponding to the first user indicates the instruction "Help me polish this text" issued by the first user in other interaction modes, and the conversation message 414 corresponding to the first digital assistant indicates the processing result determined by the first digital assistant in other interaction modes, namely, "I have polished this text for you." These conversation messages record the interaction process between the first user and the first digital assistant in other interaction modes.

[0073] In some embodiments, the target message presented in the session window may include system messages within the session window. System messages are not presented in the session window as session messages corresponding to the first user or the first digital assistant. Figure 4B A schematic diagram illustrating an example of an interaction history of other interaction modes in a first interaction mode according to some embodiments of the present disclosure is shown. Figure 4BIn the example, suppose that in the client interface 402, in the second interaction mode, the first digital assistant polishes part of the content in the target document through a command issued on the operation panel 432. After the first interaction mode is triggered, a system message 434 is presented in the session window corresponding to the client interface 404, which records the processing result of the first digital assistant on the target content.

[0074] In some embodiments, the target message presented in the session window may include an access link to the processing result, which links to the relevant portion of the target content. For example, in Figure 4A or Figure 4B In the examples, messages 412, 414, and 434 contain a link to access the edited section of the target content. Clicking this link allows users to quickly access the processed content from the target message within the session window, as needed. Providing this link allows the first user to easily access the processed content from the target message within the session window, based on their requirements.

[0075] In some embodiments, after the target message is presented in the session window corresponding to the first interaction mode, the response to the session message input by the user can be determined in the first interaction mode at least based on the target message. That is, the target message can be conveniently referenced as historical interaction information in the first interaction mode. For example, the first user can continue to initiate a session based on the target message in the session window, requesting the first digital assistant to continue to make other adjustments or processing to the target content or a part thereof connected to the target message. The first digital assistant can directly understand the processing requirements of the first user.

[0076] In the above embodiment, selecting at least a portion of the target content triggers the entry control corresponding to the first digital assistant, thereby activating the second interaction mode. As mentioned earlier, there may be other ways to trigger the second interaction mode. Figures 5A to 5H A schematic diagram of an example entry control for a digital assistant in a second interaction mode according to some embodiments of the present disclosure is shown.

[0077] In some embodiments, the entry control corresponding to the first digital assistant is fixedly displayed at a predetermined position in the target interface area. For example... Figure 5A As shown, the target interface area corresponding to the target content is presented in the client interface 500, and the entry control 520 corresponding to the first digital assistant is presented at a predetermined position in the target interface area, such as the menu position. In this way, when the target interface area corresponding to the target content is presented, the first user can trigger the entry control at the predetermined position as needed to trigger the second interaction mode corresponding to the first digital assistant.

[0078] In some embodiments, the entry control corresponding to the first digital assistant may be presented in the target interface area in response to a preset action. The preset action can be any appropriate action, including those combined with the above. Figures 2A to 2D as well as Figures 3A to 3F The description refers to the selection of a portion of content. In some examples, the preset action may also include inputting a preset symbol in the target interface area or target content, or a hover action in a preset area. For example, in Figure 5B In the client interface 501, in response to the input of " / " in the target document, a menu can be displayed, including the entry control 520 corresponding to the first digital assistant. Figure 5C In the client interface 502, in response to a hover operation in a preset area of ​​the target document, control 522 is presented. A hover operation on control 522 will further trigger the display of a menu including the entry control 520 corresponding to the first digital assistant. Figure 5D In the client interface 504, in response to a hover operation on a paragraph in the target document, control 524 is presented. A hover operation on control 524 will further trigger the display of a menu, including the entry control 520 corresponding to the first digital assistant. Figure 5E In the client interface 506, in response to the selection of a portion of the target document, a menu is displayed, including the entry control 520 corresponding to the first digital assistant.

[0079] In some embodiments, when the type of the target content is a preset type, the entry control is embedded in the target content within the target interface area. The preset type can be set as needed, for example, it can be a type of content that is pre-determined to specifically require triggering the first digital assistant for processing. In some embodiments, the preset type may include, for example, the type of blank content (e.g., a blank document), or the type of content that only includes a title.

[0080] like Figure 5F As shown, a blank document is displayed on the client interface 508, in which the entry control 522 corresponding to the first digital assistant is directly embedded. In some embodiments, based on a preset type, the entry control corresponding to the first digital assistant can also be configured to trigger corresponding instructions. For example, in Figure 5F In the middle, by triggering the entry control 522, the "Help me write" command can be triggered, requesting the first digital assistant to help write the document. Figure 5G In the client interface 510 shown, if the target document is a document that only includes a title, after triggering the entry control, the first digital assistant can compose document content based on the title and present an operation panel 524, which includes input controls and some candidate shortcuts such as "Redo" and "Stop". In some examples, if the target content does not include a title, such as... Figure 5HThe client interface 512 shown can display the operation panel 525 of the first digital assistant after triggering the entry control. It includes input controls to prompt the user to enter the document topic.

[0081] It should be understood that Figures 5A to 5H This only shows an example of how the entry control for the first digital assistant is presented in the interface area corresponding to the target content. Depending on the actual application needs, the entry control for the first digital assistant can be configured to other presentation methods; this disclosure does not impose any limitations on the embodiments herein.

[0082] It should be understood that some embodiments of this disclosure have been described above with reference to specific examples in the accompanying drawings, but these specific examples are not intended to limit the scope of the embodiments of this disclosure. The described embodiments can also be implemented in various other variations.

[0083] Figure 6 A flowchart of a process 600 for information processing according to some embodiments of the present disclosure is shown. Process 600 may be implemented at a terminal device 110. For ease of discussion, reference will be made to... Figure 1 The environment 100 is used to describe the process 200.

[0084] In box 610, the terminal device 110 presents the interaction area between the first user and the first digital assistant corresponding to the triggered interaction mode among the multiple interaction modes of the first digital assistant; wherein, the interaction method between the first user and the first digital assistant is different under different interaction modes.

[0085] In some embodiments, presenting the interaction area between the first user and the first digital assistant corresponding to the triggered interaction mode includes: when the triggered interaction mode includes two or more interaction modes, the interaction areas between the first user and the first digital assistant corresponding to the two or more interaction modes are presented simultaneously in the client interface of the first user.

[0086] In some embodiments, the historical interaction information of the first user interacting with the first digital assistant in multiple interaction modes is all associated with the first user and stored; in one of the multiple interaction modes, the first digital assistant provides services to the first user based on the historical interaction information stored in association with the first user.

[0087] In some embodiments, presenting the interaction area between the first user and the first digital assistant corresponding to the triggered interaction mode includes: when the first interaction mode among multiple interaction modes is triggered, presenting a conversation window between the first user and the first digital assistant, in which the first user and the first digital assistant interact through conversation messages.

[0088] In some embodiments, process 600 further includes: presenting interaction-related information between the first user and the first digital assistant in other interaction modes in the session window corresponding to the first interaction mode; wherein, other interaction modes are interaction modes other than the first interaction mode among a plurality of interaction modes.

[0089] In some embodiments, interaction-related information includes a description of operations performed in other interaction modes.

[0090] In some embodiments, in the first interaction mode, when the first digital assistant performs a task based on the session message in the session window, it uses the interaction-related information between the first user and the first digital assistant in other interaction modes as context; wherein, other interaction modes are interaction modes other than the first interaction mode among a plurality of interaction modes.

[0091] In some embodiments, presenting the interaction area between the first user and the first digital assistant corresponding to the triggered interaction mode includes: when the second interaction mode among multiple interaction modes is triggered, presenting the operation panel corresponding to the first digital assistant, the operation panel including at least one of the following: at least one candidate shortcut command, and an input control for receiving commands, the first user issuing commands to the first digital assistant based on the operation panel.

[0092] In some embodiments, in the second interaction mode, when the first digital assistant performs a task according to the instructions issued by the first user through the operation panel, it uses the interaction-related information between the first user and the first digital assistant in other interaction modes as context; wherein, other interaction modes are interaction modes other than the second interaction mode among a plurality of interaction modes.

[0093] In some embodiments, presenting the operation panel corresponding to the first digital assistant includes: presenting an entry control for the first digital assistant in a target interface area corresponding to the target content; determining that a second interaction mode has been triggered in response to detecting a trigger operation on the entry control; and presenting the operation panel corresponding to the first digital assistant in the target interface area.

[0094] In some embodiments, the entry control is fixedly displayed at a predetermined position in the target interface area. In some embodiments, the entry control is presented in the target interface area in response to a preset operation. In some embodiments, when the type of the target content is a preset type, the entry control is embedded in the target content in the target interface area.

[0095] In some embodiments, at least one candidate shortcut instruction in the operation panel is determined based on at least one of the following: at least a portion of the target content, historical processing operations on the target content, or interaction-related information for the target content in other interaction modes, wherein the other interaction modes are interaction modes other than the second interaction mode among a plurality of interaction modes.

[0096] In some embodiments, process 600 further includes: in a second interaction mode, determining a processing result for a target instruction based on a detected target instruction for the target content, the target instruction including a shortcut instruction triggered from at least one candidate shortcut instruction, or an instruction received through an input control; and adjusting the target content based on the processing result.

[0097] In some embodiments, adjusting the target content based on the processing result includes: presenting the processing result in an operation panel; and adjusting the target content based on the processing result in response to detecting user confirmation of the processing result.

[0098] In some embodiments, process 600 further includes providing an undo control for the adjustment.

[0099] In some embodiments, process 600 further includes: when multiple interaction modes include a first interaction mode, and the interaction area between the first user and the first digital assistant in the first interaction mode is a session window, presenting a target message in the session window corresponding to the first interaction mode, wherein the target message at least indicates the processing result.

[0100] In some embodiments, the target message includes a first session message corresponding to the first user and a second session message corresponding to the first digital assistant, wherein the first session message indicates the target instruction and the second session message indicates the processing result. In some embodiments, the target message includes system messages in the session window.

[0101] In some embodiments, the target message includes an access link to the processing result, which links to a portion of the target content related to the processing result.

[0102] In some embodiments, process 600 further includes: in a first interaction mode, determining a response to a session message in response to user input based at least on a target message.

[0103] In some embodiments, the target content includes one or more of the following: documents, audio, video, images, emails, calendars, schedules, and tasks.

[0104] Figure 7A schematic structural block diagram of an apparatus 700 for information processing according to some embodiments of the present disclosure is shown. The apparatus 700 may be implemented as or included in a terminal device 110. The various modules / components in the apparatus 700 may be implemented by hardware, software, firmware, or any combination thereof.

[0105] The device 700 includes an interactive presentation module 710, which is configured to present the interaction area between the first user and the first digital assistant corresponding to the triggered interaction mode among multiple interaction modes of the first digital assistant; wherein the interaction method between the first user and the first digital assistant is different under different interaction modes.

[0106] In some embodiments, the interactive presentation module 710 includes: a simultaneous presentation module, configured to simultaneously present the interaction areas of the first user and the first digital assistant corresponding to the two or more interaction modes in the client interface of the first user when the triggered interaction mode includes two or more interaction modes.

[0107] In some embodiments, the historical interaction information of the first user interacting with the first digital assistant in multiple interaction modes is all associated with the first user and stored; in one of the multiple interaction modes, the first digital assistant provides services to the first user based on the historical interaction information stored in association with the first user.

[0108] In some embodiments, the interactive presentation module 710 includes: a first interactive presentation module configured to present a conversation window between a first user and a first digital assistant when a first interactive mode among multiple interactive modes is triggered, wherein the first user and the first digital assistant interact through conversation messages in the conversation window.

[0109] In some embodiments, the device 700 further includes an interactive information presentation module, configured to present interaction-related information between the first user and the first digital assistant under other interactive modes in a session window corresponding to the first interactive mode; wherein, other interactive modes are interactive modes other than the first interactive mode among a plurality of interactive modes.

[0110] In some embodiments, interaction-related information includes a description of operations performed in other interaction modes.

[0111] In some embodiments, in the first interaction mode, when the first digital assistant performs a task based on the session message in the session window, it uses the interaction-related information between the first user and the first digital assistant in other interaction modes as context; wherein, other interaction modes are interaction modes other than the first interaction mode among a plurality of interaction modes.

[0112] In some embodiments, the interactive presentation module 710 includes: a second interactive presentation module, configured to present an operation panel corresponding to the first digital assistant when the second interactive mode among multiple interactive modes is triggered, the operation panel including at least one of the following: at least one candidate shortcut command, and an input control for receiving commands, wherein the first user issues commands to the first digital assistant based on the operation panel.

[0113] In some embodiments, in the second interaction mode, when the first digital assistant performs a task according to the instructions issued by the first user through the operation panel, it uses the interaction-related information between the first user and the first digital assistant in other interaction modes as context; wherein, other interaction modes are interaction modes other than the second interaction mode among a plurality of interaction modes.

[0114] In some embodiments, the second interactive presentation module includes: an entry presentation module configured to present an entry control for the first digital assistant in a target interface area corresponding to the target content; a second interactive mode triggering module configured to determine that a second interactive mode has been triggered in response to detecting a triggering operation for the entry control; and a trigger-after-presentation module configured to present an operation panel corresponding to the first digital assistant in the target interface area.

[0115] In some embodiments, the entry control is fixedly displayed at a predetermined position in the target interface area. In some embodiments, the entry control is presented in the target interface area in response to a preset operation. In some embodiments, when the type of the target content is a preset type, the entry control is embedded in the target content in the target interface area.

[0116] In some embodiments, at least one candidate shortcut instruction in the operation panel is determined based on at least one of the following: at least a portion of the target content, historical processing operations on the target content, or interaction-related information for the target content in other interaction modes, wherein the other interaction modes are interaction modes other than the second interaction mode among a plurality of interaction modes.

[0117] In some embodiments, the apparatus 700 further includes: a result determination module configured to, in a second interaction mode, determine a processing result for a target instruction based on a detected target instruction for the target content, the target instruction including a shortcut instruction triggered from at least one candidate shortcut instruction, or an instruction received through an input control; and a content adjustment module configured to adjust the target content based on the processing result.

[0118] In some embodiments, the content adjustment module includes: a result presentation module configured to present the processing result in an operation panel; and a confirmation adjustment module configured to adjust the target content based on the processing result in response to detecting user confirmation of the processing result.

[0119] In some embodiments, the apparatus 700 further includes an undo providing module configured to provide an undo control for the adjustment.

[0120] In some embodiments, the device 700 further includes a message presentation module configured to present a target message in a session window corresponding to a first interaction mode when multiple interaction modes include a first interaction mode and the interaction area between the first user and the first digital assistant in the first interaction mode is a session window, the target message indicating at least the processing result.

[0121] In some embodiments, the target message includes a first session message corresponding to the first user and a second session message corresponding to the first digital assistant, wherein the first session message indicates the target instruction and the second session message indicates the processing result. In some embodiments, the target message includes system messages in the session window.

[0122] In some embodiments, the target message includes an access link to the processing result, which links to a portion of the target content related to the processing result.

[0123] In some embodiments, the apparatus 700 further includes a response determination module configured to determine a response to a session message input by a user, based at least on a target message, in a first interaction mode.

[0124] In some embodiments, the target content includes one or more of the following: documents, audio, video, images, emails, calendars, schedules, and tasks.

[0125] It should be understood that one or more steps in the above methods can be performed by suitable electronic devices or combinations of electronic devices. Such electronic devices or combinations of electronic devices may include, for example, […]. Figure 1 The server 130, terminal device 110 and / or a combination of server 130 and terminal device 110.

[0126] Figure 8 A block diagram of an electronic device 800 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that... Figure 8 The electronic device 800 shown is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 8 The electronic device 800 shown can be used to achieve Figure 1 Terminal equipment 110.

[0127] like Figure 8As shown, electronic device 800 is in the form of a general-purpose electronic device. Components of electronic device 800 may include, but are not limited to, one or more processors or processing units 810, memory 820, storage device 830, one or more communication units 840, one or more input devices 850, and one or more output devices 860. Processing unit 810 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 820. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 800.

[0128] Electronic device 800 typically includes multiple computer storage media. Such media can be any available media accessible to electronic device 800, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 820 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 830 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media capable of storing information and / or data and accessible within electronic device 800.

[0129] Electronic device 800 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 8 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 820 may include computer program product 825 having one or more program modules configured to perform various methods or actions of various embodiments of this disclosure.

[0130] The communication unit 840 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 800 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 800 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0131] Input device 850 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 860 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 800 can also communicate with one or more external devices (not shown) via communication unit 840 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 800, or with any device that enables electronic device 800 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0132] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0133] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0134] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0135] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0136] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0137] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. An information processing method, comprising: Based on the interaction modes triggered in the multiple interaction modes of the first digital assistant, the interaction area between the first user and the first digital assistant corresponding to the triggered interaction mode is presented. When the first interaction mode among the plurality of interaction modes is triggered, the first digital assistant, when performing a task based on the session messages in the interaction area, uses the interaction-related information between the first user and the first digital assistant in other interaction modes as context. The other interaction modes are interaction modes other than the first interaction mode among the plurality of interaction modes. The interaction methods between the first user and the first digital assistant are different in different interaction modes. The historical interaction information of the first user interacting with the first digital assistant in the plurality of interaction modes is all associated with the first user and stored.

2. The method according to claim 1, wherein, The interaction area between the first user and the first digital assistant corresponding to the triggered interaction mode includes: When the triggered interaction mode includes two or more interaction modes, the interaction areas of the first user and the first digital assistant corresponding to the two or more interaction modes are simultaneously presented on the client interface of the first user.

3. The method according to claim 1, wherein, In one of the multiple interaction modes, the first digital assistant provides services to the first user based on historical interaction information associated with the first user's stored data.

4. The method according to any one of claims 1-3, wherein, The interaction area between the first user and the first digital assistant corresponding to the triggered interaction mode includes: When the first interaction mode among the plurality of interaction modes is triggered, a conversation window between the first user and the first digital assistant is presented, in which the first user and the first digital assistant interact through conversation messages.

5. The method according to claim 4, wherein, The method also includes: The interaction information between the first user and the first digital assistant in the other interaction modes is presented in the session window corresponding to the first interaction mode.

6. The method according to claim 5, wherein, The interaction-related information includes a description of the operations performed in the other interaction modes.

7. The method according to any one of claims 1-3, wherein, The interaction area between the first user and the first digital assistant corresponding to the triggered interaction mode includes: When the second interaction mode among the multiple interaction modes is triggered, the operation panel corresponding to the first digital assistant is presented. The operation panel includes at least one of the following: at least one candidate shortcut command and an input control for receiving commands. The first user issues commands to the first digital assistant based on the operation panel.

8. The method according to claim 7, wherein, In the second interaction mode, when the first digital assistant executes a task according to the instructions issued by the first user through the operation panel, it uses the interaction information between the first user and the first digital assistant in other interaction modes as context. The other interaction modes are those other than the second interaction mode among the plurality of interaction modes.

9. The method according to claim 7, wherein, The operation panel that displays the first digital assistant includes: An entry control for the first digital assistant is displayed in the target interface area corresponding to the target content; In response to detecting a trigger operation on the entry control, it is determined that the second interaction mode has been triggered; and The operation panel corresponding to the first digital assistant is displayed in the target interface area.

10. The method of claim 9, wherein The entry control is fixedly displayed at a predetermined position in the target interface area; Alternatively, the entry control may be presented in the target interface area in response to a preset operation; Alternatively, if the type of the target content is a preset type, the entry control is embedded in the target content within the target interface area.

11. The method of claim 9, wherein the at least one candidate shortcut command in the operation panel is determined based on at least one of the following: At least a portion of the target content, Historical processing operations on the target content, or Interaction-related information for the target content in other interaction modes, wherein the other interaction modes are interaction modes other than the second interaction mode among the plurality of interaction modes.

12. The method according to claim 9, further comprising: In the second interaction mode, based on the detected target instruction for the target content, the processing result for the target instruction is determined, wherein the target instruction includes the shortcut instruction triggered from the at least one candidate shortcut instruction, or the instruction received through the input control; as well as The target content is adjusted based on the processing results.

13. The method according to claim 12, wherein, Adjusting the target content based on the processing result includes: presenting the processing result in the operation panel; and adjusting the target content based on the processing result in response to detecting user confirmation of the processing result. Alternatively, the method may further include providing an undo control for the adjustment.

14. The method of claim 12, further comprising: When the plurality of interaction modes includes a first interaction mode, and in the first interaction mode the interaction area between the first user and the first digital assistant is a session window, The target message is presented in the session window corresponding to the first interaction mode, and the target message at least indicates the processing result.

15. The method of claim 14, wherein The target message includes a first session message corresponding to the first user and a second session message corresponding to the first digital assistant. The first session message indicates the target instruction, and the second session message indicates the processing result. Alternatively, the target message may include system messages in the session window; Alternatively, the target message may include an access link to the processing result, the access link being used to link to a portion of the target content related to the processing result.

16. The method of claim 14, further comprising: In the first interaction mode, the response to the session message input by the user is determined based at least on the target message.

17. The method of claim 9, wherein the target content includes one or more of the following: Documents, audio, video, images, emails, calendars, schedules, tasks.

18. An apparatus for information processing, comprising: The interactive presentation module is configured to present the interaction area between the first user and the first digital assistant corresponding to the triggered interaction mode among multiple interaction modes of the first digital assistant. When the first interaction mode among the plurality of interaction modes is triggered, the first digital assistant, when performing a task based on the session messages in the interaction area, uses the interaction-related information between the first user and the first digital assistant in other interaction modes as context. The other interaction modes are interaction modes other than the first interaction mode among the plurality of interaction modes. The interaction methods between the first user and the first digital assistant are different in different interaction modes. The historical interaction information of the first user interacting with the first digital assistant in the plurality of interaction modes is all associated with the first user and stored.

19. An electronic device comprising: At least one processing unit; as well as At least one memory, coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, which, when executed by the at least one processing unit, cause the electronic device to perform the method according to any one of claims 1 to 17.

20. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 17.

Images