Methods, apparatus, devices and storage media for information processing

CN118796074BActive Publication Date: 2026-09-18BEIJING ZITIAO NETWORK TECH CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310539277.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2023-04-11
Filing Date
2023-05-12
Publication Date
2026-09-18
Estimated Expiration
2043-05-12

Smart Images

  • Figure CN118796074B_ABST
    Figure CN118796074B_ABST
Patent Text Reader

Abstract

Embodiments of this disclosure provide a method, apparatus, device, and storage medium for information processing. The method includes: presenting an interaction window between a user and a digital assistant in a first area of ​​a client interface, wherein interaction messages in the interaction window can be associated with content in multiple components; and presenting target content in a first component of the multiple components in a second area of ​​the client interface, wherein the target content is associated with a first interaction message in the interaction window, and the first and second areas do not overlap. Thus, a partitioned collaborative approach allows the user to view and process content in different components using a digital assistant.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The exemplary embodiments disclosed herein generally relate to the field of computers, and more particularly to methods, apparatus, devices and computer-readable storage media for information processing. Background Technology

[0002] With the rapid development of internet technology, the internet has become a crucial platform for people to access and share content. Users can access the internet through terminal devices to enjoy various internet services. Terminal devices present relevant content and interact with users through user interfaces. Therefore, rich and varied interfaces are an important means of enhancing user experience. With the development of information technology, various terminal devices can provide people with various services in work and life. For example, applications that provide services can be deployed on terminal devices. Terminal devices or applications can provide assistant functions to help users use the terminal devices or applications.

[0003] Multifunctional collaboration platforms, such as office collaboration platforms (also known as office suites), can provide the integration of various types of functions or components to facilitate people's work, communication, and other activities. Within a multifunctional collaboration platform, users can activate different functions or components as needed to complete corresponding information processing, sharing, and communication.

[0004] How to apply current technological components to the office field to improve office efficiency or flexibility is a technical issue that needs to be explored. Summary of the Invention

[0005] In a first aspect of this disclosure, an information processing method is provided. The method includes: presenting an interaction window between a user and a digital assistant in a first area of ​​a client interface, wherein interaction messages in the interaction window can be associated with content in multiple components; and presenting target content in a first component of the multiple components in a second area of ​​the client interface, wherein the target content is associated with a first interaction message in the interaction window, and the first and second areas do not overlap.

[0006] In a second aspect of this disclosure, an information processing method is provided. The method includes: presenting an interaction window between a user and a digital assistant in a first area of ​​a client interface, the interaction message in the interaction window including at least first content in a first component; presenting second content in a second component in a second area of ​​the client interface; and inserting the first content into the second content in response to a user dragging the first content from the first area to the second area.

[0007] In a third aspect of this disclosure, an apparatus for information processing is provided. The apparatus includes: a first presentation module configured to present an interaction window between a user and a digital assistant in a first area of ​​a client interface, wherein interaction messages in the interaction window are associated with content in a plurality of components; and a second presentation module configured to present target content in a first component of the plurality of components in a second area of ​​the client interface, wherein the target content is associated with a first interaction message in the interaction window, and the first and second areas do not overlap.

[0008] In a fourth aspect of this disclosure, an apparatus for information processing is provided. The apparatus includes: a first presentation module configured to present an interaction window between a user and a digital assistant in a first area of ​​a client interface, the interaction message in the interaction window including at least first content in a first component; a second presentation module configured to present second content in a second component in a second area of ​​the client interface; and an insertion module configured to insert the first content into the second content in response to a user dragging the first content from the first area to the second area.

[0009] In a fifth aspect of this disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the electronic device to perform the methods of the first aspect and / or the methods of the second aspect.

[0010] In a sixth aspect of this disclosure, a computer-readable storage medium is provided. A computer program is stored on the medium, which can be executed by a processor to implement the method of the first aspect and / or the method of the second aspect.

[0011] It should be understood that the description in this section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0012] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0013] Figure 1 A schematic diagram of an example environment in which embodiments of the present disclosure can be implemented is shown;

[0014] Figures 2A to 2G A schematic diagram of an example client interface for partitioned collaboration based on a digital assistant according to some embodiments of the present disclosure is shown;

[0015] Figures 3A to 3D A schematic diagram of an example client interface for content creation based on a digital assistant, according to some embodiments of the present disclosure, is shown.

[0016] Figures 4A to 4C A schematic diagram of an example client interface for collaborative content replacement based on a digital assistant according to some embodiments of the present disclosure is shown;

[0017] Figures 5A to 5B A schematic diagram of an example client interface for collaborative content insertion based on a digital assistant according to some embodiments of the present disclosure is shown;

[0018] Figures 6A to 6B A schematic diagram of an example client interface for collaborative typesetting based on a digital assistant according to some embodiments of the present disclosure is shown;

[0019] Figures 7A to 7C A schematic diagram of an example client interface for cross-region drag-and-drop partition collaboration based on a digital assistant, according to some embodiments of the present disclosure, is shown.

[0020] Figures 8A to 8E A schematic diagram of an example client interface for content generation animation based on a digital assistant according to some embodiments of the present disclosure is shown;

[0021] Figure 9 A flowchart of a process for information processing according to some embodiments of the present disclosure is shown;

[0022] Figure 10 A flowchart of a process for information processing according to other embodiments of the present disclosure is shown;

[0023] Figure 11 A block diagram of an apparatus for information processing according to some embodiments of the present disclosure is shown;

[0024] Figure 12 Block diagrams of apparatus for information processing according to other embodiments of the present disclosure are shown; and

[0025] Figure 13 An electronic device in which one or more embodiments of the present disclosure may be implemented is shown. Detailed Implementation

[0026] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0027] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0028] In this document, unless explicitly stated otherwise, performing a step in response to A does not mean that the step is performed immediately after A, but may include one or more intermediate steps.

[0029] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0030] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, relevant users should be informed of the type, scope of use, and usage scenarios of the information involved in this disclosure through appropriate means in accordance with relevant laws and regulations, and authorization should be obtained from the relevant users. Among them, relevant users may include any type of rights holder, such as individuals, enterprises, and groups.

[0031] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly inform the user that the requested operation will require obtaining and using the user's information, thereby enabling the relevant user to choose whether to provide information to the software or hardware such as the electronic device, application, server, or storage medium that performs the operation of the technical solution disclosed herein based on the prompt message.

[0032] As an optional but non-restrictive implementation, in response to a user's active request, a prompt message can be sent to the user, such as a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide information to the electronic device.

[0033] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0034] Figure 1A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In this example environment 100, an office suite 120 is installed on a terminal device 110. A user 140 can interact with the office suite 120 via the terminal device 110 and / or an attached device of the terminal device 110. The office suite 120 is capable of providing the user 140 with the integration of multiple components. These components can be component modules within the office suite 120. The components integrated in the office suite 120 are sometimes referred to as "office applications," "office components," etc. Such components include, but are not limited to, office-related components, tool-related components, etc. As an example, the components integrated in the office suite 120 may include, but are not limited to, one or more of the following: chat components (also known as instant messaging components), document components, audio and video conferencing components, email components, calendar components, schedule components, task components, goal and key results (OKR) components, etc. It is understood that various other types of components can also be integrated into the office suite.

[0035] In some embodiments, the office suite 120 can be downloaded and installed as an application on the terminal device 110. In some embodiments, the office suite 120 can also be accessed in other ways, such as through a web page.

[0036] exist Figure 1 In environment 100, if office suite 120 is started, terminal device 110 can display the interface 150 of office suite 120. Interface 150 may include various user interfaces provided by office suite 120. Interface 150 is sometimes also referred to as client interface.

[0037] In some embodiments, terminal device 110 communicates with server 130 to provide services to office suite 120. Terminal device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, terminal device 110 can also support any type of user-facing interface (such as "wearable" circuitry). Server 130 can be any type of computing system / server capable of providing computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, etc.

[0038] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0039] While some multi-functional collaboration platforms offer integration capabilities for different components, their intelligence is insufficient. Many components (e.g., documents, spreadsheets, appointments, meeting summaries) still rely on manual processing and lack automatic generation and collaboration capabilities. However, manual information processing is inefficient, involves repetitive work, and often requires searching, understanding, and organizing massive amounts of data. Furthermore, manual work is time-consuming in areas such as data searching and reading documents or meeting minutes, and inefficient and error-prone in scenarios involving summarizing, text writing and calculation, reading comprehension, cross-language searching, and cross-component content interaction.

[0040] According to embodiments of this disclosure, several improvements for information processing are proposed to support collaboration between digital assistants and users in partitioned states. In embodiments of this disclosure, the digital assistant, as an intelligent assistant, is capable of processing information based on user instructions through dialogue.

[0041] In some embodiments, the interface is partitioned, with an interaction window (e.g., a conversation window) between the user and the digital assistant presented in a first area of ​​the client interface, and the target content associated with the interaction messages in the interaction window presented in a second area of ​​the client interface. The interaction messages in the user-digital assistant interaction window (e.g., conversation messages in the conversation window) can be associated with content in multiple different components. According to this scheme, users can view and process content in different components using the digital assistant through partitioned collaboration. Compared to traditional schemes that require users to constantly switch between different components for task processing, this partitioned collaboration method is more convenient, faster, and maintains the continuity of task processing.

[0042] In some embodiments, an interaction window (e.g., a conversation window) between the user and the digital assistant is presented in a first area of ​​the client interface through interface partitioning. The interaction messages in the interaction window (e.g., conversation messages in the conversation window) include at least the first content of the first component. Furthermore, the second content of the second component is presented in a second area of ​​the client interface. If a drag operation by the user on the first content in the interaction message is detected from the first area to the second area, the dragged first content is inserted into the second content presented in the second area. This allows the user to more conveniently and quickly merge the component content involved in the interaction with the digital assistant into another content presented in a partition, improving processing efficiency. In some embodiments, the first component corresponding to the first content and the second component corresponding to the second content are the same component, such as both being document components or both being OKR components; or, in other embodiments, the first component corresponding to the first content and the second component corresponding to the second content are different components, such as the second component being a document component, while the first component could be an OKR component or a calendar component.

[0043] Some exemplary embodiments of this disclosure will be described in detail below with reference to the accompanying drawings.

[0044] As described above, in the embodiments of this disclosure, a digital assistant is used for interaction with a user. An interaction window, such as a conversation window, is presented in the client interface for the user and the digital assistant. As an intelligent assistant, the digital assistant possesses intelligent dialogue and information processing capabilities. In the interaction window, the user inputs interactive messages, and the digital assistant responds to the user's input by providing a reply message. The client interface used to present the interaction window may correspond to a multi-functional collaboration platform, such as... Figure 1 Office suites or other collaboration platforms that can integrate multiple components.

[0045] A digital assistant can be invoked or activated by an appropriate means (e.g., keyboard shortcuts, buttons, or voice) to present an interactive window with the user. In some embodiments, the digital assistant can be included as a contact in the user's current contact list within the office suite, or in the message stream of a chat component. Selecting the digital assistant opens an interactive window. In some embodiments, the digital assistant can also be launched within one or more components supported by a multi-functional collaboration platform, thereby presenting an interactive window. The interactive window may include interface elements for information interaction, such as input boxes, message lists, message bubbles, etc. In the embodiments described below, for ease of discussion, a session window is used as an example for illustration.

[0046] Figure 2AAn example client interface 201 is shown, presenting a conversation window between a user and a digital assistant according to some embodiments of the present disclosure. The conversation window between the digital assistant (“XX Assistant”) and the current user (“User A”) is presented in area 210 of interface 201. Figure 2A In the example, the digital assistant can be considered one of the user's contacts and presented in the information stream of the instant messaging component. The information stream is presented in another area 220 of interface 201. The user can enter a conversation window by selecting the digital assistant. Furthermore, interface 201 can correspond to a multi-functional collaboration platform that integrates multiple different types of components. Area 230 of interface 201 displays access icons for multiple components; selecting these icons activates the corresponding component for operation.

[0047] It should be understood that Figure 2A This is just one example of how to launch a session window for the user and digital assistant. As mentioned earlier, there are other ways to launch this session window. Furthermore, Figure 2A The various specific information, icons, etc. provided are merely examples and are not intended to limit the scope of the embodiments disclosed herein.

[0048] In the conversation window of region 210, the user can input messages via input box 218 or other appropriate means (e.g., voice), and the digital assistant can provide a response message based on the input message and relevant knowledge. Messages in the conversation window are typically conversational messages. In embodiments of this disclosure, interaction messages in the user's interaction window with the digital assistant (e.g., conversational messages in the conversation window) can be associated with corresponding content in multiple components (e.g., a multi-functional collaboration platform or office suite). In some embodiments, the multiple components can be multiple components supported by the multi-functional collaboration platform corresponding to the client interface.

[0049] As an example, multiple components include, but are not limited to, one or more of the following: instant messaging components, document components, audio / video conferencing components, email components, calendar components, schedule components, task components, goal and key results (OKR) components, etc. The content associated with a session message can be in text, image, audio, video format, or any other suitable format. Figure 2A In the example, the user-input session message 212 instructs the creation of a document, and the digital assistant's response session messages 214 and 216 provide the document that the digital assistant automatically creates based on the user input.

[0050] In some embodiments, within a session window, the content of the component associated with each session message can be partially or entirely included in the session message, for example, Figure 2AThe session message 216 displays a portion of the target document in the document component (i.e., a thumbnail of the target document). In some embodiments, the session message may include an access path or entry point for the content of the associated component, such as a link, view icon, etc., thereby allowing access to the associated content.

[0051] Embodiments of this disclosure support displaying the session window and the content associated with the session message in a partitioned manner. Specifically, a session window between the user and the digital assistant is presented in a first area of ​​the client interface, and target content from a first component among multiple components is presented in a second area of ​​the client interface. The target content is associated with a first session message in the session window. The first and second areas do not overlap. The second area may display an operable interface provided by the first component, including the target content. In this way, various operational capabilities provided by the first component can be supported in the second area.

[0052] like Figure 2B As shown, a session window is presented in area 210 of the client interface 201, and the target document in the document component associated with session message 216 is presented in area 240 of the client interface 201. Area 240 may include the document page of the document component. Note that in Figure 2B The accompanying drawings illustrate, for example, that the first area containing the session window and the second area containing the target content are arranged side-by-side. In other embodiments, the first and second areas, as well as other areas in the client interface, can be arranged in other ways as needed. For example, the second area can be presented on the left and the first area on the right in the client interface. Alternatively, the first and second areas can be arranged vertically, and so on.

[0053] In some embodiments, the second area can be displayed while the first area is minimized in the client interface. In some embodiments, if the client interface also has a third area for displaying other content, such as an area for displaying the information stream corresponding to instant messaging messages, the third area can be hidden or minimized while the second area is displayed. This ensures sufficient area in the client interface to display the target content. Figure 2B As shown, in order to display the area 240 including the document, the area 210 of the session window can be reduced. Additionally, it can be hidden. Figure 2A The information flow is in region 220.

[0054] In some embodiments, the target content displayed in the second area can change as the conversation messages in the conversation window change. Since multiple conversation messages in the conversation window with the digital assistant can be associated with content in one or more components, the target content in the second area displayed in the conversation window can also automatically change as the conversation messages change. Specifically, the digital assistant updates the target content in the second area based on the message interactions with the user in the conversation window, such as continuing to write a document according to the user's instructions. In some embodiments, the target content displayed in the second area can change as the user makes selections in the conversation window. That is, the user can control the target content displayed in the second area as needed. For example, the user may want to maintain the display of a document associated with a previous conversation message, even if subsequent conversation messages in the conversation window may have been associated with other documents or content in other components. User selections include, for example, clicks, or specific messages entered in the conversation window.

[0055] In some embodiments, if the target content of the first component is displayed in the second area of ​​the client interface, in response to a preset trigger event, another target content of the second component among multiple components can be displayed in the second area of ​​the client interface. The other target content is associated with a second session message in the session window. That is, different target contents associated with session messages in the session window can be switched in the second area. In some embodiments, the first component and the second component may be the same component, but different content (e.g., different documents) associated with that same component in different session messages. In some embodiments, the first component and the second component may be different components; for example, the first component may be a document component, and the second component may be an email component.

[0056] In some embodiments, the preset trigger event here may include a preset action by the user in the conversation window. Examples of preset actions may be a click, a voice command, or a specific message entered in the conversation window. This allows the user's actions in the conversation window to switch the target content presented in the second area. In some embodiments, the preset trigger event may include if the digital assistant outputs a conversation message in the conversation window, and that conversation message is associated with other target content in the second component. Thus, if the conversation message output by the digital assistant relates to content in a component, that content can be presented in the second area automatically, or the content in the second area can be switched to the newly output content. This ensures that the content presentation in the second area follows the conversation between the user and the digital assistant.

[0057] In some embodiments, when switching from target content in the first component to target content in the second component in the second area, a flipping effect can be presented in the second area to flip from the side displaying the target content of the first component to the side displaying the other target content of the second component. The flipping or page-turning effect can highlight the content transition in the second area. In some embodiments, the flipping effect can begin when a search for or creation of target content in the second component begins and end when the search for or creation of target content in the second component is completed. In some embodiments, if the target content in the second component is presented in response to a user's preset operation, the flipping effect can begin after the user initiates the preset operation, such as after the user initiates a selection or viewing operation on the target content, and the target content is presented in the second area.

[0058] For example, in Figure 2C In the middle, the document contained in session message 216 is presented in area 240. Based on session message 224 entered by the user in the session window, which indicates a request to view the email, such as... Figures 2D to 2E As shown, the digital assistant is helping the user search for the email they requested to view. At this point, the side of the document displayed in area 240 begins to flip. (As shown...) Figure 2F As shown, the digital assistant completes the search and outputs reply message 226 and conversation message 228 containing the email in the conversation window. At this point, in area 240, the view has been flipped from the document side to the email side. Figure 2G As shown, after the flip is complete, the email the user wants to view is presented in the email component in area 240. Figures 2D to 2F In the example, the found emails may be automatically displayed in area 240 with a flip effect, or they may be displayed in area 240 with a flip effect in response to a user's preset action (e.g., the user clicks the view button in conversation message 228).

[0059] In some embodiments, except Figure 2A In addition to creating documents based on user input, as shown, various other types of content can be created within the conversation window with the digital assistant. In some embodiments, the conversation window can also receive user-inputted conversation messages instructing users to reply to emails, and create replies for those emails. For example, emails requiring replies can be presented in a partitioned manner in a second area alongside the conversation window, such as... Figure 2G As shown. Users can enter a conversation message in the conversation window to instruct the digital assistant to help compose an email reply. The digital assistant can then display the composed email reply in the reply message or in the second area.

[0060] In some embodiments, based on a preset trigger event, the email reply interface of the email component can be displayed in the second area of ​​the client interface, and the created reply is included in the email reply interface. This allows users to easily view more details of the email reply, such as the email format, recipients, CC recipients, attachments, etc. In some embodiments, the reply can be sent via the email component based on user confirmation. For example, while displaying the created reply in the conversation window, a confirmation control can also be displayed, allowing users to confirm the sending of the reply email. In some embodiments, while displaying the original email in the second area, a recommended email reply can also be displayed in an appropriate area of ​​the conversation window. This allows users to quickly reply to emails without having to issue further email reply commands in the conversation window.

[0061] In some embodiments, conversation messages in the user's conversation window with the digital assistant can also be associated with various other types of components, and the messages in these components can be presented in a second area. Further examples include... Figure 3A As shown in client interface 301, in the first area 310, based on the user-inputted conversation message, the digital assistant helps the user create a meeting in reply message 312, which involves meeting components. In scenarios associated with meeting components, users may be concerned about whether the meeting time is suitable for all participants.

[0062] In some embodiments, users can also view the availability status of participants in a specific meeting. Specifically, if a user input message received in the session window indicates that the availability status of multiple participants in a target meeting should be viewed, an aggregated calendar interface of the calendar component can be generated, which displays the calendar information of each of the multiple participants. In some embodiments, the generated aggregated calendar interface can be presented in a second area of ​​the client interface in response to a preset trigger event (e.g., a user clicking a view control, or a session message being output in a digital assistant). Figure 3A As shown, user session message 314 indicates a desire to check the availability of attendees for a meeting to be created. Accordingly, the digital assistant provides reply message 316, which includes an aggregated calendar interface with a calendar component. In the second area 340 of the client interface 301, the aggregated calendar interface associated with reply message 316 is expanded to show whether attendees are available for the target meeting's dates (e.g., a day, half a day, several hours, or other longer periods). By aggregating calendar information from multiple other users, the availability of these users can be more clearly shown to the user, facilitating subsequent scheduling. Of course, it should be understood that before aggregating the calendar information, the user making the request (e.g., ...) must first... Figure 3A User A) is considered to have been authorized to access and view some or all of these users' calendar information.

[0063] In some embodiments, for the task component, users can also view a task list. Specifically, if a user input message received in the session window indicates that the user should view the entire task list or a task list for a specific time period and / or a specific processing status, the task list interface of the task component can be aggregated and presented in the second area of ​​the client interface. In some embodiments, the task list interface can be presented in the second area of ​​the client interface in response to a preset trigger event (e.g., the user clicks the view control, or a session message is output by the digital assistant). Figure 3B As shown in client interface 302, user conversation message 322 indicates an intention to view tasks to be completed four months ago. Accordingly, the digital assistant provides reply messages 324 and 326, with message 326 containing a thumbnail of the task list interface. In a second area 340 of client interface 302, the task list interface associated with reply message 326 is expanded to display the tasks the user wishes to view.

[0064] In some embodiments, during content creation, in addition to generating new content based on specified content according to user instructions (e.g., in...), Figure 2A In addition to generating new documents based on specified documents, it also allows users to request assistance from the digital assistant in the conversation window for content searching, summarizing, etc. Taking documents as an example again, in... Figure 3C In the client interface 303, a user-inputted conversation message 332 in the conversation window of the first area 310 indicates a request to summarize multiple documents. Based on this conversation message 332, the digital assistant outputs a response message 334 and provides a summary document 336. The summary document 336 is presented in the second area 340 of the client interface 303. Figure 3D In the client interface 304, a user-inputted session message 342 in the session window of the first area 310 indicates a request for data analysis. Based on this session message 342, the digital assistant outputs a response message 344 and provides an analysis document 346. The analysis document 346 is presented in the second area 340 of the client interface 303.

[0065] In some embodiments, in addition to content creation, the content presented in the second area of ​​the client interface can be updated and adjusted based on the user's interaction information with the digital assistant. Specifically, the target content presented in the second area can be updated based on a session message entered by the user in the session window indicating content adjustment. The specific content adjustment method can be any appropriate adjustment method supported by the target content presented in the second area. As an example, adjustments to the target content can include, but are not limited to, one or more of the following: inserting content into the target content, deleting content from the target content, replacing content in the target content, modifying content in the target content, reformatting the target content, generating new content, etc.

[0066] In some embodiments, in response to a user-instructed content adjustment session message, a reply message from the digital assistant to the session message may also be presented in the session window. In some embodiments, the reply message may include at least a confirmation control for a specific adjustment to the target content, or multiple option controls corresponding to multiple adjustments to the target content. For example, in response to a user-inputted content adjustment session message, if a single adjustment method for the target content can be determined, a confirmation control may be provided for the user to confirm whether to adopt the provided specific adjustment. Based on the user's selection of the confirmation control, the target content in the second area may be updated using the specific adjustment. As another example, in response to a user-inputted content adjustment session message, if multiple possible adjustment methods for the target content can be determined, multiple option controls may be provided for the user to specifically select which adjustment method to adopt. Based on the user's selection of a target option control among the multiple option controls, the target content may be updated based on the adjustment corresponding to the target option control. In some embodiments, for the type of content adjustment indicated by the user (e.g., content reformatting), the target content in the second area may be adjusted directly without providing a confirmation or selection control.

[0067] In some embodiments, after adjustments to the target content in the second area are completed, an undo control can also be presented in the session window to undo the update to the target content. The undo control is presented in association with a response message output by the digital assistant. In this way, the undo control allows the user to attempt content adjustments, cancel unwanted adjustments, and achieve a satisfactory result.

[0068] The following examples, with reference to the accompanying diagrams, will illustrate how content adjustments can be made under partitioned collaboration.

[0069] Figures 4A to 4C A schematic diagram of an example client interface for collaborative content replacement based on a digital assistant, according to some embodiments of this disclosure, is shown. Figure 4A In the client interface 401, within the session window of the first area 410, the digital assistant outputs a session message 412 concerning a specific document. This document is presented in the second area 440 of the client interface 401. In the session window, a user-input session message 414 indicates a desire to replace the cover image of the document presented in the second area 440. Accordingly, the digital assistant responds to session message 414 with a reply message 416 indicating that a replacement cover image is available and listing two images 422 and 424 for the user to choose from. If the user selects one of the images, for example in... Figure 4BSelecting image 424 displays a replacement control 426 for user confirmation of whether to apply the current image as the cover. In response to confirmation of the replacement control 426, such as... Figure 4C As shown, the document cover image 442 displayed in the second area 440 is replaced with image 424. Further, a session message 432 from the digital assistant can be provided in the session window to indicate the completion of the replacement operation, and an undo control 434 can also be provided in connection with it. If the user does not wish to perform a cover replacement or wishes to use a different cover image 422, further modifications can be made by triggering the undo control 434.

[0070] Figures 5A to 5B A schematic diagram of an example client interface for collaborative content insertion based on a digital assistant, according to some embodiments of this disclosure, is shown. Figure 5A In the client interface 501, within the session window of the first area 510, the digital assistant outputs a session message 512 concerning a specific document. This document is presented in the second area 540 of the client interface 501. A session message 514 entered by the user in the session window indicates a desire to insert content into the document. Accordingly, the digital assistant provides the content to be inserted in a response message 516 to session message 514, and associatedly provides an insert control 518. By triggering the insert control 518, the user-specified content in session message 516 can be inserted into the document presented in the second area 540. Figure 5B As shown, the content in session message 516 is inserted into the document. Further, a session message 522 from the digital assistant can be provided in the session window to indicate the completion of the insertion operation, and an undo control 524 can also be provided in connection with it. If the user does not expect content insertion or expects to make other modifications, they can do so by triggering the undo control 524.

[0071] In some embodiments, new content can be inserted into a preset position within the document presented in the second area 540, such as the cursor position or the end of the document. In some embodiments, the user can control the insertion position by setting the cursor position in the document before triggering the insertion control 518. In some embodiments, the insertion position can also be determined based on a session message entered by the user in the session window indicating the insertion position.

[0072] Figures 6A to 6B A schematic diagram of an example client interface for collaborative typesetting based on a digital assistant, according to some embodiments of the present disclosure, is shown. Figure 6AIn the client interface 601, within the session window of the first area 610, session messages 612 and 614 output by the digital assistant relate to a specific document. This document is presented in the second area 640 of the client interface 601. In the session window, a user-input session message 616 indicates a desire to reformat the document. Accordingly, the digital assistant can assist with the reformatization adjustments and provide status information 618 during the process to indicate that the work is in progress. Figure 6B As shown, after the reformatting of the document in the second area is completed, a session message 622 from the digital assistant is presented in the session window to indicate that the reformatting is complete. Additionally, an undo control 624 is provided in session message 622 (or any other appropriate location in the session window). If the user is not satisfied with the current reformatting, they can revert to the previous reformatting of the document by triggering the undo control 624.

[0073] In some embodiments, a convenient drag-and-drop collaborative method is also provided in the interface partitioning collaboration between the session window and content presentation. Specifically, a session window between the user and the digital assistant is presented in a first area of ​​the client interface, where the session messages include at least the first content in a first component, and a second content in a second component is presented in a second area of ​​the client interface. At this time, in response to the user's drag-and-drop operation on the first content from the first area to the second area, the first content is inserted into the second content. By allowing drag-and-drop content interaction between the first area used for session interaction and the second area used for content presentation of various components, content collaboration can be completed more conveniently and quickly, improving processing efficiency.

[0074] In some embodiments, the first component and the second component may be the same component. In some embodiments, the first component and the second component may be different components. In some embodiments, since the second content in the session window is to be dragged and inserted into the first content in the second area, the second content or the second component providing the second content typically supports such overall content dragging or insertion. In some embodiments, the second content may have card-style content. Card-style content has structured components and styles, and can provide not only rich text styles and graphic layout modules, but also flexible interactive capabilities. This style of content can be flexibly manipulated, adapted to different layouts, and facilitates dragging across areas.

[0075] Figures 7A to 7C A schematic diagram of an example client interface for cross-region drag-and-drop partition collaboration based on a digital assistant, according to some embodiments of this disclosure, is shown. Figure 7AIn the client interface 701, within the session window of the first area 710, the user-input session message 712 indicates a desired OKR content. The document is presented in the second area 740 of the client interface 701. In response to the user's session message 712, the digital assistant outputs a session message 714 in the session window containing the user's desired OKR content 716. (The rest of the text appears to be unrelated and likely refers to a different topic.) Figure 7B As shown, based on the user's drag-and-drop operation, the OKR content 716 can be dragged from the first area 710 and placed in the document of the second area 740 based on the endpoint of the user's drag operation, as follows. Figure 7C As shown. Depending on the window layout size, OKR content 716 can be presented as a thumbnail in the session message, while OKR content 716 can be expanded in the document.

[0076] Of course, in addition to ORK content, other content with card styles or that supports cross-region dragging can also be applied to the partitioned collaboration between the digital assistant's session window and content presentation area.

[0077] In some embodiments, during content creation based on a digital assistant, dynamic effects can be provided upon completion of content creation. These dynamic effects are particularly suitable for application to the created multimedia content (e.g., images, videos, GIFs, or other rich text-style content). Specifically, in response to a session message indicating content generation input by the user in a session window, multimedia content can be generated based on target content presented in a second area of ​​the client interface. Furthermore, the generated multimedia content can be presented with dynamic effects, at least indicating movement from the second area to the first area. Such movement effects not only clearly indicate the data source of the multimedia content (i.e., the target content presented in the second area) but also provide rich visual effects. Of course, in addition to movement effects, dynamic effects for multimedia content can also include various other visual effects, including zooming, highlighting, animation, fireworks, ribbons, etc.

[0078] Figures 8A to 8E A schematic diagram of an example client interface for content generation animation based on a digital assistant, according to some embodiments of this disclosure, is shown. Figure 8A In the client interface 801, in the session window of the first area 810, the user-inputted session message 812 indicates a desire to analyze sales rankings based on the table presented in the second area 840. In response to the user's session message 812, the digital assistant outputs session message 814 in the session window indicating the sales rankings. Further, the user-inputted session message 816 indicates a desire to generate a "battle report," i.e., a poster in image form, based on the sales rankings. In response to this user instruction, such as... Figure 8BAs shown, the digital assistant outputs session message 818, indicating that the user instruction, namely image generation, has been completed. Accordingly, the generated image 822 is presented with dynamic effects, and as... Figure 8B , Figure 8C , Figures 8D to 8E As shown, image 822 is moved from the second region 840 to the session window in the first region 810, exhibiting zooming and various other animation effects during the movement. Finally, in Figure 8E In this context, image 822 is presented as a session message within the session window. This image also allows the user to perform other operations such as selection, zooming, or copying.

[0079] In some embodiments, the initial rendering position of the dynamic effect may be located at the focal point of the client interface, such as the center, to highlight the multimedia content. In some embodiments, the initial rendering position of the dynamic effect may be determined based on the rendering position of the target content, for example, it can start moving from the focal point of the target content to the session window (e.g., ...). Figures 8B to 8E (Example).

[0080] In some embodiments, dynamic effects indicative of movement across regions can be provided for specific types of instructions or events. Such instructions or events can be configured as needed. This avoids excessive disruption to the user during digital assistant-based content generation and highlights the specificity of certain instructions or events.

[0081] It should be understood that some embodiments of this disclosure have been described above with reference to specific examples in the accompanying drawings, but these specific examples are not intended to limit the scope of the embodiments of this disclosure. The described embodiments can also be implemented in various other variations.

[0082] Figure 9 A flowchart of a process 900 for information processing according to some embodiments of the present disclosure is shown. Process 900 may be implemented at a terminal device 110. For ease of discussion, reference will be made to... Figure 1 The environment 100 is used to describe the process 200.

[0083] In frame 910, terminal device 110 presents an interaction window between the user and the digital assistant in the first area of ​​the client interface. The interaction messages in the interaction window can be associated with the content of multiple components.

[0084] In frame 920, terminal device 110 presents target content in the first component of a plurality of components in the second area of ​​the client interface, wherein the target content is associated with a first interactive message in the interactive window, and the first area and the second area do not overlap.

[0085] In some embodiments, process 900 further includes: in response to a preset trigger event, presenting additional target content in a second component of a plurality of components in a second area of ​​the client interface.

[0086] In some embodiments, the preset triggering event includes: a preset operation performed by the user in the interaction window; or, the digital assistant outputs an interaction message in the interaction window, and the interaction message is associated with other target content in the second component.

[0087] In some embodiments, presenting additional target content in the second component in a second area of ​​the client interface includes: presenting a flipping effect in the second area to flip from the side displaying the target content of the first component to the other side displaying the additional target content of the second component.

[0088] In some embodiments, the target content presented in the second area changes as the interaction messages in the interaction window change. In some embodiments, the target content presented in the second area changes as the user makes a selection action in the interaction window.

[0089] In some embodiments, presenting target content in a first component of a plurality of components in a second area of ​​a client interface includes: a third interactive message created based on instructions entered by the user in an interactive window; a first interactive message containing at least a portion of the target content being output in the interactive window via a digital assistant; and presenting the target content in the second area.

[0090] In some embodiments, process 900 further includes updating the target content presented in the second area based on a fourth interactive message indicating that the user has entered an instruction in the interactive window.

[0091] In some embodiments, updating the target content presented in the second area includes: presenting a response message from the digital assistant to the fourth interaction message in an interactive window, the response message including at least a confirmation control for a specific adjustment to the target content, or multiple option controls corresponding to multiple adjustments to the target content; updating the target content using the specific adjustment based on the user's selection operation on the confirmation control; or updating the target content based on the adjustment corresponding to the target option control based on the user's selection operation on the target option control among multiple option controls.

[0092] In some embodiments, a particular adjustment or multiple adjustments include at least one of the following: inserting content into the target content, deleting content from the target content, replacing content in the target content, modifying content in the target content, or reformatting the target content.

[0093] In some embodiments, process 900 further includes: presenting an undo control in association with a response message for undoing an update to the target content.

[0094] In some embodiments, the first component includes an email component, and the target content includes an email. The process 900 further includes: receiving a fifth interactive message in an interactive window that indicates a reply to the email from the user; and creating a reply to the email.

[0095] In some embodiments, process 900 further includes: presenting an email reply interface of the email component in a second area of ​​the client interface, wherein the reply is included in the email reply interface.

[0096] In some embodiments, process 900 further includes sending a reply via an email component based on the user's confirmation of the reply.

[0097] In some embodiments, the first component includes a calendar component, wherein the target content is created based on: receiving a sixth interactive message input by the user in an interactive window, the sixth interactive message indicating the availability status of multiple participants in the target meeting; generating an aggregated calendar interface of the calendar component, the aggregated calendar interface indicating the calendar information of each of the multiple participants; and presenting the aggregated calendar interface in a second area of ​​the client interface.

[0098] In some embodiments, process 900 further includes: generating a seventh interactive message based on indications entered by the user in the interactive window; generating multimedia content based on the target content; and presenting the multimedia content with dynamic effects, the dynamic effects indicating at least movement from the second area to the first area.

[0099] In some embodiments, the initial presentation position of the dynamic effect is determined based on the presentation position of the target content.

[0100] In some embodiments, the interactive window includes at least one of the following: at least a portion of the target content, or an access path to the target content.

[0101] In some embodiments, the client interface corresponds to an office suite, and the multiple components include one or more of the following: chat component, document component, audio / video conferencing component, email component, calendar component, schedule component, task component, and goal and key results (OKR) component.

[0102] In some embodiments, the interactive window mentioned above includes a session window, and the interactive message includes a session message.

[0103] Figure 10 A flowchart of a process 1000 for information processing according to some other embodiments of the present disclosure is shown. Process 1000 may be implemented at a terminal device 110. For ease of discussion, reference will be made to... Figure 1 The environment 100 is used to describe the process 1000.

[0104] In box 1010, terminal device 110 presents an interaction window between the user and the digital assistant in a first area of ​​the client interface, the interaction message in the interaction window including at least the first content in the first component. In box 1020, terminal device 110 presents the second content in the second component in a second area of ​​the client interface. In box 1030, in response to the user's drag operation of the first content from the first area to the second area, terminal device 110 inserts the first content into the second content.

[0105] In some embodiments, the second content is content with a card style.

[0106] In some embodiments, the first region and the second region do not overlap.

[0107] In some embodiments, the interactive window mentioned above includes a session window, and the interactive message includes a session message.

[0108] Figure 11 A schematic structural block diagram of an apparatus 1100 for information processing according to some embodiments of the present disclosure is shown. The apparatus 1100 may be implemented as or included in a terminal device 110. The various modules / components in the apparatus 1100 may be implemented by hardware, software, firmware, or any combination thereof.

[0109] Device 1100 includes a first presentation module 1110 configured to present an interaction window between the user and a digital assistant in a first area of ​​a client interface, wherein interaction messages in the interaction window can be associated with content in multiple components. Device 1100 also includes a second presentation module 1120 configured to present target content in a first component of multiple components in a second area of ​​the client interface, wherein the target content is associated with a first interaction message in the interaction window, and the first and second areas do not overlap.

[0110] In some embodiments, the device 1100 further includes a content switching module 1110, configured to respond to a preset trigger event and present additional target content in a second component of a plurality of components in a second area of ​​a client interface.

[0111] In some embodiments, the preset triggering event includes: a preset operation performed by the user in the interaction window; or, the digital assistant outputs an interaction message in the interaction window, and the interaction message is associated with other target content in the second component.

[0112] In some embodiments, the content switching module 1110 includes a flip effect presentation module configured to present a flip effect in a second area, so as to flip from the side displaying the target content of the first component to the other side displaying another target content of the second component.

[0113] In some embodiments, the target content presented in the second area changes with the interaction messages in the interaction window, or the target content presented in the second area changes with the selection operation made by the user in the interaction window.

[0114] In some embodiments, the second presentation module includes: a message output module configured to create a third interactive message based on instructions entered by the user in an interactive window, and output a first interactive message containing at least part of the target content in the interactive window via a digital assistant; and a region presentation module configured to present the target content in a second region.

[0115] In some embodiments, the apparatus 1100 further includes a content update module configured to update target content presented in the second area based on a fourth interactive message indicating content adjustment entered by the user in the interactive window.

[0116] In some embodiments, the content update module includes: a response presentation module configured to present a response message from the digital assistant to the fourth interaction message in an interactive window, the response message including at least a confirmation control for a specific adjustment to the target content, or multiple option controls corresponding to multiple adjustments to the target content; a confirmation-based adjustment module configured to update the target content using specific adjustments based on the user's selection operation on the confirmation control; or a selection-based adjustment module configured to update the target content based on the adjustment corresponding to the target option control based on the user's selection operation on the target option control among multiple option controls.

[0117] In some embodiments, a particular adjustment or multiple adjustments include at least one of the following: inserting content into the target content, deleting content from the target content, replacing content in the target content, modifying content in the target content, or reformatting the target content.

[0118] In some embodiments, the apparatus 1100 further includes an undo control presentation module configured to present an undo control in association with a reply message for undoing an update to target content.

[0119] In some embodiments, the first component includes an email component, and the target content includes an email. The apparatus 1100 further includes: a message receiving module configured to receive a fifth interactive message input by the user in an interactive window, indicating an email reply; and a reply creation module configured to create a reply for the email.

[0120] In some embodiments, the device 1100 further includes a reply interface presentation module, configured to present an email reply interface of the email component in a second area of ​​the client interface, wherein the reply is included in the email reply interface.

[0121] In some embodiments, the device 1100 further includes a reply sending module configured to send a reply via an email component based on the user's confirmation of the reply.

[0122] In some embodiments, the first component of the device 1100 includes a calendar component, wherein the target content is created based on: receiving a sixth interactive message input by a user in an interactive window, the sixth interactive message indicating the availability status of multiple participants in the target meeting; generating an aggregated calendar interface of the calendar component, the aggregated calendar interface indicating the calendar information of each of the multiple participants; and presenting the aggregated calendar interface in a second area of ​​the client interface.

[0123] In some embodiments, the apparatus 1100 further includes: a multimedia generation module configured to generate a seventh interactive message based on indications entered by the user in an interactive window, and to generate multimedia content based on the target content; and a motion effect rendering module configured to render the multimedia content with dynamic effects, the dynamic effects at least indicating movement from a second area to a first area.

[0124] In some embodiments, the initial presentation position of the dynamic effect is determined based on the presentation position of the target content.

[0125] In some embodiments, the interaction window includes a session window, and the interaction message includes a session message.

[0126] In some embodiments, the interactive window includes at least one of the following: at least a portion of the target content, or an access path to the target content.

[0127] In some embodiments, the client interface corresponds to an office suite, and the multiple components include one or more of the following: chat component, document component, audio / video conferencing component, email component, calendar component, schedule component, task component, and goal and key results (OKR) component.

[0128] Figure 12 A schematic structural block diagram of an apparatus 1200 for information processing according to other embodiments of the present disclosure is shown. The apparatus 1200 may be implemented as or included in a terminal device 110. The various modules / components in the apparatus 1200 may be implemented by hardware, software, firmware, or any combination thereof.

[0129] Device 1200 includes a first presentation module 1210 configured to present an interaction window between a user and a digital assistant in a first area of ​​a client interface, wherein the interaction messages in the interaction window include at least the first content in a first component. Device 1200 also includes a second presentation module 1220 configured to present second content in a second component in a second area of ​​the client interface. Device 1200 further includes an insertion module 1230 configured to insert the first content into the second content in response to a user dragging the first content from the first area to the second area.

[0130] In some embodiments, the second content is content with a card style.

[0131] In some embodiments, the first region and the second region do not overlap.

[0132] In some embodiments, the interaction window includes a session window, and the interaction message includes a session message.

[0133] It should be understood that one or more steps in the above methods can be performed by suitable electronic devices or combinations of electronic devices. Such electronic devices or combinations of electronic devices may include, for example, […]. Figure 1 The server 130, terminal device 110 and / or a combination of server 130 and terminal device 110.

[0134] Figure 13 A block diagram of an electronic device 1300 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that... Figure 13 The electronic device 1300 shown is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 13 The electronic device 1300 shown can be used to achieve Figure 1 Terminal equipment 110.

[0135] like Figure 13 As shown, electronic device 1300 is in the form of a general-purpose electronic device. Components of electronic device 1300 may include, but are not limited to, one or more processors or processing units 1310, memory 1320, storage device 1330, one or more communication units 1340, one or more input devices 1350, and one or more output devices 1360. Processing unit 1310 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 1320. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 1300.

[0136] Electronic device 1300 typically includes multiple computer storage media. Such media can be any available media accessible to electronic device 1300, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 1320 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 1330 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media capable of storing information and / or data and accessible within electronic device 1300.

[0137] Electronic device 1300 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 13 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 1320 may include computer program product 1325 having one or more program modules configured to perform various methods or actions of various embodiments of this disclosure.

[0138] The communication unit 1340 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 1300 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 1300 can operate in a networked environment using logical connections to one or more other servers, networked personal computers (PCs), or another network node.

[0139] Input device 1350 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 1360 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 1300 can also communicate with one or more external devices (not shown) via communication unit 1340 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 1300, or with any device that enables electronic device 1300 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0140] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0141] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0142] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0143] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0144] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0145] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. An information processing method, comprising: The first area of ​​the client interface presents an interaction window between the user and the digital assistant, and the interaction messages in the interaction window can be associated with the content of multiple components; Based on a first interaction message in the interaction window, a first target content from a first component of the plurality of components is presented in a second area of ​​the client interface. The first target content is associated with the first interaction message, the first area and the second area do not overlap, and the first target content changes with changes in the first interaction message or with selections made by the user in the interaction window. In response to a preset trigger event, the second target content of the second component among the plurality of components is presented in the second area of ​​the client interface. The preset trigger event includes: a user's selection operation of a second interactive message associated with the second target content in the interactive window; or, the digital assistant outputting an interactive message in the interactive window, and this interactive message being associated with the second target content in the second component. The method further includes: Receive a fourth interactive message from the user in the interactive window of the first area, indicating that the content needs to be adjusted; In the interactive window of the first area, the digital assistant's response message to the fourth interactive message is presented; and Based on the operation performed on the response message, the first target content presented in the second area is updated.

2. The method according to claim 1, wherein, The second target content presented in the second component in the second area of ​​the client interface includes: The second area presents a flipping effect, flipping from the side displaying the first target content of the first component to the other side displaying the second target content of the second component.

3. The method according to claim 1, wherein, The presentation of the first target content of the first component among the plurality of components in the second area of ​​the client interface includes: A third interactive message, created based on the instructions entered by the user in the interactive window, is output via the digital assistant in the interactive window as a first interactive message containing at least a portion of the first target content; and The first target content is presented in the second area.

4. The method according to claim 1, wherein the response message includes at least a confirmation control for a specific adjustment to the first target content, or multiple option controls corresponding to multiple adjustments to the first target content; The updates to the first target content presented in the second region include: Based on the user's selection operation on the confirmation control, the first target content is updated using the specific adjustment; or Based on the user's selection operation of the target option control among the plurality of option controls, the first target content is updated based on the adjustment corresponding to the target option control.

5. The method according to claim 4, wherein the specific adjustment or the plurality of adjustments includes at least one of the following: inserting content into the first target content, deleting content from the first target content, replacing content in the first target content, modifying content in the first target content, and reformatting the first target content.

6. The method according to claim 1, further comprising: An undo control is presented in association with the response message to undo the update to the first target content.

7. The method of claim 1, wherein the first component includes an email component, and the first target content includes an email, the method further comprising: The interaction window receives the fifth interactive message indicating an email reply input by the user; as well as Create a reply to the email.

8. The method according to claim 7, further comprising: The email reply interface of the email component is presented in the second area of ​​the client interface, and the reply is included in the email reply interface.

9. The method according to claim 7, further comprising: Based on the user's confirmation of the reply, the reply is sent via the email component.

10. The method of claim 1, wherein the first component comprises a calendar component, and wherein the first target content is created based on: The interaction window receives a sixth interaction message input by the user, which indicates whether to view the busy / idle status of multiple participants in the target meeting. Generate an aggregated calendar interface for the calendar component, wherein the aggregated calendar interface indicates the calendar information of each of the multiple participants. as well as The aggregated calendar interface is displayed in the second area of ​​the client interface.

11. The method of claim 1, further comprising: A seventh interactive message is generated based on the instructions entered by the user in the interactive window, and multimedia content is generated based on the first target content. as well as The multimedia content is presented with dynamic effects, which at least indicate movement from the second area to the first area.

12. The method of claim 11, wherein the initial presentation position of the dynamic effect is determined based on the presentation position of the first target content.

13. The method of claim 1, wherein the interactive window comprises at least one of the following: at least a portion of the first target content, or an access path to the first target content.

14. The method of claim 1, wherein the client interface corresponds to an office suite, and the plurality of components include one or more of the following: Chat component, document component, audio / video conferencing component, email component, calendar component, schedule component, task component, and goal and key results (OKR) component.

15. The method according to any one of claims 1 to 14, wherein the interaction window comprises a session window, and the interaction message comprises a session message.

16. The method of claim 1, wherein the second target content is content having a card style.

17. An information processing apparatus, comprising: The first presentation module is configured to present an interaction window between the user and the digital assistant in the first area of ​​the client interface, wherein the interaction messages in the interaction window can be associated with the content of multiple components. A second presentation module is configured to present a first target content of a first component among the plurality of components in a second area of ​​the client interface based on a first interaction message in the interaction window, wherein the first target content is associated with the first interaction message, the first area and the second area do not overlap, and the first target content changes with changes in the first interaction message or with selection operations performed by the user in the interaction window; and The second presentation module is further configured to, in response to a preset trigger event, present a second target content from a second component of the plurality of components in the second area of ​​the client interface, wherein the preset trigger event includes: a user's selection operation of a second interactive message associated with the second target content in the interactive window, or the digital assistant outputting an interactive message in the interactive window, and the interactive message being associated with the second target content in the second component. The information processing device further includes: The receiving module is configured to receive a fourth interactive message indicating content adjustment input by the user in the interactive window of the first area; and The second presentation module is further configured to present the digital assistant's response message to the fourth interaction message in the interaction window of the first area; and to update the first target content presented in the second area based on the operation on the response message.

18. An electronic device comprising: At least one processing unit; as well as At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 16 when executed by the at least one processing unit.

19. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 16.

Citation Information

Patent Citations

  • Mobile terminal and method of controlling therefor

    CN105721668A

  • Interface display method and device

    CN110647274A