Method, apparatus and device for information interaction and storage medium

Abstract

According to embodiments of the present disclosure, methods, apparatuses, devices and storage media for information interaction and processing are provided. The information interaction method includes, in response to a preset operation, selecting a portable document format (PDF) plug-in in an interaction window of a user and a digital assistant; and using the PDF plug-in to perform a task associated with a target PDF file in an interaction process of the user and the digital assistant. Thus, the user can be supported to use the PDF plug-in to complete a task related to the PDF file in the interaction process with the digital assistant. In this way, it is beneficial to provide an efficient assistance experience to the user.

Description

Technical Field

[0001] The exemplary embodiments disclosed herein generally relate to the field of computers, and particularly to methods, apparatuses, devices and computer-readable storage media for information interaction. Background Technology

[0002] With the development of information technology, various terminal devices can provide people with a variety of services in work and life. For example, terminal devices can be equipped with applications that provide services. Terminal devices or their applications can provide assistant functions to help users complete tasks. How to make such assistant functions better serve users is a current technical problem being explored. Summary of the Invention

[0003] In a first aspect of this disclosure, an information interaction method is provided. The method includes: in response to a preset operation, selecting a portable document format PDF plugin in an interaction window between a user and a digital assistant; and during the interaction between the user and the digital assistant, using the PDF plugin to perform a task associated with a target PDF file.

[0004] In a second aspect of this disclosure, an information processing method is provided. The method includes: determining, for a target PDF file of the portable document format PDF type, the storage location of the target PDF file, the target PDF file being associated with an interaction window between a user and a digital assistant; and determining, at least based on the storage location, the availability of a PDF plugin for the target PDF file, the PDF plugin being for PDF type files, the availability indicating whether the PDF plugin is used to perform a task on the target PDF file during the interaction between the user and the digital assistant.

[0005] In a third aspect of this disclosure, an apparatus for information interaction is provided. The apparatus includes: a plug-in selection module configured to select a portable document format PDF plug-in in response to a preset operation within an interaction window between a user and a digital assistant; and a task execution module configured to use the PDF plug-in to perform a task associated with a target PDF file during the interaction between the user and the digital assistant.

[0006] In a fourth aspect of this disclosure, an apparatus for information processing is provided. The apparatus includes: a storage location determination module configured to determine the storage location of a target PDF file of a portable document format (PDF) associated with an interaction window between a user and a digital assistant; and an availability determination module configured to determine the availability of a PDF plugin for the target PDF file, at least based on the storage location, the PDF plugin being used for PDF type files, the availability indicating whether the PDF plugin is used to perform a task on the target PDF file during the interaction between the user and the digital assistant.

[0007] In a fifth aspect of this disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the methods of the first or second aspect.

[0008] In a sixth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program that can be executed by a processor to implement the methods of the first or second aspect.

[0009] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0011] Figure 1 A schematic diagram of an example environment in which embodiments of the present disclosure can be implemented is shown;

[0012] Figures 2A-2D A schematic diagram of an example interface of the main session window with the PDF plugin selected, according to some embodiments, is shown;

[0013] Figures 3A-3B A schematic diagram of an example interface of the main session window without selecting a PDF plugin, according to some embodiments, is shown;

[0014] Figures 4A-4B A schematic diagram of an example interface of a sub-session window associated with a PDF file, according to some embodiments, is shown;

[0015] Figures 5A-5C A schematic diagram illustrates an example interface for interacting with a floating window associated with a PDF file, according to some embodiments.

[0016] Figure 6 An example flow of using a PDF plugin in the main session window is shown according to some embodiments;

[0017] Figure 7 An example flow for using a PDF plugin in a split session window and a floating window, according to some embodiments, is shown;

[0018] Figure 8 An example architecture for performing permission checks on PDF files according to some embodiments is shown;

[0019] Figure 9 A flowchart illustrating an information interaction process according to some embodiments is shown;

[0020] Figure 10 A flowchart illustrating an information processing procedure according to some embodiments is shown;

[0021] Figure 11 A block diagram of an apparatus for information interaction according to some embodiments is shown;

[0022] Figure 12 A block diagram of an apparatus for information processing according to some embodiments is shown; and

[0023] Figure 13 A block diagram of an apparatus capable of implementing several embodiments of the present disclosure is shown. Detailed Implementation

[0024] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0025] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0026] In this document, unless explicitly stated otherwise, performing a step in response to A does not mean that the step is performed immediately after A, but may include one or more intermediate steps.

[0027] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0028] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, relevant users should be informed of the type, scope of use, and usage scenarios of the information involved in this disclosure through appropriate means in accordance with relevant laws and regulations, and authorization should be obtained from the relevant users. Among them, relevant users may include any type of rights holder, such as individuals, enterprises, and groups.

[0029] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly inform the user that the requested operation will require obtaining and using the user's information, thereby enabling the relevant user to choose whether to provide information to the software or hardware such as the electronic device, application, server, or storage medium that performs the operation of the technical solution disclosed herein based on the prompt message.

[0030] As an optional but non-restrictive implementation, in response to a user's active request, a prompt message can be sent to the user, such as a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide information to the electronic device.

[0031] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0032] Figure 1A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In this example environment 100, an office suite 120 is installed on a terminal device 110. A user 140 can interact with the office suite 120 via the terminal device 110 and / or an attached device to the terminal device 110. The office suite 120 is capable of providing the user 140 with integration of multiple applications or components. These applications can be application modules within the office suite 120. The applications integrated in the office suite 120 are sometimes also referred to as "office applications," "office components," "collaborative office platforms," ​​etc. As an example, the applications integrated in the office suite 120 may include, but are not limited to, one or more of the following: chat applications (also known as instant messaging (IM) applications), document applications, audio and video conferencing applications, email applications, calendar applications, scheduling applications, task applications, and goal and key results (OKR) applications.

[0033] In some embodiments, the office suite 120 can be downloaded and installed as an application on the terminal device 110. In some embodiments, the office suite 120 can also be accessed in other ways, such as through a web page.

[0034] exist Figure 1 In environment 100, if office suite 120 is started, terminal device 110 can present the interface 150 of office suite 120 to user 140. Interface 150 is sometimes also called client interface. Interface 150 can include various interfaces provided by office suite 120, such as a chat interface, a video conferencing interface, a file sharing interface, etc.

[0035] In some embodiments, terminal device 110 communicates with server 130 to provide services to office suite 120. Terminal device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, terminal device 110 can also support any type of user-facing interface (such as "wearable" circuitry). Server 130 can be any type of computing system / server capable of providing computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, etc.

[0036] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure. For example, embodiments of this disclosure can be applied to any suitable one or more applications, and are not limited to office suites.

[0037] As briefly mentioned above, a digital assistant can be provided to a user to help them complete a target task using a terminal device or application. In the embodiments of this disclosure, a digital assistant is configured for user 140. The digital assistant can be implemented in any suitable form. In some embodiments, user 140's digital assistant can interact with user 140 as a contact. Such a digital assistant can also uniquely correspond to user 140. In other words, user 140's digital assistant can be specific to or exclusive to user 140. If user 140 is an individual or person, such a digital assistant can be considered a personal digital assistant. It is understood that in the embodiments of this disclosure, the digital assistant is based on user 140's authorized access to data with granted permissions.

[0038] It should be understood that the terms "unique correspondence" or similar expressions in this disclosure are not intended to limit the digital assistant to be updated accordingly based on the interaction process between user 140 and the digital assistant.

[0039] In embodiments of this disclosure, a digital assistant is used for interaction with a user. An interaction window between the user and the digital assistant can be presented in a client interface. As an intelligent assistant, the digital assistant possesses intelligent dialogue and information processing capabilities. In the interaction window, the user inputs interactive messages, and the digital assistant responds to the user's input by providing a reply message. The client interface used to provide the digital assistant can correspond to a single-function application or a multi-functional collaboration platform, such as an office suite or other collaboration platforms capable of integrating multiple components.

[0040] The user's interaction window with the digital assistant may include a session window, in which the interaction between the user and the digital assistant may be presented in the form of session messages. Alternatively or additionally, the user's interaction window with the digital assistant may also include a non-session window, such as a floating window, in which the user can trigger the digital assistant to perform corresponding operations by entering commands, selecting shortcuts, etc.

[0041] In some embodiments, after the digital assistant is activated via a preset application, user 140 interacts with the digital assistant through a main session. The interaction window corresponding to the main session can be called the main session window. As an example, the preset application can be an IM application in an office suite. In other examples, the preset application can also be other applications or components.

[0042] In some embodiments, the digital assistant can also be activated and interacted with through applications other than the default ones. After activating the digital assistant through these non-default applications, the user can interact with it via a separate session. The interaction window corresponding to the separate session can be called a separate session window. For example, the user can activate the digital assistant through a page in a document application and then interact with it through a separate session.

[0043] As briefly mentioned earlier, digital assistants can help users use terminal devices or applications. PDF files are a commonly used type of file. Therefore, if a digital assistant can assist users in processing PDF files during their interaction with the user, it can help improve the user's work efficiency.

[0044] Based on some embodiments of this disclosure, an improved scheme for information interaction is proposed. In embodiments of this disclosure, in response to a preset operation, a PDF plugin is selected in the user's interaction window with the digital assistant. Then, during the interaction between the user and the digital assistant, the PDF plugin is used to perform tasks associated with the target PDF file. This allows users to use the PDF plugin to complete tasks related to PDF files during interaction with the digital assistant. This approach facilitates providing users with an efficient assistance experience.

[0045] According to some embodiments of this disclosure, improvements for information processing are proposed. In embodiments of this disclosure, for a target PDF file, the storage location of the target PDF file is determined, and the target PDF file is associated with an interaction window between the user and a digital assistant. The availability of a PDF plugin for the target PDF file is determined, at least based on the storage location. The PDF plugin is used for PDF type files. Availability indicates whether the PDF plugin is used to perform tasks on the target PDF file during the user's interaction with the digital assistant. In this embodiment, whether to enable the PDF plugin for the PDF file is determined based on the storage location of the PDF file. This achieves permission management during the use of the PDF plugin to avoid inappropriate copying or editing of the PDF file content.

[0046] In some embodiments, in response to a preset operation, terminal device 110 can select a PDF plugin in the interaction window between user 140 and the digital assistant. During the interaction between user 140 and the digital assistant, terminal device 110 can use the PDF plugin to perform tasks associated with a target PDF file. For example, it can summarize the content of the PDF file, translate at least a portion of the PDF file, answer questions about the PDF file, and so on.

[0047] The preset operations described herein can trigger the automatic selection of a PDF plugin and may include one or more operations. The preset operations may be related to the type of interaction window in which user 140 interacts with the digital assistant. Some example operations are described below with reference to the accompanying drawings. In the examples below, the digital assistant is shown with the name "XX Assistant," but it should be understood that this is merely exemplary and not intended to limit the scope of this disclosure. In embodiments of this disclosure, the digital assistant may have any suitable name, and user 140 may customize the name of the digital assistant.

[0048] PDF plugin in the main session window

[0049] In some embodiments, user 140 can interact with the digital assistant in the main session window. In some embodiments, terminal device 110 can display a plugin selection control in the main session window for selecting plugins to use in the main session window. If user 140 selects a PDF plugin in the main session window, terminal device 110 can select the PDF plugin for the target PDF file. The target PDF file can be the PDF file indicated by user 140 in the main session window. For example, after selecting a PDF plugin, the user can upload a PDF file or send a link to a PDF file in the main session window, etc.

[0050] In some embodiments, the display of the plugin selection control may be triggered by the opening of a new topic. For example, if an instruction to open a new topic is received from user 140 in the main session window, terminal device 110 may display the plugin selection control in the main session window.

[0051] refer to Figures 2A to 2D This describes a sample interface for selecting the PDF plugin in the main session window. For example... Figure 2A As shown, the main conversation window 210 between the user and the digital assistant is displayed in the client interface. User 140 triggers a new topic control 211 to start a new topic; for example, the user clicks the new topic control 211. In response, a topic separator 212 can be displayed in the main conversation window 210 to indicate the start of a new topic and separate different topics, such as... Figure 2B As shown. Accordingly, a plug-in selection control 213 can be displayed in the main session window 210. If user 140 selects the PDF plug-in via the plug-in selection control 213, then terminal device 110 can enable the PDF plug-in, as shown. Figure 2C As shown.

[0052] Furthermore, in some embodiments, in response to the selection or activation of the PDF plugin, a prompt message about the PDF plugin can be displayed in the main session window. For example, such as... Figure 2CAs shown, prompt message 214 informs user 140 that the PDF plugin can be used for interaction, and prompts the user to indicate the PDF file to be used.

[0053] like Figure 2C As shown, an instruction regarding a PDF file is received in the main session window 210. In this example, the user sends a PDF file, also referred to as the target PDF file, in the main session window 210. Next, during the interaction between user 140 and the digital assistant, the PDF plugin can be used to perform tasks related to the target PDF file.

[0054] In some embodiments, to further improve user efficiency, one or more instructions related to PDF files can be provided to the user for selection. Each of these instructions corresponds to a preset task, such as summarizing a PDF file, translating all or part of a PDF file, etc. These instructions are also called shortcuts. For example, such instructions can be displayed in the main session window. If the user selects one of the instructions, the preset task corresponding to that instruction can be executed.

[0055] Continue to refer to Figure 2C After the user uploads the PDF file, a message 215 from the digital assistant is displayed in the main session window 210. For example, message 215 may contain instructions 221, 222, and 223. The user 140 can conveniently instruct the digital assistant to perform tasks by selecting the displayed instructions.

[0056] It should be understood that the instructions are displayed only to facilitate quick instructions from the user. Users can also send tasks related to the target PDF file that they expect the digital assistant to perform in input box 230.

[0057] In some embodiments, simultaneous display of the session window and the PDF file can be supported. That is, the session window and the PDF file can be displayed in different areas of the client interface. (See reference) Figure 2D For example, if a user clicks on a PDF file sent in the main session window 210, the pages of that PDF file can be displayed in area 250 of the interface. In other words, the session window and the PDF file can be displayed in separate pages. In this way, users can interact with the digital assistant while viewing the PDF file without switching pages. This further enhances the user's interactive experience with the digital assistant. It should be understood that... Figure 2D This is just an example; it is also possible to support simultaneous display of separate session windows and PDF files.

[0058] The above describes an example embodiment where the user selects a PDF plugin in the main session window. In some embodiments, user input indicating a target PDF file is received in the main session window, such as the user uploading a PDF file or sending a link to a PDF file in the main session window. In response to this user input, if the user does not select a PDF plugin, one or more instructions related to the PDF type of file can be displayed in the main session window. Each of these instructions corresponds to a preset task, such as summarizing a PDF file, translating all or part of the content of a PDF file, etc. If the user selects one of the displayed instructions, the PDF plugin can be automatically selected, that is, the PDF plugin can be automatically enabled for the target PDF file.

[0059] In some embodiments, in response to a user selecting one of the displayed instructions, the PDF plugin can perform a preset task corresponding to the selected instruction on the target PDF file. In some embodiments, in response to a user selecting one of the displayed instructions, a new topic can be automatically started.

[0060] The following is for reference. Figures 3A to 3B To describe an example. For example... Figure 3A As shown, user 140 can send a PDF file or a link to a PDF file to the main session window 310. Specifically, in this example, user 140 sends a PDF file named "Introduction Outline". Since user 140 did not select a PDF plugin beforehand, a prompt message 320 from the digital assistant can be displayed in the main session window 310, such as... Figure 3B As shown. The prompt message 320 may contain several instructions 321, 322, and 323 related to the PDF file.

[0061] In this example, user 140 selects instruction 323. In response to instruction 323 being selected, terminal device 110 can automatically select the PDF plugin for user 140. Accordingly, terminal device 110 can execute the task corresponding to instruction 323. In this example, the digital assistant sends a reply message 330 to user 140.

[0062] In some embodiments, if the user does not select any of the displayed instructions but instead enters a message directly in the input box, the message entered by the user may not be responded to based on the PDF file indicated by the user 140.

[0063] Alternatively, in some embodiments, a PDF plugin can be automatically selected in response to user input indicating a target PDF file received in the main session window. For example, once user 140 indicates a PDF file in the main session window, a PDF plugin can be directly selected for user 140 without further user input or instructions.

[0064] The above describes the selection and use of PDF plugins in the main session window. PDF plugins can also be selected and used in other types of interactive windows.

[0065] In some embodiments, in response to activating the digital assistant via a target PDF file, a PDF plugin can be automatically selected. For example, user 140 can open a PDF file locally on the user's device (e.g., terminal device 110) or a PDF file stored in the cloud. Then, user 140 can activate the digital assistant within the opened PDF file. That is, if user 140 activates the digital assistant via a PDF file, a PDF plugin can be automatically selected for user 140 without requiring additional user input.

[0066] In some embodiments, a separate session window displaying the user's interaction with the digital assistant can be triggered via the target PDF file. In response, a PDF plugin can be automatically selected.

[0067] refer to Figure 4A Here's an example. User 140 opens a PDF file named "Introduction Outline". User 140 can click on control 401 displayed on the file page to invoke the digital assistant. In response to control 401 being triggered, terminal device 110 can present a separate session window 410 between the user and the digital assistant. Furthermore, terminal device 110 can automatically select a PDF plugin.

[0068] Additionally, in some embodiments, the terminal device 110 may also use a PDF plugin to perform a preset task on the target PDF file and display the result of the task in the main session window. (See reference...) Figure 4B Describe an example. For instance, Figure 4B The interface shown is for mobile devices, but this is just an example; similar displays can be made for other types of devices. In this example, the default task is to summarize the contents of a PDF file. The result 430 of this default task, namely the summary of the contents of the "Introduction Outline" PDF file, can be displayed in the sub-session window 420.

[0069] Additionally, in some embodiments, terminal device 110 may also display one or more recommended controls related to the target PDF file in a separate session window. Each recommended control indicates the next action of the digital assistant. That is, questions or instructions to be given to the digital assistant can be recommended to user 140. (Continue) Figure 4B The example shows recommended controls 431, 432, and 433 in the sub-session window 420.

[0070] In some embodiments, a non-conversational window, such as a pop-up window, can be triggered via a target PDF file to display a connection between the user and the digital assistant. In response, a PDF plugin can be automatically selected. One or more instructions related to the PDF plugin can be displayed in the pop-up window. Each instruction corresponds to a preset task.

[0071] refer to Figure 5A Describe an example. An open PDF file named "Introduction Outline" is displayed in the interface. In response to the user selecting a portion of the PDF file, a floating window 510 is displayed. Within the floating window 510, commands such as "Explain," "Translate," and "Summary" are displayed. These commands can be shortcuts already registered with server 130.

[0072] In some embodiments, the instructions displayed in the floating window may have multiple sub-instructions for the user to select. (See reference) Figure 5B If the user selects the "Translate" command, menu 515 will be displayed. Menu 515 shows several sub-commands for translating into different languages. The user can make a selection according to their needs.

[0073] As another example, Figure 5C This example interface is shown on another type of user device (e.g., a mobile device). An open PDF file named "XXX Project Planning" is displayed in the interface. A pop-up window 530 appears in response to the user selecting a portion of the PDF file. The pop-up window 530 displays commands such as "Explain," "Translate," and "Summary."

[0074] In the above description, the number, shape, etc., of the various elements shown in the accompanying drawings are exemplary and not intended to be limiting. In particular, the number of instructions shown is also exemplary and not intended to be limiting. In embodiments of this disclosure, any suitable number of instructions may be shown.

[0075] Example usage process and permission checks

[0076] Now for reference Figure 6 This describes an example flow 600 of using a PDF plugin in the main session window between the user and the digital assistant. In box 601, user 140 uploads a PDF file in the main session window. In box 602, terminal device 101 determines whether to select the PDF plugin. If the PDF plugin is selected, for example, through the plugin selection control described above, flow 600 proceeds to box 605. In box 605, one or more instructions can be recommended based on the content of the PDF file. For example, refer to the above... Figure 2C As described, commands 221, 222, and 223 can be displayed in the main session window.

[0077] If no PDF plugin is selected, process 600 proceeds to box 603. In box 603, terminal device 110 can provide several instructions to guide the user in selecting the PDF plugin. For example, refer to the above... Figure 3B As described, instructions 321, 322, and 323 can be displayed in the main session window 310. If the user clicks on a displayed instruction, process 600 proceeds to frame 604. In frame 604, terminal device 110 can open a new topic, automatically select a PDF plugin, and execute the selected instruction, such as those described in the reference above. Figure 3B As described. Then, process 600 proceeds to frame 605.

[0078] In addition, such as Figure 6 As shown, if the user clicks on the uploaded PDF file, process 600 proceeds to box 606. In box 606, the PDF file can be viewed using pagination. That is, the PDF file can be displayed simultaneously with the main session window, as referenced above. Figure 2D As described.

[0079] Figure 7 An example flow 700 using a PDF plugin in a sub-session window and a floating window, according to some embodiments, is shown. In box 701, user 140 uploads a PDF file, for example, via an IM application. If user 140 clicks on the PDF file, flow 700 proceeds to box 702. In box 702, terminal device 110 can open the PDF file in a tab for user viewing. In box 703, terminal device 110 can send guidance information in the sub-session window, for example, as a digital assistant. Alternatively or additionally, terminal device 110 can also automatically summarize the PDF file and / or recommend instructions to user 140, such as those mentioned above. Figure 4B As described.

[0080] Continuing with reference to box 702. If a section of content is selected in the already opened PDF file, process 700 proceeds to box 704. In box 704, terminal device 110 can invoke and display a floating window. In box 705, through the floating window, free-response question-and-answer can be performed, meaning the user can input interactive messages to the digital assistant; or the user can select displayed shortcuts, such as explaining the content of the document, translating all or part of the document, summarizing the document, etc.

[0081] Given that PDF plugins can perform operations such as copying PDF files, in order to ensure data security, in some embodiments, permission checks can be performed on PDF files involved in user interactions with digital assistants. Figure 8An example architecture for permission checks on PDF files according to some embodiments is shown. In some embodiments, the PDF file indicated by user 140 may include two sources: a PDF file 801 located locally on the user's device and a PDF file 803 stored in the cloud. In view of this, in user-digital assistant interactions such as those described above, the storage location of the indicated PDF file can be determined. Based on the storage location, the availability of the PDF plugin for the target PDF file is then determined, i.e., whether the PDF plugin can be used to perform tasks on the target PDF file.

[0082] like Figure 8 As shown, for PDF files stored locally on the user's device, the usage policy shown in box 802 can be executed, meaning the digital assistant can answer the user's messages based on the PDF content and can recommend guiding questions to the user. For PDF files stored in the cloud, it can be determined whether user 140 has copy permissions for the PDF file. If user 140 has copy permissions, the usage policy in box 8025 can be executed. If user 140 does not have copy permissions, the usage policy shown in box 806 can be executed, meaning the digital assistant cannot answer the user's messages based on the PDF content and does not recommend guiding questions to the user.

[0083] This method ensures that PDF plugins are used appropriately for PDF files.

[0084] Example operation of PDF plugin

[0085] In embodiments of this disclosure, the PDF plugin can perform any suitable operation to execute tasks associated with a target PDF file. Example operations of the PDF plugin are described below. In some embodiments, to perform a task, the content of the target PDF file can be extracted. For example, blocks in the target PDF file can be parsed, such as titles, author information, text, images, formulas, etc. Then, the parsed blocks can be segmented, concatenated, and combined to obtain complete text blocks, table blocks, image blocks, etc., and the reading order of these blocks can be restored.

[0086] In some embodiments, a PDF file understanding module can be used to extract the content of a target PDF file. The PDF file understanding module may include a basic information parsing submodule, a table extraction submodule, an image extraction submodule, a formula extraction submodule, a semantic tag classification submodule, a page layout segmentation submodule, and a paragraph splicing submodule. The basic information parsing submodule can be used to obtain basic text information and bounding box information of the target PDF file. The table extraction submodule can be used to identify and extract table content from each page. The image extraction submodule can be used to identify and extract image content from each page. The formula extraction submodule can be used to identify and extract formula content from each page. The page layout segmentation submodule can be used to divide each page of the PDF file into multiple visually isolated blocks and restore the reading order of these blocks according to a preset order. The preset order may be, for example, from top to bottom, from left to right, etc. The semantic tag classification submodule can be used to identify the tags of these blocks segmented by the page layout segmentation submodule, such as, but not limited to, titles, text, tables, images, headers, and footers. The paragraph concatenation submodule can be used to concatenate the text in each block into a complete paragraph based on the tags of each block. After processing the blocks on each page, paragraphs spanning multiple pages can be concatenated.

[0087] It should be understood that the above description of PDF file understanding is merely exemplary and is not intended to limit the scope of this disclosure. In embodiments of this disclosure, the PDF plugin may employ any suitable technology to understand PDF files.

[0088] After extracting the content of the target PDF file, further processing can be performed on the extracted content to execute the task. In some embodiments, the task can be executed based on the concatenated paragraphs.

[0089] As an example, a message from user 140 could instruct the rewriting of the content of a target PDF file. Hereinafter, the content the user expects to rewrite is also referred to as the target content. One or more paragraphs can be extracted from the target content and processed individually. For example, prompts for each paragraph can be generated, and based on these prompts, a machine learning model can be used to generate the corresponding rewrite results for each paragraph. These rewrite results can then be combined and fed back to user 140 as the rewritten target content.

[0090] As another example, a message from user 140 could instruct the summarization of a target PDF file. A mapping-reduction process can be used to generate this summary. Specifically, the content of each paragraph can be summarized. For example, prompts for each paragraph can be generated, and a machine learning model can be used to generate a summary for each paragraph. Then, based on the summaries of each paragraph in the target PDF file, a summary of the entire target PDF file can be generated. For example, prompts for the target PDF file can be generated based on the summaries of each paragraph, and a machine learning model can be used to generate a summary of the entire target PDF file.

[0091] The above examples illustrate PDF plugin operations using content rewriting and summarizing as examples. It can be understood that, based on understanding the PDF file to extract its content, the PDF plugin can employ any suitable method to perform tasks associated with the PDF file.

[0092] Example processes, apparatus and equipment

[0093] Figure 9 A flowchart illustrating an information interaction process 900 according to some embodiments is shown. Process 900 can be implemented at terminal device 110. Reference is made below. Figure 1 Describe the process 900.

[0094] In box 910, terminal device 110 responds to a preset operation by selecting a portable document format PDF plugin in the user's interaction window with the digital assistant.

[0095] In box 920, during the interaction between the user and the digital assistant, terminal device 110 uses a PDF plugin to perform tasks associated with a target PDF file.

[0096] In some embodiments, the target PDF file is stored locally on the user's device, or the target PDF file is stored in the cloud and the user has copy rights to the target PDF file.

[0097] In some embodiments, the interaction window includes a main session window between the user and the digital assistant, and the preset operations include: displaying a plugin selection control in the main session window for selecting a plugin to be used in the main session window; and receiving the user's selection of a PDF plugin in the main session window.

[0098] In some embodiments, displaying a plugin selection control in the main session window includes: receiving an instruction from a user to start a new topic in the main session window; and displaying the plugin selection control in the main session window in response to the instruction to start a new topic.

[0099] In some embodiments, using the PDF plugin to perform a task associated with a target PDF file includes: displaying one or more instructions related to a PDF type file in the main session window, each of the one or more instructions corresponding to a preset task; and in response to a first instruction being selected among the one or more instructions, using the PDF plugin to perform the preset task corresponding to the first instruction on the target PDF file.

[0100] In some embodiments, the session window includes a main session window for the user and the digital assistant, and the preset operations include: receiving user input in the main session window indicating a target PDF file; in response to the user input, displaying one or more instructions related to the PDF type file in the main session window, each of the one or more instructions corresponding to a preset task; and receiving a selection of a second instruction among the one or more instructions.

[0101] In some embodiments, using a PDF plugin to perform a task associated with a target PDF file includes: using the PDF plugin to perform a preset task on the target PDF file corresponding to a second instruction.

[0102] In some embodiments, the session window includes a main session window between the user and the digital assistant, and the default operation includes receiving user input indicating a target PDF file in the main session window.

[0103] In some embodiments, the preset operation includes: activating a digital assistant via a target PDF file.

[0104] In some embodiments, the interaction window includes a separate session window for the user and the digital assistant, and process 900 further includes: displaying the results of performing a preset task on the target PDF file using the PDF plugin in the separate session window.

[0105] In some embodiments, process 900 further includes: displaying one or more recommended controls related to the target PDF file in a sub-session window, each of the one or more recommended controls indicating the next action of the digital assistant.

[0106] In some embodiments, the interaction window includes a non-session window between the user and the digital assistant, and process 900 further includes: displaying one or more instructions related to the PDF plugin in the non-session window, each of the one or more instructions corresponding to a preset task.

[0107] Figure 10 A flowchart illustrating an information processing procedure 1000 according to some embodiments is shown. Procedure 1000 can be implemented at a terminal device 110 or a server 130. Reference is made below. Figure 1The process 1000 is described using the example of implementation at terminal device 110.

[0108] In box 1010, for a target PDF file of portable document format (PDF), terminal device 110 determines the storage location of the target PDF file, which is associated with the user's interaction window with the digital assistant; and

[0109] In box 1020, terminal device 110 determines the availability of a PDF plugin for a target PDF file, based at least on the storage location. The availability indicates whether the PDF plugin is used to perform a task on the target PDF file during the user's interaction with the digital assistant.

[0110] In some embodiments, determining the availability of the PDF plugin for the target PDF file includes: in response to the target PDF file being stored on a user's user device, determining that the PDF plugin is available for the target PDF file.

[0111] In some embodiments, determining the availability of the PDF plugin for the target PDF file includes: in response to the target PDF file being stored in the cloud, determining whether the user has copy permission for the target PDF file; in response to the user having copy permission for the target PDF file, determining that the PDF plugin can be used for the target PDF file; and in response to the user not having copy permission for the target PDF file, determining that the PDF plugin cannot be used for the target PDF file.

[0112] Figure 11 A schematic structural block diagram of an apparatus 1100 for information interaction according to certain embodiments of the present disclosure is shown. The apparatus 1100 may be implemented as or included in a terminal device 110. The various modules / components in the apparatus 1100 may be implemented by hardware, software, firmware, or any combination thereof.

[0113] Device 1100 includes a plug-in selection module 1110 configured to select a portable document format PDF plug-in in an interaction window between the user and the digital assistant in response to a preset operation. Device 1100 also includes a task execution module 1120 configured to use the PDF plug-in to perform tasks associated with a target PDF file during user-digital assistant interaction.

[0114] In some embodiments, the target PDF file is stored locally on the user's device, or the target PDF file is stored in the cloud and the user has copy rights to the target PDF file.

[0115] In some embodiments, the interaction window includes a main session window between the user and the digital assistant, and the preset operations include: displaying a plugin selection control in the main session window for selecting a plugin to be used in the main session window; and receiving the user's selection of a PDF plugin in the main session window.

[0116] In some embodiments, displaying a plugin selection control in the main session window includes: receiving an instruction from a user to start a new topic in the main session window; and displaying the plugin selection control in the main session window in response to the instruction to start a new topic.

[0117] In some embodiments, the task execution module 1120 is further configured to: display one or more instructions related to a PDF type file in the main session window, each of the one or more instructions corresponding to a preset task; and in response to the selection of a first instruction among the one or more instructions, use the PDF plugin to execute the preset task corresponding to the first instruction on the target PDF file.

[0118] In some embodiments, the session window includes a main session window for the user and the digital assistant, and the preset operations include: receiving user input in the main session window indicating a target PDF file; in response to the user input, displaying one or more instructions related to the PDF type file in the main session window, each of the one or more instructions corresponding to a preset task; and receiving a selection of a second instruction among the one or more instructions.

[0119] In some embodiments, the task execution module 1120 is further configured to: use a PDF plugin to execute a preset task corresponding to the second instruction on the target PDF file.

[0120] In some embodiments, the session window includes a main session window between the user and the digital assistant, and the default operation includes receiving user input indicating a target PDF file in the main session window.

[0121] In some embodiments, the preset operation includes: activating a digital assistant via a target PDF file.

[0122] In some embodiments, the interaction window includes a separate session window for the user and the digital assistant, and the device 1100 further includes a result display module configured to display, in the separate session window, the result of performing a preset task on the target PDF file using the PDF plugin.

[0123] In some embodiments, the device 1100 further includes a recommendation control display module configured to display one or more recommendation controls related to the target PDF file in a sub-session window, each of the one or more recommendation controls indicating the next action of the digital assistant.

[0124] In some embodiments, the interaction window includes a non-session window between the user and the digital assistant, and the device 1100 further includes an instruction display module configured to display one or more instructions related to the PDF plugin in the non-session window, each of the one or more instructions corresponding to a preset task.

[0125] Figure 12 A schematic structural block diagram of an apparatus 1200 for information processing according to certain embodiments of the present disclosure is shown. The apparatus 1200 may be implemented as or included in a terminal device 110 or a server 130. The various modules / components in the apparatus 1200 may be implemented by hardware, software, firmware, or any combination thereof.

[0126] The device 1200 includes a storage location determination module 1210 configured to determine the storage location of a target PDF file (Portable Document Format, PDF) associated with a user-digital assistant interaction window. The device 1200 also includes an availability determination module 1220 configured to determine the availability of a PDF plugin for the target PDF file, based at least on the storage location. The availability indicates whether the PDF plugin is used to perform a task on the target PDF file during user-digital assistant interaction.

[0127] In some embodiments, the availability determination module 1220 is further configured to determine that the PDF plugin is available for the target PDF file in response to the target PDF file being stored on the user's user device.

[0128] In some embodiments, the availability determination module 1220 is further configured to: determine whether a user has copy permission for the target PDF file in response to the target PDF file being stored in the cloud; determine that the PDF plugin can be used for the target PDF file in response to the user having copy permission for the target PDF file; and determine that the PDF plugin cannot be used for the target PDF file in response to the user not having copy permission for the target PDF file.

[0129] Figure 13 A block diagram of an electronic device 1300 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that... Figure 13 The electronic device 1300 shown is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 13 The electronic device 1300 shown can be used to achieve Figure 1 Terminal device 110 or server 130.

[0130] like Figure 13As shown, electronic device 1300 is in the form of a general-purpose electronic device. Components of electronic device 1300 may include, but are not limited to, one or more processors or processing units 1310, memory 1320, storage device 1330, one or more communication units 1340, one or more input devices 1350, and one or more output devices 1360. Processing unit 1310 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 1320. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 1300.

[0131] Electronic device 1300 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 1300, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 1320 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 1330 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 1300.

[0132] Electronic device 1300 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 13 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 1320 may include computer program product 1325 having one or more program modules configured to perform various methods or actions of various embodiments of this disclosure.

[0133] The communication unit 1340 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 1300 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 1300 can operate in a networked environment using logical connections to one or more other servers, networked personal computers (PCs), or another network node.

[0134] Input device 1350 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 1360 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 1300 can also communicate with one or more external devices (not shown) via communication unit 1340 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 1300, or with any device that enables electronic device 1300 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0135] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0136] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0137] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0138] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0139] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0140] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. An information exchange method, comprising: In response to the default action, select the portable document format PDF plugin in the user's interaction window with the digital assistant; During the interaction between the user and the digital assistant, the PDF plugin is used to perform a task associated with a target PDF file, wherein the PDF plugin performs the task by extracting the content of the PDF file and performing further processing based on the extracted content; as well as Based on the execution result of the task generated using the PDF plugin, the digital assistant's response message to the user's interactive message is determined.

2. The method according to claim 1, wherein The target PDF file is stored locally on the user's device, or The target PDF file is stored in the cloud and the user has copying rights to the target PDF file.

3. The method according to claim 1, wherein the interaction window includes the main session window between the user and the digital assistant, and the preset operation includes: In the main session window, a plugin selection control is displayed for selecting the plugins used in the main session window; as well as In the main session window, the user's selection of the PDF plugin is received.

4. The method of claim 3, wherein displaying the plug-in selection control in the main session window comprises: The main session window receives an instruction from the user to start a new topic; as well as In response to the instruction to start a new topic, the plugin selection control is displayed in the main session window.

5. The method of claim 3, wherein using the PDF plugin to perform a task associated with the target PDF file comprises: The main session window displays one or more instructions related to PDF type files, each of which corresponds to a preset task; as well as In response to the selection of a first instruction among the one or more instructions, the PDF plugin is used to perform a preset task on the target PDF file corresponding to the first instruction.

6. The method according to claim 1, wherein the interaction window includes the main session window between the user and the digital assistant, and the preset operation includes: The main session window receives user input indicating the target PDF file. In response to the user input, one or more instructions related to PDF type files are displayed in the main session window, each of the one or more instructions corresponding to a preset task; as well as Receive a selection of a second instruction from the one or more instructions.

7. The method of claim 6, wherein using the PDF plugin to perform a task associated with the target PDF file comprises: The PDF plugin is used to perform a preset task on the target PDF file corresponding to the second instruction.

8. The method according to claim 1, wherein the interaction window includes the main session window between the user and the digital assistant, and the preset operation includes: The main session window receives user input indicating the target PDF file.

9. The method according to claim 1, wherein the preset operation includes: The operation of the digital assistant is invoked via the target PDF file.

10. The method of claim 9, wherein the interaction window includes a separate session window between the user and the digital assistant, and the method further includes: The sub-session window displays the results of performing a preset task on the target PDF file using the PDF plugin.

11. The method of claim 10, further comprising: In the sub-session window, one or more recommended controls related to the target PDF file are displayed, each of the one or more recommended controls indicating the digital assistant's next action.

12. The method of claim 9, wherein the interaction window comprises a non-session window between the user and the digital assistant, and the method further comprises: The non-session window displays one or more instructions related to the PDF plugin, each of which corresponds to a preset task.

13. An information exchange method, comprising: Based on the interaction between the user and the digital assistant in the interaction window, determine the target PDF file of the portable document format PDF type indicated by the user; Determine the storage location of the target PDF file; The availability of the PDF plugin for the target PDF file is determined, at least based on the storage location. The PDF plugin is used for PDF type files, and the availability indicates whether the PDF plugin is used to perform a task on the target PDF file during the interaction between the user and the digital assistant. as well as In response to determining that the PDF plugin is available for the target PDF file, the digital assistant determines a response message to the user's interaction message based on the execution result of the task performed on the target PDF file using the PDF plugin.

14. The method of claim 13, wherein determining the availability of the PDF plugin for the target PDF file comprises: In response to the target PDF file being stored on the user's user device, it is determined that the PDF plugin is available for the target PDF file.

15. The method of claim 13, wherein determining the availability of the PDF plugin for the target PDF file comprises: In response to the fact that the target PDF file is stored in the cloud, determine whether the user has copy permission for the target PDF file; In response to the user having copy permission for the target PDF file, it is determined that the PDF plugin can be used for the target PDF file; as well as In response to the user not having copy permissions for the target PDF file, it is determined that the PDF plugin cannot be used with the target PDF file.

16. An apparatus for information interaction, comprising: The plugin selection module is configured to respond to preset actions and allow users to select portable PDF plugins in the user's interaction window with the digital assistant. A task execution module is configured to use the PDF plugin to perform a task associated with a target PDF file during the interaction between the user and the digital assistant, wherein the PDF plugin performs the task by extracting the content of the PDF file and performing further processing based on the extracted content; as well as The response message determination module is configured to determine the digital assistant's response message to the user's interaction message based on the execution result of the task generated using the PDF plugin.

17. An apparatus for information processing, comprising: The file determination module is configured to determine the target PDF file of portable document format PDF type indicated by the user based on the interaction in the interaction window between the user and the digital assistant. The storage location determination module is configured to determine the storage location of the target PDF file; as well as An availability determination module is configured to determine the availability of a PDF plugin for a target PDF file, based at least on the storage location, the PDF plugin being used for PDF type files, the availability indicating whether the PDF plugin is used to perform a task on the target PDF file during the user's interaction with the digital assistant; as well as The response message determination module is configured to determine the digital assistant's response message to the user's interaction message in response to determining that the PDF plugin can be used for the target PDF file, based on the execution result of performing a task on the target PDF file using the PDF plugin.

18. An electronic device comprising: At least one processing unit; as well as At least one memory, coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 12 or any one of claims 13 to 15 when executed by the at least one processing unit.

19. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 12 or any one of claims 13 to 15.

Images