Information interaction method and device, equipment and storage medium
By generating and presenting file overview information, it solves the problem that users find it difficult to intuitively understand file content in digital assistant interaction, and improves interaction efficiency and experience.
Patent Information
- Application Number
- CN202311560534.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-21
- Publication Date
- 2024-11-22
AI Technical Summary
The prior art is difficult to improve interaction flexibility in the interaction between users and digital assistants. Users cannot intuitively understand the file content when processing session messages containing files, which affects interaction efficiency.
By generating file overview information and presenting it in the session window, including overview information and part of the file content, providing message presentation in the form of a card, using the model to extract key information and access information of the file, improving users' understanding of file content.
It improves the efficiency of users when processing sessions containing files, facilitates and quickly obtains file information, and enhances the interactive experience.
Smart Images

Figure CN119002743A_ABST
Abstract
Description
Technical Field
[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for information interaction. Background Art
[0002] With the rapid development of Internet technology, the Internet has become an important platform for people to obtain and share content. Users can access the Internet through terminal devices to enjoy various Internet services. The terminal device presents the corresponding content through the user interface of the application and interacts with the user and provides services to the user. Therefore, the colorful interactive interface of the application is an important means to improve the user experience. With the development of information technology, various terminal devices can provide various services to people in work and life. For example, applications that provide services can be deployed in terminal devices. Terminal devices or applications can provide users with digital assistant functions to assist users in using terminal devices or applications. How to improve the flexibility of interaction between users and digital assistants is a technical problem to be explored at present. Summary of the invention
[0003] In a first aspect of the present disclosure, a method for information interaction is provided. The method includes: generating summary information about at least one file for first session information including at least one file sent to a target session; and presenting a first message corresponding to the first session information in a session window of the target session, the first message including at least the summary information and at least part of the content of the first session information.
[0004] In a second aspect of the present disclosure, a device for information interaction is provided. The device includes: an information generation module configured to generate summary information about at least one file for first session information containing at least one file sent to a target session; and a message presentation module configured to present a first message corresponding to the first session information in a session window of the target session, wherein the first message includes at least the summary information and at least part of the content of the first session information.
[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.
[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.
[0007] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:
[0009] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;
[0010] Figure 2A and Figure 2B A schematic diagram showing an example client interface of an interactive window according to some embodiments of the present disclosure;
[0011] Figure 3A and Figure 3B A schematic diagram showing an example client interface of an interactive window according to other embodiments of the present disclosure;
[0012] Figure 4A and Figure 4B A schematic diagram showing an example client interface of an interactive window according to still other embodiments of the present disclosure;
[0013] Figure 5 A schematic diagram showing an example of presenting a first message in a structured form according to some embodiments of the present disclosure;
[0014] Figure 6 A schematic diagram showing an example of a first message according to some embodiments of the present disclosure;
[0015] Figure 7 A flowchart of a process for information interaction according to still other embodiments of the present disclosure is shown;
[0016] Figure 8 A block diagram showing an apparatus for information interaction according to some embodiments of the present disclosure; and
[0017] Fig. 9 A block diagram of an electronic device in which one or more embodiments of the present disclosure may be implemented is shown. DETAILED DESCRIPTION
[0018] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0019] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.
[0020] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.
[0021] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.
[0022] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the types, scopes of use, usage scenarios, etc. of the information involved in the present disclosure should be informed to relevant users and their authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations. The relevant users may include any type of right holders, such as individuals, enterprises, and groups.
[0023] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can independently choose whether to provide information to software or hardware such as an electronic device, application, server or storage medium that executes the operation of the technical solution of the present disclosure based on the prompt message.
[0024] As an optional but non-limiting implementation, in response to receiving an active request from a relevant user, a prompt message is sent to the relevant user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to select "agree" or "disagree" to provide information to the electronic device.
[0025] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.
[0026] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In the example environment 100, a digital assistant 120 and an application 125 are installed in a terminal device 110. A user 140 can interact with the digital assistant 120 and the application 125 via the terminal device 110 and / or an attached device of the terminal device 110.
[0027] In some embodiments, the digital assistant 120 and the application 125 can be downloaded and installed on the terminal device 110. In some embodiments, the digital assistant 120 and the application 125 can also be accessed through other means, such as through a web page. Figure 1 In the environment 100 , in response to the application 125 being started, the terminal device 110 can present the interface 150 of the digital assistant 120 and the application 125 .
[0028] Application 125 includes but is not limited to one or more of the following: chat application (also known as instant messaging application), document application, audio and video conferencing application, email application, task application, calendar application, objectives and key results (OKR) application, etc. It can be understood that although Figure 1 A single application is shown in the figure, but in fact, multiple applications can be installed on the terminal device 110. In some embodiments, the application 125 may include a multi-functional collaboration platform, such as an office collaboration platform (also called an office suite) that can provide integration of multiple types of applications or components to facilitate people to carry out office work, communication and other activities. In the multi-functional collaboration platform, people can start different applications or components as needed to complete corresponding information processing, sharing, communication, etc.
[0029] The application 125 may provide a content entity 126. The content entity 126 may be a content instance created by the user 140 or other users on the application 125. For example, depending on the type of the application 125, the content entity 126 may be a document (e.g., a word document, a pdf document, a presentation, a spreadsheet document, etc.), an email, a message (e.g., a conversation message on an instant messaging application), a calendar, a schedule, a task, an audio, a video, an image, etc.
[0030] In some embodiments, the digital assistant 120 may be provided by a separate application or may be integrated into an application 120 that can provide a content entity. The application for providing a client interface of the digital assistant may correspond to a single-function application or a multi-function collaboration platform, such as an office suite or other collaboration platform that can integrate multiple components. It is understood that similar to an application, although Figure 1 A single digital assistant is shown in the figure, but in fact, multiple digital assistants may be installed on the terminal device 110, and these multiple digital assistants may be digital assistants integrated in different applications. For example, multiple applications may be installed in the terminal device 110, and these multiple applications include application A and application B, wherein digital assistant A is integrated in application A, and digital assistant B is integrated in application B.
[0031] In some embodiments, the digital assistant 120 supports the use of plug-ins. Each plug-in can provide one or more functions of the application. Such plug-ins include, but are not limited to, one or more of the following: a search plug-in, a contact plug-in, a message plug-in, a document plug-in, a table plug-in, a mail plug-in, a calendar plug-in, a schedule plug-in, a task plug-in, and the like.
[0032] The digital assistant 120 is an intelligent assistant of the user, which has intelligent dialogue and information processing capabilities. In an embodiment of the present disclosure, the digital assistant 120 is used to interact with the user 140 to assist the user 140 in using a terminal device or application. An interaction window with the digital assistant 120 may be presented in the client interface. In the interaction window, the user 140 can communicate with the digital assistant 120 by inputting natural language to instruct the digital assistant to assist in completing various tasks, including operations on the content entity 126.
[0033] In some embodiments, the digital assistant 120 can be included in the contact list of the current user 140 in the office suite as a contact of the user 140, or included in the information flow of the chat component. In some embodiments, the user 140 has a corresponding relationship with the digital assistant 120. For example, the first digital assistant corresponds to the first user, the second digital assistant corresponds to the second user, and so on. In some embodiments, the first digital assistant can correspond uniquely to the first user, the second digital assistant can correspond uniquely to the second user, and so on. That is, the first digital assistant of the first user can be specific to or exclusive to the first user. For example, in the process of the first digital assistant providing assistance or service to the first user, the first digital assistant can use its historical interaction information with the first user, the data authorized by the first user that it can access, and the current interaction context with the first user. If the first user is an individual or an individual, the first digital assistant can be regarded as a personal digital assistant. It can be understood that in the disclosed embodiments, the first digital assistant is based on the authorized access to the data to which the permission is granted by the first user. It should be understood that "uniquely corresponding" or similar expressions in the present disclosure are not intended to limit the first digital assistant to be updated accordingly based on the interaction process between the first user and the first digital assistant. Of course, depending on actual application needs, the digital assistant 120 does not have to be specific to the current user 140, but can be a general digital assistant.
[0034] In some embodiments, multiple interaction modes between the user 140 and the digital assistant 120 can be provided, and the multiple interaction modes can be flexibly switched. When a certain interaction mode is triggered, the corresponding interaction area is presented to facilitate the interaction between the user 140 and the digital assistant 120. The user 140 and the digital assistant 120 interact in different ways in different interaction modes, so that it can be flexibly adapted to the interaction needs in different application scenarios.
[0035] In some embodiments, information processing services specific to user 140 can be provided based on historical interaction information between user 140 and digital assistant 120 and / or a data range specific to user 140. In some embodiments, historical interaction information of user 140 interacting with digital assistant 120 in multiple interaction modes can be stored in association with user 140. In this way, in one interaction mode (any one or a designated one of the interaction modes) among the multiple interaction modes, digital assistant 120 can provide services to user 140 based on historical interaction information stored in association with user 140.
[0036] The digital assistant 120 can be called or awakened by an appropriate method (e.g., shortcut keys, buttons, or voice) to present an interaction window with the user 140. By selecting the digital assistant 120, the interaction window with the digital assistant 120 can be opened. The interaction window may include interface elements for information interaction, such as an input box, a message list, a message bubble, and the like. In other embodiments, the digital assistant 120 can be awakened through an entry control or menu provided in a page, or by inputting a preset instruction.
[0037] The interactive window between the digital assistant 120 and the user 140 may include a conversation window, such as a conversation window in an instant messaging application or an instant messaging module of a target application. In the conversation window, the interaction between the digital assistant 120 and the user 140 may be presented in the form of a conversation message. Alternatively or additionally, the interactive window between the digital assistant 120 and the user 140 may also include other types of windows, such as a window in a floating window mode, in which the user 140 may trigger the digital assistant 120 to perform a corresponding operation by inputting instructions, selecting shortcut instructions, etc.
[0038] In some embodiments, the terminal device 110 communicates with the server 130 to provide services for the digital assistant 120 and the application 125. The terminal device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a television receiver, a radio broadcast receiver, an e-book device, a gaming device, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.). The server 130 can be various types of computing systems / servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.
[0039] It should be understood that the structure and function of the various elements in the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.
[0040] As briefly mentioned above, digital assistants can assist users in using terminal devices or applications. Some applications can provide integrated functions of different plug-ins. In addition to being able to have free conversations with digital assistants, users can also use natural language instructions to enable digital assistants to use different plug-ins to complete some more complex business-related operations related to the application, such as creating documents, inviting schedules, creating tasks, etc.
[0041] According to some embodiments of the present disclosure, an improved scheme for information interaction is proposed. In an embodiment of the present disclosure, for first session information containing at least one file sent to a target session, summary information about the at least one file is generated. A first message corresponding to the first session information is presented in a session window of the target session. The first message includes at least the summary information and at least part of the content of the first session information.
[0042] In general, although users can send conversation messages containing files in a conversation, such conversation messages often only present icons, titles, and links corresponding to the files. Users cannot intuitively understand the specific content of the file based on the conversation message. According to the embodiments of the present disclosure, by automatically generating summary information of the file and providing it in the conversation message, users participating in the conversation can conveniently and quickly understand the content of the file, thereby improving the efficiency of the user's conversation.
[0043] Some example embodiments of the present disclosure will be described in detail below with reference to examples of the accompanying drawings.
[0044] In some embodiments, the interactive windows that the terminal device 110 can present in the client interface include an interactive window between the user and the digital assistant, an interactive window between the user and another user, and an interactive window between the user and multiple users. The interactive window can be, for example, a session window. The session window between a user and another user, or a user and a digital assistant (for example, a session window between user A and user B) can also be referred to as a single chat session window, a private chat session window, and the like. The session window between a user and multiple other users including a digital assistant (for example, a session window between user A and a group of other users) can also be referred to as a group chat session window. The interaction between the user and the digital assistant / another user / other multiple users can be presented in the form of a session message. The client interface for providing a digital assistant can correspond to a single-function application or a multi-function collaboration platform, such as an office suite or other collaboration platform capable of integrating multiple components.
[0045] The user can interact with at least one other user / digital assistant by sending and / or receiving messages in the conversation window. The terminal device 110 can, for example, determine the content of the message to be sent by the user in response to detecting the text entered by the user in the input box. The terminal device 110 can also collect the user audio in response to detecting the user's triggering operation on the audio control. The terminal device 110 can determine the audio or the text content corresponding to the audio as the content of the message to be sent by the user. It should be noted that the operations performed by the aforementioned terminal device 110 and the operations performed by the terminal device 110 described subsequently can specifically be performed by relevant applications installed on the terminal device 110.
[0046] Figures 2A to 4B Schematic diagrams showing example client interfaces 200 to 400 of interactive windows according to some embodiments of the present disclosure. The client interfaces 200 to 400 can all be implemented at the terminal device 110. Figure 1 describe Figures 2A to 4B .
[0047] In some embodiments, the terminal device 110 displays a corresponding session window in response to a preset operation (e.g., selecting a session from a session list) of a user (also referred to as a first user, i.e., a user corresponding to the terminal device 110) on a session (e.g., a session between the first user and a digital assistant, a session between the first user and another user other than the first user, and a session between the first user and multiple users other than the first user). For the convenience of description, the following exemplary description is given by taking the selected session as the target session as an example.
[0048] In some embodiments, Figure 2A As shown, the session window of the target session is presented in area 210 of interface 200. At least one session of the first user is presented in the information stream (feed) of the instant messaging application. The instant messaging application is presented in area 230 of interface 200, and the information stream is presented in area 220 of interface 200. In each session, at least one session object participating in the session may include the first user, other users other than the first user, and / or may also include one or more digital assistants of each user. It is understood that the session window in area 210 may present a session message sent by at least one session object participating in the session in the target session.
[0049] In some embodiments described below, for ease of discussion, the target session is mainly described by taking the session between the first user and at least one user as an example. In some embodiments, first session information including at least one file may be received in the target session. The at least one file here may include an online file or a locally uploaded file. The online file may include, for example, a web page link, an online document, etc. The locally uploaded file may be various local files of the user, such as a PDF file, a Word file, an audio file, a video file, etc.
[0050] In an embodiment of the present disclosure, for the first session information including at least one file sent to the target session, the terminal device 110 generates summary information about the at least one file, and presents a first message corresponding to the first session information in the session window of the target session. The first message includes at least the summary information and at least part of the content of the first session information. It can be understood that the first session information is the information directly input into the target session by the user who sends the first session information, which may include information such as text, emoticons, images, and at least one file. In the case where the first session information includes information such as text, emoticons, images, etc., in the presented first message, at least part of the content of the first session information includes the text, emoticons, images, etc. input by the user in the first session information. In some embodiments, regardless of whether the first session information includes information such as text, emoticons, images, etc., at least part of the content of the first session information in the first message may include at least one file, or may not include at least one file.
[0051] In some embodiments, the first message may include at least one summary information, and the number of the at least one summary information may be the same as the number of the at least one file. That is, for each file in the first session information, the terminal device 110 may determine the corresponding summary information and present the determined summary information in the first message. Alternatively or additionally, in some embodiments, the first message may also include only one summary information, which is the overall summary information about at least one file. That is, no matter how many files are included in the first session information, the terminal device 110 may summarize these files to obtain the overall summary information corresponding to these files.
[0052] The summary information of at least one file may be directly determined by the terminal device 110 based on the content of the at least one file based on a predetermined rule. The summary information of the at least one file may also be determined by the terminal device 110 with the help of a model. In the case where at least one file is a local file, the terminal device 110 may, for example, directly provide the content of the at least one file to the model. In the case where at least one file is a non-local file, the terminal device 110 may, for example, provide the model with access information of the at least one file. In this case, the model may obtain the content of the at least one file based on the access information of the at least one file. Exemplarily, in the case where at least one file is a file or an online document corresponding to at least one web page link, the terminal device 110 may provide the model with a link to at least one web page link or an online document. The model may, for example, crawl at least one web page link with the help of a web page plug-in to obtain the content of the at least one file, or obtain the content in the online document through an interface with an online document service.
[0053] Further, the model can determine the summary information of at least one file based on the acquired content. The model here can be, for example, a machine learning model, a deep learning model, a learning model, a neural network, etc. In some embodiments, the model can be based on a language model (LM). The language model can have question-answering capabilities by learning from a large amount of corpus. The model can also be based on other appropriate models. The model can determine the summary information from the content of at least one file. The terminal device 110 can obtain the output of the model and determine the summary information corresponding to at least one file based on the output of the model.
[0054] In some embodiments, the first message may also include an identifier corresponding to the access information of at least one file. The identifier corresponding to the access information here may be, for example, a link and / or domain name of the access information of at least one file. In some embodiments, the first message may also include an intelligent generation identifier for the overview information. The intelligent generation identifier may be used, for example, to indicate that the overview information is information generated by a digital assistant and / or a model based on the content of at least one file. In some embodiments, the first message may also include a content portion extracted from at least one file. The content portion extracted from at least one file includes pictures in at least one file and / or the respective titles of at least one file. The extracted content portion here may also be obtained by the terminal device 110 based on predetermined rules, or obtained with the help of a model.
[0055] In some embodiments, the first message may include a message in a card form. Specifically, when the first session information only includes at least one file, the terminal device 110 may directly present the first message in a card form in the session window. Figure 2A and Figure 2B An example of a first message corresponding to the first session information including only the first file is shown. Figure 2A and Figure 2B As shown, the terminal device 110 can directly present the first message 211 and the first message 212 in the form of cards in the conversation window presented in the area 210. In the case where the first conversation information also includes information such as text, emoticons, and images input by the user, the terminal device 110 can, for example, only present the summary information of at least one file, the content part extracted from at least one file, the identifier corresponding to the access information of at least one file, and the intelligently generated identifier for the summary information in the form of cards in the conversation window.
[0056] Figure 3A An example of a first message corresponding to first session information including a file and user input text is shown. Figure 3AAs shown, the first message 310 includes at least part of the content of the first session information (i.e., the text "Are you interested?" entered by the user and the link to the file in the first session information "After much polishing, "XXXX" is finally available for sale"). The first message 310 also includes a card 311, which includes summary information of the first file (i.e., the file included in the first session information) (i.e., "The book provides various xxxx methods and techniques. This book can help readers better xxxxxx. This book has received attention and discussion on XX and XX"), a content part extracted from the first file (i.e., the picture and the title "After much polishing, "XXXX" is finally available for sale"), an identifier corresponding to the access information of the first file (i.e., "xx.xxxxxx.xx.com"), and an intelligently generated identifier for the summary information (i.e., "digital assistant intelligent summary").
[0057] Figure 3B An example of a first message corresponding to first session information including multiple files and user input text is shown. Figure 3B As shown, in the case where the first session information includes two files, the first message 320 may include at least part of the content of the first session information (i.e., the text "Are you interested?" entered by the user and the links "After much polishing, "XXXX" is finally on sale" and the link "The track "XXX" expresses and appeals to xxxxxx") corresponding to the two files in the first session information respectively). The first message 320 may also include cards corresponding to the two files respectively (i.e., card 321 and card 322). Each card may include summary information of the corresponding file, a content portion extracted from the corresponding file, an identifier corresponding to the access information of the corresponding file, and an intelligently generated identifier for the summary information.
[0058] Regarding the specific manner in which the terminal device 110 generates an overview message, in some embodiments, the terminal device 110 may automatically generate overview information about at least one file in response to the first session information being sent to the target session. That is, the terminal device 110 may directly generate an overview message by default in response to the first session information being sent to the target session. In other embodiments, the terminal device 110 may generate overview information about at least one file in response to detecting an overview generation request after the first session information is sent to the target session. For example, the terminal device 110 may present an operation control for generating overview information in association with the first session information. The terminal device 110 may then determine that an overview generation request has been received in response to detecting a trigger operation for the operation control. In this way, for the session information that has been sent to the target session, different users may trigger the generation of overview information as needed. For example, Figure 4AAs shown, after the first session information 410 is sent to the target session and presented as a corresponding message in the session window, the terminal device 110 may present the operation control 401 in association with the first session information 410. If a trigger operation for the operation control 401 is detected, the terminal device 110 may determine that a summary generation request is received. The terminal device 110 may then generate summary information of the file in the first session information 410 in response to receiving the summary generation request.
[0059] Since it may take some time to generate the summary information, in some embodiments, the terminal device 110 may present an initial message including the first session information in the session window in response to receiving the first session information. The initial message is the first session information that has not been replaced. The initial message may be, for example, Figure 4A The terminal device 110 may then replace the initial message with the first message in response to the summary information being generated. In some embodiments, if the first session information 410 is Figure 3A The initial message corresponding to the first message 310 in the first session information 410 may be directly presented by the terminal device 110 in response to the summary information of the file in the first session information 410 being generated. Figure 3A In the example 300 shown, the first message 310 may be presented directly.
[0060] In some embodiments, when the first session information is sent to the target session and the summary information has not yet been generated, the terminal device 110 may also generate an intermediate message corresponding to the first session information 410. The intermediate message may include at least part of the content in the first session information 410. At least part of the content of the first session information 410 in the intermediate message is the same as at least part of the content of the first session information 410 in the first message 310. In some embodiments, the intermediate message may also include part of the content extracted from at least one file (for example, the file title, the pictures contained therein, etc.), because compared with the generation of the summary information, the speed of directly extracting part of the content from at least one file may be faster. In some embodiments, the intermediate message may also be in the form of a card message. The card message may include the content part extracted from the first file (that is, the picture and the title "After polishing, "XXXX" is finally on the market") and / or the identifier corresponding to the access information of the first file (that is, "xx.xxxxxx.xx.com"). Since the generation of the summary information has not yet been completed, compared with the card in the first message 310, the card in the intermediate message does not include the summary information and the intelligent generation identifier for the summary information. Figure 4B As shown, the message 420 may be, for example, an intermediate message corresponding to the first session information 410. Figure 3AIn the example of FIG. 1 , the first message 310 in the first session information 410 is replaced by the first message 420, and the message 420 only includes at least part of the content of the first session information 410 and the card 421. The card 421 presents the picture and title of the first file. Further, in response to the summary information being generated, the terminal device 110 may replace the intermediate information with the first message. That is, the terminal device 110 may replace the message 420 with the first message 310.
[0061] Regarding the presentation method of the first message, in some embodiments, the terminal device 110 may present the first message in a structured form (eg, FIG. 2A to FIG. 3B In this case, the first message may include multiple areas, which may be used to present summary information, content extracted from at least one file, an identifier corresponding to access information of at least one file, and an intelligently generated identifier for the summary information. The access information of each file may include a local or online access address of the file. For a web link or an online document, the access information may include a domain name of the access address. Figure 5 FIG. 5 is a schematic diagram showing an example 500 of presenting a first message in a structured form according to some embodiments of the present disclosure. Figure 5 As shown, the terminal device 110 can present all contents other than at least part of the contents of the first session information in the first message in the form of a card. Taking the first session information including only one file (that is, the first file) as an example, the example 500 can include multiple areas, and the terminal device 110 can present the summary information 530 of the first file, the content part extracted from the first file (that is, the picture 510 and the title 520 extracted from the first file), the identifier 540 corresponding to the access information of the first file (for example, the domain name), and the intelligently generated identifier 550 for the summary information in these multiple areas.
[0062] Regarding the presentation method of the summary information in the first message, in some embodiments, the terminal device 110 may directly present the summary information in plain text form. Figure 2B As shown, the terminal device 110 may directly present the determined summary information in the first message 212. In this case, the terminal device 110 may not need to determine the icon corresponding to the summary information.
[0063] In some embodiments, the terminal device 110 may also present the summary information in a structured form (eg Figure 2A , Figure 3A as well as Figure 3B In this case, the area for presenting the summary information may include at least one partition, and the terminal device 110 may present the summary information in at least one partition, each partition including an icon and a portion of the summary information. Figure 5 ,like Figure 5 As shown, the area for presenting the overview information may include at least one partition, and each partition may be, for example, a row of the area for presenting the overview information. Each row (i.e., each partition) may be used to present a portion of the overview information and a corresponding icon. It should be noted that the icon in each partition may have a corresponding relationship with a portion of the overview information in the partition. The terminal device 110 may, for example, determine the icon in each partition based on the content of the first file. In some embodiments, the terminal device 110 may also have an icon library. The terminal device 110 may query from the icon library based on a portion of the overview information in each partition to determine the corresponding icon. The terminal device 110 may, for example, determine the icon in each partition based on a predetermined rule. The terminal device 110 may also, for example, determine the icon in each partition with the aid of a model.
[0064] In some embodiments, when presenting the summary information in a structured form, if it is not possible to determine the icons in each partition, the terminal device 110 may also select and present a default icon and a portion of the summary information in each partition. Figure 6 As shown, example 600 may include multiple areas, and the terminal device 110 may respectively present the summary information of at least one file included in the first session information, the content part extracted from the at least one file, the identifier corresponding to the access information of the at least one file, and the intelligently generated identifier for the summary information in these multiple areas. The area for presenting the summary information may include at least one partition, and each partition may be, for example, a row of the area for presenting the summary information. The terminal device 110 may present a part of the summary information and the default icon 610 in each partition. Of course, Figure 6 The default icons given are only examples, and various default icons may be configured according to application requirements, or different default icons may be configured according to different file types.
[0065] In summary, according to the embodiments of the present disclosure, when a user sends session information containing a file, providing summary information related to the file in the session message helps users participating in the session to obtain file information conveniently and quickly, thereby helping to improve the efficiency of user sessions.
[0066] Figure 7 FIG. 7 is a flowchart of a process 700 for information interaction according to some embodiments of the present disclosure. The process 700 may be implemented at the terminal device 110. For ease of discussion, reference will be made to FIG. Figure 1 The process 700 is described in the environment 100.
[0067] In block 710 , the terminal device 110 generates summary information about at least one file for first session information including at least one file sent to a target session.
[0068] In block 720 , the terminal device 110 presents a first message corresponding to the first session information in the session window of the target session, where the first message includes at least summary information and at least part of the content of the first session information.
[0069] In some embodiments, the at least one file includes one or more of the following: a web page link; a PDF file; a Word file; an online document; an audio file; or a video file.
[0070] In some embodiments, generating overview information about at least one file includes: generating overview information about at least one file in response to first session information being sent to a target session, or generating overview information about at least one file in response to detecting an overview generation request after the first session information is sent to the target session.
[0071] In some embodiments, the first message further includes: a content portion extracted from at least one file; an identifier corresponding to access information of at least one file; and an intelligently generated identifier for the summary information.
[0072] In some embodiments, the content portion extracted from the at least one file includes at least one of the following: a picture in the at least one file, and a title of the at least one file.
[0073] In some embodiments, the summary information is presented in a structured form or in plain text form in the first message.
[0074] In some embodiments, presenting the summary information in a structured form includes presenting the summary information in at least one partition, each partition including an icon and a portion of the summary information.
[0075] In some embodiments, presenting a first message corresponding to the first session information in the session window of the target session includes: in response to receiving the first session information, presenting an initial message in the session window, the initial message including the first session information; and in response to the summary information being generated, replacing the initial message with the first message.
[0076] In some embodiments, generating the summary information includes: providing content in the at least one file or access information of the at least one file to the model; and determining the summary information from the content in the at least one file using the model.
[0077] In some embodiments, the first message includes a message in the form of a card.
[0078] In some embodiments, the session window includes a single chat session window or a group chat session window of the user.
[0079] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes.
[0080] Figure 8 A schematic structural block diagram of an apparatus 800 for information interaction according to some embodiments of the present disclosure is shown. The apparatus 800 may be implemented in or included in the terminal device 110, for example. Each module / component in the apparatus 800 may be implemented by hardware, software, firmware, or any combination thereof.
[0081] As shown in the figure, the device 800 includes an information generation module 810, which is configured to generate summary information about at least one file for the first session information containing at least one file sent to the target session. The device 800 also includes a message presentation module 820, which is configured to present a first message corresponding to the first session information in the session window of the target session, wherein the first message at least includes the summary information and at least part of the content of the first session information.
[0082] In some embodiments, the at least one file includes one or more of the following: a web page link; a PDF file; a Word file; an online document; an audio file; or a video file.
[0083] In some embodiments, the information generation module 810 is further configured to: generate overview information about at least one file in response to the first session information being sent to the target session, or generate overview information about at least one file in response to detecting an overview generation request after the first session information is sent to the target session.
[0084] In some embodiments, the first message further includes: a content portion extracted from at least one file; an identifier corresponding to access information of at least one file; and an intelligently generated identifier for the summary information.
[0085] In some embodiments, the content portion extracted from the at least one file includes at least one of the following: a picture in the at least one file, and a title of the at least one file.
[0086] In some embodiments, the summary information is presented in a structured form or in plain text form in the first message.
[0087] In some embodiments, presenting the summary information in a structured form includes presenting the summary information in at least one partition, each partition including an icon and a portion of the summary information.
[0088] In some embodiments, the message presentation module 820 is further configured to: in response to receiving the first conversation information, present an initial message in the conversation window, the initial message including the first conversation information; and in response to the summary information being generated, replace the initial message with the first message.
[0089] In some embodiments, the information generation module 810 is further configured to: provide the model with content in the at least one file or access information of the at least one file; and determine summary information from the content in the at least one file using the model.
[0090] In some embodiments, the first message includes a message in the form of a card.
[0091] In some embodiments, the session window includes a single chat session window or a group chat session window of the user.
[0092] The units and / or modules included in the device 800 can be implemented in various ways, including software, hardware, firmware or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units and / or modules in the device 800 can be implemented at least in part by one or more hardware logic components. As an example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0093] It should be understood that one or more steps in the above method can be performed by a suitable electronic device or a combination of electronic devices. Such an electronic device or a combination of electronic devices may include, for example, Figure 1 The server 130, the terminal device 110 and / or the combination of the server 130 and the terminal device 110.
[0094] Fig. 9 900 is a block diagram of an electronic device in which one or more embodiments of the present disclosure may be implemented. It should be understood that Fig. 9 The electronic device 900 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Fig. 9 The electronic device 900 shown can be used to implement Figure 1 The terminal device 110 and / or the server 130, or Figure 8 Device 800.
[0095] like Fig. 9As shown, the electronic device 900 is in the form of a general electronic device. The components of the electronic device 900 may include, but are not limited to, one or more processors or processing units 910, a memory 920, a storage device 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. The processing unit 910 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 920. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 900.
[0096] The electronic device 900 typically includes a plurality of computer storage media. Such media can be any available media accessible to the electronic device 900, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 920 can be a volatile memory (e.g., register, cache, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory) or some combination thereof. The storage device 930 can be a removable or non-removable medium, and can include a machine-readable medium, such as a flash drive, a disk, or any other medium, which can be used to store information and / or data and can be accessed within the electronic device 900.
[0097] The electronic device 900 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig. 9 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. Memory 920 may include a computer program product 925 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.
[0098] The communication unit 940 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 900 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 900 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.
[0099] The input device 950 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 960 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 900 may also communicate with one or more external devices (not shown) through the communication unit 940 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 900, or communicate with any device that allows the electronic device 900 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).
[0100] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.
[0101] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.
[0102] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0103] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0104] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.
[0105] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.
Claims
1. A method for information interaction, comprising: For first session information including at least one file sent to a target session, generating summary information about the at least one file; as well as A first message corresponding to the first session information is presented in the session window of the target session, where the first message at least includes the summary information and at least part of the content of the first session information.
2. The method according to claim 1, wherein: The at least one file includes one or more of the following: Web links; PDF files; Word document; Online documentation; Audio files; Video file.
3. The method of claim 1, wherein generating summary information about the at least one file comprises: generating summary information about the at least one file in response to the first session information being sent to the target session, or In response to detecting a summary generation request after the first session information is sent to the target session, summary information about the at least one file is generated.
4. The method according to claim 1, wherein the first message further comprises: a content portion extracted from the at least one file; An identifier corresponding to the access information of the at least one file; An identifier is intelligently generated for the summary information.
5. The method according to claim 4, wherein the content portion extracted from the at least one file comprises at least one of the following: The picture in the at least one file, A respective title of the at least one file. The method of claim 1 , wherein the summary information is presented in the first message in a structured form or in a plain text form.
7. The method of claim 6, wherein presenting the summary information in the structured form comprises: The summary information is presented in at least one partition, each partition including an icon and a portion of the summary information.
8. The method according to claim 1, wherein presenting a first message corresponding to the first session information in the session window of the target session comprises: In response to receiving the first session information, presenting an initial message in the session window, the initial message including the first session information; as well as In response to the summary information being generated, the initial message is replaced with the first message.
9. The method of claim 1, wherein generating the summary information comprises: Providing the model with the content of the at least one file or the access information of the at least one file; as well as The summary information is determined from content in the at least one file using the model.
10. The method of claim 1, wherein the first message comprises a message in the form of a card.
11. The method according to claim 1, wherein the conversation window comprises a single chat conversation window or a group chat conversation window of the user.
12. A device for information interaction, comprising: An information generation module, configured to generate summary information about at least one file for first session information including at least one file sent to a target session; as well as The message presenting module is configured to present a first message corresponding to the first session information in the session window of the target session, wherein the first message at least includes the summary information and at least part of the content of the first session information.
13. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 11 when executed by the at least one processing unit.
14. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Information display method, device and system and storage medium
CN114168869A
Session message presentation method and device, equipment and storage medium
CN115396391A
Session message processing method and device, computer equipment and storage medium
CN116644040A
Conversation enrichment through component re-order
US20180063057A1
