Interaction method and device, electronic equipment and computer readable storage medium

Abstract

The invention relates to an interaction method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of artificial intelligence and computers. The interaction method comprises the steps that in response to the received first message sent by a first user, the first message is displayed in a message display area of a session interface between a second user and the first user, and the session interface comprises the message display area and an input area; the message display area is used for displaying messages sent by a first user and a second user, and the input area is used for receiving and displaying messages input by the second user; displaying one or more candidate reply messages generated based on the first message in an associated region of the first message in the message display region; according to a target reply message selected by a second user from the one or more candidate reply messages, a second message sent by the second user to the first user is displayed in the message display area, and the second message is determined according to the target reply message.

Description

Technical Field

[0001] The present disclosure relates to the fields of artificial intelligence and computer technologies, and particularly relates to an interaction method, an apparatus, an electronic device, and a computer-readable storage medium. Background Art

[0002] With the development of Internet technologies, communication between people has become more and more convenient. Various instant messaging (IM) applications or platforms can facilitate users to communicate with others anytime and anywhere. For example, a user can chat with friends and family through an instant messaging application or platform, or can also report problems to customer service staff through an instant messaging application or platform. Summary of the Invention

[0003] According to some embodiments of the present disclosure, there is provided an interaction method, including: in response to receiving a first message sent by a first user, displaying the first message in a message display area of a conversation interface between a second user and the first user, where the conversation interface includes a message display area and an input area, the message display area is used to display messages sent by the first user and the second user, and the input area is used to receive and display messages input by the second user; displaying one or more candidate reply messages generated based on the first message in an associated area of the first message in the message display area; and according to a target reply message selected by the second user from the one or more candidate reply messages, displaying a second message sent by the second user to the first user in the message display area, where the second message is determined according to the target reply message.

[0004] According to some other embodiments of the present disclosure, there is provided an interaction apparatus, including: a first display module configured to, in response to receiving a first message sent by a first user, display the first message in a message display area of a conversation interface between a second user and the first user, where the conversation interface includes a message display area and an input area, the message display area is used to display messages sent by the first user and the second user, and the input area is used to receive and display messages input by the second user; a second display module configured to display one or more candidate reply messages generated based on the first message in an associated area of the first message in the message display area; and a third display module configured to, according to a target reply message selected by the second user from the one or more candidate reply messages, display a second message sent by the second user to the first user in the message display area, where the second message is determined according to the target reply message.

[0005] According to some embodiments of the present disclosure, there is provided an electronic device, including: a processor; and a memory coupled to the processor for storing instructions, which when executed by the processor, cause the processor to execute the interaction method according to any one of the embodiments.

[0006] According to some embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the processor is caused to execute the interaction method of any one of the embodiments in the present disclosure.

[0007] Other features, aspects, and advantages of the present disclosure will become apparent from the following detailed description of the exemplary embodiments of the present disclosure with reference to the accompanying drawings. Description of the Drawings

[0008] Embodiments of the present disclosure will be described below with reference to the accompanying drawings. It should be understood that the drawings in the following description only relate to some embodiments of the present disclosure and do not constitute a limitation to the present disclosure. In the drawings:

[0009] Figure 1 A flowchart showing the interaction method of some embodiments of the present disclosure;

[0010] Figure 2 and 3 A schematic diagram showing the session interface of some embodiments of the present disclosure;

[0011] Figure 4 A schematic diagram showing the first configuration interface of some embodiments of the present disclosure;

[0012] Figure 5A and 5B A schematic diagram showing the candidate reply message of some embodiments of the present disclosure;

[0013] Figures 6A - 6E A schematic diagram showing the candidate reply messages of different modalities of some embodiments of the present disclosure;

[0014] Figures 7A - 7C A schematic diagram showing the operation control of the candidate reply message of some embodiments of the present disclosure;

[0015] Figure 8 A schematic diagram showing the second configuration interface of some embodiments of the present disclosure;

[0016] Figure 9 A schematic diagram showing the structure of the interaction device of some embodiments of the present disclosure;

[0017] Figure 10 A schematic diagram showing the structure of the electronic device of some embodiments of the present disclosure;

[0018] Figure 11 A schematic diagram showing the structure of the electronic device of some other embodiments of the present disclosure. Detailed Embodiments

[0019] The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure. It should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein.

[0020] It should be understood that the steps recited in the method embodiments of the present disclosure can be executed in different orders and / or executed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this regard. Unless otherwise specifically stated, the relative arrangement of the steps set forth in these embodiments should be construed as merely exemplary and does not limit the scope of the present disclosure.

[0021] The term "comprising" and variations thereof used in the present disclosure mean an open term that includes at least the subsequent element / feature, but does not exclude other elements / features, that is, "including but not limited to". The term "based on" means "at least partially based on".

[0022] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependent relationships. Unless otherwise specified, the concepts such as "first" and "second" are not intended to imply that the objects so described must be in a given order in terms of time, space, ranking or any other way.

[0023] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive. Those skilled in the art should understand that unless otherwise clearly specified in the context, it should be understood as "one or more".

[0024] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only for illustrative purposes and do not limit the scope of these messages or information.

[0025] The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings, but the present disclosure is not limited to these specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. In addition, in one or more embodiments, specific features, structures or characteristics can be combined in any suitable manner that will be clear to those of ordinary skill in the art from the present disclosure.

[0026] During instant messaging, the user needs to organize their own language, input it, and then send it to the other party. Especially when interacting via text messages, the user needs to organize language, input text, and send it, involving multiple operation steps. In related technologies, when providing reply suggestions, if the other party sends multiple messages in a row, only one or more candidate reply messages can be displayed for one message in the input area. For other messages, the user still needs to organize their own language, input text, and send it. In a fast-paced instant messaging scenario, especially when a large amount of information needs to be processed quickly, users are prone to feeling that the operations are cumbersome and the reply efficiency is low.

[0027] To address the above problems, the present disclosure proposes an interaction method. In response to receiving a first message sent by a first user, in the conversation interface between the second user and the first user, not only the first message is displayed, but also one or more candidate reply messages automatically generated based on the first message are displayed in real time in the associated area of the first message. In response to the second user selecting a target reply message from the one or more candidate reply messages, a second message is generated based on the target reply message and sent to the first user. The second user can perform simple operations such as selecting the automatically generated candidate reply message to send the second message, which simplifies the operations of the second user and improves the reply efficiency. Additionally, the conversation interface includes a message display area and an input area. The one or more candidate reply messages are displayed in the associated area of the first message in the message display area, and candidate reply messages can be displayed for multiple messages simultaneously, enabling the second user to quickly and accurately locate the one or more candidate reply messages corresponding to the first message. Especially when the first user sends multiple messages, the second user can also quickly and accurately identify the one or more candidate reply messages corresponding to the first message, further improving the efficiency and accuracy of the reply.

[0028] The following will be combined with Figures 1 - 8 to describe the interaction method of the present disclosure.

[0029] Figure 1 is a flowchart of some embodiments of the interaction method of the present disclosure. As Figure 1 shown, the method of this embodiment includes steps S102 to S106. The method of this embodiment can be executed by a client on the second user's side. It can be understood that the method of the present disclosure is implemented based on the user's full authorization and the activation of the conversation intelligent assistance function.

[0030] In step S102, in response to receiving a first message sent by a first user, the first message is displayed in the message display area of the conversation interface between the second user and the first user.

[0031] The conversation interface includes a message display area and an input area. The message display area can be used to display the messages sent by the first user and the second user. The message display area can be used to display messages of one or more modalities. For example, at least one of text, image, video, audio, table, chart, information card, etc., but not limited to the examples given. The first message can also include information of at least one modality.

[0032] The input area can be used to receive and display the message input by the second user. The input area can be used to input information of one or more modalities. For example, the input area includes an input box, a virtual keyboard area, a send control, a voice input control, an emoji input control, etc. According to different instant messaging applications, the input area may also include some other function controls, such as function controls for adding pictures, taking pictures, sending files, inserting links, enabling location sharing, etc., not limited to the examples given.

[0033] In step S104, one or more candidate reply messages generated based on the first message are displayed in the associated area of the first message in the message display area.

[0034] For example, the associated area of the first message can be an area around the first message at a specific distance from the display position of the first message. For example, the interval between the display area of the first message and the center of the associated area of the first message is less than a predetermined threshold, etc. Exemplarily, the associated area of the first message can be an area adjacent to the first message. No other messages are displayed between the associated area and the first message. The associated area can be located at any position above, below, to the left, to the right, etc. of the first message, not limited to the examples given.

[0035] For example, in response to a swipe operation of the second user on the message display area, the message display area can be switched and displayed based on the swipe operation, while the positional relationship and distance between the associated area and the display position of the first message remain fixed. For example, the associated area can be bound to the first message for display. In response to the switching and display of the message display area based on the swipe operation, the associated area and the first message are switched and displayed together based on the swipe operation. In this way, it enables the user to quickly and accurately locate and identify one or more candidate reply messages corresponding to the first message, avoiding confusion in the case of displaying one or more candidate reply messages for each of multiple messages, and improving the efficiency and accuracy of the reply.

[0036] One or more candidate reply messages are generated based on the first message and are messages that reply to the first message, rather than further questions or other associated recommended information. For example, an AI (Artificial Intelligence) model can be used to generate one or more candidate reply messages based on the first message. For example, the AI model can be a machine learning model, and for different modalities of the first message, the machine learning model can be different models. For example, when the first message is text, the machine learning model can be an LLM (Large Language Model), and when the first message includes information of multiple modalities, the machine learning model can be a multimodal large model.

[0037] In step S106, according to the target reply message selected by the second user from one or more candidate reply messages, a second message sent by the second user to the first user is displayed in the message display area.

[0038] The second message is determined based on the target reply message. In the message display area, the second user can directly select the target reply message from one or more candidate reply messages, and then the second message can be determined based on the target reply message and displayed in the message display area. For example, the target reply message can be directly used as the second message, or the second user can perform a simple editing operation on the target reply message to obtain the second message.

[0039] The interaction method of the above embodiment, in response to receiving the first message sent by the first user, not only displays the first message in the conversation interface between the second user and the first user, but also displays one or more candidate reply messages automatically generated based on the first message in the associated area of the first message in real time. In response to the second user selecting the target reply message from one or more candidate reply messages, a second message is generated based on the target reply message and sent to the first user. The second user can perform simple operations such as selecting on the automatically generated candidate reply messages to send the second message, which simplifies the operation of the second user and improves the reply efficiency. In addition, the conversation interface includes a message display area and an input area, and one or more candidate reply messages are displayed in the associated area of the first message in the message display area, and candidate reply messages can be displayed for multiple messages simultaneously, enabling the second user to quickly and accurately locate one or more candidate reply messages corresponding to the first message. Especially when the first user sends multiple messages, the second user can also quickly and accurately identify one or more candidate reply messages corresponding to the first message, further improving the efficiency and accuracy of the reply.

[0040] In addition, since the display mode of the message display area is more flexible, supporting switching display based on the user's sliding operation, more content can be displayed, and one or more candidate reply messages can be displayed for each of multiple messages. Compared with the solution where only one or more candidate reply messages can be displayed for one message in the input area, the efficiency and accuracy of the reply are further improved.

[0041] Some display methods for one or more candidate reply messages are described in detail below.

[0042] In some embodiments, displaying one or more candidate reply messages generated based on the first message in the associated area of the first message in the message display area includes: in the message display area, displaying the first message and one or more candidate reply messages as a message body, where the display area of the message body includes the associated area of the first message; or in the message display area, displaying each of the first message and one or more candidate reply messages as a message body, where the associated area of the first message includes the display areas of one or more message bodies corresponding to the one or more candidate reply messages.

[0043] One or more candidate reply messages can be displayed only for the second user, that is, only one or more candidate reply messages are displayed in the conversation interface of the second user's client, and one or more candidate reply messages are invisible to the first user, which can improve the user experience.

[0044] Displaying the first message and one or more candidate reply messages as a message body can display the message body in a visual message component. To further distinguish different candidate reply messages, a visual message component corresponding to each candidate reply message can be nested and displayed in the visual message component where the message body is located, and each candidate reply message can be displayed in a visual message component. Displaying the first message and one or more candidate reply messages as a whole can enable the second user to more quickly and accurately locate and identify one or more candidate reply messages corresponding to the first message, improving the reply efficiency and accuracy.

[0045] Displaying each of the first message and one or more candidate reply messages as a message body can display each message body in a visual message component. There is no nested relationship between the visual message components. Displaying the first message and each of one or more candidate reply messages as a message body respectively can enable the second user to more quickly and accurately distinguish different messages, improving the understanding efficiency of different messages and the efficiency of selecting the target reply message.

[0046] The visual message component can correspond to a specific geometric area, and the content of the message body is included within this geometric area. The background of the visual message component can be distinguished from the background of the message display area by different colors, textures, effects, etc. The visual message component has a boundary, which can be depicted by a line with a color. For example, the visual message component is a message bubble, and the example is not limited to this.

[0047] As Figure 2 shown, it is the conversation interface between the second user and the first user, including a message display area 201 and an input area 202. When the second user inputs text, a virtual keyboard, etc. can also be displayed in the input area 202, which will not be elaborated here. The first message 203 sent by the first user can be displayed in the message display area 201, and at the same time, one or more candidate reply messages 204 can be displayed as a message body in the visual message component 205 together with the first message 203. Further, each candidate reply message 204 can be displayed in a visual message component 206 and nested in the visual message component 205. In addition, the conversation interface further includes a message list area 207 for displaying relevant information about the interaction between different users and the second user. Depending on the design of different instant messaging applications or platforms and the type of the terminal, etc., the conversation interface may or may not include a message list area, and the present disclosure does not limit this area.

[0048] As Figure 3 shown, the first message 303 sent by the first user and one or more candidate reply messages 304 are displayed in the message display area 301. The first message 303 is displayed as a message body in the visual message component 305. Each candidate reply message 304 can be displayed in a visual message component 306. There is no nesting relationship between different visual message components.

[0049] Displaying one or more candidate reply messages in an associated area adjacent to the lower part of the first message conforms to the natural reading habit and operation flow of the second user, can enable the second user to quickly and accurately locate the display area of one or more candidate reply messages without additional searching, reduce the cognitive load of the second user, and improve the efficiency and fluency of the operation.

[0050] The display manners of the first message and one or more candidate reply messages are not limited to Figure 2 and Figure 3 the examples given. For example, one or more candidate reply messages can be displayed above the first message. For example, the first message can be displayed as a message body in a visual message component, and one or more candidate reply messages can be displayed as a message body in another visual message component, etc., which will not be elaborated here.

[0051] The visual message components corresponding to one or more candidate reply messages can be displayed in a different style from the visual message component corresponding to the first message. For example, the background color, texture, geometric shape, etc. of the visual message components corresponding to one or more candidate reply messages are different from those of the visual message component corresponding to the first message. One or more candidate reply messages and the first message can be displayed in different styles. For example, the text font, color, effect, etc. of one or more candidate reply messages are different from those of the first message. By displaying one or more candidate reply messages and / or their corresponding visual message components in a specific style, it can attract the attention of the second user more, facilitate the second user to quickly distinguish the first message from one or more candidate reply messages, and improve the reply efficiency.

[0052] In some embodiments, displaying one or more candidate reply messages generated based on the first message in the associated area of the first message in the message display area includes: in the associated area of the first message in the message display area, displaying each candidate reply message among the one or more candidate reply messages in a visual message component, and displaying the one or more visual message components corresponding to the one or more candidate reply messages and the one or more candidate reply messages in a target style, where the target style is determined based on the semantic information of the first message or the target style is determined based on the configuration of the second user.

[0053] For example, an AI model can be used to determine the reply urgency based on the semantic information of the first message and the semantic information of the context of the first message, and determine the target style according to the reply urgency. For example, the higher the reply urgency, the more prominent the target style. For example, for the first message with the highest reply urgency, the visual message components of one or more candidate reply messages can be displayed in red, etc. Also, for example, an AI model can be used to determine the style type based on the semantic information of the first message and the semantic information of the context of the first message, and determine the target style according to the style type. Also, for example, an AI model can be used to determine the semantic scenario based on the semantic information of the first message and the semantic information of the context of the first message, and determine the target style according to the semantic scenario.

[0054] Automatically determining the target style of one or more candidate reply messages and their corresponding visual message components based on the semantic information of the first message can display one or more candidate reply messages and visual message components in different styles for different first messages, more prominently display the candidate reply messages, and enable the second user to quickly determine the reply urgency, style type, semantic scenario, etc. of the first message through the style. In the case where the first user sends multiple messages, quickly and accurately locate and view different messages and the candidate reply messages corresponding to different messages, improving the reply efficiency and the timeliness of replies to different messages.

[0055] The second user can configure the styles of one or more candidate reply messages and / or one or more visual message components corresponding to one or more candidate reply messages. In some embodiments, displaying one or more visual message components corresponding to one or more candidate reply messages and the one or more candidate reply messages in a target style includes: in response to a triggering operation of the second user on a first configuration entry, displaying a first configuration interface, where the first configuration interface includes one or more first configuration items corresponding to one or more visual message components and one or more second configuration items corresponding to one or more candidate reply messages; in response to a configuration operation of the second user on one or more first configuration items and / or one or more second configuration items, displaying one or more visual message components corresponding to one or more candidate reply messages and the one or more candidate reply messages in a target style.

[0056] The first configuration entry can be set in the conversation interface or in other interfaces, for example, in the configuration interface of an instant messaging application, not limited to the examples given. The second user can trigger the control of the first configuration entry, thereby triggering the display of the first configuration interface. In the first configuration interface, the user can configure the styles of one or more visual message components corresponding to one or more candidate reply messages and / or configure the styles of one or more candidate reply messages. For example, one or more of the first configuration items can correspond to at least one of the shape, background pattern, and background color of the visual message component. One or more of the second configuration items can correspond to at least one of the color, font, effect, layout, and size of the candidate reply message. When one or more candidate reply messages include information of multiple modalities, one or more of the second configuration items can include configuration items corresponding to each modality. For example, for text, the second user can configure the color, font, size, etc., and for images, the second user can configure the size, resolution, etc., not limited to the examples given.

[0057] The second user can, in advance or after one or more candidate reply messages are displayed, configure the styles of one or more candidate reply messages and / or one or more visual message components corresponding to one or more candidate reply messages. When the second user configures one or more candidate reply messages and / or one or more visual message components in advance, the second user can configure them for different types of candidate reply messages and / or visual message components. Different types can be determined according to at least one of the reply urgency, style type, and semantic scenario.

[0058] Such as Figure 4As shown, in response to the triggering operation of the second user on the first configuration entry, the first configuration interface 401 can be displayed. The first configuration interface 401 can include two sub - pages. For example, the first sub - page 402 for configuring the visual message component and the second sub - page 403 for configuring the candidate reply message. For example, multiple first configuration items 404, 405, 406, 407, etc. can be displayed in the first sub - page 402. For example, the first configuration item 404 is used to configure the background color of the visual message component. In response to the triggering operation of the second user on the first configuration item 404, multiple sub - configuration items can also be displayed. For example, the multiple sub - configuration items are used to configure the colors of different positions of the visual message component.

[0059] The display methods and configured contents of the first configuration interface, one or more first configuration items, and one or more second configuration items can be set according to requirements, not limited to the examples given. The second user can also configure the style of the first message and / or the visual message component corresponding to the first message. Reference can be made to the foregoing embodiments and will not be elaborated here.

[0060] By configuring the style of one or more candidate reply messages and / or one or more visual message components by the second user, the personalized needs of the second user can be met, enabling the second user to quickly and accurately locate the candidate reply messages, thereby simplifying the operation process and improving the message reply efficiency.

[0061] Since the size of the message display area is limited, especially for terminals with small screen sizes such as mobile phones, in order to more effectively display one or more candidate reply messages, one or more candidate reply messages can be displayed in a thumbnail manner. In some embodiments, displaying each candidate reply message in one or more candidate reply messages in a visual message component includes: for a candidate reply message that exceeds a specific length among one or more candidate reply messages, within the visual message component corresponding to the candidate reply message that exceeds the specific length, displaying the thumbnail information of the candidate reply message that exceeds the specific length; in response to a specific operation of the second user on the visual message component corresponding to the candidate reply message that exceeds the specific length, completely displaying the candidate reply message that exceeds the specific length.

[0062] As Figure 5A shown, a thumbnail information 502 of a candidate reply message is displayed below the first message 501. In response to a specific operation of the second user on the visual message component corresponding to the thumbnail information 502, the complete candidate reply message 503 as Figure 5B shown can be displayed. The display size of the visual message component can be dynamically adjusted according to the length of the candidate reply message. For example, the specific operation can be that the second user hovers the mouse over the visual message component, clicks on the visual message component, etc., not limited to the examples given.

[0063] In the case of fully displaying a candidate response message that exceeds a specific length, in response to another specific operation of a second user on a visual message component corresponding to the candidate response message that exceeds the specific length, thumbnail information of the candidate response message that exceeds the specific length is displayed. For example, the another specific operation may be an operation such as the second user moving the mouse away from the visual message component or clicking on the visual message component, and is not limited to the examples given.

[0064] Candidate response messages that do not exceed the specific length can be fully displayed. In the case of fully displaying a candidate response message of a specific length, the display positions of other messages can be adjusted according to the size of the visual message component of the candidate response message, and the messages do not block each other.

[0065] Through the method of the above embodiments, a candidate response message that exceeds a specific length can be displayed in a thumbnail manner, and the candidate response message can be fully displayed in response to a specific operation of a second user, which can save display space, highlight the key points, avoid information overload, and improve the display effect. In addition, by displaying the candidate response message that exceeds the specific length in a thumbnail manner, the occlusion of other messages is reduced, the reading and operation processes of the user are not interrupted, and the naturalness and immersion of the user experience are improved.

[0066] In some embodiments, each candidate response message among one or more candidate response messages includes information of at least one modality, and the at least one modality includes at least one of text, image, video, audio, table, chart, and information card.

[0067] Each candidate response message can include information of at least one modality. For example, as Figure 6A shown, multiple candidate response messages 602 can be displayed below the first message 601, and the multiple candidate response messages 602 are documents, and the documents can include information of at least one modality. As Figure 6B shown, multiple candidate response messages 603 can be displayed below the first message 601, and the multiple candidate response messages 603 are images. As Figure 6C shown, a candidate response message 604 can be displayed below the first message 601, and the candidate response message 604 is a table. As Figure 6D shown, a candidate response message 605 can be displayed below the first message 601, and the candidate response message 605 is an information card, and the information card can include information of one or more modalities. As Figure 6EAs shown, candidate response messages 606 can be displayed below the first message 601, and the candidate response messages 606 are charts. In addition, the candidate response messages can also be plain text, audio, video, etc., which will not be listed one by one, or can be a combination of any one or more of the above modalities of information. The second user can view the information for each modality. For example, the second user can trigger the enlarged display of an image, the playback of audio, the playback of video, etc.

[0068] The method of the above embodiment supports displaying the information of one or more models as candidate response messages, improving the richness and accuracy of the content of the candidate response messages, meeting the diverse communication needs of users, and enhancing the user experience.

[0069] In some embodiments, at least one modality corresponding to each candidate response message is determined according to the semantic information of the first message and the semantic information of the context of the first message.

[0070] For example, an AI model can be used to semantically understand the first message and the context of the first message to determine which one or more modalities of information are suitable for use in the response, so as to determine at least one modality corresponding to each candidate response message. The first message can also include information of at least one modality, and an AI model can be used to semantically understand the information of at least one modality.

[0071] Determining at least one modality corresponding to each candidate response message according to the semantic understanding of the first message and its context can improve the accuracy of the candidate response messages, meet the diverse needs of users, and enhance the user experience.

[0072] One or more candidate response messages can be determined by an AI model according to the semantic information of the first message, the semantic information of the context of the first message, the historical interaction data of the first user, the historical interaction data of the second user, and the conversation scenario, which can improve the accuracy of the candidate response messages and provide more accurate and demand-compliant response suggestions for the second user. It can be understood that the above solutions are implemented under the full authorization of the user.

[0073] One or more candidate response messages can be displayed for each message sent by the first user. In some embodiments, each message sent by the first user is used as the first message, and in the associated area of the first message in the message display area, displaying one or more candidate response messages generated based on the first message includes: in the message display area, in the associated area of each message sent by the first user, displaying one or more candidate response messages generated based on the message.

[0074] For each message sent by the first user, one or more candidate reply messages are generated based on the message, and one or more candidate reply messages corresponding to the message are displayed in the associated area of the message. This can reduce the probability of missing or misreplying to the messages sent by the first user, and the second user can select candidate reply messages for reply for each message, further improving the reply efficiency and accuracy.

[0075] In some cases, the first user continuously sends multiple messages to form a complete sentence or a complete piece of information, and it may not be necessary to display one or more candidate reply messages for each message. In some embodiments, the first message is the message that needs to be replied to determined from multiple messages according to the semantic information of the multiple messages sent by the first user, and no candidate reply messages are displayed in the associated areas of the other messages other than the first message among the multiple messages.

[0076] For example, an AI model can be used to perform semantic understanding on the multiple messages sent by the first user, automatically identify the message that needs to be replied to, generate one or more candidate reply messages for the message that needs to be replied to, and no candidate reply messages are displayed in the associated areas of the other messages other than the first message among the multiple messages. This can avoid generating invalid candidate reply messages that interfere with the understanding and selection of the second user, enabling the second user to quickly determine the message that needs to be replied to and the candidate reply messages, thereby improving the reply efficiency and accuracy.

[0077] The methods for displaying the first message and one or more candidate reply messages are described in the foregoing various embodiments. The generation and display of one or more candidate reply messages can be based on the configuration and authorization of the second user. For example, in response to the second user fully authorizing and enabling the session intelligent assistance function, when receiving the first message sent by the first user, the first message is displayed in the message display area, and one or more candidate reply messages generated based on the first message are displayed in the associated area of the first message.

[0078] Each candidate reply message includes information in at least one modality. In the case where the information in at least one modality includes information stored locally on the user's device, the collection, use, display, etc. of this information are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of the relevant data need to comply with the relevant laws, regulations, and standards of the relevant countries and regions, and corresponding operation entries are provided for the user to select authorization or rejection. For example, the second user can pre-configure and authorize a specific storage space, and when generating one or more candidate reply messages, information can be obtained from the specific storage space.

[0079] The following describes the related methods for the second user to operate on one or more candidate reply messages.

[0080] The second user can directly select a target reply message from one or more candidate reply messages and send the target reply message as the second message. In some embodiments, according to the target reply message selected by the second user from one or more candidate reply messages, displaying the second message sent by the second user to the first user in the message display area includes: in response to the sending operation of the target reply message by the second user in the message display area, displaying the target reply message sent by the second user to the first user in the message display area as the second message.

[0081] The second user can directly perform a sending operation on the target reply message in the message display area. For example, in the message display area, a sending control is displayed for each candidate reply message. In response to the triggering operation of the sending control of the target reply message by the second user, the target reply message sent by the second user to the first user is displayed in the message display area. For another example, in response to specific operations such as clicking or double-clicking on the target reply message by the second user, the target reply message sent by the second user to the first user is displayed in the message display area, that is, specific operations such as clicking or double-clicking can be used as the sending operation.

[0082] As Figure 7A shown, a plurality of candidate reply messages 702 are displayed below the first message 701, and a sending control 703 is displayed on the right side of each candidate reply message 702. The second user can directly send any one of the candidate reply messages 703 by triggering the sending control 703. If the pointer of the mouse can be displayed in the session interface, when the pointer of the mouse hovers over any sending control 703, a first guiding message 704 "Send directly" can be displayed to prompt the user that they can send the candidate reply message by clicking the sending control.

[0083] For the method of the above embodiments, the second user can directly select and perform a sending operation on the target reply message in the message display area, which is simple and convenient, simplifies the operation process, and improves the operation efficiency and reply efficiency.

[0084] The second user can also edit the target reply message after selection and send the edited target reply message as the second message. In some embodiments, according to the target reply message selected by the second user from one or more candidate reply messages, displaying the second message sent by the second user to the first user in the message display area includes: in response to the editing operation of the target reply message by the second user, displaying the edited target reply message; in response to the sending operation of the edited target reply message by the second user, displaying the edited target reply message sent by the second user to the first user in the message display area as the second message.

[0085] If the second user makes simple modifications, additions, or deletions to the target reply message, the second user can perform an editing operation on the target reply message. The second user can select any candidate reply message as the target reply message, and editing operations are supported. Through simple editing operations, the second user can make the target reply message more in line with the needs of the second user, improving the accuracy and flexibility of the reply.

[0086] The second user can edit the target reply message in different ways. In some embodiments, in response to the second user's editing operation on the target reply message, displaying the edited target reply message includes: in response to the second user's selection operation on the target reply message in the message display area, displaying the target reply message in the input area; in response to the second user's editing operation on the target reply message in the input area, displaying the edited target reply message in the input area.

[0087] The second user can trigger the display of the target reply message in the input area, and then perform an editing operation on the target reply message in the input area. As Figure 7B shown, a candidate reply message 702 is displayed below the first message 701. The second user can copy the target reply message to the input area for display by clicking, double-clicking, or other selection operations. If the mouse pointer can be displayed in the conversation interface, when the mouse pointer hovers over the candidate reply message 702, the second guiding information 705 "Click to copy to the input box" can be displayed to prompt the user that they can copy the target reply message to the input area by clicking. Of course, after copying the target reply message to the input area, the second user can also directly send the target reply message. For example, when the target reply message is text, the second user can directly modify the text in the input box.

[0088] In the above embodiments, through the linkage between the message display area and the input area, the display of the target reply message in different areas can be realized, thereby facilitating the editing operation of the second user and improving the accuracy and flexibility of the reply.

[0089] In some embodiments, in response to the second user's editing operation on the target reply message, displaying the edited target reply message includes: in the message display area, displaying an editing control for each of one or more candidate reply messages; in response to the second user's triggering of the editing control corresponding to the target reply message, displaying an editing interface; in response to the second user's editing operation on the target reply message in the editing interface, displaying the edited target reply message in the editing interface.

[0090] As Figure 6AAs shown, an editing control 607 can be displayed for each candidate reply message. After the second user triggers the editing control 607, an editing interface can be displayed. The second user can perform editing operations on the target reply message in the editing interface. For example, when the candidate reply message is a document, the content of the document can be displayed in the editing interface, and the second user can perform editing operations on the content of the document in the editing interface.

[0091] As Figure 6B shown, multiple candidate reply messages can be multiple images, and an editing control 608 can be displayed for performing editing operations on the images. In response to the triggering operation of the second user on the editing control 608, an editing interface can be displayed. Multiple images can be displayed in the editing interface. The second user can select a target image from the multiple images and then edit the target image. For example, edit the size, resolution, color, effect, etc. of the target image. It is also possible to respond to the selection operation of the second user on the target image among the multiple images, and then trigger the editing control to display the editing interface of the target image, and the size, resolution, color, effect, etc. of the target image can be edited in the editing interface. The selection and editing operations on the target image among the multiple images are not limited to the examples given above.

[0092] When the target reply message includes text, an input box can be displayed in the editing interface, and the text is displayed in the input box. The second user can edit the text in the input box.

[0093] When the target reply message includes audio, one or more editing items corresponding to the audio can be displayed in the editing interface. The second user can edit the volume, length, sound effect, etc. of the audio.

[0094] When the target reply message includes a table, a table in the editing state can be displayed in the editing interface. The second user can edit the data in the table.

[0095] When the target reply message includes a chart, a chart in the editing state can be displayed in the editing interface. The second user can edit the data for generating the chart and trigger the regeneration of the chart.

[0096] When the target reply message includes an information card, the information card can be displayed in the editing interface. The second user can edit the content in the information card.

[0097] In the case where the target reply message includes information of multiple modalities, in response to an editing operation of the second user on the information of at least one modality in the target reply message, the edited target reply message is displayed. For example, in the editing interface, information of multiple modalities can be displayed, and for the information of each modality, a sub-editing control can be displayed. In response to a triggering operation of the second user on the sub-editing control of the information of the target modality, a sub-editing interface of the information of the target modality can be displayed, and the second user can edit the information of the target modality in the sub-editing control.

[0098] In the method of the above embodiment, the second user can flexibly edit the target reply message based on requirements, use the personalized expression mode of the second user, and improve the accuracy and flexibility of the reply.

[0099] The second user can also perform other operations on the target reply message. In some embodiments, according to the target reply message selected by the second user from one or more candidate reply messages, the second message sent by the second user to the first user displayed in the message display area includes: in response to the operation of the second user triggering the regeneration of the target reply message, the regenerated target reply message is displayed; in response to the sending operation of the second user on the regenerated target reply message, the regenerated target reply message sent by the second user to the first user is displayed in the message display area as the second message.

[0100] If the second user is not satisfied with one or more candidate reply messages, the regeneration of any one candidate reply message or all candidate reply messages can be triggered. As Figure 7C shown, an update control 706 can be displayed on the right side of the candidate reply message 702. In response to the triggering operation of the second user on the update control 706, the candidate reply message 702 can be regenerated. An update control can also be displayed for multiple candidate reply messages. In response to the triggering operation of the second user on the update control, multiple candidate reply messages can be regenerated.

[0101] In the above embodiment, the second user can trigger the regeneration of the candidate reply message, the operation is convenient, the efficiency of regenerating the candidate reply message is improved, the candidate reply message is more matched with the needs of the second user, and the accuracy of the reply is improved.

[0102] The second user can also upload information to replace the information in the target reply message. As Figure 6A shown, an upload control 609 can also be displayed for each candidate reply message. In response to the second user triggering the upload control 609, a plurality of optional files are displayed. In response to the selection operation of the second user on any file, the selected file is used to replace the file in the target reply message.

[0103] As Figure 6BAs shown, a replacement control 611 is displayed. In response to the second user triggering the replacement control 611, multiple selectable images are displayed. In response to the second user's selection operation on any image, the selected image is used to replace one or more currently displayed images. The second user can also first select a target image from the multiple currently displayed images and then trigger the replacement control 611. Then, in response to the second user's selection operation on any image among the multiple selectable images, the selected image is used to replace the target image.

[0104] The second user can also delete information in the target reply message. As Figure 6A shown, a deletion control 610 can also be displayed for information of one or more modalities in each candidate reply message. In response to the second user triggering the deletion control 610 for information of any modality, the information can be deleted.

[0105] The second user can perform various forms of operations and adjustments on one or more candidate reply messages or the target reply message to better match the needs of the second user and improve the accuracy of the reply.

[0106] To make one or more reply messages more compatible with the user's expression style, the language style of one or more candidate reply messages is variable. In some embodiments, one or more candidate reply messages are expressed in a target language style, and the target language style is determined based on at least one of the conversation scenario between the first user and the second user and the configuration of the second user.

[0107] For example, an AI model can be used to determine the conversation scenario based on the conversation information between the first user and the second user, and then determine the target language style based on the conversation scenario. For example, if the conversation scenario between the first user and the second user is a friend chat, the target language style can be a relaxed style. For example, if the conversation scenario between the first user and the second user is a user consulting a customer service, the target language style can be a professional style. The second user can also configure the target language style. The language style can represent the reply style, reply mode, etc. corresponding to the candidate reply message.

[0108] Adjusting the language style of one or more candidate reply messages according to at least one of different conversation scenarios and the configuration of the second user can make the generated candidate reply messages more in line with the expression style of the second user, more compatible with different conversation scenarios, improve the accuracy of the reply, and meet the personalized needs of the second user.

[0109] In some embodiments, in response to a triggering operation of a second user on a second configuration entry, a second configuration interface is displayed, wherein the second configuration interface includes configuration items of the current session, and the current session is a session between a first user and the second user; in response to a triggering operation of the second user on the configuration items of the current session, one or more language styles are displayed; in response to the selection of a target language style by the second user from the one or more language styles, the correspondence between the current session and the target language style is determined.

[0110] The second user can configure the language style of the current session so that the second user's reply to the first user better meets the needs of the second user. Similarly, the second user can also configure the language style of any session, which facilitates the second user to reply to different session objects in different language styles, better meets the needs of the second user, and improves the accuracy of the reply.

[0111] In some embodiments, in response to a triggering operation of a second user on a second configuration entry, a second configuration interface is displayed, wherein the second configuration interface includes configuration items of all sessions, and all sessions are sessions between the second user and all users other than the second user; in response to a triggering operation of the second user on the configuration items of all sessions, one or more language styles are displayed; in response to the selection of a target language style by the second user from the one or more language styles, the correspondence between all sessions and the target language style is determined.

[0112] The second user can configure the language style of all sessions, and by configuring the language style of all sessions at one time, the configuration efficiency is improved.

[0113] As Figure 8 shown, a control 801 of the second configuration entry can be displayed in the input area. In response to a triggering operation of the second user on the control 801 of the second configuration entry, a second configuration interface is displayed. The second configuration interface includes configuration items 802 of the current session and configuration items 803 of all sessions. In response to a triggering operation of the second user on the configuration items 802 of the current session or the configuration items 803 of all sessions, one or more language styles can be displayed. The second configuration entry can be displayed at other positions, not limited to the examples given. The types of the one or more language styles are also not limited to the examples given.

[0114] The present disclosure also provides an interaction device, which will be described below in conjunction with Figure 9 this.

[0115] Figure 9 This is a structural diagram of some embodiments of the interaction device of the present disclosure. As Figure 9 shown, the interaction device 90 of this embodiment includes: a first display module 910, a second display module 920, and a third display module 930.

[0116] The first display module 910 is configured to display a first message in a message display area of a session interface between a second user and the first user in response to receiving the first message sent by the first user. The session interface includes a message display area and an input area. The message display area is used to display messages sent by the first user and the second user, and the input area is used to receive and display messages input by the second user.

[0117] The second display module 920 is configured to display one or more candidate reply messages generated based on the first message in an associated area of the first message in the message display area.

[0118] The third display module 930 is configured to display a second message sent by the second user to the first user in the message display area according to the target reply message selected by the second user from one or more candidate reply messages, where the second message is determined according to the target reply message.

[0119] The interaction device in the above embodiment, in response to receiving the first message sent by the first user, not only displays the first message in the session interface between the second user and the first user, but also displays one or more candidate reply messages automatically generated based on the first message in real time in the associated area of the first message. In response to the second user selecting a target reply message from one or more candidate reply messages, a second message is generated based on the target reply message and sent to the first user. The second user can perform simple operations such as selecting on the automatically generated candidate reply messages to send the second message, which simplifies the operation of the second user and improves the reply efficiency. In addition, the session interface includes a message display area and an input area. One or more candidate reply messages are displayed in the associated area of the first message in the message display area, and candidate reply messages can be displayed for multiple messages simultaneously, enabling the second user to quickly and accurately locate one or more candidate reply messages corresponding to the first message. Especially when the first user sends multiple messages, the second user can also quickly and accurately identify one or more candidate reply messages corresponding to the first message, further improving the efficiency and accuracy of the reply.

[0120] In addition, since the display method of the message display area is more flexible, supporting switching display based on the user's sliding operation, more content can be displayed, and one or more candidate reply messages can be displayed for each of multiple messages. Compared with the solution where only one or more candidate reply messages can be displayed for one message in the input area, the efficiency and accuracy of the reply are further improved.

[0121] In some embodiments, the second display module 930 is configured to display, in a message display area, the first message and one or more candidate reply messages as a single message body, where the display area of the message body includes the associated area of the first message; or to display, in the message display area, each of the first message and one or more candidate reply messages as a separate message body, where the associated area of the first message includes the display areas of one or more message bodies corresponding to the one or more candidate reply messages.

[0122] In some embodiments, the second display module 930 is configured to display each of one or more candidate reply messages in a visual message component within the associated area of the first message in the message display area, and to display the one or more visual message components corresponding to the one or more candidate reply messages and the one or more candidate reply messages in a target style, where the target style is determined based on the semantic information of the first message or is determined based on the configuration of the second user.

[0123] In some embodiments, the second display module 930 is configured to display a first configuration interface in response to a trigger operation of the second user on the first configuration entry, where the first configuration interface includes one or more first configuration items corresponding to one or more visual message components and one or more second configuration items corresponding to one or more candidate reply messages; and to display the one or more visual message components corresponding to the one or more candidate reply messages and the one or more candidate reply messages in a target style in response to a configuration operation of the second user on the one or more first configuration items and / or the one or more second configuration items.

[0124] In some embodiments, the second display module 930 is configured to, for a candidate reply message among one or more candidate reply messages that exceeds a specific length, display thumbnail information of the candidate reply message that exceeds the specific length within the visual message component corresponding to the candidate reply message that exceeds the specific length; and to completely display the candidate reply message that exceeds the specific length in response to a specific operation of the second user on the visual message component corresponding to the candidate reply message that exceeds the specific length.

[0125] In some embodiments, each of one or more candidate reply messages includes information of at least one modality, and the at least one modality includes at least one of text, image, video, audio, table, chart, and information card.

[0126] In some embodiments, the at least one modality corresponding to each candidate reply message is determined based on the semantic information of the first message and the semantic information of the context of the first message.

[0127] In some embodiments, each message sent by the first user is regarded as a first message, and the second display module 930 is configured to display one or more candidate reply messages generated based on the message in the associated area of each message sent by the first user in the message display area.

[0128] In some embodiments, the first message is a message that needs to be replied to determined from multiple messages according to the semantic information of the multiple messages sent by the first user, and no candidate reply messages are displayed in the associated areas of the other messages other than the first message among the multiple messages.

[0129] In some embodiments, the third display module 930 is configured to, in response to the sending operation of the second user on the target reply message in the message display area, display the target reply message sent by the second user to the first user in the message display area as a second message.

[0130] In some embodiments, the third display module 930 is configured to, in response to the editing operation of the second user on the target reply message, display the edited target reply message; in response to the sending operation of the second user on the edited target reply message, display the edited target reply message sent by the second user to the first user in the message display area as a second message.

[0131] In some embodiments, the third display module 930 is configured to, in response to the selection operation of the second user on the target reply message in the message display area, display the target reply message in the input area; in response to the editing operation of the second user on the target reply message in the input area, display the edited target reply message in the input area.

[0132] In some embodiments, the third display module 930 is configured to display an editing control for each candidate reply message among one or more candidate reply messages in the message display area; in response to the triggering of the editing control corresponding to the target reply message by the second user, display an editing interface; in response to the editing operation of the second user on the target reply message in the editing interface, display the edited target reply message in the editing interface.

[0133] In some embodiments, the third display module 930 is configured to, in response to the operation of the second user triggering the regeneration of the target reply message, display the regenerated target reply message; in response to the sending operation of the second user on the regenerated target reply message, display the regenerated target reply message sent by the second user to the first user in the message display area as a second message.

[0134] In some embodiments, one or more candidate reply messages are expressed in a target language style, and the target language style is determined based on at least one of the conversation scenario between the first user and the second user and the configuration of the second user.

[0135] In some embodiments, the interaction device further includes: a fourth display module 940, configured to display a second configuration interface in response to a triggering operation of a second user on a second configuration entry, where the second configuration interface includes configuration items of a current session, and the current session is a session between a first user and the second user; display one or more language styles in response to a triggering operation of the second user on the configuration items of the current session; and determine a correspondence between the current session and a target language style in response to a selection of the target language style by the second user from the one or more language styles.

[0136] In some embodiments, the fourth display module 940 is further configured to display a second configuration interface in response to a triggering operation of the second user on the second configuration entry, where the second configuration interface includes configuration items of all sessions, and all sessions are sessions between the second user and all users other than the second user; display one or more language styles in response to a triggering operation of the second user on the configuration items of all sessions; and determine a correspondence between all sessions and a target language style in response to a selection of the target language style by the second user from the one or more language styles.

[0137] The interaction device of the present disclosure can execute the interaction method in any of the foregoing embodiments to achieve the same or similar technical effects, which will not be elaborated herein.

[0138] The present disclosure also provides an electronic device. In some embodiments, the electronic device of the present disclosure includes: a processor; and a memory coupled to the processor for storing instructions, which, when executed by the processor, cause the processor to execute the interaction method in any of the embodiments as described above.

[0139] The electronic device of the present disclosure, in response to receiving a first message sent by a first user, not only displays the first message in a session interface between the second user and the first user, but also displays one or more candidate reply messages automatically generated based on the first message in a related area of the first message in real time. In response to the second user selecting a target reply message from the one or more candidate reply messages, a second message is generated based on the target reply message and sent to the first user. The second user can perform simple operations such as selecting the automatically generated candidate reply message to send the second message, which simplifies the operation of the second user and improves the reply efficiency. In addition, the session interface includes a message display area and an input area, and the one or more candidate reply messages are displayed in the related area of the first message in the message display area, so that the candidate reply messages recommended for multiple messages can be displayed simultaneously, enabling the second user to quickly and accurately locate the one or more candidate reply messages corresponding to the first message. Especially when the first user sends multiple messages, the second user can also quickly and accurately identify the one or more candidate reply messages corresponding to the first message, further improving the efficiency and accuracy of the reply.

[0140] In addition, since the display mode of the message display area is more flexible, it supports switching displays based on the user's sliding operation, can display more content, and can display one or more candidate reply messages for each of multiple messages. Compared with the solution where only one or more candidate reply messages can be displayed for one message in the input area, the efficiency and accuracy of the reply are further improved.

[0141] Figure 10 A block diagram of an electronic device according to some embodiments of the present disclosure is shown.

[0142] The memory 101 is used to store one or more computer-readable instructions. The memory 101 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory, including but not limited to random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), and flash memory. The memory 101 may store, for example, an operating system, application programs, a boot loader (BootLoader), a database, and other programs, and may also store various application programs and various data.

[0143] The processor 102 is used to run the computer-readable instructions to implement the interaction method described in any of the foregoing embodiments. For the specific implementation of each step of the interaction method, reference may be made to the above embodiments, and the repeated parts will not be elaborated here.

[0144] The processor 102 may be embodied as various processing devices, such as a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The central processing unit (CPU) may be of the X86 or ARM architecture, etc.

[0145] The processor 102 and the memory 101 may communicate with each other directly or indirectly. For example, the processor 102 and the memory 101 may communicate through a network. The network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network. The processor 102 and the memory 101 may also communicate with each other through a system bus, and the present disclosure does not limit this.

[0146] It should be noted that Figure 10 The components of the electronic device 10 shown are exemplary and not restrictive. According to actual application needs, the electronic device 10 may also have other components. The processor 102 may control other components in the electronic device 10 to perform desired functions.

[0147] The electronic device 10 can be implemented in software, firmware, and / or hardware, and can be integrated into a device installed with relevant application programs.

[0148] Figure 11 The block diagram of an electronic device according to some other embodiments of the present disclosure is shown.

[0149] Figure 11 The illustrated electronic device 11 can be a computer system with a dedicated hardware structure, and can execute corresponding functions when installed with relevant application programs.

[0150] The electronic device includes but is not limited to mobile terminals such as smart phones, laptop computers, personal digital assistants (PDAs), tablet personal computers (Tablet PCs), portable multimedia players (PMPs), in-vehicle terminals (such as in-vehicle navigation terminals), wearable devices, etc., and fixed terminals such as digital TVs, desktop computers, etc.

[0151] As Figure 11 shown, the central processing unit (CPU) 111 executes various processes according to the program stored in the read-only memory (ROM) 112 or the program loaded from the storage section 118 into the random access memory (RAM) 113. In the RAM 113, data required when the CPU 111 executes various processes, etc., is stored as needed. The central processing unit is merely exemplary, and it can also be other types of processors, such as the various processors described above. The ROM 112, RAM 113, and storage section 118 can be various forms of computer-readable storage media. It should be noted that although Figure 11 the ROM 112, RAM 113, and storage section 118 are shown separately, one or more of them can be combined, or located in the same or different memories or storage modules.

[0152] The CPU 111, ROM 112, and RAM 113 are connected to each other via a bus 114. The input / output interface 115 is also connected to the bus 114.

[0153] The following components are connected to the input / output interface 115: an input section 116 such as a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output section 117 including a display such as a cathode ray tube (CRT), a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage section 118 including a hard disk, a magnetic tape, etc.; and a communication section 119 including a network interface card such as a LAN card, a modem, etc. The communication section 119 allows communication processing to be performed via a network such as the Internet. It is easily understood that although Figure 11 the components shown in [0000356] communicate with each other through the bus 114, they may also communicate through a network or other means, where the network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network.

[0154] As needed, a drive 1110 is also connected to the input / output interface 115. A removable medium 1111 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is installed on the drive 1110 as needed, so that a computer program read therefrom is installed in the storage section 118 as needed.

[0155] In the case where the above-described series of processes are implemented by software, a program constituting the software can be installed from a network such as the Internet or a storage medium such as the removable medium 1111.

[0156] According to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product that, when run on a computer, causes the computer to implement the method described in any of the foregoing embodiments. The computer program product includes computer instructions carried on a computer-readable medium and includes program code for performing the method shown in the flowchart. In such an embodiment, the computer instructions can be downloaded and installed from a network via the communication section 119, or installed from the storage section 118, or installed from the ROM 112. When the computer program is executed by the CPU 111, the method of the embodiment of the present disclosure is executed.

[0157] According to some embodiments of the present disclosure, there is provided a computer-readable storage medium having a computer program stored thereon, and when the program is executed by a processor, the processor is caused to execute the interaction method described in any of the embodiments of the present disclosure.

[0158] The computer-readable storage medium of the present disclosure, in response to receiving a first message sent by a first user, not only displays the first message in the conversation interface between the second user and the first user, but also displays one or more candidate reply messages automatically generated based on the first message in the associated area of the first message in real time. In response to the second user selecting a target reply message from the one or more candidate reply messages, a second message is generated based on the target reply message and sent to the first user. The second user can perform simple operations such as selecting the automatically generated candidate reply messages to send the second message, which simplifies the operation of the second user and improves the reply efficiency. In addition, the conversation interface includes a message display area and an input area. The one or more candidate reply messages are displayed in the associated area of the first message in the message display area, and the candidate reply messages can be displayed for multiple messages at the same time, enabling the second user to quickly and accurately locate the one or more candidate reply messages corresponding to the first message. Especially when the first user sends multiple messages, the second user can also quickly and accurately identify the one or more candidate reply messages corresponding to the first message, further improving the efficiency and accuracy of the reply.

[0159] In addition, since the display method of the message display area is more flexible, it supports switching display based on the user's sliding operation, can display more content, and can display one or more candidate reply messages for each of the multiple messages. Compared with the solution where only one or more candidate reply messages can be displayed for one message in the input area, the efficiency and accuracy of the reply are further improved.

[0160] It should be noted that in the context of the present disclosure, a computer-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.

[0161] A computer-readable medium can be a computer-readable storage medium, or a computer-readable signal medium, or any combination of the above two.

[0162] Computer-readable storage media include, but are not limited to: electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any combination of the foregoing. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In the present disclosure, a computer-readable storage media can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. Computer instructions are stored on the computer-readable storage media, and when executed by a processor, implement the method described in any of the foregoing embodiments.

[0163] A computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted with any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

[0164] The foregoing computer-readable media can be included in the aforementioned electronic device; or can exist separately without being assembled into the electronic device.

[0165] In some embodiments, a computer program is also provided, including: instructions that, when executed by a processor, cause the processor to execute the interaction method of any of the foregoing embodiments. For example, the instructions can be embodied as computer program code.

[0166] In embodiments of the present disclosure, computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The above-mentioned programming languages include, but are not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partially on the user's computer, execute as a stand-alone software package, execute partially on the user's computer and partially on a remote computer, or execute entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (for example, by connecting through the Internet using an Internet service provider).

[0167] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the block may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0168] The functions described above may be performed, at least in part, by one or more hardware logic components. For example, by way of non-limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGA), application specific integrated circuits (ASIC), application specific standard products (ASSP), system on a chip (SOC), complex programmable logic devices (CPLD), and so on.

[0169] Although some specific embodiments of the present disclosure have been described in detail by way of examples, those skilled in the art should understand that the above examples are for illustrative purposes only and not for limiting the scope of the present disclosure. Those skilled in the art should understand that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. An interaction method, comprising: In response to receiving a first message sent by a first user, displaying the first message in a message display area of a session interface between a second user and the first user, wherein the session interface includes the message display area and an input area, the message display area is used to display messages sent by the first user and the second user, and the input area is used to receive and display messages input by the second user; Displaying one or more candidate reply messages generated based on the first message in an associated area of the first message in the message display area; According to a target reply message selected by the second user from the one or more candidate reply messages, displaying a second message sent by the second user to the first user in the message display area, wherein the second message is determined according to the target reply message.

2. The interactive method according to claim 1, wherein, The displaying one or more candidate reply messages generated based on the first message in an associated area of the first message in the message display area includes: In the message display area, displaying the first message and the one or more candidate reply messages as a message body, wherein the display area of the message body includes the associated area of the first message; or In the message display area, displaying each of the first message and the one or more candidate reply messages as a message body, wherein the associated area of the first message includes the display areas of one or more message bodies corresponding to the one or more candidate reply messages.

3. The interaction method according to claim 1, wherein, The displaying one or more candidate reply messages generated based on the first message in an associated area of the first message in the message display area includes: In the associated area of the first message in the message display area, displaying each candidate reply message in the one or more candidate reply messages in a visual message component, and displaying the one or more visual message components corresponding to the one or more candidate reply messages and the one or more candidate reply messages in a target style, wherein the target style is determined based on the semantic information of the first message, or the target style is determined based on the configuration of the second user.

4. The interaction method according to claim 3, wherein, The displaying the one or more visual message components corresponding to the one or more candidate reply messages and the one or more candidate reply messages in a target style includes: In response to a trigger operation of the second user on a first configuration entry, displaying a first configuration interface, wherein the first configuration interface includes one or more first configuration items corresponding to the one or more visual message components and one or more second configuration items corresponding to the one or more candidate reply messages; In response to a configuration operation of the second user on the one or more first configuration items and / or the one or more second configuration items, displaying the one or more visual message components corresponding to the one or more candidate reply messages and the one or more candidate reply messages in a target style.

5. The interaction method according to claim 3, wherein, Said displaying each candidate reply message among the one or more candidate reply messages in a visual message component includes: For a candidate reply message among the one or more candidate reply messages that exceeds a specific length, within the visual message component corresponding to the candidate reply message that exceeds the specific length, display thumbnail information of the candidate reply message that exceeds the specific length; In response to a specific operation by the second user on the visual message component corresponding to the candidate reply message that exceeds the specific length, fully display the candidate reply message that exceeds the specific length.

6. The interactive method according to claim 1, wherein Each candidate reply message among the one or more candidate reply messages includes information of at least one modality, and the at least one modality includes at least one of text, image, video, audio, table, chart, and information card.

7. The interaction method according to claim 6, wherein, The at least one modality corresponding to each candidate reply message is determined according to the semantic information of the first message and the semantic information of the context of the first message.

8. The interactive method according to claim 1, wherein, Each message sent by the first user is used as the first message. Displaying one or more candidate reply messages generated based on the first message within the associated area of the first message in the message display area includes: In the message display area, within the associated area of each message sent by the first user, display one or more candidate reply messages generated based on the message.

9. The interactive method according to claim 1, wherein The first message is the message to be replied to determined from the multiple messages sent by the first user according to the semantic information of the multiple messages. No candidate reply messages are displayed within the associated areas of the other messages other than the first message among the multiple messages.

10. The interaction method according to any one of claims 1-9, wherein, Said displaying the second message sent by the second user to the first user in the message display area according to the target reply message selected by the second user among the one or more candidate reply messages includes: In response to the sending operation of the target reply message by the second user in the message display area, display the target reply message sent by the second user to the first user in the message display area as the second message.

11. The interaction method according to any one of claims 1-9, wherein, Said displaying the second message sent by the second user to the first user in the message display area according to the target reply message selected by the second user among the one or more candidate reply messages includes: In response to the editing operation of the second user on the target reply message, display the edited target reply message; In response to the sending operation of the edited target reply message by the second user, display the edited target reply message sent by the second user to the first user in the message display area as the second message.

12. The interaction method according to claim 11, wherein, Said in response to the editing operation of the second user on the target reply message, displaying the edited target reply message includes: In response to the selection operation of the target reply message by the second user in the message display area, display the target reply message in the input area; In response to an editing operation of the second user on the target reply message in the input area, display the edited target reply message in the input area.

13. The interaction method according to claim 11, wherein, The displaying the edited target reply message in response to the editing operation of the second user on the target reply message includes: In the message display area, display an editing control for each of the one or more candidate reply messages; In response to the second user triggering the editing control corresponding to the target reply message, display an editing interface; In response to the editing operation of the second user on the target reply message in the editing interface, display the edited target reply message in the editing interface.

14. The interaction method according to any one of claims 1-9, wherein, The displaying the second message sent by the second user to the first user in the message display area according to the target reply message selected by the second user from the one or more candidate reply messages includes: In response to the second user triggering an operation to regenerate the target reply message, display the regenerated target reply message; In response to the second user's sending operation on the regenerated target reply message, display the regenerated target reply message sent by the second user to the first user in the message display area as the second message.

15. The interactive method according to any one of claims 1-9, wherein The one or more candidate reply messages are expressed in a target language style, and the target language style is determined according to at least one of the conversation scenario between the first user and the second user and the configuration of the second user.

16. The interaction method according to claim 15, further comprising: In response to the second user triggering the second configuration entry, display a second configuration interface, where the second configuration interface includes configuration items for the current session, and the current session is the session between the first user and the second user; In response to the second user triggering the configuration item of the current session, display one or more language styles; In response to the second user selecting the target language style from the one or more language styles, determine the corresponding relationship between the current session and the target language style.

17. The interaction method according to claim 15, further comprising: In response to the second user triggering the second configuration entry, display a second configuration interface, where the second configuration interface includes configuration items for all sessions, and the all sessions are the sessions between the second user and all users other than the second user; In response to the second user triggering the configuration item of the all sessions, display one or more language styles; In response to the second user selecting the target language style from the one or more language styles, determine the corresponding relationship between the all sessions and the target language style.

18. An interaction device, comprising: A first display module, configured to display the first message in a message display area of a session interface between a second user and the first user in response to receiving the first message sent by the first user, where the session interface includes the message display area and an input area, the message display area is used to display messages sent by the first user and the second user, and the input area is used to receive and display messages input by the second user; A second display module, configured to display one or more candidate reply messages generated based on the first message in an associated area of the first message in the message display area; A third display module, configured to display a second message sent by the second user to the first user in the message display area according to a target reply message selected by the second user from the one or more candidate reply messages, where the second message is determined according to the target reply message.

19. An electronic device, comprising: A processor; And A memory coupled to the processor for storing instructions, which when executed by the processor cause the processor to execute the interaction method according to any one of claims 1 to 17.

20. A computer-readable storage medium having a computer program stored thereon, wherein, When the program is executed by the processor, it causes the processor to execute the interaction method according to any one of claims 1 to 17.

Images