Method, device, equipment, storage medium and product for interface interaction

Abstract

A user interface interaction method, apparatus, device, storage medium, and product are provided. The proposed method includes: presenting a first message on a first interface, the first interface corresponding to a first interaction mode of a first object, the first interaction mode including message-based dialogue interaction; responding to receiving a first operation, presenting a second interface, the second interface corresponding to a second interaction mode of the first object, the second interaction mode including call interaction; and presenting at least a portion of the first message on the second interface. This approach improves the continuity and convenience of interaction and effectively reduces the waste of computing resources.

Description

Technical Field

[0001] The examples in this article generally relate to the field of computer science, and in particular to methods, apparatuses, devices, computer-readable storage media, and products for user interface interaction. Background Technology

[0002] With the development of computer technology and continuous breakthroughs in the field of artificial intelligence, various models have emerged. Users can communicate continuously and fluently with these models through conversational text, completing various tasks such as information inquiry, logical thinking, and content interpretation without using complex commands. How to enable better interaction between users and models, and how to provide users with richer content, have become pressing issues that need to be addressed. Summary of the Invention

[0003] In a first aspect, a method for interface interaction is provided. The method includes: presenting a first message on a first interface, the first interface corresponding to a first interaction mode of a first object, the first interaction mode including message-based dialogue interaction; in response to receiving a first operation, presenting a second interface, the second interface corresponding to a second interaction mode of the first object, the second interaction mode including call interaction; and presenting at least a portion of the first message on the second interface.

[0004] In a second aspect, an apparatus for interface interaction is provided. The apparatus includes: a first presentation module configured to present a first message on a first interface, the first interface corresponding to a first interaction mode of a first object, the first interaction mode including message-based dialogue interaction; a second presentation module configured to present a second interface in response to receiving a first operation, the second interface corresponding to a second interaction mode of the first object, the second interaction mode including call interaction; and a third presentation module configured to present at least a portion of the first message on the second interface.

[0005] In a third aspect, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0007] In a fifth aspect, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0008] In this way, the example in this paper can present the first message related to the first interaction mode in the second interface corresponding to the second interaction mode. This allows users to view messages corresponding to different interaction modes when the first object is in different interaction modes, thus avoiding information inconsistencies caused by changes in interaction modes and improving the continuity and convenience of interaction. Furthermore, the example in this paper can still present messages corresponding to the interaction mode before the switch when switching interaction modes, achieving message synchronization across interaction modes and effectively reducing the waste of computing resources.

[0009] It should be understood that the content described in this section is not intended to limit the key or important features of the examples in this article, nor is it intended to restrict the scope of the solution. Other features will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of the example environment is shown; Figures 2A to 2L Example interfaces for some scenarios are shown; Figure 3 The flowcharts show example processes of interface interactions in some scenarios; Figure 4 Schematic block diagrams of example devices for interface interaction in some scenarios are shown; and Figure 5 A block diagram of an electronic device capable of implementing multiple illustrative scenarios is shown. Detailed Implementation

[0011] The examples in this document will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.

[0012] It should be noted that the headings of any section / subsection provided herein are not restrictive. Various examples are described throughout this document, and examples of any type may be included under any section / subsection. Furthermore, examples described in any section / subsection may be combined in any way with any other examples described in the same section / subsection and / or different sections / subsections.

[0013] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0014] The examples in this document may involve user data, data acquisition, and / or use. All of these aspects comply with relevant laws, regulations, and rules. In the examples, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.

[0015] In this manual and the sample solutions, any processing of personal information will be conducted only under legal grounds (such as obtaining the consent of the data subject or being necessary for the performance of a contract) and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.

[0016] As mentioned above, with the development of computer technology and continuous breakthroughs in the field of artificial intelligence, various models have emerged. Users can communicate continuously and fluently with these models through conversational text, completing various tasks such as information inquiry, logical thinking, and content interpretation without using complex commands. How to enable better interaction between users and models, and how to provide users with richer content, have become pressing issues that need to be addressed.

[0017] A user interface interaction scheme is proposed. The scheme includes: presenting a first message on a first interface, the first interface corresponding to a first interaction mode of a first object, the first interaction mode including message-based dialogue interaction; in response to receiving a first operation, presenting a second interface, the second interface corresponding to a second interaction mode of the first object, the second interaction mode including call interaction; and presenting at least a portion of the first message on the second interface.

[0018] In this way, the example in this paper can present the first message related to the first interaction mode in the second interface corresponding to the second interaction mode. This allows users to view messages corresponding to different interaction modes when the first object is in different interaction modes, thus avoiding information inconsistencies caused by changes in interaction modes and improving the continuity and convenience of interaction. Furthermore, the example in this paper can still present messages corresponding to the interaction mode before the switch when switching interaction modes, achieving message synchronization across interaction modes and effectively reducing the waste of computing resources.

[0019] The following describes various examples of this scheme in further detail with reference to the accompanying drawings.

[0020] Example Environment Figure 1 A schematic diagram of example environment 100 is shown. (e.g.) Figure 1 As shown, example environment 100 may include electronic device 110.

[0021] In this example environment 100, electronic device 110 can run an application 120 that supports user interface interaction. Application 120 can be any suitable type of application for user interface interaction, including but not limited to: content sharing applications, assistant applications, online shopping applications, or other suitable applications. User 140 can interact with application 120 via electronic device 110 and / or its attached devices.

[0022] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.

[0023] In some cases, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some cases, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0024] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.

[0025] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some cases, server 130 and electronic device 110 can exchange signaling information through their communication connection.

[0026] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the scheme.

[0027] The following description of the example will continue with reference to the accompanying drawings.

[0028] Example Interaction Figures 2A to 2L Example interfaces 200A to 200L are shown, illustrating interface interactions under various scenarios. Interfaces 200A to 200L can, for example, be... Figure 1 The electronic device 110 shown is provided.

[0029] In some cases, electronic device 110 presents a first message on a first interface. The first interface corresponds to a first interaction mode of a first object. The first interaction mode includes message-based dialogic interaction. As an example, such as Figure 2AAs shown, electronic device 110 can present a first interface (e.g., interface 200A). The first interface (e.g., interface 200A) can be any suitable interface, such as an interactive interface between a user and a first object. Electronic device 110 can support interaction between the user and the first object (e.g., dialogue interaction, call interaction, etc.) via the first interface (e.g., interface 200A). For example, electronic device 110 can receive user input content via interface 200A and provide the input content to the first object. After the first object generates output content based on the input content, electronic device 110 can present the output content in an appropriate form on interface 200A. The first object can be associated with multiple interaction modes, which can indicate different interaction methods between the user and the first object. For example, interacting with the first object by sending messages (including audio messages, text messages, image messages, video messages, etc.) or by making a call (including video calls, voice calls, etc.).

[0030] The multiple interaction modes associated with the first object may include a first interaction mode, which includes message-based dialogue interaction. Message-based dialogue interaction can indicate that a user can send a message (including text messages, audio messages, image messages, video messages, etc.) to the first object, and the first object can generate a corresponding reply message based on the message sent by the user to provide to the user. The first interaction mode corresponding to the first object on the first interface can indicate that the electronic device 110 can receive messages sent by the user to the first object through the first interface and provide the message to the first object to provide the user with a reply message generated by the first object. For example, the electronic device 110 can present an input component 205 on the interface 200A. The electronic device 110 can receive user input content (e.g., text, audio, images, video, etc.) via the input component 205, send the input content as a message to the first object, and present the message on the interface 200A. After receiving the message sent by the user, the first object can generate a corresponding reply message based on the message. After the reply message is generated, the electronic device 110 can present the reply message on the interface 200A.

[0031] In this paper, the first object refers to an object capable of autonomous control based on a machine learning model. The first object is, for example, a virtual object or physical entity capable of making decisions and autonomously executing actions based on a machine learning model to achieve a preset goal or complete a preset task. The first object can be an automated program that understands the user's intent and can utilize models or invoke tools to complete various types of tasks. In some cases, examples of the first object may include, but are not limited to: agents, bots, chatbots, digital avatars, intelligent customer service, digital assistants, intelligent systems, intelligent components, virtual assistants, etc. Alternatively, the first object can also be an intelligent role implemented based on a machine learning model. The "first object" can process user requests based on generative models (e.g., language models, multimodal models) to perform specified types of tasks. In some cases, the first object may also refer to a virtual account, which may have a corresponding avatar or nickname.

[0032] Electronic device 110 may present first message 210 on a first interface (e.g., interface 200A). First message 210 may include one or more messages sent by the user to a first object (including messages 211 and 212), or it may include a reply message from the first object to the user (including message 213). In some scenarios, first message 210 may only include one or more messages sent by the user to the first object (including messages 211 and 212), or only include a reply message from the first object to the user (including message 213). For ease of description, the following explanation will use the example of first message 210 including messages 211 to 213.

[0033] In some scenarios, the first message in the first interface may correspond to a first display style. The first display style includes a message bubble and / or an avatar associated with the first object. For example, such as... Figure 2A As shown, messages 211 (sent by the user), 212 (sent by the user), and 213 (reply from the first respondent) presented in interface 200A can be displayed in a bubble format, with the sender's avatar displayed next to each message (e.g., to the left or right of the bubble). For example, the user's avatar is displayed next to messages 211 and 212, and the first respondent's avatar is displayed next to message 213, which is a reply from the first respondent. This display style helps users clearly distinguish the message source in the dialogue interaction mode, improving readability.

[0034] In some cases, electronic device 110, in response to receiving a first operation, presents a second interface. The second interface corresponds to a second interaction mode applied to the first object. The second interaction mode includes call interaction. As an example, such as... Figure 2AAs shown, electronic device 110 can receive a first operation via a first interface (e.g., interface 200A). The first operation can be any appropriate operation, such as a voice operation, an interface operation (e.g., a click, a double-click), etc. For example, electronic device 110 can present a call control 220 in interface 200A. Electronic device 110 can receive the first operation via the call control 220. Such a first operation could be, for example, a click on the call control 220. After the call control 220 is clicked, electronic device 110 can trigger the first object to open a second interaction mode. The second interaction mode includes call interaction. The call interaction can instruct electronic device 110 to establish a call link between the user and the first object to support real-time calls (e.g., voice calls, video calls, etc.) between the user and the first object. After the first object opens the second interaction mode, as... Figure 2B As shown, the electronic device 110 can present a second interface (e.g., interface 200B). The second interface can correspond to a second interaction mode of the first object, that is, the second interface can represent an established communication link between the user and the first object.

[0035] In some cases, the electronic device 110 presents at least a portion of the first message on a second interface. For example, such as... Figure 2B As shown, when a second interface (e.g., interface 200B) is presented, the electronic device 110 can present at least a portion of the first message 210 in the second interface (e.g., interface 200B). For example, the electronic device 110 can present message 212 of the first message 210 in interface 200B to indicate that the context information of the first object in the first interaction mode is synchronized to the second interaction mode. As another example, the electronic device 110 can also present message 213 of the first message 210 in interface 200B. In the scenario where the context information of the first interaction mode is synchronized to the second interaction mode, the first object can respond to user input based on the context information of the first interaction mode.

[0036] In some scenarios, the electronic device 110 can present at least a portion of the first message 210 in a second display style on a second interface. The second display style may differ from the first display style. Specifically, the second display style may not include an avatar or message bubbles; that is, at least a portion of the first message 210 may be presented in plain text form on the second interface. For example... Figure 2B As shown, the text content of message 213 presented in interface 200B (e.g., "I searched for the background music of this video, and the background music is song A"). Message 213 may not be wrapped in a speech bubble or accompanied by an avatar, but may be displayed directly in the interface as plain text.

[0037] In other scenarios, electronic device 110 also allows users to view other parts of the first message 210 that are not displayed in the second interface. For example, such as... Figure 2C As shown, the electronic device 110 can display a prompt message 215 on the interface 200C. The prompt message 215 can indicate the interactive operation (e.g., a swipe operation in a preset direction) required to trigger the display of other parts of the first message 210. The prompt message 215 can be presented in any suitable form, such as one or more of graphic elements and text elements. Further, as... Figure 2C and 2D As shown, electronic device 110 can receive user interaction operations (such as a swipe operation in a preset direction) via a second interface (e.g., interface 200C). After receiving the interaction operation, electronic device 110 can present other parts of the first message 210 that were not previously presented in interface 200D. For example, electronic device 110 can present message 211 in interface 200D.

[0038] In some cases, the first message includes the first media content. The electronic device 110 can display the first media content on a second interface. For example, such as... Figure 2A As shown, the first message 210 includes message 212. Message 212 includes first media content (e.g., media content 225). The first media content may include, for example, images, videos, audio, etc. Figure 2D As shown, when the second interface (e.g., interface 200D) is presented, the electronic device 110 can also present the first media content in the first message 210 in the second interface (e.g., interface 200D). For example, the electronic device 110 can present message 212, which includes the first media content (e.g., media content 225), in interface 200D.

[0039] In this way, the example in this paper can present media content in context when the user interacts with the first object during a call, thereby helping the user to better perceive the context and improve the efficiency of the user in obtaining information.

[0040] In some cases, electronic device 110 can receive a second operation. The second operation is related to the first media content. Further, electronic device 110 can play the first media content. For example, such as... Figure 2D As shown, the second interface (e.g., interface 200D) displays the first media content (e.g., media content 225). The electronic device 110 can receive a second operation via interface 200D. This second operation can be a click operation on the media content 225. When the media content 225 is clicked, the electronic device 110 can play the media content 225. While the media content 225 is playing, to better facilitate the user's viewing of the media content 225, such as... Figure 2EAs shown, the electronic device 110 can adjust the display size of the media content 225. Furthermore, the electronic device 110 can also display a set of controls 225-1 related to the media content 225, including a pause control, a progress bar, etc. Users can use the set of controls 225-1 to adjust the progress of the media content 225 or pause its playback.

[0041] In some scenarios, after the media content 225 is clicked, the electronic device 110 can also display a viewing interface for the media content 225, which includes the media content 225. Furthermore, the electronic device 110 can receive a second operation via the viewing interface. Such a second operation could be, for example, clicking a playback control on the viewing interface. When the playback control is clicked, the electronic device 110 can play the media content 225.

[0042] In this way, during the user's interaction with the first object, the example in this article supports playing media content from the first message, thereby providing the user with a better interactive experience.

[0043] In some scenarios, electronic device 110 can adjust the interaction mode of the call interaction in response to the playback of the first media content. For example, after the first media content (e.g., media content 225) is played, electronic device 110 can adjust the interaction mode of the call interaction to a first mode. In the first mode, electronic device 110 can pause the audio output of the first object to allow the user to better view the first media content. In some scenarios, when the call interaction is in the first mode, electronic device 110 can still receive the user's input audio. After receiving the input audio, the first object can also generate a corresponding response based on the input audio. After the response is generated, electronic device 110 may not play the audio corresponding to the response, but instead present the text content corresponding to the response in a second interface. For example, electronic device 110 can present appropriate interface components (e.g., windows, panels, containers, etc.) in the second interface, and present the text content corresponding to the response in such interface components.

[0044] In this way, the example in this paper can adjust the interaction mode of the call while playing media content, so that the playback of media content and the call no longer conflict, thus improving the user's interactive experience.

[0045] In some situations, electronic device 110 may pause call interaction with the first object in response to playing the first media content. As an example, to ensure the playback quality of the first media content, electronic device 110 may pause call interaction with the first object while the first media content is playing. For example, electronic device 110 may pause the call to stop receiving audio input from the user and audio output from the first object. In other situations, electronic device 110 may adjust the input or output mode of the call interaction in response to playing the first media content. As an example, such as... Figure 2E As shown, during the playback of the first media content, the electronic device 110 can adjust the input mode of the call interaction. For example, the electronic device 110 can switch the input mode from free talk mode to keypad talk mode, and display control 226 on the interface 200E. Free talk mode means that the electronic device 110 can receive the user's audio input throughout the call. Keypad talk mode means that the electronic device 110 will only receive the user's audio input when control 226 is triggered during the call. In some scenarios, during the playback of the first media content, the electronic device 110 can also adjust the output mode of the call interaction. For example, the electronic device 110 can use different audio channels to output the audio of the first media content and the output audio from the first object. Furthermore, the electronic device 110 can also reduce the volume of the output audio from the first object to ensure the playback quality of the first media content.

[0046] In this way, the example in this paper can pause the call interaction or adjust the input / output mode of the call interaction during the playback of the first media content, thereby ensuring the playback quality of the first media content.

[0047] In some situations, to ensure call quality between the user and the first object, the electronic device 110 can also mute the first media content. For example, during a call between the user and the first object, the electronic device 110 supports playing the first media content. Specifically, the electronic device 110 can mute the first media content to ensure call continuity between the user and the first object. Here, mute playback can indicate that only the visuals of the first media content are played without outputting audio content. During the mute playback of the first media content, the electronic device 110 can maintain call interaction between the user and the first object. That is, during the mute playback of the first media content, the user can interact with the first object at any time through the call. In some scenarios, during the mute playback of the first media content, the electronic device 110 can also present a first element, which can indicate that the first media content is in a mute playback state. When the first element is triggered (e.g., by a single click or double click), the electronic device 110 can play the audio content of the first media content. Furthermore, the electronic device 110 can also adjust the call volume output mode. For example, the electronic device 110 can reduce the call output volume.

[0048] In this way, the example in this paper can play the first media content silently without interrupting the call. This allows users to obtain the visual information of the first media content in a timely manner, while avoiding the interference of the audio content of the first media content on the call. This provides users with a more flexible and richer media playback format and ensures the call interaction experience.

[0049] In some cases, the first interface displays multiple messages, and the second interface displays a portion of these messages. The portion of the messages includes the first message. For example, the first interface may also display multiple messages, which could be historical messages between the user and the first object. When the second interface is displayed, the electronic device 110 may also display a portion of the multiple messages, including the first message, on the second interface. Such a portion of the messages can satisfy a first filtering condition. That is, only the portion of the multiple messages that meets the first filtering condition will be displayed on the second interface. For example, the multiple messages may correspond to different sending times. When the messages are displayed on the second interface, the electronic device 110 can determine whether the sending time of a portion of the multiple messages is later than a preset time. If the sending time of a portion of the multiple messages is later than the preset time, then the electronic device 110 can display that portion of the multiple messages on the second interface.

[0050] In some cases, before presenting at least a portion of the first message on the second interface, the electronic device 110 may first determine the relevance between the first message and the topic of the current call interaction. Specifically, in response to the relevance of the first message to the topic of the call interaction, the electronic device 110 may present at least a portion of the first message on the second interface.

[0051] As an example, such as Figure 2A As shown, the first message 210 includes a message between the user and the first object regarding "video background music". When the user switches the first object from a first interaction mode (message-based dialogue interaction) to a second interaction mode (call interaction) through a first operation, the electronic device 110 can obtain the topic of the current call interaction. This topic can be determined by semantic analysis of the user's initial input during the call. For example, at the start of the call between the user and the first object, the user asks, "What was the background music in that video?" The first object can identify through semantic analysis that the current call topic involves "video background music". Further, the first object can determine that the content in the first message 210 (e.g., media content 225 in message 212 and the reply about background music in message 213) is associated with the current call topic "video background music", thus determining that at least a portion of the first message is related to the topic of the call interaction. The electronic device 110 can then present at least a portion of the first message 210 (e.g., the text content of message 213) on a second interface (e.g., interface 200B). Conversely, if part of the content of the first message is unrelated to the current call topic (for example, the first message includes information about logistics, while the user asks about background music recognition after switching to the call), the electronic device 110 may not display the logistics-related part of the first message on the second interface to avoid irrelevant information interfering with the user.

[0052] In some scenarios, electronic device 110 can also determine the scope of presentation based on a threshold of relevance to the call content. For example, if the relevance of the first message to the call content is higher than a preset threshold, electronic device 110 can present the complete first message on the second interface. When the relevance of the first message is lower than the threshold, electronic device 110 can present a summary of the first message on the second interface. In this way, the example in this paper can filter and present messages related to the current discussion topic during call interaction, ensuring the continuity of interaction and avoiding interference from irrelevant information to the user interface, thereby further improving the targeting of information display and the efficiency of user interaction.

[0053] In some situations, electronic device 110 may output first content during a call interaction. The first content originates from a first object. The first content is associated with a first message. For example, such as... Figure 2FAs shown, during a call, the first object can proactively generate and output first content based on the first message. Such first content could be, for example, a further explanation or description of a portion of the content in the first message. For instance, the first message 210 includes media content 225 (e.g., video), and the first object has already output a response (e.g., message 213) regarding the background music of the media content 225. During the call, the first object can also access the media content 225 in the first message 210. The first object can use an appropriate method (e.g., image recognition) to identify the screen content of the media content 225 to generate the first content based on the identification result. The first content can then be a further description of the screen content of the media content 225. Furthermore, the electronic device 110 can output audio content related to the first content via the call and / or present a message 230 corresponding to the first content through the interface 200F.

[0054] In some scenarios, during a call interaction, the first content can also be passively output. As an example, the electronic device 110 can also receive user input (including one or more of text, audio, image, and video input). After receiving the input, the electronic device 110 can provide the input to a first object. The first object can perform semantic understanding on the input to determine its semantic information. Further, the first object can match the required portion of content (e.g., media content 225) from the first message 210 based on the semantic information. Further, the first object can generate the first content based on the semantic information and the matched content (e.g., media content 225) to provide the first content to the user via a call or interface 200F. For example, the user's input is "What is this video about?" The first object can then generate first content (including message 230) about the video overview based on the input and media content 225. Such first content could be, for example, "This video describes a travel plan for City A." Further, the electronic device 110 can output the audio content corresponding to the first content via a call and / or present the message 230 corresponding to the first content on the interface 200F.

[0055] In this way, the example in this paper provides first content based on the first message related to the first interaction mode when the first object is in the second interaction mode, thus connecting the interaction information in different modes and improving the content generation quality of the first object.

[0056] In some cases, the first content is generated based on contextual information. This contextual information is associated with a first message. The first and second interaction modes are associated with the same contextual information. For example, associating contextual information with first message 210 may indicate that the contextual information includes first message 210. Associating the first and second interaction modes with the same contextual information indicates that the first object can obtain contextual information about other interaction modes regardless of whether it is in any of these modes. For instance, when the first object is switched to the second interaction mode (call interaction), it can also obtain historical messages (including first message 210) from the first interaction mode (message-based dialogue interaction) to respond to the user's request. For example, the first object can generate the first content based on at least a portion of first message 210 (e.g., messages 212, 213) to provide the first content to the user.

[0057] In some scenarios, to ensure the consistency and coherence of contextual information between the first interaction mode (e.g., message-based dialogue) and the second interaction mode (e.g., voice call), the electronic device 110 can dynamically create an independent session context container (which can be referred to as a "session room") for this interaction session when the user first interacts with the first object (e.g., the user initiates a new service request or inquires about a specific issue). This session room has a globally unique identifier, and its lifecycle is maintained by the electronic device. It persists from the time of its creation until the specific issue or service is explicitly terminated by the user (e.g., the user actively closes the service, the issue is marked as resolved, or a preset idle time limit is exceeded).

[0058] Specifically, when a user enters the first message through the first interface, the electronic device 110 can trigger a determination of whether a session room already exists associated with this interaction. If not, the electronic device 110 can trigger the allocation of a new session room identifier and bind this identifier to the current user, the currently involved first object instance, and the question type label. This binding relationship can be stored in an appropriate persistent storage unit to ensure that the state of the session room can still be restored after the application process is switched or terminated.

[0059] During the duration of the session, all data related to that session (including but not limited to text messages and multimedia messages sent by the user in the first interaction mode), as well as reply messages, structured cards, and operation instructions returned by the first object, can be associated with the session room identifier in real time. This data is organized into an ordered context sequence in chronological order, and the metadata of each piece of data (such as message type, sender, timestamp, etc.) is recorded.

[0060] When a user performs a first action (e.g., clicking a call control on the first interface) to trigger a switch from the first interaction mode to the second interaction mode, the electronic device 110 can, instead of creating a new conversation room, obtain the current conversation room identifier and pass it to the call service component corresponding to the presented second interface. During initialization, the call service component requests the context information associated with that identifier. Based on this, the call service component can load all historical messages generated in the first interaction mode in the background and use these messages as the basis for generating a response from the first object in the second interaction mode. In other words, in the second interaction mode, the first object can be configured to prioritize retrieving and utilizing the accumulated context information within the current conversation room, rather than relying solely on the voice content input by the user at the moment of the current call.

[0061] In this way, the example in this paper connects the interactive information in different modes, so that the first object can obtain sufficient contextual information to respond to the user's request regardless of the interaction mode scenario. This can improve the quality of the content generated by the first object and enhance the interaction effect between the first object and the user.

[0062] In some cases, electronic device 110 can receive a first input. The first input indicates a reference to a first message. Further, electronic device 110 can output first content based on the first input. For example, such as... Figure 2FAs shown, electronic device 110 can receive a first input and present a message 235 corresponding to the first input in interface 200F. The first input here can be, for example, audio input from a user during a call. For example, electronic device 110 can receive audio input from a user during a call. Further, electronic device 110 can trigger a first object to transcribe the audio input to obtain text content corresponding to the audio input, and present the text content as message 235 in interface 200F. After receiving the first input, the first object can determine the semantic information corresponding to the first input through semantic analysis. Further, the first object can determine, based on the semantic information, that the first input refers to or is a part of the first message 210, thus determining that the first input references the first message 210. For example, if the first input is "What does this video tell us?", the first object can determine that the first input refers to the media content 225 in the first message 210, thus determining that the first input references the first message 210. After determining that the first input references the first message 210, the first object can generate first content based on the first input. For example, the first object can determine, based on the semantic information of the first input, that a recognition task needs to be performed. The first object can identify the image of the media content 225 to obtain an identification result. Further, the first object can generate first content based on the identification result and the first input. The first content could be, for example, "a video describing a travel plan for City A." After obtaining the first content, the electronic device 110 can output the audio content corresponding to the first content via a call and / or present the message 230 corresponding to the first content via the interface 200F.

[0063] In some scenarios, the first input may also include a reference to the first message 210. For example, when the first message 210 is long-pressed, the electronic device 110 may display a reference control. After the reference control is clicked, the electronic device 110 may send a notification to the first object to inform it that the first message 210 has been referenced.

[0064] In this way, the examples in this paper allow users to reference a first message related to a first interaction mode in order to output first content based on the first input, thereby improving the output quality of the first content.

[0065] In some cases, the electronic device 110 may present a second message and an indicator element on a second interface. The indicator element represents a reference from the first message to the second message. For example, such as... Figure 2GAs shown, taking voice input as the first input as an example, upon receiving the first input, the first object can transcribe the first input to obtain the text content corresponding to the first input. The first object can also determine the reference content of the first message based on the first input. Further, the electronic device 110 can acquire the text content and reference content corresponding to the first input, and perform screen rendering based on the above data to present the second message (e.g., message 235) and indicator element 240 corresponding to the text content in the second interface (e.g., interface 200G). The indicator element 240 may include message 212 to indicate that the second message references at least a portion of the first message 210.

[0066] In this way, the example in this article can present a corresponding second message and indicator elements after the first input indicator references the first message, so that users can better perceive the referenced content and improve the efficiency of users obtaining information.

[0067] In some cases, electronic device 110 can maintain call interaction and present a third interface. Furthermore, electronic device 110 can present interactive components within the third interface. These interactive components display at least a portion of the initial message. For example, such as... Figure 2H As shown, electronic device 110 can receive user interface switching requests. Such requests can be, for example, clicks on any appropriate content in the second interface (e.g., clicking an interface jump control or a content component), or audio input indicating an interface jump. Upon receiving an interface switching request, electronic device 110 can maintain the call interaction and present a third interface (e.g., interface 200H). Maintaining the call interaction means that during interface switching, electronic device 110 can maintain the call link between the user and the first object, ensuring that the user can still communicate with the first object after the interface switch. For example, electronic device 110 can present the content component of song A in the second interface. After the content component of song A is clicked, electronic device 110 can present the playback interface of song A (e.g., interface 200H). Throughout the entire presentation process and after the presentation of the song A playback interface, electronic device 110 can maintain the call between the user and the first object.

[0068] Furthermore, the electronic device 110 can present interactive components in the interface 200H. Interactive components can indicate any appropriate element in the interface, and can be presented in an appropriate style. Interactive components include, but are not limited to, panels, cards, widgets, windows, etc. Taking window 245 as an example, the electronic device 110 can present at least a portion of the first message 210 in window 245. For example, the electronic device 110 can present message 213 of the first message 210 in window 245. In some scenarios, when presenting at least a portion of the first message 210 in an interactive component, the electronic device 110 can also adopt a second display style. That is, the electronic device 110 can display the first message 210 in plain text only, without an avatar or message bubble. For example, as shown... Figure 2H As shown, the electronic device 110 can display message 213 in plain text form in window 245.

[0069] In this way, the example in this paper can switch interfaces during a call between the user and the first object, and can present at least a portion of the first message in the switched interface, which can enhance the continuity of the user's interaction and improve the user's interactive experience. Furthermore, by displaying at least a portion of the first message in the interactive component, the efficiency of the user in obtaining information can be improved.

[0070] In some cases, electronic device 110 can receive a second input via an interactive component. Furthermore, electronic device 110 can output second content, which is derived based on the second input and the first message. For example, such as... Figure 2IAs shown, electronic device 110 can receive a second input. The second input includes text input, audio input, image input, video input, etc. For example, when a user clicks an interactive component (e.g., window 245), electronic device 110 can display a virtual keyboard. Electronic device 110 can receive the user's second input via the virtual keyboard. As another example, the interactive component (e.g., window 245) includes a media content upload control. Electronic device 110 can receive media content uploaded by the user via the media content upload control as a second input. After receiving the second input, electronic device 110 can provide the second input to a first object. The first object can determine the semantic information of the second input to match at least a portion of the message (e.g., message 212) indicated by the second input from the first message 210 based on the semantic information. Further, the first object can generate second content based on the semantic information of the second input and message 212. For example, the second input could be "What other background music is in this video besides song A?" The first object can determine the task to be performed as a song recognition task based on the semantic information of the second input. Furthermore, the first object can match the media content 225 from the first message 210 based on the semantic information of the second input to perform song recognition on the media content 225. After song recognition, the first object can determine that the background music of the media content 225 includes song B in addition to song A. Further, the first object can generate second content based on this recognition result. Such second content could be, for example, "In addition to song A, there is also song B". After obtaining the second content, the electronic device 110 can output the audio corresponding to the second input through a call or present the message 250 corresponding to the second content through window 245.

[0071] In some scenarios, electronic device 110 can also present message 251 corresponding to the second input in window 245. Message 251 and message 250 can have different display styles to distinguish between user input and the response of the first object. For example, electronic device 110 can present message 250 in black font to indicate that message 250 was generated by the first object. Electronic device 110 can also present message 251 in gray font to indicate that message 251 corresponds to the second input.

[0072] In this way, the example in this paper can trigger the first object to respond to the user's second output based on the preceding context information after the interface is switched, thereby improving the continuity of interaction between the user and the first object and improving the generation quality of the second output.

[0073] In some cases, the electronic device 110 may respond to presenting a first interface, on which a third message corresponding to the second input and a fourth message corresponding to the second content are presented. As an example, such as... Figure 2I and2J As shown, electronic device 110 can receive appropriate requests. Such requests may be, for example, a return request or a call end request. A return request may indicate a switch back to the first interface. Taking electronic device 110 receiving a call end request as an example, upon receiving the call end request, electronic device 110 can stop the call between the user and the first object and present the first interface (e.g., interface 200J). Taking electronic device 110 receiving a return request as an example, upon receiving the return request, electronic device 110 can maintain the call between the user and the first object and present the first interface (e.g., interface 200J). Furthermore, electronic device 110 may present a third message 255 corresponding to the second input and a fourth message (e.g., message 250) corresponding to the second content on interface 200J to indicate that the interaction information between the user and the first object is synchronized even in different interfaces.

[0074] In some cases, electronic device 110 may display content items on the first interface in response to the end of a call interaction. These content items are related to the content of the call interaction. For example, such as... Figure 2K As shown, after the call interaction between the user and the first object ends, the electronic device 110 can present content item 265 in the first interface (e.g., interface 200K). In this document, content item can represent an interface element used to carry information, and content item can be used to present content of various genres such as images, videos, audio, and text. Content item can include, but is not limited to, cards, containers, panels, etc. The electronic device 110 can present various information related to the call content in content item 265. For example, the electronic device 110 can present the call topic between the user and the first object (e.g., "background music of the communication video") in content item 265. In some scenarios, the first object can also generate one or more to-do items based on the call content, such as creating content based on the identified song A, playing song A, sharing song B, etc. The electronic device 110 can present one or more of the above to-do items in content item 265 for reminder purposes.

[0075] In some cases, electronic device 110 may display descriptive text within content items, which is generated based on the call interaction. For example, such as... Figure 2KAs shown, after the call interaction ends, the first object can generate descriptive text 270 based on the call content. Descriptive text 270 can be a summary of the call content, which may include key information received or generated by the first object during the call (such as the name of the identified song or the content of the identified video). In some scenarios, the first object can also truncate the call content based on its length and complexity. After truncating, the first object can obtain the most relevant conclusive statements in the call content to the user's questions, and use these conclusive statements as descriptive text 270. After descriptive text 270 is generated, electronic device 110 can present descriptive text 270 in content item 265. In some scenarios, electronic device 110 can also present descriptive text 270 in a structured manner. For example, electronic device 110 can present the information included in descriptive text 270 in content item 265 in a list format.

[0076] In this way, the example in this article can provide users with descriptive text about the call interaction after the call ends. When users want to follow up, they can quickly learn about the content of the call through the descriptive text, thereby improving the efficiency of users obtaining information.

[0077] In some situations, electronic device 110 can respond to a triggering operation on a content item by displaying the call content of the call interaction. For example, such as... Figure 2K As shown, the electronic device 110 can receive a trigger operation on the content item 265. Such a trigger operation could be, for example, a click on the content item 265. After the content item 265 is clicked, as... Figure 2L As shown, electronic device 110 can display component 275 in interface 200L. Component 275 includes call content for interactive calls. In some scenarios, electronic device 110 can also display different parts of the call content in component 275 in different styles. For example, electronic device 110 can display message 276 corresponding to the audio content entered by the user during the call in component 275 using a first font color. Electronic device 110 can also display message 277 corresponding to the audio content output by a first object during the call in component 275 using a second font color. Furthermore, electronic device 110 can also display indicator elements of different colors to distinguish messages from different objects in component 275. In this way, the example in this paper supports providing users with call content for interactive calls after the call ends, enabling users to view the call content at any time and improving the efficiency of information retrieval.

[0078] In this way, the example in this paper can present the first message related to the first interaction mode in the second interface corresponding to the second interaction mode. This allows users to view messages corresponding to different interaction modes when the first object is in different interaction modes, thus avoiding information inconsistencies caused by changes in interaction modes and improving the continuity and convenience of interaction. Furthermore, the example in this paper can still present messages corresponding to the interaction mode before the switch when switching interaction modes, achieving message synchronization across interaction modes and effectively reducing the waste of computing resources.

[0079] Example process Figure 3 A flowchart illustrating an example process 300 for interface interaction under certain conditions is shown. Process 300 can be implemented at electronic device 110. See below for reference. Figure 1 To describe process 300.

[0080] like Figure 3 As shown in box 310, electronic device 110 presents a first message on a first interface. The first interface corresponds to a first interaction mode of a first object. The first interaction mode includes message-based dialogue interaction.

[0081] In frame 320, electronic device 110 responds to receiving a first operation by presenting a second interface, the second interface corresponding to a second interaction mode of the first object, the second interaction mode including call interaction.

[0082] In box 330, electronic device 110 presents at least a portion of the first message in the second interface.

[0083] In some cases, during a call interaction, the first content is output, the first content comes from the first object, and the first content is associated with the first message.

[0084] In this way, the example in this paper provides first content based on the first message related to the first interaction mode when the first object is in the second interaction mode, thus connecting the interaction information in different modes and improving the content generation quality of the first object.

[0085] In some cases, the first content is generated based on contextual information, which is associated with the first message, where the first interaction mode and the second interaction mode are associated with the same contextual information.

[0086] In this way, the example in this paper connects the interactive information in different modes, so that the first object can obtain sufficient contextual information to respond to the user's request regardless of the interaction mode scenario. This can improve the quality of the content generated by the first object and enhance the interaction effect between the first object and the user.

[0087] In some cases, outputting the first content includes: receiving a first input, the first input representing a reference to a first message; and outputting the first content based on the first input.

[0088] In this way, the examples in this paper allow users to reference a first message related to a first interaction mode in order to output first content based on the first input, thereby improving the output quality of the first content.

[0089] In some cases, the output of the first content includes: on the second interface, presenting a second message and an indicator element, the indicator element representing the reference of the second message to the first message.

[0090] In this way, the example in this article can present a corresponding second message and indicator elements after the first input indicator references the first message, so that users can better perceive the referenced content and improve the efficiency of users obtaining information.

[0091] In some cases, the first message includes first media content, wherein at least a portion of presenting the first message includes: presenting the first media content on a second interface.

[0092] In this way, the example in this paper can present media content in context when the user interacts with the first object during a call, thereby helping the user to better perceive the context and improve the efficiency of the user in obtaining information.

[0093] In some cases, process 300 may also include: receiving a second operation related to the first media content; and playing the first media content.

[0094] In this way, during the user's interaction with the first object, the example in this article supports playing media content from the first message, thereby providing the user with a better interactive experience.

[0095] In some cases, process 300 also includes: adjusting the interactive mode of the call interaction in response to playing the primary media content.

[0096] In this way, the example in this paper can adjust the interaction mode of the call while playing media content, so that the playback of media content and the call no longer conflict, thus improving the user's interactive experience.

[0097] In some cases, adjusting the interaction mode of a call may include: pausing the call interaction with a first party in response to the playback of first media content; or adjusting the input or output mode of the call interaction in response to the playback of first media content.

[0098] In this way, the example in this paper can pause the call interaction or adjust the input / output mode of the call interaction during the playback of the first media content, thereby ensuring the playback quality of the first media content.

[0099] In some cases, playing the first media content includes: playing the first media content muted.

[0100] In this way, the example in this paper can play the first media content silently without interrupting the call. This allows users to obtain the visual information of the first media content in a timely manner, while avoiding the interference of the audio content of the first media content on the call. This provides users with a more flexible and richer media playback format and ensures the call interaction experience.

[0101] In some cases, process 300 also includes: maintaining the call interaction and presenting a third interface; and in the third interface, presenting an interactive component that displays at least a portion of the first message.

[0102] In this way, the example in this paper can switch interfaces during a call between the user and the first object, and can present at least a portion of the first message in the switched interface, which can enhance the continuity of the user's interaction and improve the user's interactive experience. Furthermore, by displaying at least a portion of the first message in the interactive component, the efficiency of the user in obtaining information can be improved.

[0103] In some cases, process 300 further includes: receiving a second input via an interactive component; and outputting second content, the second content being obtained based on the second input and the first message.

[0104] In this way, the example in this paper can trigger the first object to respond to the user's second output based on the preceding context information after the interface is switched, thereby improving the continuity of interaction between the user and the first object and improving the generation quality of the second output.

[0105] In some cases, process 300 further includes: in response to presenting the first interface, presenting a third message corresponding to the second input and a fourth message corresponding to the second content on the first interface.

[0106] In some cases, the first screen displays multiple messages, and the second screen displays some of the messages from those multiple messages, including the first message.

[0107] In some cases, presenting at least a portion of the first message includes: in response to the first message being relevant to the topic of the call interaction, presenting at least a portion of the first message on a second interface.

[0108] In this way, the example in this paper can filter and present messages that are relevant to the current discussion topic during the call interaction, which not only ensures the continuity of the interaction, but also avoids irrelevant information from interfering with the user interface, thereby further improving the relevance of information display and the efficiency of user interaction.

[0109] In some cases, process 300 may also include: in response to the end of the call interaction, presenting content items on the first screen, the content items being related to the call content of the call interaction.

[0110] In some cases, process 300 also includes presenting descriptive text in the content item, the descriptive text being generated based on the call interaction.

[0111] In this way, the example in this article can provide users with descriptive text about the call interaction after the call ends. When users want to follow up, they can quickly learn about the content of the call through the descriptive text, thereby improving the efficiency of users obtaining information.

[0112] In some cases, process 300 also includes: in response to a triggering operation on a content item, presenting the call content of the call interaction.

[0113] In this way, the example in this article supports providing users with call content for interaction after the call ends, enabling users to view the call content at any time and improving the efficiency of users obtaining information.

[0114] Example devices and equipment A corresponding apparatus for implementing the above methods or processes is also provided. Figure 4 A schematic structural block diagram of an example device 400 for interface interaction is shown, according to some scenarios. Device 400 can be implemented as or included in electronic device 110. The various modules / components in device 400 can be implemented by hardware, software, firmware, or any combination thereof.

[0115] like Figure 4 As shown, the device 400 includes: a first presentation module 410 configured to present a first message on a first interface, the first interface corresponding to a first interaction mode of a first object, the first interaction mode including message-based dialogue interaction; a second presentation module 420 configured to present a second interface in response to receiving a first operation, the second interface corresponding to a second interaction mode of the first object, the second interaction mode including call interaction; and a third presentation module 430 configured to present at least a portion of the first message on the second interface.

[0116] In some cases, the device 400 also includes a first output module configured to output first content during a call interaction, the first content being derived from a first object and associated with a first message.

[0117] In some cases, the first content is generated based on contextual information, which is associated with the first message, where the first interaction mode and the second interaction mode are associated with the same contextual information.

[0118] In some cases, the first output module is also configured to: receive a first input, the first input representing a reference to a first message; and output first content based on the first input.

[0119] In some cases, the first output module is also configured to present a second message and an indicator element on a second interface, the indicator element representing a reference of the second message to the first message.

[0120] In some cases, the first message includes the first media content, and the third presentation module 430 is also configured to present the first media content on the second interface.

[0121] In some cases, device 400 also includes a playback module configured to receive a second operation related to the first media content; and to play the first media content.

[0122] In some cases, device 400 also includes an adjustment module configured to adjust the interaction mode of the call interaction in response to playing the first media content. In some cases, the adjustment module is also configured to: suspend the call interaction with the first object in response to the playback of the first media content; or adjust the input or output mode of the call interaction in response to the playback of the first media content.

[0123] In some cases, the playback module is also configured to mute the first media content.

[0124] In some cases, device 400 also includes a fourth presentation module configured to maintain call interaction and present a third interface; and in the third interface, to present interactive components that display at least a portion of the first message.

[0125] In some cases, the device 400 also includes a second output module configured to receive a second input via an interactive component; and to output second content, the second content being derived based on the second input and the first message.

[0126] In some cases, the device 400 also includes a fifth presentation module configured to present a third message corresponding to the second input and a fourth message corresponding to the second content on the first interface in response to presenting the first interface.

[0127] In some cases, the first screen displays multiple messages, and the second screen displays some of the messages from those multiple messages, including the first message.

[0128] In some cases, the third presentation module 430 is also configured to present at least a portion of the first message on a second interface in response to the topic of the first message and the call interaction.

[0129] In some cases, device 400 also includes a sixth presentation module configured to present content items on a first interface in response to the end of a call interaction, the content items being related to the call content of the call interaction.

[0130] In some cases, device 400 also includes a seventh presentation module configured to present descriptive text in a content item, the descriptive text being generated based on the call interaction.

[0131] In some cases, device 400 also includes a content presentation module configured to present call content of the call interaction in response to a triggering operation on a content item.

[0132] The modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some cases, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 400 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on.

[0133] Figure 5 A block diagram of an electronic device 500 in which one or more examples may be implemented is shown. It should be understood that... Figure 5 The electronic device 500 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 5 The electronic device 500 shown can be used to implement the electronic device 110 discussed above.

[0134] like Figure 5As shown, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processing units or processors 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0135] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0136] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 5 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various examples.

[0137] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.

[0138] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0139] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0140] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0141] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0142] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0143] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0144] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for interface interaction, comprising: On the first interface, a first message is presented. The first interface corresponds to a first interaction mode of a first object. The first interaction mode includes message-based dialogue interaction. In response to receiving the first operation, a second interface is presented, the second interface corresponding to the second interaction mode of the first object, the second interaction mode including call interaction; as well as In the second interface, at least a portion of the first message is presented.

2. The method according to claim 1, further comprising: During the call interaction, first content is output, the first content comes from the first object, and the first content is associated with the first message.

3. The method according to claim 2, wherein the first content is generated based on context information, the context information being associated with the first message, wherein the first interaction mode and the second interaction mode are associated with the same context information.

4. The method according to claim 2, wherein the first output content includes: Receive a first input, which represents a reference to the first message; as well as Based on the first input, output the first content.

5. The method according to claim 2, wherein the first output content includes: On the second interface, a second message and an indicator element are presented, the indicator element representing the reference of the second message to the first message.

6. The method of claim 1, wherein the first message comprises first media content, and wherein presenting at least a portion of the first message comprises: The first media content is displayed on the second interface.

7. The method of claim 6, further comprising: Receive a second operation, which is related to the first media content; as well as Play the first media content.

8. The method according to claim 7, further comprising: In response to playing the first media content, the interaction mode of the call interaction is adjusted.

9. The method of claim 8, wherein adjusting the interaction mode of the call interaction comprises: In response to playing the first media content, the call interaction with the first object is paused; or In response to playing the first media content, the input or output mode of the call interaction is adjusted.

10. The method according to claim 7, wherein playing the first media content comprises: Play the first media content silently.

11. The method of claim 1, further comprising: Maintain the call interaction and present a third interface; as well as In the third interface, an interactive component is presented, which displays at least a portion of the first message.

12. The method of claim 11, further comprising: The second input is received via the interactive component; as well as Output a second piece of content, which is obtained based on the second input and the first message.

13. The method of claim 12, further comprising: In response to presenting the first interface, a third message corresponding to the second input and a fourth message corresponding to the second content are presented on the first interface.

14. The method according to claim 1, further comprising: In response to the end of the call interaction, a content item is displayed on the first interface, the content item being related to the call content of the call interaction.

15. The method of claim 14, further comprising: The content item includes descriptive text, which is generated based on the call interaction.

16. The method of claim 14, further comprising: In response to a triggering operation on the content item, the call content of the call interaction is presented.

17. A device for interface interaction, comprising: The first presentation module is configured to present a first message on a first interface, the first interface corresponding to a first interaction mode of a first object, the first interaction mode including message-based dialogue interaction; The second presentation module is configured to present a second interface in response to receiving a first operation. The second interface corresponds to a second interaction mode of the first object, and the second interaction mode includes call interaction. as well as The third presentation module is configured to present at least a portion of the first message in the second interface.

18. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 16 when executed by the at least one processor.

19. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 16.

20. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 16.

Images