Methods, apparatus, devices, storage media and products for user interface interaction

Abstract

A method, apparatus, device, storage medium, and product for interface interaction are provided. The proposed method includes: receiving a first input on a first interface, the first interface being used to interact with an intelligent system; and presenting first content and at least one interactive component on the first interface, the first content being generated based on the first input, the at least one interactive component being associated with the first content, the first interface supporting multiple types of interactive components, the multiple types including at least a first type and a second type, the first type of interactive component being used to provide services associated with the intelligent system, and the second type of interactive component being used to send messages to the intelligent system. In this manner, the interaction methods with the intelligent system can be enriched, and interaction efficiency can be improved.

Description

Technical Field

[0001] The examples in this article generally relate to the field of computer science, and in particular to methods, apparatuses, devices, computer-readable storage media, and products for user interface interaction. Background Technology

[0002] With the development of computer technology, intelligent systems are being applied more and more widely. Intelligent systems can be embedded in various types of applications to help users quickly obtain information. In addition to providing response content, intelligent systems can also provide guidance information to guide users to further obtain or understand relevant information. Summary of the Invention

[0003] In a first aspect, a method for interface interaction is provided. The method includes: receiving a first input on a first interface, the first interface being used to interact with an intelligent system; and presenting first content and at least one interactive component on the first interface, the first content being generated based on the first input, the at least one interactive component being associated with the first content, the first interface supporting multiple types of interactive components, the multiple types including at least a first type and a second type, the first type of interactive component being used to provide services associated with the intelligent system, and the second type of interactive component being used to send messages to the intelligent system.

[0004] In a second aspect, an apparatus for interface interaction is provided. The apparatus includes: a receiving module and a presentation module, wherein the receiving module is configured to receive a first input on a first interface, the first interface being used to interact with an intelligent system; and the presentation module is configured to present first content and at least one interactive component on the first interface, the first content being generated based on the first input, the at least one interactive component being associated with the first content, the first interface supporting multiple types of interactive components, the multiple types including at least a first type and a second type, the first type of interactive component being used to provide services associated with the intelligent system, and the second type of interactive component being used to send messages to the intelligent system.

[0005] In a third aspect, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0007] In a fifth aspect, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0008] This approach can enrich the ways to interact with intelligent systems and improve interaction efficiency.

[0009] It should be understood that the content described in this section is not intended to limit the key or important features of the examples in this article, nor is it intended to restrict the scope of the solution. Other features will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of the example environment is shown; Figures 2A to 2B Example interfaces for some scenarios are shown; Figures 3A to 3B Example interfaces for some scenarios are shown; Figures 4A to 4B Example interfaces for some scenarios are shown; Figure 5 Example interfaces for some scenarios are shown; Figure 6 The sequence diagrams show some scenarios of interface interaction; Figure 7 The flowcharts show example processes of interface interactions in some scenarios; Figure 8 Schematic block diagrams of example devices for interface interaction in some scenarios are shown; and Figure 9 A block diagram of an electronic device capable of implementing multiple illustrative scenarios is shown. Detailed Implementation

[0011] The examples in this document will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.

[0012] It should be noted that the headings of any section / subsection provided herein are not restrictive. Various examples are described throughout this document, and examples of any type may be included under any section / subsection. Furthermore, examples described in any section / subsection may be combined in any way with any other examples described in the same section / subsection and / or different sections / subsections.

[0013] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0014] The examples in this document may involve user data, data acquisition, and / or use. All of these aspects comply with relevant laws, regulations, and rules. In the examples, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.

[0015] In this manual and the sample solutions, any processing of personal information will be conducted only under legal grounds (such as obtaining the consent of the data subject or being necessary for the performance of a contract) and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.

[0016] In this paper, "intelligent system" refers to an object capable of autonomous control based on machine learning models. An intelligent system, for example, can make decisions and autonomously execute actions based on machine learning models to achieve preset goals or complete preset tasks. In some cases, an intelligent system may also be called an intelligent component or virtual object, which can be, for example, an automated program that understands user intent and can utilize models or invoke tools to complete various types of tasks. Examples of intelligent systems include, but are not limited to: agents, bots, chatbots, digital avatars, intelligent customer service, digital assistants, etc. Alternatively, an intelligent system can also be an intelligent role implemented based on a machine learning model. An "intelligent system" can, for example, process user requests based on generative models (e.g., language models, multimodal models) to perform specified types of tasks. In some cases, an intelligent system may also relate to virtual accounts, which may have corresponding avatars or nicknames.

[0017] As mentioned above, with the rapid development of computer technology, intelligent systems can be embedded in various types of applications to help users quickly obtain information. In addition to providing response content, intelligent systems can also provide guidance information to guide users to further obtain or understand relevant information.

[0018] In related technologies, users can converse with intelligent systems using natural language, and the intelligent systems can generate corresponding responses based on user input. With the rapid development of science and technology, users' requirements for intelligent interactive systems are no longer limited to simple question-and-answer capabilities, but rather they expect the systems to provide richer and more convenient interaction methods and to proactively guide users to complete complex tasks.

[0019] In existing technologies, intelligent systems typically present replies in plain text or simple rich text format. Interactive components (such as recommendation options and function entry points) are often fixed as independent controls in specific areas of the chat interface (such as the bottom operation bar or independent buttons), creating a clear disconnect from the message flow in the conversation interface. When users need to access core functions such as audio / video calls, photo uploads, or PPT generation, they usually need to manually click on the independent function entry point, resulting in a lengthy operation path.

[0020] Furthermore, the recommended content (such as search suggestions or reply options) provided by existing intelligent systems is mostly generated by smaller models independent of the main model. These smaller models differ from the main model in terms of semantic understanding and context alignment capabilities, and struggle to fully utilize users' historical interaction memories. In practical applications, such recommended content is often quite generic and lacks personalization. Simultaneously, user feedback signals, such as clicks on interactive components, are not effectively fed back into the model training process, making it difficult for the system to continuously learn and adapt to user preferences.

[0021] Here, a user interface interaction scheme is proposed. The scheme includes: a first interface for receiving a first input, the first interface being used to interact with an intelligent system; and the first interface for presenting first content and at least one interactive component, the first content being generated based on the first input, the at least one interactive component being associated with the first content, the first interface supporting multiple types of interactive components, the multiple types including at least a first type and a second type, the first type of interactive component being used to provide services associated with the intelligent system, and the second type of interactive component being used to send messages to the intelligent system.

[0022] In this way, while generating response content based on user input, at least one interactive component associated with the response content can be presented. It can also support multiple types of interactive components to trigger various interaction methods with the intelligent system, thereby effectively enriching the interaction methods with the intelligent system and improving the interaction efficiency associated with the intelligent system.

[0023] The following describes various examples of this scheme in further detail with reference to the accompanying drawings.

[0024] Example Environment Figure 1 A schematic diagram of example environment 100 is shown. (e.g.) Figure 1 As shown, example environment 100 may include electronic device 110.

[0025] In this example environment 100, electronic device 110 can run an application 120 that supports user interface interaction. Application 120 can be any suitable type of application for user interface interaction, including but not limited to: conversational applications, entertainment and social applications, instant messaging applications, or other suitable applications. User 140 can interact with application 120 via electronic device 110 and / or its attached devices.

[0026] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.

[0027] In some cases, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some cases, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0028] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.

[0029] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some cases, server 130 and electronic device 110 can exchange signaling information through their communication connection.

[0030] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the scheme.

[0031] The following description of the example will continue with reference to the accompanying drawings.

[0032] Example Interaction Figures 2A to 2BExample interfaces 200A to 200B are shown, illustrating interface interactions under various scenarios. Interfaces 200A to 200B can, for example, be... Figure 1 The electronic device 110 shown is provided.

[0033] refer to Figure 2A As shown, the electronic device 110 can present an interface 200A (which may also be referred to as a first interface). As an example, such an interface 200A can be used to interact with a smart system.

[0034] In some cases, the electronic device 110 may display descriptive information 205 associated with the intelligent system on the interface 200A. As an example, such descriptive information may indicate the intelligent agent associated with the intelligent system. For instance, such descriptive information 205 may include an image identifier, name identifier, status identifier, etc., corresponding to the intelligent agent.

[0035] Through interface 200A, electronic device 110 can receive input content from user 140 (e.g., also referred to as first input) and present the corresponding input message 210 in interface 200A. As an example, such input content may include, but is not limited to, at least one of the following: text content, audio content, image content, video content, etc.

[0036] refer to Figure 2A As shown, in response to receiving input message 210, electronic device 110 can present a response message 220 for message 210 in interface 200A. As an example, such response message 220 may include first content 225 and an interactive component 230 associated with the first content 225.

[0037] In some cases, such first content 225 may be generated by the intelligent system based on the input content corresponding to input message 210. In some examples, such first content 225 may also be generated by the intelligent system based on input content and context information. As an example, such context information may include, but is not limited to: historical interaction information between user 140 and the intelligent system, configuration information associated with the intelligent system, and association information of user 140.

[0038] In some cases, during or after the generation of the first content 225, the intelligent system may determine the interactive component 230 associated with the first content 225 based on at least one of the input content corresponding to the input message 210 and the first content 225.

[0039] As an example, interface 200A can support multiple types of interactive components. For example, such multiple types can include at least a first type and a second type, where the first type of interactive component can be used to provide services associated with the intelligent system, and the second type of interactive component can be used to send messages to the intelligent system (e.g., triggering follow-up messages for the first content 225, etc.).

[0040] In some examples, the intelligent system can determine at least one type from multiple types based on at least one of the input content corresponding to the input message 210 and the first content 225, and then present an interactive component corresponding to such at least one type. For example Figure 2A As shown, in response to determining that the interaction type corresponding to the input content or the first content 225 is to provide a service associated with the intelligent system, the intelligent system can determine that the type of the interaction component 230 (which may also be called the first interaction component) is a first type, and then further determine the first service corresponding to the first type, thereby determining the presentation style and presentation position of the interaction component 230, and sending it to the electronic device 110, which then presents the corresponding first content 225 and the interaction component 230 corresponding to the first type in the response message 220.

[0041] In some cases, in response to the interaction component 230 providing a first service, the electronic device 110 may display prompt text and image icons corresponding to the first service in the interaction component 230. As an example, such prompt text may indicate the service content or guided action corresponding to the first service, such as "make a phone call," "take a photo," "shop," or "display a visual demonstration." As an example, such image icons may be image icons that match the service content, such as a phone icon or a camera icon.

[0042] Corresponding to the first type of interactive component 230, in response to receiving a trigger operation on the interactive component 230, the electronic device 110 may send a first instruction associated with the first service to the intelligent system. In some cases, such a first instruction may instruct the intelligent system to perform at least one action associated with the first service. As an example, corresponding to the "make a phone call" service, such an action may be to start an audio call component; corresponding to the "take a picture" service, such an action may include to start a camera or image acquisition component; corresponding to the "go shopping" service, such an action may include to invoke a shopping component, etc.

[0043] As an example, in response to a triggering operation on the interactive component 230, the electronic device 110 can display a second interface, which provides the first service corresponding to the interactive component 230. For example, such a second interface could be a call interface, a camera interface, a shopping interface, a playback interface, or a viewing interface, etc.

[0044] In some cases, in response to a triggering operation on the interactive component 230, the electronic device 110 can update the context information associated with the intelligent system. This context information represents the triggering operation on the interactive component 230. For example, corresponding to the interactive component 230 providing the first service, the electronic device 110 can generate interaction record information associated with the first service and write the context information associated with the intelligent system based on this interaction record information. For instance, the electronic device 110 can record the time when the intelligent system provides the first service, the service type corresponding to the first service provided, etc.

[0045] In some cases, in response to determining the interactive component 230 corresponding to the first content 225 or input content, the intelligent system or electronic device 110 can further determine the positional relationship between the first content 225 and the interactive component 230, and then the electronic device 110 renders and presents the first content 225 and the interactive component 230 based on such positional relationship.

[0046] As an example, such positional relationships may include, but are not limited to: interactive component 230 being located before the first content 225, interactive component 230 being located after the first content 225, interactive component 230 being located between the first part and the second part of the first content 225, etc.

[0047] For example Figure 2A As shown, the electronic device 110 determines that the position of the interactive component 230 is after the first content 225 based on at least one of the input content corresponding to the input message 210, the first content 225, and the first service provided by the interactive component 230, and can present the interactive component 230 after the first content 225.

[0048] In some cases, the electronic device 110, in its interface for interacting with the intelligent system, can display first content from the intelligent system and at least one corresponding interactive component in an interlaced pattern.

[0049] For example Figure 2BThe interface 200B shown, in response to receiving input message 240, can generate a response message 250 by an intelligent system based on the input content corresponding to input message 240. In some examples, the intelligent system can generate corresponding response content (e.g., also referred to as first content) based on the input content. Such response content may include a first part 255-1 and a second part 225-2. Then, based on the input content and response content, the type of at least one interactive component is determined. As an example, the intelligent system determines that the interactive component is of a first type and is used to provide a second service (e.g., taking a photo or recording a video), thereby determining that the interactive component corresponding to the response content is an interactive component that provides the second service. Then, the electronic device 110 determines, based on the service content corresponding to the second service and the content structure of the response content, that such an interactive component is suitable to be located between the first part and the second part of the response content. Then, the electronic device 110 can sequentially render the first part 255-1 of the response content, the interactive component 260, and the second part 255-2 of the response content in the response message 250, thereby presenting the interactive component 260 at the position between the first part 255-1 and the second part 255-2.

[0050] Figures 3A to 3B Example interfaces 300A to 300B are shown, illustrating interface interactions under various scenarios. Interfaces 300A to 300B can, for example, be... Figure 1 The electronic device 110 shown is provided.

[0051] refer to Figure 3A As shown, electronic device 110 can present interface 300A for interaction between user 140 and intelligent system. For example, via interface 300A, electronic device 110 can receive input from user 140 and present it as input message 310, then send the input message 310 to intelligent system for processing and response. In response to receiving a response message from intelligent system, electronic device 110 can present the response message on interface 300A, such as response message 320.

[0052] As an example, such a response message 320 may include text content 325 (which may also be referred to as first content) and an interactive component 330 (which may also be referred to as second interactive component). In some examples, the electronic device 110 may display the text content 325 and the interactive component 330 in an interlaced style. For example, the electronic device 110 may present the interactive component 330 between the first and second parts of the text content 325.

[0053] In some cases, interactive component 330 may include at least one content item associated with at least one keyword or guiding information in text content 325. For example, in interactive component 330, electronic device 110 may present multiple content items, which may be associated with multiple different keywords in text content 325, or multiple content items may be associated with multiple different guiding information corresponding to the same keyword in text content 325.

[0054] In some cases, at least one such content item may be generated based on stored information associated with the intelligent system, which represents historical interactions with the intelligent system. In some examples, such stored information may include, but is not limited to: contextual information associated with the intelligent system (e.g., historical interaction information, configuration information, etc.), and may also include descriptive information associated with user 140, reference information in a preset dataset (e.g., at least one dataset corresponding to application 120 or the intelligent system) associated with text content 325 or input content, such as reference information corresponding to at least one keyword in text content 325 or input content.

[0055] In some cases, at least one content item is associated with the first part of the text content 325. As an example, the electronic device 110 may present the interactive component 330 at the associated location of the first part. In this way, the association between at least one content item and the first part of the text content 325 can be visually presented, thereby improving the efficiency of interaction based on the text content 325 or at least one content item.

[0056] In some examples, such an interactive component 330 can be a second type of interactive component, where at least one content item can be used to trigger the sending of a message to the intelligent system. Such a message can be generated based on at least one of the input content and text content 325. In some cases, the electronic device 110 can receive a trigger operation on any of the at least one content item to send a message corresponding to that content item to the intelligent system.

[0057] refer to Figure 3B As shown, in response to receiving a trigger operation on the first content item 335 in the interactive component 330, the electronic device 110 can send interactive content (which may also be referred to as second content) to the smart system and present the corresponding interactive message 340 in the interface 300B. In some cases, such interactive content can represent a reference to text content 325.

[0058] As an example, such an interactive message 340 may include a reference portion 340-1 and a description portion 340-2. The reference portion 340-1 may include at least a portion of the text content 325 to represent a reference to the text content 325. In some examples, the description portion 340-2 may correspond to the triggered first content item 335; for example, the description text of the description portion 340-2 may be the same as or correspond to the description text in the first content item 335.

[0059] In some cases, the interactive content sent by electronic device 110 to the intelligent system based on a trigger operation on the first content item 335 may include: the input content corresponding to input message 310, the text content 325 in response message 320, the descriptive text corresponding to all content items in interactive component 330, and the descriptive text in the selected first content item 335, etc. In some examples, electronic device 110 may splice the various parts of the above interactive content according to a preset splicing order and send them to the intelligent system.

[0060] In some cases, electronic device 110 can be configured with character count thresholds associated with interactive content. For example, electronic device 110 can be configured with a total character count threshold for interactive content sent to the intelligent system, or it can be configured with multiple character count thresholds corresponding to multiple concatenated parts of the interactive content.

[0061] Taking a character count threshold of N (where N is an integer greater than 1, such as 100) for each concatenation part as an example, in some cases, in response to the input content exceeding the character count threshold N, the electronic device 110 can select the first N / 2 part and the last N / 2 part of the input content as the first concatenation part corresponding to the input content. For example, the first N / 2 part and the last N / 2 part can be connected or replaced by an ellipsis ("...").

[0062] As an example, in response to the text content 325 exceeding the threshold N, the electronic device 110 can select the first N / 2 parts and the last N / 2 parts of the text content 325 as the second concatenation part corresponding to the text content 325. For example, the first N / 2 parts and the last N / 2 parts can be connected or replaced by an ellipsis ("...").

[0063] In some examples, if at least one content item of the interactive component 330 is a portion of the text content 325 (e.g., presented as an underline or in a different font / size / color style), and the number of words in the text content 325 exceeds a threshold N, the electronic device 110 can, based on the position of the at least one content item in the text content 325, select the N / 2 portion before the position and the N / 2 portion after the position, and combine them with all the descriptive text of the at least one content item, sequentially concatenating them as the second concatenated portion corresponding to the text content 325. The remaining content before and after the selected portion can be connected or replaced with ellipses (“…”).

[0064] After sending interactive content to the intelligent system based on a trigger operation on the first content item 335, the electronic device 110 can also receive response content corresponding to the interactive content from the intelligent system and present it on the interface 300B in the form of a conversation message. As an example, such a conversation message can also include text content and at least one interactive component. The process of determining and interacting with such text content and at least one interactive component can be referred to the process of determining and interacting with text content 325 and interactive component 330 in response message 320, and will not be repeated here.

[0065] In some cases, the electronic device 110 may update the context information associated with the intelligent system in response to a triggering operation on the first content item 335 in the interaction component 330. In some examples, the updated portion of such context information represents the triggering operation on the first content item 335 in the interaction component 330.

[0066] As an example, the electronic device 110 can write the description text corresponding to the first content item 335, the input message 310, the text content 325, and the reference relationship of the interaction message 340 to the text content 325 into the context information associated with the intelligent system, so as to update the context information.

[0067] Figures 4A to 4B Example interfaces 400A to 400B are shown, illustrating interface interactions under various scenarios. Interfaces 400A to 400B can, for example, be... Figure 1 The electronic device 110 shown is provided.

[0068] refer to Figure 4AAs shown, electronic device 110 can present interface 400A for interaction between user 140 and intelligent system. For example, via interface 400A, electronic device 110 can receive input from user 140 and present it as input message 410, then send the input message 410 to intelligent system for processing and response. In response to receiving a response message from intelligent system, electronic device 110 can present the response message on interface 400A, such as response message 420.

[0069] As an example, such a response message 420 may include text content 425 (which may also be referred to as first content) and an interactive component 430 (which may also be referred to as second interactive component). For example, the electronic device 110 may present the interactive component 430 after the text content 425.

[0070] In some cases, the interactive component 430 may include at least one content item associated with at least one keyword or guiding information in the text content 425. As an example, multiple such content items may be associated with multiple different guiding information corresponding to the same keyword in the text content 425 or the input message 410. For instance, if the input message 410 relates to a query request for the abbreviation "OOD," the electronic device 110 may present multiple content items in the interactive component 430, each presenting multiple different guiding information associated with "OOD," such as different technical fields related to "OOD," such as "deep learning" or "software programming."

[0071] In some cases, at least one content item in the interactive component 430 is associated with a first portion 425-1 of the text content 425. As an example, such a first portion 425-1 may include question content, and at least one content item may include an answer to that question content. For instance, such a first portion 425-1 may relate to whether an explanation of "OOD" in common scenarios is needed, and the corresponding at least one content item may include multiple different technical scenarios involving "OOD," such as "deep learning" and "software programming."

[0072] As an example, at least one such content item can be generated based on the input message 410 and the data set associated with the intelligent system.

[0073] In some examples, at least one content item in the interaction component 430 may also be generated by the intelligent system based on the input message 410 and historical interaction records with the user 140. As an example, the historical interaction records include multiple rounds of historical interactions that are the same as or similar to the input message 410, such as multiple rounds of historical interactions including the same interaction content or keywords as the input message. For instance, if the input message 410 includes "location A is equivalent to a certain number of times location B," and the user's historical interaction records with the intelligent system include at least one historical interaction involving the query message "location A is equivalent to a certain number of times location B," the intelligent system can provide a portion of the text corresponding to "Do you need to generate a conversion tool?" and provide the interaction component 430 corresponding to "Yes" or "Generate for me" to trigger the intelligent system to generate and provide the corresponding conversion tool.

[0074] In some cases, in response to receiving a trigger operation on the first content item 435 in the interactive component 430, the electronic device 110 can send interactive content (which may also be referred to as second content) to the intelligent system and present the corresponding interactive message 440 in the interface 400B. In some cases, such interactive content may represent a reference to text content 425.

[0075] In some cases, in response to sending such interactive content to the intelligent system, the electronic device 110 can stop displaying the interactive component 430 on the interface 400B. For example, in response to a triggering operation on the first content item 435 in the interactive component 430, the electronic device 110 can display the interactive message 440 and simultaneously stop displaying the interactive component 430. In this way, it is possible to determine whether the interactive function of the interactive component 430 has been triggered and executed through an interactive operation with any content item in the interactive component 430. By stopping the display of the interactive component 430, unnecessary information in the interface 400B is reduced, unnecessary occupation of interface resources is reduced, and the simplicity and capacity of the content displayed in the interface 400B are improved.

[0076] Figure 5 An example interface 500 is shown, illustrating interface interactions based on various scenarios. Interface 500, for example, can be... Figure 1 The electronic device 110 shown is provided.

[0077] refer to Figure 5As shown, electronic device 110 can present interface 500 for interaction between user 140 and intelligent system. For example, via interface 500 (which may also be referred to as a first interface), electronic device 110 can receive input from user 140 and present it as input message 510, then send the input message 510 to intelligent system for processing and response. In response to receiving a response message from intelligent system, electronic device 110 can present the response message in interface 500, such as response message 520.

[0078] As an example, such a response message 520 may include text content 525 (which may also be referred to as first content) and at least one interactive component. In some examples, the electronic device 110 may display the text content 525 and the corresponding at least one interactive component in an interlaced style on the interface 500.

[0079] In some cases, at least one interactive component may include multiple interactive components, such as interactive component 530, interactive component 540, and interactive component 550. These multiple interactive components may be associated with different parts of the text content 525, and the display position of the multiple interactive components is determined based on their corresponding parts.

[0080] As an example, text content 525 may include a first part 525-1, a second part 525-2, and a third part 525-3. For instance, such multiple parts may correspond to multiple execution steps of input message 510. Figure 5 As shown, taking interactive component 530 corresponding to the first part 525-1, interactive component 540 corresponding to the second part 525-2, and interactive component 550 corresponding to the third part 525-3 as an example, the electronic device 110 can present interactive component 530 (for example, it may include multiple content items) between the first part 525-1 and the second part 525-2, then present interactive component 540 between the second part 525-2 and the third part 525-3, and present interactive component 550 after the third part 525-3.

[0081] In some cases, after receiving the response content generated by the intelligent system, the electronic device 110 can also determine the presentation style of the interactive component based on the type and content of the interactive component in the response content.

[0082] In some examples, corresponding to the first type of interactive component, the electronic device 110 can determine that the presentation style of the interactive component is a bubble or a button style, for example... Figure 2A The interactive components 230 and shown Figure 2B The interactive component 260 shown.

[0083] In some examples, corresponding to the second type of interactive component, the electronic device 110 can determine the corresponding presentation style based on at least one content item in the interactive component, such as a control or button style (e.g. Figure 4A The first content item 435 in the interactive component 430 shown Figure 5 The interactive components 530, 540, and 550 shown can also be text-style (e.g., Figure 3A The first content item 335 in the interactive component 330 shown.

[0084] As an example, corresponding to text-style interactive components, electronic device 110 can present at least one content item through a visual style distinct from the text content in a response message. Figure 3A Taking the text content 325 and the first content item 335 as examples, the electronic device 110 can present the descriptive text corresponding to the first content item 335 in a visual style different from the text content 325. For example, compared to the text content 325, the electronic device 110 can present the first content item 325 in at least one of the following visual styles: bold, different color, different font, different font size, underline, etc.

[0085] In some cases, the process by which electronic device 110 presents a response message (e.g., response message 220, 320, 420, or 520) may include: acquiring structured content generated by a machine learning model based on input content; and presenting at least one interactive component in response to the structured content representation, rendering the response message (which may also be referred to as a message object) in the interactive interface based on the structured content. As an example, such a response message includes text content (e.g., which may also be referred to as first content) and at least one interactive component.

[0086] As an example, such a machine learning model can correspond to an intelligent system, for instance, the machine learning model can be at least one model deployed in an intelligent system, or at least one model that the intelligent system can invoke.

[0087] In some cases, electronic device 110 can obtain description information of at least one interactive component from structured content; determine the display style of the response message based on the description information; and render the response message based on such display style.

[0088] As an example, such display styles may include, but are not limited to: the display style of text content (e.g., one-segment or multi-segment, font, font size, etc. of each paragraph), the display style of at least one interactive component (e.g., button, bubble, or text style, etc.), and the positional relationship between the text content and at least one interactive component (e.g., at least one interactive component is located before, after, or interspersed among multiple parts of the text content, etc.).

[0089] Figure 6 A timing diagram of an example process 600 for some scenarios of interface interaction is shown. Process 600 can be implemented at electronic device 110.

[0090] refer to Figure 6 As shown, user 610 can interact with intelligent system 640 via electronic device 620. An application capable of interacting with intelligent system 640 (e.g., ...) is deployed on electronic device 620. Figure 1 As shown in application 120, in response to receiving an interaction request, electronic device 620 can invoke intelligent system 640 through server 630 to respond to the interaction request.

[0091] In step 611, user 610 can input a prompt word into electronic device 620 through an interactive interface associated with smart system 640. As an example, such a prompt word may include, but is not limited to, at least one of the following: text content, audio content, image content, video content, etc. Through such a prompt word, user 610 can initiate an interaction request with smart system 640.

[0092] In step 621, in response to receiving the prompt word, the electronic device 620 initiates an interaction request with the intelligent system 640 to the server 630.

[0093] In some examples, the electronic device 620 can also present the input message corresponding to the interaction request in the interactive interface (e.g., Figure 2A The input message 210 shown is... Figure 3A Input message 310, etc. (as shown).

[0094] In step 631, server 630 responds to receiving the interaction request by obtaining the context corresponding to the interaction request and constructing the input data corresponding to the intelligent system.

[0095] As an example, such context may include, but is not limited to: historical interaction information between user 610 and intelligent system 640, configuration information in electronic device 620 associated with intelligent system 640, and association information of user 610.

[0096] Server 630 constructs the input data corresponding to the received interaction request based on the prompt words and the obtained context, and then executes step 632.

[0097] In step 632, server 630 sends the constructed input data to intelligent system 640.

[0098] In step 641, the intelligent system 640 generates a structured response to the input data and returns the structured response to the server 630.

[0099] As an example, the intelligent system 640 parses and processes the received input data. For instance, the intelligent system 640 may invoke at least one model to analyze and process the input data to generate structured response content for that input data.

[0100] In step 633, server 630 sends the structured response content received from intelligent system 640 to electronic device 620.

[0101] In step 622, in response to receiving structured response content, electronic device 620 parses the structured response content to determine the text content and at least one interactive component of at least one type in the structured response content.

[0102] In step 623, the electronic device 620 performs style matching on the determined text content and at least one interactive component of at least one type to determine the presentation style of the response content.

[0103] In step 624, the electronic device 620 renders the text content and at least one interactive component based on the presentation style determined in step 623 to generate a response message corresponding to the prompt word, and then executes step 625.

[0104] In step 625, the electronic device 620 presents the rendered response message to the user 610 in the interactive interface.

[0105] As an example, such a response message includes rendered text content and at least one interactive component. For more information on rendered response messages, please refer to [link / reference]. Figure 2A Response message 220 in Figure 3A Response message 320 in Figure 4A The response message 420 and Figure 5 The specific rendering style of the response message 520 will not be described in detail here.

[0106] In step 612, user 610 may trigger at least one interactive component in the response message to initiate a further interaction request via the interactive component. For example, such an interaction request may instruct the invocation of a service or to request further information.

[0107] As an example, the service call corresponding to such an interaction request can indicate the call to a first type of service deployed in the smart system 640 (such as taking a picture, making a phone call, etc.), or it can indicate the call to a second type of service associated with the smart system 640 (such as a third-party service embedded in the smart system 640 or the application, such as a mini-program, etc.).

[0108] In step 626, in response to receiving a trigger operation on an interactive component or a content item within an interactive component, the electronic device 620 may send a corresponding component instruction to the server 630 based on the type of the interactive component.

[0109] As an example, in response to determining that the component type corresponding to the component instruction is a first type (e.g., providing a service), the electronic device 620 can send the component instruction corresponding to the first type to the server 630; in response to determining that the component type corresponding to the component instruction is a second type (e.g., sending a message), the electronic device 620 can send the component instruction corresponding to the second type to the server 630.

[0110] In step 634, in response to receiving a component instruction, server 630 can identify the component instruction and send a corresponding action request to intelligent system 640.

[0111] As an example, server 630 can execute step 635a for component instructions of the first type; server 630 can execute step 635b for component instructions of the second type.

[0112] In step 635a, in response to determining that the received component instruction is to provide a service, the server 630 initiates a service call request corresponding to the service to the intelligent system 640.

[0113] In step 642a, the intelligent system 640 provides services with corresponding content based on the received service call request.

[0114] In step 636a, server 630 sends the service call result back to electronic device 620 based on the service provided by intelligent system 640.

[0115] In step 627a, the electronic device 620 provides the corresponding service content to the user 610 based on the service call result. Examples include call service, photography service, shopping service, and display service.

[0116] In response to determining that the triggered interactive component is of the second type, the electronic device 620 may also perform step 627b.

[0117] In step 627b, the electronic device 620 can present follow-up messages corresponding to the triggered interactive components or content items to the user 610 in the interactive interface.

[0118] As an example, electronic device 610 can display the follow-up message using a reference style. For instance, such a reference style could indicate that the follow-up message references the response message displayed in step 625. For example, the presentation style of such a follow-up message could refer to... Figure 3B The interactive message 340 shown is... Figure 4BThe interaction message 440 shown will not be described in detail here.

[0119] In step 635b, corresponding to the second type of component instruction, server 630 responds to determining that the received component instruction is a send message, and constructs input data based on the component instruction using interrogation logic.

[0120] As an example, such questioning logic may include: based on contextual information such as the prompt words corresponding to the interaction request received in step 621, the response content fed back in step 633, the component instructions received in step 626 and the reference relationship between the component instructions and the response content, and the historical interactions between user 610 and intelligent system 640, concatenating them in a preset order to construct the input data corresponding to the second type of interaction component.

[0121] In step 636b, server 630 sends the input data constructed in step 635b to intelligent system 640.

[0122] In step 642b, the intelligent system 640 parses the input data, generates the corresponding structured response content, and returns the structured content to the server 630.

[0123] In step 637b, server 630 sends the received structured response content to electronic device 620.

[0124] In step 628b, the electronic device 620 parses and renders the structured content. The specific parsing and rendering process can be found in the descriptions of steps 622 to 624 above, and will not be repeated here.

[0125] In step 629b, the electronic device 620 displays the rendered response message to the user 610 through an interactive interface.

[0126] It should be noted that, regardless of whether it corresponds to the first type of component instruction or the second type of component instruction, in response to the identification of the component instruction in step 634, the server 630 may also asynchronously execute step 638 during or after the execution of step 635a or step 635b.

[0127] In step 638, server 630 may asynchronously update the context information associated with user 610 and intelligent system 640.

[0128] As an example, server 630 can update the context information based on the identified component instructions, or based on the component instructions and the execution process or result. For example, such context information may at least include interaction information or interaction records between user 610 and intelligent system 640.

[0129] Example process Figure 7 A flowchart of an example process 700 for interface interaction under certain conditions is shown. Process 700 can be implemented at electronic device 110. See below for reference. Figure 1 To describe process 700.

[0130] In frame 710, electronic device 110 receives first input on a first interface, the first interface being used to interact with an intelligent system.

[0131] In frame 720, electronic device 110 presents first content and at least one interactive component on a first interface. The first content is generated based on a first input, and the at least one interactive component is associated with the first content. The first interface supports multiple types of interactive components, including at least a first type and a second type. The first type of interactive component is used to provide services associated with an intelligent system, and the second type of interactive component is used to send messages to the intelligent system.

[0132] In this way, while generating response content based on user input, at least one interactive component associated with the response content can be presented. It can also support multiple types of interactive components to trigger various interaction methods with the intelligent system, thereby effectively enriching the interaction methods with the intelligent system and improving the interaction efficiency associated with the intelligent system.

[0133] In some cases, presenting at least one interactive component includes: electronic device 110 determining at least one type from a plurality of two types based on at least one of a first input and a first content; and presenting at least one interactive component corresponding to at least one type.

[0134] In this way, the required interactive component type can be dynamically determined based on the first input and / or the first content, making the presented interactive components more in line with the current context, reducing interference from irrelevant information, improving the targeting and intelligence of the interaction, and improving the efficiency of the interaction.

[0135] In some cases, presenting at least one interactive component includes: an electronic device 110 presenting a first interactive component for providing a first service; and in response to a triggering operation on the first interactive component, sending a first instruction associated with the first service.

[0136] In this way, a specific first service can be provided through the first interactive component, and a first instruction can be sent to the intelligent system in response to the user's trigger operation. This quickly transforms the service corresponding to the interactive component into an operation that the intelligent system can execute, reducing the operation path, improving service call efficiency, and improving the interaction efficiency with the intelligent system.

[0137] In some cases, the first instruction directs the intelligent system to perform at least one action associated with the first service.

[0138] In this way, the first instruction can be used to instruct the intelligent system to perform at least one action, so that the intelligent system can be triggered to complete at least one action with a single trigger, thereby improving the response efficiency of the intelligent system, reducing the number of repeated user interactions, and thus improving the interaction efficiency with the intelligent system.

[0139] In some cases, presenting at least one interactive component includes: an electronic device 110 presenting a second interactive component, the second interactive component presenting at least one content item; and in response to a triggering operation on a first content item among the at least one content item, sending second content to a smart system, the second content corresponding to the first content item.

[0140] In this way, multiple content items can be presented through the second interactive component, and corresponding content can be sent to the intelligent system based on the user's selection of content items, thereby guiding the user to quickly input or select information, reducing the cost of manual input, and improving the efficiency of interaction with the intelligent system.

[0141] In some cases, the second content represents a reference to the first content.

[0142] In this way, the continuity of context can be maintained during the interaction with the intelligent system, avoiding repeated input of information, improving the continuity of interaction and the accuracy of the intelligent system's response.

[0143] In some cases, at least one content item is associated with a first part of the first content, and presenting the second interactive component includes: the electronic device 110 presenting the second interactive component at the associated location of the first part.

[0144] In this way, by presenting the second interactive component at the associated position of the first part of the first content, the spatial association between the first content and the interactive component can be achieved, reducing the user's eye movement and cognitive burden, improving the naturalness of the interaction and the efficiency of operation, thereby improving the interaction efficiency with the intelligent system.

[0145] In some cases, the first part includes the question content, and at least one content item includes a response to the question content.

[0146] In this way, corresponding answer-type content items can be provided for the question content, thereby helping users to quickly reply or ask follow-up questions, reducing the probability of conversation interruption, and improving the smoothness and efficiency of question-and-answer interactions.

[0147] In some cases, at least one content item is generated based on stored information associated with the intelligent system, which represents the historical interactions with the intelligent system.

[0148] In this way, at least one content item can be generated based on historical interaction information with the intelligent system, thereby enabling personalized recommendations and contextual memory of content items, and enhancing the adaptability and user stickiness of the intelligent system.

[0149] In some cases, process 700 also includes: electronic device 110 stopping the presentation of the second interactive component on the first interface in response to sending the second content.

[0150] In this way, the second interactive component can be automatically stopped after the second content is sent, thereby promptly cleaning up unnecessary interface elements, avoiding interface redundancy and misoperation, and improving interface cleanliness and interactive focus.

[0151] In some cases, presenting at least one interactive component includes: electronic device 110 displaying first content and at least one interactive component in an interlaced pattern on a first interface.

[0152] In this way, interactive components can be naturally embedded into the content flow of the first content, improving visual integration and reading continuity, and enhancing the smoothness of interaction.

[0153] In some cases, at least one interactive component includes multiple interactive components, which are associated with different parts of the first content, and the display positions of the multiple interactive components are determined based on the corresponding parts.

[0154] In this way, multiple interactive components can be positioned and displayed according to different parts of the first content, thereby achieving precise alignment between different parts of the first content and the interactive components, reducing the cost for users to find related operations, improving the efficiency of information acquisition and operation, and thus improving the efficiency of interaction with the intelligent system.

[0155] In some cases, process 700 further includes: electronic device 110 updating context information in response to a triggering operation on at least one interactive component, the context information representing the triggering operation on at least one interactive component.

[0156] In this way, users' actions on interactive components can be recorded in a timely manner, providing more accurate contextual basis for subsequent interactions with intelligent systems and enhancing the continuity and intelligence of the interaction.

[0157] In some cases, presenting first content and at least one interactive component includes: electronic device 110 acquiring structured content generated by a machine learning model based on the first content; and in response to the structured content representation, rendering a message object based on the structured content, the message object including the first content and at least one interactive component.

[0158] In this way, structured content can be generated based on the first content through machine learning models, and interactive components and rendering message objects can be determined based on the structured content, thereby achieving intelligent and dynamic interface generation and rendering, reducing hard coding, and improving scalability and content adaptability.

[0159] In some cases, rendering a message object based on structured content includes: electronic device 110 obtaining description information of at least one interactive component from structured content; determining the style of the message object based on the description information; and rendering the message object based on the style.

[0160] In this way, descriptive information of interactive components can be extracted from structured content and the style of message objects can be determined accordingly, so that the layout and appearance of interactive components can be aligned with the semantics of the first content, improving the flexibility and consistency of interface rendering.

[0161] Example devices and equipment A corresponding apparatus for implementing the above methods or processes is also provided. Figure 8 A schematic structural block diagram of an example device 800 for interface interaction is shown, according to some scenarios. Device 800 can be implemented as or included in electronic device 110. The various modules / components in device 800 can be implemented by hardware, software, firmware, or any combination thereof.

[0162] like Figure 8 As shown, the device 800 includes a receiving module 810 and a presentation module 820, wherein the receiving module 810 is configured to receive a first input on a first interface, the first interface being used to interact with an intelligent system; and the presentation module 820 is configured to present first content and at least one interactive component on the first interface, the first content being generated based on the first input, the at least one interactive component being associated with the first content, the first interface supporting multiple types of interactive components, the multiple types including at least a first type and a second type, the first type of interactive component being used to provide services associated with the intelligent system, and the second type of interactive component being used to send messages to the intelligent system.

[0163] In some cases, the presentation module 820 is configured to: determine at least one type from a plurality of two types based on at least one of a first input and a first content; and present at least one interactive component corresponding to the at least one type.

[0164] In some cases, the presentation module 820 is configured to: present a first interactive component for providing a first service; and, in response to a triggering operation on the first interactive component, send a first instruction associated with the first service.

[0165] In some cases, the first instruction directs the intelligent system to perform at least one action associated with the first service.

[0166] In some cases, the presentation module 820 is configured to: present a second interactive component that presents at least one content item; and, in response to a triggering operation on a first content item among the at least one content item, send second content to the intelligent system, the second content corresponding to the first content item.

[0167] In some cases, the second content represents a reference to the first content.

[0168] In some cases, at least one content item is associated with a first part of the first content, and the presentation module 820 is configured to present a second interactive component at the associated location of the first part.

[0169] In some cases, the first part includes the question content, and at least one content item includes a response to the question content.

[0170] In some cases, at least one content item is generated based on stored information associated with the intelligent system, which represents the historical interactions with the intelligent system.

[0171] In some cases, device 800 also includes a sending module configured to stop presenting a second interactive component on the first interface in response to sending second content.

[0172] In some cases, the presentation module 820 is configured to display first content and at least one interactive component in an interwoven style on a first interface.

[0173] In some cases, at least one interactive component includes multiple interactive components, which are associated with different parts of the first content, and the display positions of the multiple interactive components are determined based on the corresponding parts.

[0174] In some cases, the device 800 also includes an update module configured to update context information in response to a triggering operation on at least one interactive component, the context information representing the triggering operation on at least one interactive component.

[0175] In some cases, the presentation module 820 is configured to: acquire structured content generated by a machine learning model based on the first content; and, in response to the structured content representation, present at least one interactive component, and render a message object based on the structured content, the message object including the first content and at least one interactive component.

[0176] In some cases, rendering a message object based on structured content includes: obtaining description information of at least one interactive component from the structured content; determining the style of the message object based on the description information; and rendering the message object based on the style.

[0177] The modules included in device 800 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some cases, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 800 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on.

[0178] Figure 9 A block diagram of an electronic device 900 in which one or more examples may be implemented is shown. It should be understood that... Figure 9 The electronic device 900 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 9 The illustrated electronic device 900 can be used to implement the electronic device 110 discussed above.

[0179] like Figure 9 As shown, electronic device 900 is in the form of a general-purpose electronic device. Components of electronic device 900 may include, but are not limited to, one or more processing units or processors 910, memory 920, storage devices 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. Processor 910 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 920. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 900.

[0180] Electronic device 900 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 900, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 920 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 930 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 900.

[0181] Electronic device 900 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 9 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 920 may include computer program product 925 having one or more program modules configured to perform various methods or actions of various examples.

[0182] The communication unit 940 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 900 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 900 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.

[0183] Input device 950 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 960 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 900 can also communicate with one or more external devices (not shown) via communication unit 940 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 900, or with any device that enables electronic device 900 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interfaces (not shown).

[0184] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0185] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0186] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0187] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0188] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0189] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for interface interaction, comprising: On the first interface, a first input is received, and the first interface is used to interact with the intelligent system. as well as On the first interface, first content and at least one interactive component are presented. The first content is generated based on the first input. The at least one interactive component is associated with the first content. The first interface supports multiple types of interactive components. The multiple types include at least a first type and a second type. The first type of interactive component is used to provide services associated with the intelligent system. The second type of interactive component is used to send messages to the intelligent system.

2. The method according to claim 1, wherein, Presenting the at least one interactive component includes: Based on at least one of the first input and the first content, determine at least one type from the plurality of types; and Present the at least one interactive component corresponding to the at least one type.

3. The method according to claim 1, wherein, Presenting the at least one interactive component includes: Presenting a first interactive component, the first interactive component being used to provide a first service; and In response to a trigger operation on the first interactive component, a first instruction associated with the first service is sent.

4. The method according to claim 3, wherein, The first instruction instructs the intelligent system to perform at least one action associated with the first service.

5. The method according to claim 1, wherein, Presenting the at least one interactive component includes: A second interactive component is presented, which presents at least one content item; and In response to a triggering operation on a first content item among the at least one content item, a second content item is sent to the intelligent system, the second content item corresponding to the first content item.

6. The method according to claim 5, wherein, The second content represents a reference to the first content.

7. The method according to claim 5, wherein, The at least one content item is associated with a first portion of the first content, and presenting the second interactive component includes: The second interactive component is presented at the associated location of the first part.

8. The method according to claim 5, wherein, The at least one content item is generated based on stored information associated with the intelligent system, the stored information representing historical interactions with the intelligent system.

9. The method according to claim 5, further comprising: In response to sending the second content, the presentation of the second interactive component on the first interface is stopped.

10. The method according to claim 1, wherein, Presenting the at least one interactive component includes: In the first interface, the first content and the at least one interactive component are displayed in an interwoven style.

11. The method of claim 10, wherein the at least one interactive component comprises a plurality of interactive components, the plurality of interactive components being associated with different portions of the first content, and the display positions of the plurality of interactive components being determined based on the corresponding portions.

12. The method according to claim 1, further comprising: In response to a triggering operation on the at least one interactive component, context information is updated, the context information representing the triggering operation on the at least one interactive component.

13. The method according to claim 1, wherein, The presentation of the first content and at least one interactive component includes: Obtain structured content generated by a machine learning model based on the first content; and In response to the presentation of the at least one interactive component by the structured content representation, a message object is rendered based on the structured content, the message object including the first content and the at least one interactive component.

14. The method of claim 13, wherein rendering the message object based on the structured content comprises: From the structured content, obtain the description information of the at least one interactive component; Based on the description information, determine the style of the message object; as well as The message object is rendered based on the style.

15. A device for user interface interaction, comprising: The receiving module is configured to receive a first input on a first interface, the first interface being used to interact with the intelligent system. as well as A presentation module is configured to present first content and at least one interactive component on the first interface. The first content is generated based on the first input, and the at least one interactive component is associated with the first content. The first interface supports multiple types of interactive components, including at least a first type and a second type. The first type of interactive component is used to provide services associated with the intelligent system, and the second type of interactive component is used to send messages to the intelligent system.

16. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 14 when executed by the at least one processor.

17. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 14.

18. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 14.

Images