Methods, apparatus, devices and computer program products for user interface interaction

Abstract

A user interface interaction method, apparatus, device, and computer program product are provided. The proposed method includes: receiving a first input, which instructs an intelligent system to perform a media generation task; and presenting first content, which originates from the intelligent system. The first content includes first media content and a first interactive component. The first media content is related to the media generation task and includes a first visual element. The first interactive component provides a first service associated with a first object, which is associated with the first visual element. This approach can improve the efficiency of information retrieval for users and reduce the consumption of computing resources.

Description

Technical Field

[0001] The examples in this article generally relate to the field of computer science, and in particular to methods, apparatuses, devices, and computer program products for user interface interaction. Background Technology

[0002] With the development of computer technology and continuous breakthroughs in the field of artificial intelligence, various models have emerged. Users can communicate continuously and fluently with models through conversational text, completing various tasks such as information consultation, logical thinking, and content interpretation without using complex commands. Summary of the Invention

[0003] In a first aspect, a method for interface interaction is provided. The method includes: receiving a first input, the first input instructing an intelligent system to perform a media generation task; and presenting first content, the first content originating from the intelligent system, the first content including first media content and a first interactive component, the first media content being related to the media generation task, the first media content including a first visual element, and the first interactive component being used to provide a first service associated with a first object, the first object being associated with the first visual element.

[0004] In a second aspect, an apparatus for interface interaction is provided. The apparatus includes: a first receiving module configured to receive a first input, the first input instructing an intelligent system to perform a media generation task; and a first presentation module configured to present first content, the first content originating from the intelligent system, the first content including first media content and a first interactive component, the first media content being related to the media generation task, the first media content including a first visual element, and the first interactive component for providing a first service associated with a first object, the first object being associated with the first visual element.

[0005] In a third aspect, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0007] In this way, the example in this paper, upon receiving the first input, can present the first content from the intelligent system, and can also present the first media content and the corresponding first interactive component within the first content, thereby allowing users to obtain richer content and improving the efficiency of information acquisition. Furthermore, when the user browses the first content from the intelligent system, the example in this paper can obtain the first service associated with the first object through the first interactive component, thereby reducing the interaction path and thus reducing the consumption of computing resources.

[0008] It should be understood that the content described in this section is not intended to limit the key or important features of the examples in this article, nor is it intended to restrict the scope of the solution. Other features will become readily apparent from the following description. Attached Figure Description

[0009] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of the example environment is shown; Figures 2A to 2J Example interfaces for some scenarios are shown; Figure 3 The flowcharts show example processes of interface interactions in some scenarios; Figure 4 Schematic block diagrams of example devices for interface interaction in some scenarios are shown; and Figure 5 A block diagram of an electronic device capable of implementing multiple illustrative scenarios is shown. Detailed Implementation

[0010] The examples in this document will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.

[0011] It should be noted that the headings of any section / subsection provided herein are not restrictive. Various examples are described throughout this document, and examples of any type may be included under any section / subsection. Furthermore, examples described in any section / subsection may be combined in any way with any other examples described in the same section / subsection and / or different sections / subsections.

[0012] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0013] The examples in this document may involve user data, data acquisition, and / or use. All of these aspects comply with relevant laws, regulations, and rules. In the examples, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.

[0014] In this manual and the sample solutions, any processing of personal information will be conducted only under legal grounds (such as obtaining the consent of the data subject or being necessary for the performance of a contract) and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.

[0015] As mentioned above, with the development of computer technology and continuous breakthroughs in the field of artificial intelligence, various models have emerged. Users can communicate continuously and fluently with models through conversational text, completing various tasks such as information consultation, logical thinking, and content interpretation without using complex commands.

[0016] A user interface interaction scheme is proposed. The scheme includes: receiving a first input, which instructs an intelligent system to perform a media generation task; and presenting first content, which originates from the intelligent system. The first content includes first media content and a first interactive component. The first media content is related to the media generation task and includes a first visual element. The first interactive component is used to provide a first service associated with a first object, and the first object is associated with the first visual element.

[0017] In this way, the example in this paper, upon receiving the first input, can present the first content from the intelligent system, and can also present the first media content and the corresponding first interactive component within the first content, thereby allowing users to obtain richer content and improving the efficiency of information acquisition. Furthermore, when the user browses the first content from the intelligent system, the example in this paper can obtain the first service associated with the first object through the first interactive component, thereby reducing the interaction path and thus reducing the consumption of computing resources.

[0018] The following describes various examples of this scheme in further detail with reference to the accompanying drawings.

[0019] Example Environment Figure 1 A schematic diagram of example environment 100 is shown. (e.g.) Figure 1 As shown, example environment 100 may include electronic device 110.

[0020] In this example environment 100, electronic device 110 can run an application 120 that supports user interface interaction. Application 120 can be any suitable type of application for user interface interaction, including but not limited to: applications for interaction with intelligent systems or other suitable applications. User 140 can interact with application 120 via electronic device 110 and / or its attached devices.

[0021] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.

[0022] In some cases, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some cases, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0023] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.

[0024] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some cases, server 130 and electronic device 110 can exchange signaling information through their communication connection.

[0025] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the scheme.

[0026] The following description of the example will continue with reference to the accompanying drawings.

[0027] Example Interaction Figures 2A to 2J Example interfaces 200A to 200J are shown, illustrating interface interactions under various scenarios. Interfaces 200A to 200J can, for example, be... Figure 1 The electronic device 110 shown is provided.

[0028] In some cases, electronic device 110 receives a first input. The first input instructs the intelligent system to perform a media generation task. For example, such as... Figure 2AAs shown, electronic device 110 can present interface 200A. Interface 200A can be, for example, an interactive interface between a user and an intelligent system. Electronic device 110 can support interaction between the user and the intelligent system via interface 200A. For example, electronic device 110 can receive user input via input component 205 in interface 200A. After receiving user input, electronic device 110 can present a message corresponding to the user input in interface 200A. Additionally, after receiving user input, electronic device 110 can also provide the user input to the intelligent system. The intelligent system can process the user input using appropriate algorithms or models. For example, the intelligent system can perform semantic analysis on the user input to determine semantic information. Further, the intelligent system can generate a corresponding response based on the semantic information. After the response is generated, electronic device 110 can present a message corresponding to the response in interface 200A to support interaction between the user and the intelligent system.

[0029] In some scenarios, electronic device 110 can receive the first input via interface 200A. For example, electronic device 110 can receive the first input via an input component in interface 200A. The first input can be of any form, including, for example, text input, image input, video input, audio input, or a combination thereof. The first input can be used to instruct the intelligent system to perform a media generation task. The media generation task can instruct the intelligent system to call an appropriate model (e.g., a generative model) to create corresponding media content based on the description of the first input. As an example, the media generation task can include, but is not limited to, image generation tasks, video generation tasks, audio generation tasks, 3D model generation tasks, etc. For ease of description, the following will use image generation as an example for the media generation task. After receiving the first input, electronic device 110 can also present a message 210 corresponding to the first input in interface 200A. Message 210 can include text content and image content corresponding to the first input.

[0030] In this paper, an intelligent system refers to a system capable of autonomous control based on machine learning models. An intelligent system is, for example, a virtual object or physical entity capable of making decisions and autonomously executing actions based on machine learning models to achieve preset goals or complete preset tasks. An intelligent system can be an automated program that understands user intent and can utilize models or invoke tools to complete various types of tasks. In some contexts, examples of intelligent systems may include, but are not limited to: agents, bots, chatbots, digital avatars, intelligent customer service, digital assistants, etc. Alternatively, an intelligent system can also be an intelligent role implemented based on machine learning models. An "intelligent system" can process user requests based on generative models (e.g., language models, multimodal models) to perform specified types of tasks. In some cases, an intelligent system may also relate to virtual accounts, which may have corresponding avatars or nicknames.

[0031] In some cases, electronic device 110 can present first content. The first content originates from an intelligent system. The first content includes first media content and a first interactive component. The first media content is related to a media generation task. The first media content includes first visual elements. The first interactive component is used to provide a first service associated with a first object. The first object is associated with the first visual element.

[0032] As an example, such as Figure 2BAs shown, after receiving the first input, the electronic device 110 can provide the first input to the intelligent system. The intelligent system can perform a media generation task based on the first input to generate first content. The generation process of the first content will be described below, and will not be elaborated on here. After the first content is generated, the electronic device 110 can present the first content 215 in the interface 200B. The first content 215 includes first media content 215-1 and a first interactive component 215-2. The first media content 215-1 may include a first visual element 216. The first visual element 216 can be any suitable object in the first media content 215-1. For example, if the first media content 215-1 is an image of a room, then the first visual element 216 can be any furniture in the room, such as a bed, wardrobe, sofa, etc. The first interactive component 215-2 can be any suitable interface component related to the first object. As an example, the first interactive component 215-2 may include, but is not limited to: containers, cards (e.g., merchandise cards), panels, etc. Electronic device 110 can present information related to the first object in the first interactive component 215-2, such as displaying an image, name, and description of the first object. In some scenarios, the first interactive component 215-2 can provide a first service associated with the first object. The first object can be, for example, an appropriate object indicated by a first visual element, which may include, but is not limited to, goods, animals, and plants. Taking a good object (e.g., a double bed A) as an example, the first service provided by the first interactive component 215-2 can be a service related to the good object (e.g., double bed A), which may include, for example, a service to obtain the good object or a service to view the good object's details. Users can obtain the first service through the first interactive component 215-2. For example, when the first interactive component 215-2 is clicked, electronic device 110 can trigger the creation of an order associated with the first object (e.g., double bed A) to obtain the first object.

[0033] In some cases, the first media content is generated based on a first input and first reference information. The first reference information is associated with a first object. As an example, upon receiving the first input, the electronic device 110 can provide the first input to an intelligent system. The intelligent system can perform semantic recognition on the first input to determine the media generation task indicated by the first input. Further, the intelligent system can perform the media generation task to generate the first media content. During the execution of the media generation task, the intelligent system can determine the first object and the first reference information associated with the first object based on the first input. For example, the first input includes style information about a double bed (e.g., modern style). The intelligent system can then search a dataset for a double bed A that matches the style information (e.g., modern style) as the first object. After determining the double bed A, the intelligent system can obtain the first reference information corresponding to the double bed A. The first reference information here can be any appropriate information related to the first object, which may include, for example, a text description of the first object, an image of the first object, a video of the first object, etc. After obtaining the first reference information, the intelligent system can generate the first media content based on the first input and the first reference information. For example, an intelligent system can generate first media content based on a description of the room style in the first input and a textual description of the appearance of the first object in the first reference information.

[0034] In some scenarios, the initial input can also instruct the intelligent system to perform a media generation task related to clothing matching. For example, such an initial input could be "Help me match summer clothes; the sizes run large." Upon receiving the initial input, the intelligent system can, based on the "summer" in the initial input, determine clothing item A from the dataset that matches "summer" as the first target. Furthermore, the intelligent system can generate first media content based on the textual description of clothing item A and the "clothing sizes run large" in the initial input.

[0035] In some cases, the first reference information includes at least one piece of media content. This at least one piece of media content displays a first object. As an example, after identifying the first object, the intelligent system can acquire the first reference information associated with the first object. The first reference information can be at least one piece of media content associated with the first object. Such at least one piece of media content may include, for example, an image or video of the first object. For example, the intelligent system can search based on the name of the first object to obtain an image of the first object. After acquiring the first reference information, the intelligent system can generate the first media content based on the first reference information and the first input. For example, the intelligent system can generate the first media content based on a photograph of a double bed A and an appropriate description in the first input (e.g., "adding decorations and new furniture to the existing conditions").

[0036] In this way, the examples in this paper can generate first media content based on at least one piece of media content of the first object, which can effectively improve the generation quality of the first media content.

[0037] In some cases, the first object is obtained based on a search task. The search task includes searching for an object using first media content. As an example, after receiving a first input, the intelligent system can also generate first media content based on the first input. For example, the first input might include "generate a room decoration image in style A". The intelligent system can generate a room decoration image in style A based on such a first input. After the first media content is generated, the intelligent system can segment the first media content using an appropriate algorithm or model (e.g., an image segmentation model) to obtain first visual elements. After obtaining the first visual elements, the intelligent system can perform a search task based on the first visual elements to obtain a first object matching the first visual elements. For example, the intelligent system can segment the first media content to obtain an image of a double bed. After obtaining the image of a double bed, the intelligent system can search based on the image to obtain a product object (e.g., double bed A) corresponding to the image. After obtaining the first object, the intelligent system can provide the associated information of the first object (e.g., name, description, image, etc.) to the electronic device 110. Electronic device 110 can render based on associated information to present a first interactive component corresponding to the first object in interface 200B.

[0038] In this way, the examples in this paper enable the search for objects using the first media content after the first media content is generated, thereby obtaining the first object more efficiently and improving the generation efficiency of the first content.

[0039] In some scenarios, the intelligent system is configured to select a first object from a set of objects in response to the generation of first media content. As an example, after generating the first media content, the intelligent system can perform image segmentation on the first media content to obtain a first visual element. After obtaining the first visual element, the intelligent system can match the first object from the set of objects based on the first visual element. For example, the intelligent system can determine the first object based on the similarity between the first visual element and multiple candidate objects in the set of objects. When the intelligent system obtains a candidate object from the set whose similarity to the first visual element is greater than a threshold, it can use that candidate object as the first object. In this paper, "set of objects" can represent a collection of multiple product objects, which may include, but are not limited to, furniture, clothing, accessories, etc. Each product object in the set of objects may have its own product identifier, attribute information (e.g., size, color, material, etc.), inventory status, etc.

[0040] In some cases, the primary media content includes a fourth visual element. Electronic device 110 can present a fourth interactive component. The fourth interactive component provides a fourth service associated with a fourth object. The fourth object is associated with the fourth visual element.

[0041] As an example, such as Figure 2C As shown, the first media content 215-1 may include not only the first visual element 216, but also a fourth visual element 218. The fourth visual element 218 can be an appropriate object within the first media content. For example, if the first media content is a room decoration illustration, and the first visual element is a double bed in the illustration, then the fourth visual element could be a potted plant in the illustration. When the first media content includes multiple visual elements, the electronic device 110 can present multiple interactive components in the first content 215. For example, the electronic device 110 can present a fourth interactive component 220 corresponding to the fourth visual element in the first content 215. The fourth interactive component 220 is associated with a fourth object (e.g., a potted plant) and can be used to provide a fourth service related to the fourth object. Such a fourth service can be any appropriate service related to the fourth object, such as a service for obtaining or viewing the fourth object.

[0042] In some scenarios, the electronic device 110 can also display interactive components corresponding to other visual elements included in the first media content 215-1 within the first content 215. For example, the first media content 215-1 also includes a fifth visual element corresponding to the shelf. The electronic device 110 can then display the fifth interactive component corresponding to the shelf within the first content 215. Users can adjust the portion of the first content 215 displayed on the interface by sliding in the first direction. Figure 2D As shown, the electronic device 110 can receive a swipe operation (e.g., swipe up) in the first direction to adjust the portion of the first content 215 that is presented, so as to present the fifth interactive component 222 in the interface 200D.

[0043] In some cases, the first object and the fourth object correspond to the same type. The electronic device 110 can present the first interactive component and the fourth interactive component based on a first sequence. The first sequence is obtained based on the association information between the first object and the fourth object.

[0044] As an example, the first object and the fourth object can correspond to the same type; for example, both the first object and the fourth object can be potted plants. The first object is potted plant A, and the fourth object can be potted plant B. The electronic device 110 can present a first interactive component corresponding to potted plant A and a fourth interactive component corresponding to potted plant B in the first content 215 in a first order. The first order can be determined by the association information of potted plant A and potted plant B. This association information may include, for example, the first number of resources required to obtain potted plant A and the second number of resources required to obtain potted plant B. As an example, the electronic device 110 can obtain the first number of resources for potted plant A and the second number of resources for potted plant B. Further, the electronic device 110 can determine the first order based on the size of the first number of resources and the second number of resources. For example, if the first number of resources is greater than the second number of resources, then the electronic device 110 can place the first interactive component corresponding to potted plant A first, and the fourth interactive component corresponding to potted plant B last.

[0045] In this way, when objects of the same type exist, the examples in this paper can sort the corresponding interactive components based on the association information of the corresponding objects, so that users can more clearly perceive the association information of the objects through the sorted interactive components, thereby improving the efficiency of users obtaining information.

[0046] In some cases, the electronic device 110 can receive a fourth input, which instructs the selection of a third object. Further, the electronic device 110 can present third content. The third content includes third media content and third interactive components. The third media content includes third visual elements related to the third object. The third interactive components are used to provide third services associated with the third object.

[0047] As an example, electronic device 110 can receive a fourth input via the first interactive component 215-2. The fourth input can be any type of input, including voice input, action input (e.g., swiping, clicking), etc. For example, the fourth input here could be a swiping operation in the second direction (e.g., swiping left or right). After receiving the fourth input, electronic device 110 can switch the interactive component presented in interface 200D. For example, electronic device 110 can switch the first interactive component 215-2 to a third interactive component related to a third object to select the third object. After the third object is selected, electronic device 110 can update the first content 215 to the third content. For example, electronic device 110 can switch the first interactive component 215-2 to the third interactive component. When switching interactive components, electronic device 110 can trigger the intelligent system to generate third media content based on the association information of the third object. Specifically, the intelligent system can obtain the association information of the third object, which may include a description of the appearance of the third object, images of the third object, videos, etc. After obtaining the association information of the third object, the intelligent system provides this information to the media content generation model. The media content generation model can then use information such as the description of the third object's appearance, images, and videos to generate third media content. After the third media content is generated, the electronic device 110 can replace the first media content 215-1 in the first content 215 with the third media content, thus using the updated first content as the third content.

[0048] In this way, the examples in this paper allow users to select a third object to present third media content and third interactive components associated with that third object, thereby enabling users to obtain richer information and improving the efficiency of information acquisition.

[0049] In some cases, the electronic device 110 may present multiple candidate interactive components. These multiple candidate interactive components are associated with different objects. Furthermore, the electronic device 110 may receive a fourth input via a third interactive component among the multiple candidate interactive components.

[0050] As an example, such as Figure 2EAs shown, upon receiving a long press operation on the first interactive component 215-2, the electronic device 110 can present a selection window 224. The electronic device 110 can present multiple candidate interactive components in the selection window 224. These multiple candidate interactive components may include interactive components 224-1 and 224-2. Different interactive components can be applied to different objects. For example, interactive component 224-1 corresponds to double bed A, and interactive component 224-2 corresponds to double bed B. The electronic device 110 can receive a fourth input via a third interactive component (e.g., interactive component 224-2) among the multiple candidate interactive components. The fourth input may, for example, be a selection of interactive component 224-2. After interactive component 224-2 is selected, as... Figure 2F As shown, the electronic device 110 can present third content 226 in the interface 200F. The third content 226 includes third media content 226-1 generated based on the association information of a third object (e.g., double bed B) and a third interactive component 226-2 corresponding to the third object (e.g., double bed B).

[0051] In some cases, electronic device 110 can present second content. This second content originates from an intelligent system. The second content includes second media content and a second interactive component. The second visual element in the second media content is distinct from the first visual element. The second interactive component is used to provide a second service associated with a second object. The second object is associated with the second visual element.

[0052] As an example, such as Figure 2GAs shown, the electronic device 110 can present second content 228 in the interface 200G. The second content 228 includes second media content 228-1. The visual elements included in the second media content 228-1 can be distinguished from the visual elements in the first media content 215-1. For example, the second media content 228-1 includes a second visual element 230. The second visual element 230 can be distinguished from the first visual element 216. For example, the second visual element 230 could be a double bed of style A, while the first visual element 216 could be a double bed of style B. In some scenarios, the electronic device 110 can also present a second interactive component 228-2 in the second content 228. The second interactive component 228-2 corresponds to the second object indicated by the second visual element 230. For example, if the second object indicated by the second visual element 230 is a double bed C, then the second interactive component 228-2 could be a product card for double bed C. In other scenarios, the electronic device 110 can provide the user with a second service associated with the second object through the second interactive component 228-2. For example, when a user clicks the second interactive component 228-2, the electronic device 110 can display an interface associated with the second object. Such an interface could be, for example, an interface for obtaining the second object. The electronic device 110 can provide the user with a second service to obtain the second object through this interface.

[0053] In some scenarios, electronic device 110 can present second content in response to receiving a second input. The second content is derived based on the first and second inputs. The second input is used to trigger the generation of the second media content. As an example, electronic device 110 can receive a second input. The second input can have any suitable form, such as text input, image input, voice input, action input, or touch input to an interface element. As an example, the second input can include a click operation on a regeneration control in the interface. After the regeneration control is clicked, electronic device 110 can trigger an intelligent system to regenerate the media content based on the first input to obtain the second media content. In some scenarios, the second input can also include reference content entered by the user (e.g., reference text, reference media content). After the regeneration control is clicked, electronic device 110 can trigger an intelligent system to regenerate the media content based on the first and second inputs to obtain the second media content.

[0054] As another example, the second input may also include content typed in input component 205, such content may include reference text and reference media content. Such reference text could be, for example, "replace double bed A with a luxury double bed," to indicate the replacement of a portion of the object in the first media content. Upon receiving the second input, electronic device 110 can provide the second input to the intelligent system.

[0055] Upon receiving a second input, the intelligent system can generate second media content based on both the first and second inputs. For example, the intelligent system can first perform semantic analysis on the first and second inputs. The first input may contain an initial description of the overall scene (e.g., "generate a cozy bedroom"). The second input may contain instructions to modify or replace specific visual elements in the first media content (e.g., "replace double bed A with a luxury double bed"). The intelligent system can understand that the second input aims to change a first visual element in the first media content.

[0056] After determining that a change needs to be made to the first visual element, the intelligent system can identify a second object associated with the second input. For example, the intelligent system can search for beds matching "luxury style" and "double bed" from the object set as the second object (e.g., "double bed C"). Further, the intelligent system can acquire reference information related to the second object (e.g., photos, videos, etc.) and combine it with the scene description in the first input (e.g., "cozy bedroom") and the modification requirements in the second input to generate second media content. The second media content may include a second visual element 230 corresponding to the second object (e.g., "double bed C"), thus distinguishing it from the first visual element 216 (e.g., "double bed A") in the first media content 215-1. After the second content is generated, as... Figure 2G As shown, the electronic device 110 can display the second content 228 in the interface 200G.

[0057] In this way, the examples in this paper allow users to regenerate media content or modify or replace any part of the media content to provide users with new secondary media content, thereby effectively enriching the flexibility and efficiency of human-computer interaction.

[0058] In some cases, second media content has already been generated. Electronic device 110 can receive a third input. The third input is used to replace the first media content with the second media content. Further, electronic device 110 can present the second content in response to replacing the first media content with the second media content.

[0059] As an example, after receiving the first input, the intelligent system can generate multiple contents based on the first input. For instance, when a user requests the generation of a bedroom image through the first input, the intelligent system can generate multiple bedroom images of different styles or containing different furniture at the same time based on the same first input. The first media content 215-1 is the currently displayed image, while the second media content is the generated but not yet displayed alternative images.

[0060] In some scenarios, electronic device 110 can receive a third input. The third input can be any input used to switch the first media content, and it can have any appropriate form. Examples include text input, voice input, gesture input, or touch input to interface elements. Taking a swipe operation (e.g., a left swipe) on the first media content 215-1 as an example, when the third input is received, such as... Figure 2G As shown, the electronic device 110 can switch the first media content 215-1 to the second media content 228-1. After switching the first media content 215-1 to the second media content 228-1, the electronic device 110 can replace the first content 215 with the second content 228, and present interactive components corresponding to multiple visual elements in the second media content 228-1 in the second content 228. For example, a second interactive component 228-2 corresponding to the second object of the second visual element 230 is presented.

[0061] In this way, the example in this paper can quickly switch between different media content pre-generated by the intelligent system after receiving a third input, and synchronously update the corresponding interactive components after switching, thereby effectively improving the user's ease of operation when browsing content and improving the efficiency of human-computer interaction.

[0062] In some cases, electronic device 110 may replace the display style of the first interactive component in response to receiving a fifth input. For example, such as... Figure 2H As shown, the electronic device 110 can receive a fifth input, which can be any suitable form of input, such as text input, voice input, or action input. The fifth input may include, for example, double-clicking or dragging the first interactive component 215-2, clicking on controls associated with the first interactive component 215-2 (e.g., clicking on a collapsed or expanded control associated with the first interactive component 215-2), or a specific gesture (e.g., two-finger zooming within the area of ​​the first interactive component 215-2). In a specific example, the fifth input may be a double-click operation of the user on the first interactive component 215-2. Upon receiving such a fifth input, the electronic device 110 can replace the display style of the first interactive component 215-2. The replacement of the display style may include, but is not limited to, changing the size, shape, color, transparency, border style, or expanding or collapsing the information contained within the first interactive component 215-2. The replacement of the display style may also include switching the content layout format in the first interactive component 215-2. For example, switching from a content layout format of icons and text to a content layout format that only displays icons. As an example, such as... Figure 2H As shown, after receiving the fifth input, the electronic device 110 can adjust the background color of the first interactive component 215-2.

[0063] In this way, the example in this paper allows users to flexibly switch the display style of the first interactive component, thereby improving the flexibility of the interaction and the user experience.

[0064] In some cases, the fifth input is used to select the first visual element. The electronic device 110 can display the first interactive component in a first style. For example, such as... Figure 2B As shown, the first media content 215-1 includes a first visual element 216. The first interactive component 215-2 can currently be presented in a default style (e.g., a white background). The electronic device 110 can receive a fifth input. The fifth input can be a click operation on the first visual element 216. When the first visual element 216 is clicked, as... Figure 2H As shown, the electronic device 110 can display the first interactive component in a first style. This first style may include, for example, highlighting, a specific background color, a specific border, etc. As a concrete example, when the first visual element 216 is clicked, the electronic device 110 can change the background color of the first interactive component 215-2 from white to gray to indicate that the first visual element 216 corresponds to the first interactive component 215-2.

[0065] In this way, the examples in this paper allow users to select corresponding visual elements in media content and adjust the corresponding interactive components, thereby helping users to better perceive the interactive components corresponding to the visual elements and thus improving the efficiency of human-computer interaction.

[0066] In some cases, electronic device 110 can respond to a sixth input and replace the display style of the first visual element. For example, electronic device 110 can receive a sixth input, which can be any suitable form of input, such as text input, voice input, or gesture input. The sixth input can be associated with the first visual element, and may include, for example, a single click, long press, or double click on the first visual element. Upon receiving the sixth input, electronic device 110 can replace the display style of the first visual element 216. For example, electronic device 110 can change the color, brightness, contrast, and transparency of the first visual element 216, and add highlight borders, halos, shadows, etc., to indicate that the first visual element 216 is selected. For example, when the first visual element 216 is clicked, electronic device 110 can display appropriate interface elements (such as arrow elements, specific borders, etc.) in the area where the first visual element 216 is located to indicate that the first visual element 216 is selected.

[0067] In some cases, the sixth input is used to select the first interactive component. The electronic device 110 can display the first visual element in a second style. For example, as... Figure 2IAs shown, the electronic device 110 can receive a sixth input. The sixth input can be, for example, a selection of the first interactive component 215-2, such as a single click, double click, or long press on the first interactive component 215-2. After the first interactive component 215-2 is selected, the electronic device 110 can display the first visual element in the first media content 215-1 in a second style. The second style can be any appropriate display style different from the default style of the first visual element 216. The second style can include, but is not limited to, a highlight style, a magnification style, or adding an outline stroke. As an example, the second style can include a specific interface element, such as element 232. After the first interactive component 215-2 is selected, the electronic device 110 can present element 232 in the area corresponding to the first visual element in the first media content 215-1 to indicate that the first interactive component 215-2 corresponds to the first visual element 216.

[0068] In this way, when a user selects the first interactive component, the visual element corresponding to that interactive component in the first media content will be highlighted in the second style, thus establishing a clear correspondence between the interactive component and the visual element. This allows the user to more intuitively perceive the correspondence between the interactive component and the visual element, further enhancing the human-computer interaction experience.

[0069] In some cases, electronic device 110 can receive a seventh input. This seventh input is related to the first object. Further, electronic device 110 can trigger a service request corresponding to the first service based on the seventh input. The service request is used to obtain the first object. As an example, the seventh input here can be any suitable input used to trigger the service request corresponding to the first service, which may include, for example, text input, action input, voice input, gesture input, etc. Taking text input as an example, electronic device 110 can receive the seventh input via input component 205. The seventh input could be, for example, "Get me a double bed A". After receiving the seventh input, electronic device 110 can provide it to the intelligent system. The intelligent system can create a service request corresponding to the first service, which can be used to obtain the first object (e.g., double bed A). In this document, a service request can represent an instruction or data packet used to invoke or obtain a specific service. Service requests can include, but are not limited to: invocation instructions for calling an application programming interface (API), messages or events that trigger service components within the device, or commands used to create orders, appointments, inquiries, or other business operations. Service requests can carry parameters associated with the service, such as object identifiers (e.g., product SKUs), user identifiers, quantities, and delivery addresses. As an example, the smart system can send an order creation request for a first object to the server 130 to obtain the first object. The creation request can include the first object's identifier information, user identifier, delivery address, and quantity to be obtained. After triggering the service request, the electronic device 110 can also present the processing result of the service request. For example, the electronic device 110 can present an order confirmation interface. The order confirmation interface includes a thumbnail of the first object, the delivery address, and a submit order control. The user can click the submit order control to obtain the first object.

[0070] In this way, the example in this article allows users to quickly trigger service requests through the seventh input, without having to manually search for specific objects. The service request can be triggered simply through the seventh input, thereby effectively improving the triggering efficiency of service requests.

[0071] In some cases, the first service is provided by a service component. The electronic device 110 can display an interactive interface of the service component. The interactive interface displays product information of the first object. Furthermore, the electronic device 110 can trigger a service request in response to receiving a seventh input on the interactive interface.

[0072] As an example, a service component can represent a functional unit that encapsulates specific business logic and an interface. It can be loaded and run within the environment of a smart system to provide services such as music playback, article browsing, video playback, and object retrieval. As an example, a service component can be a "mini-program." Service components can be pre-built into the smart system or provided by a third-party application. When a service request needs to be triggered, the electronic device 110 can trigger the smart system to call the service component to complete the service request.

[0073] As an example, such as Figure 2I and 2J As shown, when the first interactive component 215-2 is clicked, the electronic device 110 can present the interactive interface of the service component. Such an interactive interface could be, for example, interface 200J. The electronic device 110 can present product information of the first object in interface 200J. For example, the electronic device 110 can present image 234 of the first object in interface 200J. The electronic device 110 can also present panel 236 in interface 200J. Panel 236 can present a description of the first object. For example, the electronic device 110 can present the name, inventory, etc. of the first object in panel 236. In some scenarios, the electronic device 110 can present control 238 in interface 200J. The electronic device 110 can receive a seventh input via control 238. Such a seventh input could be a click operation on control 238. After control 238 is clicked, the electronic device 110 can trigger a service request to construct an order for obtaining the first object.

[0074] In this way, the example in this paper, upon receiving the first input, can present the first content from the intelligent system, and can also present the first media content and the corresponding first interactive component within the first content, thereby allowing users to obtain richer content and improving the efficiency of information acquisition. Furthermore, when the user browses the first content from the intelligent system, the example in this paper can obtain the first service associated with the first object through the first interactive component, thereby reducing the interaction path and thus reducing the consumption of computing resources.

[0075] Example process Figure 3 A flowchart illustrating an example process 300 for interface interaction under certain conditions is shown. Process 300 can be implemented at electronic device 110. See below for reference. Figure 1 To describe process 300.

[0076] like Figure 3 As shown, in box 310, electronic device 110 receives a first input that instructs the intelligent system to perform a media generation task.

[0077] In frame 320, electronic device 110 presents first content, which comes from an intelligent system. The first content includes first media content and a first interactive component. The first media content is related to a media generation task and includes a first visual element. The first interactive component is used to provide a first service associated with a first object, which is associated with the first visual element.

[0078] In some cases, the first media content is generated based on a first input and a first reference, the first reference being associated with a first object.

[0079] In some cases, the first reference information includes at least one piece of media content, and at least one piece of media content is presented to the first object.

[0080] In this way, the examples in this paper can generate first media content based on at least one piece of media content of the first object, which can effectively improve the generation quality of the first media content.

[0081] In some cases, the first object is obtained based on a search task, which includes searching for the object using the content of the first media.

[0082] In this way, the examples in this paper enable the search for objects using the first media content after the first media content is generated, thereby obtaining the first object more efficiently and improving the generation efficiency of the first content.

[0083] In some cases, the intelligent system is configured to: in response to the generation of first media content, select a first object from the set of objects based on the first media content.

[0084] In some cases, process 300 further includes: presenting second content, the second content originating from an intelligent system, the second content including second media content and a second interactive component, the second visual element in the second media content being distinct from the first visual element, the second interactive component being used to provide a second service associated with a second object, the second object being associated with the second visual element.

[0085] In some cases, presenting the second content includes: in response to receiving a second input, presenting the second content, which is obtained based on the first input and the second input, the second input being used to trigger the generation of the second media content.

[0086] In this way, the examples in this paper allow users to regenerate media content or modify or replace any part of the media content to provide users with new secondary media content, thereby effectively enriching the flexibility and efficiency of human-computer interaction.

[0087] In some cases, second media content has been generated, and presenting the second content includes: receiving a third input for replacing the first media content with the second media content; and presenting the second content in response to replacing the first media content with the second media content.

[0088] In this way, the example in this paper can quickly switch between different media content pre-generated by the intelligent system after receiving a third input, and synchronously update the corresponding interactive components after switching, thereby effectively improving the user's ease of operation when browsing content and improving the efficiency of human-computer interaction.

[0089] In some cases, process 300 further includes: receiving a fourth input indicating the selection of a third object; and presenting third content, the third content including third media content and a third interactive component, the third media content including third visual elements associated with the third object, and the third interactive component for providing a third service associated with the third object.

[0090] In this way, the examples in this paper allow users to select a third object to present third media content and third interactive components associated with that third object, thereby enabling users to obtain richer information and improving the efficiency of information acquisition.

[0091] In some cases, receiving a fourth input includes: presenting multiple candidate interactive components, which are associated with different objects; and receiving the fourth input via a third interactive component among the multiple candidate interactive components.

[0092] In some cases, process 300 may also include: replacing the display style of the first interactive component in response to receiving a fifth input.

[0093] In this way, the example in this paper allows users to flexibly switch the display style of the first interactive component, thereby improving the flexibility of the interaction and the user experience.

[0094] In some cases, the fifth input is used to select the first visual element, and replacing the display style of the first interactive component includes: displaying the first interactive component in a first style.

[0095] In this way, the examples in this paper allow users to select corresponding visual elements in media content and adjust the corresponding interactive components, thereby helping users to better perceive the interactive components corresponding to the visual elements and thus improving the efficiency of human-computer interaction.

[0096] In some cases, process 300 further includes: replacing the display style of the first visual element in response to receiving a sixth input.

[0097] In some cases, a sixth input is used to select a first interaction component, and the replacement display style of the first visual element includes: displaying the first visual element in a second style.

[0098] In this way, when the user selects the first interaction component, the visual element corresponding to the interaction component in the first media content will be highlighted in the second style, so that a clear correspondence can be established between the interaction component and the visual element, enabling the user to more intuitively perceive the correspondence between the interaction component and the visual element, further enhancing the human-computer interaction experience.

[0099] In some cases, process 300 further includes: receiving a seventh input, where the seventh input is related to a first object; and based on the seventh input, triggering a service request corresponding to a first service, where the service request is used to obtain the first object.

[0100] In this way, the examples in this article support the user to quickly trigger a service request through the seventh input, so that there is no need to manually search for a specific object, and the service request can be triggered only through the seventh input, thereby effectively improving the triggering efficiency of the service request.

[0101] In some cases, the first service is provided by a service component, and triggering the service request corresponding to the first service includes: presenting an interaction interface of the service component, where the interaction interface presents product information of the first object; and in response to receiving the seventh input on the interaction interface, triggering the service request.

[0102] In some cases, the first media content includes a fourth visual element, and process 300 further includes: presenting a fourth interaction component, where the fourth interaction component provides a fourth service associated with a fourth object, and the fourth object is associated with the fourth visual element.

[0103] In some cases, the first object and the fourth object correspond to the same type, and process 300 further includes: presenting the first interaction component and the fourth interaction component based on a first order, where the first order is obtained based on the association information of the first object and the fourth object.

[0104] Example devices and equipment Corresponding devices for implementing the above method or process are also provided. Figure 4 The schematic structural block diagram of an example device 400 for interface interaction according to some cases is shown. Device 400 can be implemented as or included in an electronic device 110. Each module / component in device 400 can be implemented by hardware, software, firmware, or any combination thereof.

[0105] As Figure 4As shown, the device 400 includes: a first receiving module 410 configured to receive a first input, the first input instructing an intelligent system to perform a media generation task; and a first presentation module 420 configured to present first content, the first content originating from the intelligent system, the first content including first media content and a first interactive component, the first media content being related to the media generation task, the first media content including a first visual element, and the first interactive component being used to provide a first service associated with a first object, the first object being associated with the first visual element.

[0106] In some cases, the first media content is generated based on a first input and a first reference, the first reference being associated with a first object.

[0107] In some cases, the first reference information includes at least one piece of media content, and at least one piece of media content is presented to the first object.

[0108] In some cases, the first object is obtained based on a search task, which includes searching for the object using the content of the first media.

[0109] In some cases, the intelligent system is configured to: in response to the generation of first media content, select a first object from the set of objects based on the first media content.

[0110] In some cases, device 400 also includes a second presentation module configured to present second content, which is derived from an intelligent system. The second content includes second media content and a second interactive component. The second visual element in the second media content is distinct from the first visual element. The second interactive component is used to provide a second service associated with a second object, which is associated with the second visual element.

[0111] In some cases, the second presentation module is also configured to: in response to receiving a second input, present second content, the second content being obtained based on the first input and the second input, the second input being used to trigger the generation of second media content.

[0112] In some cases, second media content has been generated, and the second presentation module is further configured to: receive a third input for replacing the first media content with the second media content; and, in response to replacing the first media content with the second media content, present the second content.

[0113] In some cases, device 400 further includes a second receiving module configured to receive a fourth input indicating the selection of a third object; and to present third content, the third content including third media content and a third interactive component, the third media content including third visual elements associated with the third object, and the third interactive component for providing a third service associated with the third object.

[0114] In some cases, the second receiving module is also configured to: present multiple candidate interactive components, which are associated with different objects; and receive a fourth input via a third interactive component among the multiple candidate interactive components.

[0115] In some cases, the device 400 also includes a first replacement module configured to replace the display style of the first interactive component in response to receiving a fifth input.

[0116] In some cases, the fifth input is used to select the first visual element, and the first replacement module is also configured to display the first interactive component in a first style.

[0117] In some cases, the device 400 also includes a second replacement module configured to replace the display style of the first visual element in response to receiving a sixth input.

[0118] In some cases, the sixth input is used to select the first interactive component, and the second replacement module is also configured to display the first visual element in a second style.

[0119] In some cases, the device 400 also includes a triggering module configured to receive a seventh input, which is associated with the first object; and based on the seventh input, to trigger a service request corresponding to the first service, the service request being used to obtain the first object.

[0120] In some cases, the first service is provided by a service component, and the triggering module is also configured to: present the interactive interface of the service component, the interactive interface presenting the product information of the first object; and trigger a service request in response to receiving a seventh input on the interactive interface.

[0121] In some cases, the first media content includes a fourth visual element, and the device 400 also includes a third presentation module configured to present a fourth interactive component that provides a fourth service associated with a fourth object, which is associated with the fourth visual element.

[0122] In some cases, the first object and the fourth object correspond to the same type, and the device 400 also includes a fourth presentation module configured to present the first interactive component and the fourth interactive component based on a first order, the first order being obtained based on the association information of the first object and the fourth object.

[0123] The modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some cases, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 400 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on.

[0124] Figure 5 A block diagram of an electronic device 500 in which one or more examples may be implemented is shown. It should be understood that... Figure 5 The electronic device 500 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 5 The electronic device 500 shown can be used to implement the electronic device 110 discussed above.

[0125] like Figure 5 As shown, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processing units or processors 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0126] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0127] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 5 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various examples.

[0128] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.

[0129] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0130] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0131] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0132] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0133] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0134] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0135] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for interface interaction, comprising: Receive a first input, which instructs the intelligent system to perform a media generation task; as well as The system presents first content, which originates from the intelligent system. The first content includes first media content and a first interactive component. The first media content is related to the media generation task. The first media content includes a first visual element. The first interactive component is used to provide a first service associated with a first object. The first object is associated with the first visual element.

2. The method according to claim 1, wherein the first media content is generated based on the first input and the first reference information, the first reference information being associated with the first object.

3. The method of claim 2, wherein the first reference information includes at least one piece of media content, the at least one piece of media content displaying the first object.

4. The method according to claim 1, wherein the first object is obtained based on a search task, the search task including searching for the object using the first media content.

5. The method of claim 4, wherein the intelligent system is configured to: In response to generating the first media content, the first object is selected from the object set based on the first media content.

6. The method according to claim 1, further comprising: The system presents second content, which originates from the intelligent system. The second content includes second media content and a second interactive component. The second visual element in the second media content is different from the first visual element. The second interactive component is used to provide a second service associated with a second object, which is associated with the second visual element.

7. The method of claim 6, wherein presenting the second content comprises: In response to receiving a second input, the second content is presented, the second content being obtained based on the first input and the second input, the second input being used to trigger the generation of the second media content.

8. The method of claim 6, wherein the second media content has been generated, and the presentation of the second content comprises: Receive a third input, the third input being used to replace the first media content with the second media content; as well as In response to replacing the first media content with the second media content, the second content is presented.

9. The method according to claim 1, further comprising: Receive a fourth input, which indicates the selection of a third object; as well as The third content is presented, which includes third media content and third interactive components. The third media content includes third visual elements related to the third object, and the third interactive components are used to provide third services associated with the third object.

10. The method of claim 9, wherein receiving the fourth input comprises: Multiple candidate interactive components are presented, and these multiple candidate interactive components are associated with different objects; as well as The fourth input is received via the third interaction component among the plurality of candidate interaction components.

11. The method according to claim 1, further comprising: In response to receiving a fifth input, the display style of the first interactive component is replaced.

12. The method of claim 11, wherein the fifth input for selecting the first visual element and replacing the display style of the first interactive component comprises: The first interactive component is displayed in the first style.

13. The method according to claim 1, further comprising: In response to receiving the sixth input, the display style of the first visual element is replaced.

14. The method of claim 13, wherein the sixth input for selecting the first interactive component and replacing the display style of the first visual element comprises: The first visual element is displayed in the second style.

15. The method of claim 1, further comprising: Receive a seventh input, which is related to the first object; as well as Based on the seventh input, a service request corresponding to the first service is triggered, and the service request is used to obtain the first object.

16. The method of claim 15, wherein the first service is provided by a service component, and triggering a service request corresponding to the first service comprises: The interactive interface of the service component is presented, and the interactive interface presents the product information of the first object; as well as In response to receiving the seventh input on the interactive interface, the service request is triggered.

17. The method of claim 1, wherein the first media content includes a fourth visual element, and the method further includes: A fourth interactive component is presented, which provides a fourth service associated with a fourth object, which is associated with the fourth visual element.

18. A device for user interface interaction, comprising: The first receiving module is configured to receive a first input, which instructs the intelligent system to perform a media generation task. as well as A first presentation module is configured to present first content, which originates from the intelligent system. The first content includes first media content and a first interactive component. The first media content is related to the media generation task and includes a first visual element. The first interactive component is used to provide a first service associated with a first object, which is associated with the first visual element.

19. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 17 when executed by the at least one processor.

20. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 17.

Images