Method, device, equipment and program product for interface interaction

Abstract

Methods, apparatus, devices, and program products are provided for interface interaction. The method includes receiving a first request, the first request being used to instruct a smart system to perform a first task, the first request including an identification of at least one media content; presenting a first element, the first element being used to mark a first object of the at least one media content; and presenting a first media content, the first media content being provided by the smart system, the first media content including a first visual content, the first visual content corresponding to the first object. In this way, the efficiency of a user obtaining information can be improved.

Description

Technical Field

[0001] The examples in this article generally relate to the field of computer science, and in particular to methods, apparatuses, devices, and program products for user interface interaction. Background Technology

[0002] With the development of artificial intelligence technology, intelligent systems are now able to identify, describe, and reason to a certain extent about media content provided by users, and provide suggestions or conclusions in text form. However, users often find it difficult to intuitively understand the process by which intelligent systems process media content, thus placing higher demands on the intuitiveness of the interface interaction and the comprehensibility of the results. Summary of the Invention

[0003] In a first aspect, a method for interface interaction is provided. The method includes: receiving a first request, the first request instructing an intelligent system to perform a first task, the first request including an identifier of at least one piece of media content; presenting a first element, the first element used to mark a first object of the at least one piece of media content; and presenting first media content, the first media content provided by the intelligent system, the first media content including first visual content, the first visual content corresponding to the first object.

[0004] In a second aspect, an apparatus for interface interaction is provided. The apparatus includes: a receiving module configured to receive a first request, the first request being used to instruct an intelligent system to perform a first task, the first request including an identifier of at least one piece of media content; a first presentation module configured to present a first element, the first element being used to mark a first object of the at least one piece of media content; and a second presentation module configured to present first media content, the first media content being provided by the intelligent system, the first media content including first visual content, the first visual content corresponding to the first object.

[0005] In a third aspect, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0007] In this way, the processing elements of the marked object and the corresponding result content can be presented locally at the relevant position of the media content during the execution of the task by the intelligent system. This allows users to intuitively and coherently perceive the processing process and its results, which can improve the efficiency of users to obtain information and reduce the overhead caused by interface jumps and repeated rendering.

[0008] It should be understood that the descriptions in this section are not intended to limit the key or important features of the examples in this paper, nor are they intended to restrict the scope of the scheme. Other features will become readily apparent from the following descriptions. Attached Figure Description

[0009] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of the example environment is shown; Figures 2A to 2K Example interfaces for some scenarios are shown; Figures 3A to 3I Example interfaces for some scenarios are shown; Figure 4 The flowcharts show example processes of interface interactions in some scenarios; Figure 5 Schematic block diagrams of example devices for interface interaction in some scenarios are shown; and Figure 6 A block diagram of an electronic device capable of implementing multiple illustrative scenarios is shown. Detailed Implementation

[0010] The examples in this document will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.

[0011] It should be noted that the headings of any section / subsection provided herein are not restrictive. Various examples are described throughout this document, and examples of any type may be included under any section / subsection. Furthermore, examples described in any section / subsection may be combined in any way with any other examples described in the same section / subsection and / or different sections / subsections.

[0012] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0013] The examples in this article may involve users' historical interaction data, the acquisition of such data, and / or its use. All of these aspects comply with relevant laws, regulations, and rules. In the examples presented here, all collection, acquisition, processing, manipulation, forwarding, and use of historical interaction data are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the types, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.

[0014] In one context, an intelligent system is an information processing system. This intelligent system uses at least one or more models to process one or more inputs. The intelligent system may include the one or more models as components, or it may use models external to the system for processing. Those skilled in the art will recognize that there are various implementations of intelligent systems in the industry, including but not limited to agents, artificial intelligence (AI) assistants, AI workers, copilot systems, and chatbots. The inputs include data in one or more modalities. The modal data includes, but is not limited to, text, audio, images, video, application-specific data, or scientific computing data. The models include, but are not limited to, one or more combinations of the following: large-scale parametric models, deep learning models, neural network models, machine learning models, statistical models, rule-based models, or other models capable of processing the inputs. The specific implementation of the models can employ various existing or improved models. The intelligent system may involve one or more of the following operations: receiving single-round or multi-round input; recognizing and / or understanding the input; generating answers, decisions, or processing results using one or more models; invoking one or more external tools, interfaces, knowledge bases, or other systems to obtain information or perform operations; processing in a self-decision-making or human-machine collaborative manner, or transferring tasks to human or other systems for processing. Self-decision-making refers to execution without human intervention. Human-machine collaboration refers to partial human participation or confirmation. The above explanation of "intelligent system" is illustrative, and each description is an example, not necessarily necessary, and does not constitute an exhaustive list.

[0015] The term "media content" as used in this article refers to content carriers that carry visual, image, video, text, or a combination thereof, and may typically include, but is not limited to, user-uploaded images, videos, images returned from searches, generated images, and screenshots.

[0016] As used in this article, the term "object" refers to the actual entity, area, or content element contained in media content, which may include, but is not limited to, clothing, furniture, objects, text areas, or combinations thereof.

[0017] The term "element" as used in this article refers to a visual component presented at a relevant location in media content, used to mark or explain objects or relationships between objects. It may include, but is not limited to, numbered markers, boxes, dots, connecting lines, and combinations thereof, used to characterize the processing of media content by an intelligent system.

[0018] The term "visual content" as used in this article refers to the visible portion of media content that corresponds to a specific object. Visual content can originate directly from the image area of ​​an object, or it can be image or video content that still corresponds to the object after being cropped, transformed, redrawn, generated, virtually tried on, repositioned, or styled.

[0019] The term "virtual avatar" as used in this article refers to a visual image used to carry and display the effect of clothing outfits, which can typically include, but is not limited to, two-dimensional or three-dimensional images generated based on user-provided images or videos.

[0020] The term "processing" used in this article refers to the process by which an intelligent system understands, locates, calculates, and makes decisions about media content during the execution of a task. The intermediate steps can usually be organized in the form of a Chain of Thought (CoT) and can be presented as externalized content.

[0021] As used in this document, a "stage" refers to a part of a task that can be distinguished from other parts based on at least one of the following: processing objective, processing object, input data, intermediate results, processing time period, or interface state. Different stages may be executed sequentially, partially overlapping, or when certain conditions are met.

[0022] The term “associated location” as used in this article refers to the location on coordinates corresponding to the marked object in the media content, which may include, but is not limited to, the area above the object, its edge, or its neighboring area, so that the element can be overlaid on the media content in situ.

[0023] As used in this article, the term "component" refers to a visual container in an interface used to display media content, carry elements, or receive operations. Components may include image display areas, video playback areas, visualization canvases, toolbars, buttons, input boxes, or combinations of the above functions.

[0024] The term "style" as used in this article can include an element's color, shape, line style, thickness, opacity, fill mode, text content, animation mode, display level, or a combination of these attributes. The first style and the second style differ only in at least one style attribute.

[0025] The term "outfit effect" as used in this article refers to the visual presentation of clothing worn by a virtual avatar, achieved by combining one or more outfit elements with the avatar. Outfit effects can be obtained by overlaying, blending, deforming, mapping, or rendering outfit elements onto the virtual avatar, or by generating models based on outfit elements and the virtual avatar. Outfit effects can include static images, dynamic images, videos, 3D models, or combinations thereof, and can display the virtual avatar's front, side, back, different poses, or different action states.

[0026] The term "dynamic process" as used in this article refers to the presentation process in which the first element changes over time. Dynamic processes can include the appearance, disappearance, movement, extension, shortening, scaling, rotation, blinking, color change, shape change, style change, display state change, or switching between different elements.

[0027] As used in this document, the term "service" refers to a function or process associated with an object that is provided to a user through a user interface component. Services may include obtaining, renting, reserving a trial, saving, downloading, subscribing, obtaining a link, requesting information, or obtaining information related to the object. A service used to obtain the first object may allow the user to obtain the first object itself, or it may allow the user to obtain ownership, usage rights, access rights, download rights, reservation qualifications, or information for further obtaining the first object.

[0028] The term "Optical Character Recognition (OCR)" as used in this article refers to the technology of locating and recognizing text content from images, which can typically be used to locate and extract text regions in media content.

[0029] The term "HyperText Markup Language (HTML)" as used in this article refers to a markup language used to describe and present interface content and structure. It is typically used to carry and render media content and the elements and dynamic effects overlaid on it. In some cases, it can also be implemented by Scalable Vector Graphics (SVG), Canvas, or other client-side components.

[0030] As mentioned above, while intelligent systems can understand media content and provide suggestions or conclusions in text form, users often need to rely on their own imagination to understand which part of the media content the conclusion corresponds to, what the basis for the judgment is, and what differences will occur before and after adjusting the content. In other words, there is no local, visual correspondence between the processing process and the result and the original media content. Users need to repeatedly compare the textual conclusion with the original content and jump between different interfaces multiple times to understand the result and perform subsequent operations. This not only increases the number of steps for users but also makes it necessary to repeatedly load and render separate pages to present the conclusion, thus bringing additional front-end rendering and end-to-end cloud communication overhead.

[0031] A user interface interaction scheme is proposed. According to the scheme, an electronic device receives a first request for instructing an intelligent system to perform a first task, the first request including an identifier for at least one piece of media content; presents a first element for marking a first object in the media content; thereafter, the electronic device presents first media content provided by the intelligent system, the first media content including first visual content corresponding to the first object.

[0032] Through the above solution, users can see, in a continuous and localized manner, which objects the intelligent system is focusing on and the basis for its processing during the media content processing process. They can also directly see the visual content corresponding to the objects of interest in the results, reducing the need for users to repeatedly compare textual conclusions with the original content and navigate between multiple interfaces. Since the processing and results reuse the same media content and its coordinate system for local overlay presentation, electronic devices do not need to load and render separate pages for the process and results. This reduces client-side page rendering overhead, document object model refresh frequency, and cache usage, as well as the number of page requests to the server and the bandwidth usage for end-to-end cloud communication.

[0033] The following describes various examples of this scheme in further detail with reference to the accompanying drawings.

[0034] Example Environment Figure 1 A schematic diagram of example environment 100 is shown. (e.g.) Figure 1 As shown, example environment 100 may include electronic device 110.

[0035] In this example environment 100, electronic device 110 can run an application 120 that supports user interface interaction. Application 120 can be any suitable type of application for user interface interaction, including but not limited to smart assistant applications, image processing applications, content browsing applications, or other suitable applications. User 140 can interact with application 120 via electronic device 110 and / or its attached devices.

[0036] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.

[0037] In some cases, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, virtual reality (VR) / augmented reality (AR) devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some cases, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0038] Server 130 can be a single physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.

[0039] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some cases, server 130 and electronic device 110 can exchange signaling information through their communication connection.

[0040] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the scheme.

[0041] The examples described herein can be implemented on electronic device 110. It should be noted that the operations described relative to electronic device 110 can be performed by a related application 120 running on electronic device 110. The interface described relative to electronic device 110 can be provided by application 120; for example, electronic device 110 presents the corresponding interface by running application 120. Furthermore, some operations described relative to electronic device 110 may require the assistance of server 130 to complete.

[0042] The following description of the example will continue with reference to the accompanying drawings.

[0043] Example Interaction Figures 2A to 2K Some sample interfaces 200A to 200K are shown. The following explanation uses an outfit scenario as the main example. In this scenario, at least one piece of media content can include a wardrobe photo or a photo of an individual item. The first object can be a top, the second object can be a skirt or pants, the first element can be a box or number used to mark the clothing, and the first media content can be an outfit illustration or an outfit video.

[0044] In some cases, electronic device 110 may present an input component 202 for interacting with an intelligent system and receive a first request through the input component 202, the first request being used to instruct the intelligent system to perform a first task, wherein the first request may be in the form of natural language.

[0045] As an example, such as Figure 2AAs shown, a user can upload at least one piece of media content via input component 202, and then input a text description such as "Based on the clothes in my wardrobe, please recommend an outfit for tomorrow's dinner party." The at least one piece of media content can be a wardrobe photo. Electronic device 110 can acquire at least one piece of media content, such as the wardrobe photo uploaded by the user, and combine the photo with natural language content to form a first request. Upon receiving the first request, electronic device 110 can present at least one piece of media content associated with the first request (e.g., media content 204) and a message 206 corresponding to the text description in the first request on interface 200A.

[0046] Upon receiving the first request, electronic device 110 can provide it to the intelligent system. Based on the date and weather information, the intelligent system interprets "tomorrow's outfit" as an outfit task suitable for the corresponding temperature and weather, and then begins to identify clothing items in the wardrobe photos. The first request in natural language is not limited to complete sentences; it can also be keywords, follow-up questions to existing requests, or omitted expressions in multi-turn dialogues. For example, if the user has already uploaded wardrobe photos and only enters "change to something more formal," electronic device 110 can interpret this content as a first request to adjust the current outfit recommendations based on the conversation context. By having the input component simultaneously carry media content and natural language, users can initiate tasks and follow up in the same location, eliminating the need for complex forms on the front end for each task; the back end can then complete omitted information based on the conversation context.

[0047] In some scenarios, the first request may include an identifier for at least one piece of media content. For example, the identifier for at least one piece of media content may include the storage address, access link, resource identifier, file identifier, object storage key, content number, or other information that can be used to retrieve at least one piece of media content. The first request may not carry the at least one piece of media content itself; the intelligent system can access the corresponding storage location or content service based on the identifier information in the first request to retrieve at least one piece of media content. For example, a user selects a previously uploaded wardrobe photo in a session interface and enters, "Based on the clothes in my wardrobe, please recommend an outfit for tomorrow's dinner party." In response to the user's sending operation, the electronic device 110 generates a first request including the access address of the wardrobe photo and the aforementioned natural language content, and provides the first request to the intelligent system. The intelligent system parses the first request, retrieves the wardrobe photo from the storage location indicated by the access address, then identifies the clothing in the wardrobe photo, and generates an outfit recommendation based on the identified clothing. Therefore, the first request does not need to directly carry image data. Instead, it can transmit the identification information of the media content so that the intelligent system can obtain the corresponding media content, thereby reducing the amount of data carried in the request and supporting the reuse of media content that has already been uploaded or stored.

[0048] In some cases, electronic device 110 presents a first element. The first element is used to mark a first object containing at least one piece of media content. For example, such as... Figure 2B As shown, upon receiving a first request, the intelligent system can determine and execute a first task. For example, the first task is an object identification task. The intelligent system can identify a first object (e.g., object 212-1) in at least one piece of media content and generate a first element for marking object 212-1. After the first element is generated, the electronic device 110 can present the first element. For example, element 210-1 is presented in interface 200B.

[0049] In some cases, during the execution of a first task by the intelligent system, the electronic device 110 may present at least one element at an associated location of at least one media content, the at least one element representing the intelligent system’s processing of at least one media content and including a first element for marking a first object.

[0050] As an example, such as Figure 2B As shown, upon receiving a first request, the intelligent system can determine the first task corresponding to the first request and execute the first task. For example, if the first request is an outfit recommendation request, the intelligent system can determine that the first task is an outfit recommendation task. Further, the intelligent system can identify at least one piece of media content and identify at least one object from the at least one piece of media content that matches the outfit recommendation task. For example, clothing item A in a wardrobe photo. Further, the electronic device 110 can present component 208 in interface 200B. Component 208 includes at least one piece of media content (e.g., media content 204). Further, the electronic device 110 can present elements 210-1 to 210-3 at associated positions in media content 204. Different elements are used to label different objects in the at least one piece of media content. For example, element 210-1 is used to label object 212-1, element 210-2 is used to label object 212-2, and element 210-3 is used to label object 212-3. Element 210-1 in elements 210-1 to 210-3 can be the first element, which is used to mark the first object (e.g., object 212-1), and can be presented in the associated location of object 212-1, for example, in the area where object 212-1 is located.

[0051] In some cases, a first request may characterize a first need, and a first object may include at least one object that matches the first need. For example, such as... Figure 2A and Figure 2BAs shown, a user uploads a photo showcasing their wardrobe and enters, "Based on the clothes in my wardrobe, please recommend an outfit for tomorrow's dinner party." The intelligent system extracts demand features such as "dinner party," "formal," and "choose from the existing wardrobe" from this input. It then performs category, color, material, and formality recognition on the clothing in the wardrobe photo, identifying top A as the first object matching the first demand. Electronic device 110 presents the first element 210-1 at the associated location of top A to provide feedback to the user on the object matching the first demand. Here, "the first request represents the first demand" means that the goal or constraint the user hopes the first task will satisfy can be determined from the first request itself or the context associated with the first request. The first demand may include one or more of the following: usage scenario, object category, style, color, size, weather, spatial function, or output format; the first demand does not need to be explicitly filled in as a separate field, nor is it required that the natural language in the first request be exactly the same as the first demand. As a further example, the user can enter, "Not too formal, outdoor temperature around ten degrees Celsius." The intelligent system can analyze this content along with previous dinner requests, reducing the weight of formality and increasing the constraint of warmth, and recalculate the match between candidate clothing and the primary requirement. If the original top still meets the updated primary requirement, it is retained; otherwise, a new primary element is presented to mark another more matching coat, and the outfit illustration is updated based on the new object. By directly linking the requirement matching results to the marked objects, the system can display the recommendation basis and adjustment results to the user; the backend can incrementally update only the requirement weight and candidate ranking, avoiding reprocessing all media content with each follow-up query.

[0052] In some cases, at least one piece of media content may include a second object. For example, such as... Figure 2B As shown, in response to the message "Give me some outfit suggestions for tomorrow's dinner party based on the clothes in my wardrobe," the intelligent system identifies top A and bottom A from the wardrobe photos, designating them as the first and second objects, respectively. The electronic device 110 sequentially presents element 210-1, which marks top A, and element 210-3, which marks bottom A, allowing the user to verify the clothing objects that the intelligent system is preparing to combine.

[0053] In some cases, electronic device 110 may present a second element 214 connecting a first object and a second object, wherein the second element 214 represents a first relationship between the first object and the second object. As an example, such as... Figure 2CAs shown, after the intelligent system determines that top A and bottom A are compatible in terms of color and formality, it outputs the object identifiers of the two and their "outfit matching" relationship. The electronic device 110 dynamically draws a connecting line 214 between elements 210-1 and 210-3 based on the display positions of the two objects, and can also display descriptive text such as "evening outfit" near the connecting line. When the user switches to another bottom through appropriate operation, the intelligent system re-determines the relationship, and the electronic device 110 accordingly moves the endpoints of the connecting line or stops displaying the original connecting line. The first relationship can include matching relationship, positional relationship, subordinate relationship, comparative relationship, operation sequence relationship, or other semantic relationship. The second element 214 can directly connect the boundaries or centers of the two objects, or it can connect elements used to mark the two objects, as long as its display effect can represent the first relationship between the two objects. By synchronously displaying object selection and object relationships on the front end, users can verify the combination logic and change objects in a timely manner before generating the final result; the back end can save the relationship judgment result as an updatable structured relationship without fixing the relationship in the final image.

[0054] In some cases, the electronic device 110 may present first media content including first visual content corresponding to a first object; the first media content may also include second visual content corresponding to a second object, and the first media content displays a combination of the first object and the second object. As an example, such as... Figure 2D As shown, after the user confirms the pairing relationship between top A and bottom A, the intelligent system extracts or generates first visual content 219-1 and second visual content 219-2 corresponding to top A and bottom A respectively, combines the two according to their pairing relationship into a complete look, and presents the combination result as first media content (e.g., media content 218) in component 216. This allows for continuous feedback between object confirmation, relationship confirmation, and result generation; the backend can avoid prematurely generating the more costly complete image if the relationship has not been confirmed by the user. The "pairing" of the first and second objects refers to their joint use, joint display, or establishment of a combination relationship in the first media content according to the first requirement, and is not limited to clothing pairings. For example, pairing can be a clothing combination of top and bottom, a spatial arrangement of sofa and floor lamp, a combination of main products and accessories, or a dish combination of ingredients.

[0055] In some cases, the first media content may also include a virtual avatar, a first object corresponding to a first clothing element, a second object corresponding to a second clothing element, and the first media content displays the clothing effect obtained by applying the first and second clothing elements to the virtual avatar. As an example, such as... Figure 2EAs shown, the intelligent system extracts the appearance features of top A and bottom A from a wardrobe photo, generating a first dressing element 222-1 and a second dressing element 222-2, respectively. The intelligent system can adjust the size, angle, and occlusion relationship of the two dressing elements based on the visual features of the virtual avatar, presenting top A on the upper body of the virtual avatar and bottom A on the lower body, and performing edge blending. The electronic device 110 then presents first media content (e.g., media content 220) to allow the user to see the dressing effect after the entire outfit is applied to the virtual avatar. Here, the first and second dressing elements are visual content in the first media content used to create the dressing effect; they can be layers extracted from the corresponding object, 3D models reconstructed from the corresponding object, textures, or clothing images obtained from the generated model. Applying dressing elements to the virtual avatar can include overlaying, blending, rendering, deforming, mapping, or generating a corresponding wearing state.

[0056] In some scenarios, electronic device 110 can receive third-party media content and create a virtual avatar based on it. For example, a user can upload third-party media content before generating virtual try-on content, which may include the visual features of the corresponding object. The intelligent system detects the visual features of the object in the third-party media content and creates a two-dimensional or three-dimensional virtual avatar that matches the content. The intelligent system can then apply the matching elements corresponding to top A and bottom A to the virtual avatar to generate a matching effect image. The third-party media content can also be multi-angle videos, existing virtual avatars, or other suitable content. By reusing the same virtual avatar, different combinations of objects can be presented from a consistent perspective, facilitating user comparison; and the various parameters of the virtual avatar can be cached, updating only the matching elements when changing clothes, thereby reducing redundant modeling.

[0057] In some cases, the first media content can display a virtual avatar's first and second outfit effects, with the second outfit effect derived from a third and fourth outfit element, and at least one piece of media content includes both the third and fourth outfit elements. As an example, such as... Figure 2FAs shown, when performing the first task, the intelligent system can identify top A and bottom A from the wardrobe photo as the first group, and top B and bottom B as the second group, generating a first and second outfit effect for the virtual avatar, respectively. Here, top B and bottom B can correspond to the third and fourth outfit elements. The electronic device 110 can present the two effects in two parts of the same first media content. The electronic device 110 can also present different media content to display different outfit effects. For example, the electronic device 110 can present media content 220 and 224, using these two media contents to display different outfit effects. Alternatively, the first media content can be a video, with different video clips sequentially displaying two outfit effects. Multiple outfit effects can be sorted according to the degree of fulfillment of the first requirement, color coordination, warmth, or object availability. In response to the user input "put the warmer ones first," the electronic device 110 can rearrange the corresponding image portions or video clips without re-identifying all clothing items. Therefore, it is possible to provide a switchable and sortable comparison experience within the same content carrier, and to share object recognition results and virtual image parameters, generating only the different content corresponding to different combinations.

[0058] In some cases, electronic device 110 can receive a first input for replacing a second object with a third object, and present second media content displaying a combination of the first and third objects. As an example, such as... Figure 2G As shown, the electronic device 110 can first present a first media content showing the outfit of top B and bottom B. The user can input "Change the top of this skirt outfit to white." The intelligent system determines the object to be replaced as the second object based on the combination of "top" and the current object, determines the third object based on "white," locates the corresponding top C in the wardrobe photo, and re-executes the combination and rendering processes related to object replacement. The electronic device 110 then presents a second media content (e.g., media content 228), which retains bottom B and displays the new outfit formed by bottom B and top C. The first input can specify the object to be replaced, the replacement object, or both. When the first input only specifies the replacement object, the intelligent system can determine the object to be replaced by combining the current selection state, object category, or historical interaction information; when multiple possible objects exist, the electronic device 110 can also present a query and complete the replacement based on the user's further selection. The second media content can reuse the virtual image, composition, and background of the first media content to allow the user to compare the differences before and after the replacement.

[0059] In some cases, electronic device 110 can receive initial input in the form of natural language via an input component. For example, such as... Figure 2GAs shown, after the electronic device 110 presents the outfit result of top B and bottom B, the user enters "change the top to a white T-shirt" in the input component 202. The intelligent system identifies the replacement category as top and the third object as white T-shirt (corresponding to top C) from the natural language content, locates the white T-shirt using the object identifier in the wardrobe photo, keeps bottom B and the virtual image unchanged, and generates the outfit effect of white T-shirt and bottom B as the second media content. In some scenarios, after receiving the first input, the electronic device 110 can present the message 226 corresponding to the first input on the interface 200G.

[0060] In other scenarios, electronic device 110 can receive fourth media content, including a third object, as the first input. For example, after electronic device 110 presents a combination of top B and bottom B, the user uploads a photo showcasing a third object, such as a blue knit sweater. The intelligent system can identify the blue knit sweater in the photo and determine it as the third object, perform background removal and scaling adjustments, and then replace top B with the blue knit sweater. Electronic device 110 ultimately presents a new outfit including the blue knit sweater and bottom B. The first input in natural language and the fourth media content including the third object can be received individually or in combination. For example, a user can upload a photo containing multiple garments and input "replace the top with the blue knit sweater on the right," thereby simultaneously eliminating ambiguity regarding the third object through location descriptions in natural language and image recognition results. By simultaneously supporting element operations, natural language, and new media content, the front end can adapt to different scenarios, such as the user having already seen the replacement object, knowing the object's name, or needing to temporarily upload a new object; the back end can uniformly convert different inputs into a third object identifier and replacement action.

[0061] In some cases, at least one piece of media content may include a third object, and the electronic device 110 may also present a fourth element for marking the third object, and the electronic device 110 may receive a first operation for selecting the fourth element. As an example, such as... Figure 2B As shown, the wardrobe photo can also display object 212-2, which could be, for example, a white T-shirt. Electronic device 110 can display a fourth element 210-2 on the white T-shirt based on the position of the third object output by the intelligent system. Electronic device 110 can receive a first operation, such as clicking the fourth element 210-2 to select the white T-shirt as the third object. After receiving the first operation of clicking the fourth element 210-2, electronic device 110 can provide the first operation to the intelligent system. The intelligent system then replaces the top B in the original outfit with the third object, i.e., the white T-shirt, and generates a new outfit effect of the white T-shirt and bottom B. The first operation of selecting the fourth element can also be touch, selection by box, hover confirmation, keyboard selection, or voice confirmation.

[0062] In some cases, at least one piece of media content may include multiple pieces of media content, and the first object and the second object originate from different pieces of media content. For example, such as... Figure 2H As shown, the user uploaded multiple media contents, such as media content 230 and media content 236. Media content 230 and 236 can be different wardrobe photos. During the execution of the first task, the intelligent system can present elements 232 and 238 in media content 230 and media content 236 respectively to identify different objects. For example, element 232 is used to identify object 234, and element 238 is used to identify object 240. Further, the intelligent system can identify object 234 and object 240 from media content 230 and media content 236 respectively, and obtain the visual representations corresponding to the two objects to generate the first media content. In some scenarios, when objects come from different media content, the intelligent system can perform scale unification, background removal, lighting correction, and orientation correction on different photos, so that the two visual contents can be combined into the same first media content. The above preprocessing does not change the relationship that the first object and the second object come from different media content. This allows users to upload objects one by one without requiring a pre-made composite image, and by saving the source media identifier and object identifier separately, it is possible to continue tracing the source of each visual content after compositing.

[0063] In some cases, electronic device 110 can present corresponding first media content based on objects from different media content sources. For example, such as... Figure 2I As shown, after the intelligent system completes the cross-media object combination or object replacement, it combines the visual content of the retained object with the newly selected object to form the first media content (e.g., media content 242), which is then presented by the electronic device 110. The electronic device 110 can reuse the previous composition, virtual image, and background, allowing the user to directly compare the object combination before and after adjustment. Furthermore, the electronic device only needs to read the confirmed object identifiers and combination relationships to perform the final synthesis.

[0064] In some cases, electronic device 110 can receive a third request for publishing first media content and present the first media content on a first interface. As an example, such as... Figure 2I and Figure 2J As shown, after the user confirms the outfit rendering, the publishing control 244 can be triggered. The electronic device 110 can receive a third request including the identifier of the content to be published, the target information stream, and the visible range, save the outfit rendering as a viewable work, and can jump to the information stream viewing interface 200J after publishing, where the first media content (such as media content 246) is presented.

[0065] In some cases, the first interface can be a playback interface for the first media content, a feed view interface for the first media content, or a product view interface related to the first object. For example, ... Figure 2J and Figure 2K As shown, when the first media content is an outfit video, the first interface can be the video playback interface, which is used to play the video; when the first media content is published as a dynamic work, the first interface can be the information stream viewing interface, which is used to present the information stream including the first media content; when the first media content is used to display product combinations, the first interface can be the product viewing interface related to the corresponding object in the first media content, that is, the product details page.

[0066] In some cases, the electronic device 110 may also present a second component 250 on the first interface, the second component 250 being used to provide a first service for obtaining the first object. As an example, such as... Figure 2K As shown, after the first media content (e.g., media content 248) is presented on the product viewing interface 200K of the white shirt, the electronic device 110 presents a second component 250 below the media content 248. After the user triggers this component, the electronic device 110 can determine the product corresponding to the first object (e.g., shirt B) based on the object identifier associated with the first media content. Furthermore, the electronic device 110 can present an order creation interface to obtain the first object (e.g., shirt B) by creating an order. Thus, the user can continue from browsing the first media content to the service process of obtaining the first object. The first service is not limited to purchasing services; it can also include rental, trial booking, and other services. In a home renovation scenario, the first service can be used to obtain furniture, lighting fixtures, or decorative materials; in a digital content scenario, the first service can be used to obtain courses, templates, or consulting services related to the first object. In this way, the user can directly enter the acquisition process from the generated result, and the electronic device can use the object identifier stored in the first media content to associate with the corresponding service, avoiding relying solely on images to retrieve the object again.

[0067] The following examples will be used to describe the various cases in this article, specifically in the context of interior design. In an interior design scenario, at least one piece of media content may include photos of the room and furniture. The first object may be a sofa, lamp, or wall. The first element may be a frame or outline marking the furniture. The first piece of media content may be an interior design rendering or a design video.

[0068] In some cases, the first request can characterize a first need in terms of spatial function, decoration style, or object adjustment, and the first object can be furniture, building surface, or spatial area that matches the first need. As an example, a user uploads a photo of their living room and enters "adjust the living room to a warm-colored reading space." The intelligent system interprets "warm color" and "reading space" as first needs in terms of color temperature, lighting, and functional zoning. It identifies a floor lamp located in the corner of the living room photo, determines the floor lamp as the first object, and outputs its outline coordinates. The electronic device 110 first marks the floor lamp as the first element, and then presents a decoration rendering; in this rendering, the floor lamp emits warm light and illuminates the reading seating area, and the image corresponding to the floor lamp is the first visual content.

[0069] In some scenarios, the intelligent system can adjust the display style of a first object based on a first request, while ensuring that the adjusted visual content still corresponds to the first object. For example, a user inputs "change the sofa to off-white to match a warm-toned decorating style." The intelligent system identifies a gray sofa in a living room photo, generates a first element covering the sofa's outline to display the processing area, and then, while maintaining the sofa's shape, folds, and location, adjusts its color and material to off-white fabric. The electronic device 110 displays the adjusted decorating effect, allowing the user to compare it with the original living room photo. Style adjustments can also include changing wall colors, furniture materials, lighting colors, or object transparency.

[0070] In some scenarios, the intelligent system can adjust the position of a first object in space based on a first request and present the adjusted object in the first media content. For example, a user inputs "rearrange the furniture to expand the passageway." The intelligent system identifies the sofa in front of the window in the original living room photo, estimates the room boundaries, door and window positions, and passageway, calculates the available passage width after the sofa is moved to the side wall, and presents a suggested direction of movement via arrows. After user confirmation, the intelligent system generates a rendering showing the sofa positioned against the side wall, while simultaneously completing the background of the original sofa area. The sofa's position in the first media content differs from its position in the original living room photo.

[0071] In some scenarios, the first and second objects can originate from different media content and form a spatial arrangement relationship within the first media content. For example, a user uploads a photo of their living room and a product photo of a floor lamp, and inputs "Put this lamp next to the sofa and see." The intelligent system identifies the sofa from the living room photo, extracts the floor lamp from the product photo and estimates its size, then scales and rotates the floor lamp to a reasonable position based on the living room's perspective, and finally presents the floor lamp to the side of the sofa. The electronic device 110 displays a decoration rendering that includes both the sofa and the floor lamp, allowing them to form a reading area together. Objects, elements, and media content in the dressing scene and decoration scene can be interchanged. For example, a clothing frame can be replaced with a furniture outline, dressing relationship lines can be replaced with spatial arrangement relationship lines, and virtual try-on results can be replaced with room arrangement effects, without changing the basic processing chain between object recognition, process externalization, and media content generation. By presenting the objects to be adjusted, their direction of movement, or the areas to be processed before generating the interior design renderings, the front end allows users to confirm the scope of adjustments and reduces the risk of accidental changes; the back end can reuse room boundaries, perspective parameters, and unadjusted areas, performing partial compositing only on object styles, positions, or cross-media objects.

[0072] Figures 3A to 3I Some example interfaces 300A to 300I are shown. The following example illustrates how to convert the desktop size analysis process into an instructional video or graphic tutorial. At least one piece of media content can be a desktop photograph or operation diagram, the first object can be a desktop, table edge, or bowl, the first element can be a line, endpoint, or arrow marking the table edge, and the first media content can be an instructional video or step-by-step graphic tutorial.

[0073] In some cases, electronic device 110 can receive a first request via input component 301. This first request can be used to instruct the intelligent system to perform a first task and includes identification information of media content 302. As an example, such as... Figure 3AAs shown, a user uploads a photo including a table and bowls and enters "How many of the same bowls can fit on this table?" Electronic device 110 combines the photo and natural language content into a first request and provides it to the intelligent system. Based on the first request, the intelligent system determines that it needs to identify bowls, measure bowl widths, measure the available length of the tabletop, and calculate the number of bowls that can be arranged, and then begins the corresponding processing. The first task can be divided into stages such as object identification, determining the starting and ending points of measurement, displaying the ruler placement method, reading dimensions, performing calculations, and generating explanatory content, depending on the processing objective. The stage division can be predetermined by the intelligent system or dynamically determined based on intermediate results. For example, when the image lacks a scale reference, a stage can be added requesting the user to provide reference dimensions. In some scenarios, after receiving the first request, electronic device 110 can present content related to the first request on interface 300A. For example, it can present a message 304 matching the text description in the first request and media content 302 uploaded by the user in the first request.

[0074] In some cases, during the execution of a first task by the intelligent system, the electronic device 110 may present at an associated location of the media content 302. The at least one element characterizes the intelligent system's processing of the media content 302 and includes a first element for marking a first object. The first task may include at least a first phase and a second phase. The electronic device 110 may present a first set of elements corresponding to the first phase, then stop presenting the first set of elements and present a second set of elements corresponding to the second phase. As an example, such as... Figure 3B and Figure 3CAs shown, in the first stage of identifying the bowl width, the electronic device 110 presents elements 310-2 and 310-3 on the media content 308, marking the left and right boundaries of the bowl respectively, and also presents the width line between them. The electronic device 110 may also present element 310-1, marking the position of the left boundary of the bowl, and element 310-4, marking the position and width of the right boundary of the bowl. After obtaining the bowl width, the intelligent system enters the second stage of determining the usable length of the tabletop. The electronic device 110 stops presenting the aforementioned bowl boundary elements, keeps the original image visible, and presents elements 312-2 and 312-3, marking the left and right ends of the table respectively, and the dimension line 312-4 connecting the two ends. The electronic device 110 may also present element 312-1, marking the position of the left end of the table, and element 312-5, marking the position and length of the right end of the table. The intelligent system then uses the results of the two stages to calculate the number of bowls that can be placed. Stopping the presentation of the first set of elements can be done by immediately removing, fading, hiding, collapsing to the stage record, or converting it to an inactive state; presenting the second set of elements can occur simultaneously with or after stopping the presentation of the first set of elements. By switching element groups, users can distinguish the objects and stages that the intelligent system is currently processing, avoiding occlusion caused by the simultaneous overlapping of markers from multiple stages. Electronic devices can maintain element sets by stage and perform set switching when stage states change, thereby reducing the burden of rendering a large number of irrelevant elements simultaneously.

[0075] In some cases, electronic device 110 may present a first element in first component 306 and receive a second request through first component 306. As an example, such as... Figure 3C As shown, the first component 306 is a visual component that carries a desktop photo, measurement lines, and stage prompts. The electronic device 110 can display a control 314 within the first component 306. Users can directly trigger the control 314 within the first component 306. The electronic device 110 can use the user's triggering of the control 314 as a second request, thereby triggering the intelligent system to generate corresponding first media content. After the first media content is generated, the electronic device 110 can display it. Receiving the second request through the first component is not limited to setting a button within the component; it can also include performing a long press operation on a stage card in the first component, dragging an element into the media generation area, selecting a generation operation through the component's context menu, or receiving a natural language command when the first component gains input focus. This limitation allows the second request to be directly associated with the currently presented processing procedure and enables the front end to automatically carry task and stage identifiers, reducing the possibility of the user selecting the wrong task or the back end associating with an incorrect context.

[0076] In some cases, electronic device 110 can receive a second request for obtaining first media content and present the first media content obtained based on the second request. As an example, such as... Figure 3C and Figure 3DAs shown, after the intelligent system completes the process of measuring the desktop length, the electronic device 110 presents a media generation control 314 at the associated location of the processing. The user triggers control 314, and the electronic device 110 receives a second request accordingly. The intelligent system reads the stage sequence, object coordinates, element changes, and intermediate results saved in this task, arranges the process of identifying the table edge, aligning the ruler, and reading the dimensions into a video script, generates a teaching video, and the electronic device 110 presents the first media content (e.g., media content 318, i.e., the generated teaching video) in component 316. The second request "for obtaining the first media content" can indicate a request to generate first media content that does not yet exist, or a request to retrieve, synthesize, or convert the first media content from already generated candidate media content. The second request can specify the content type, duration, aspect ratio, coverage stage, language, and purpose, but does not require all generation parameters to be included. As another example, the user can enter "generate a teaching video of the process of measuring the table just now" in the input component. The intelligent system associates "just now" with the most recently completed desktop measurement task in the current session, determines the output media type based on "teaching video," and defaults to covering the main stages of that task. Electronic device 110 can display progress information during the generation process and present a playable, editable, and publishable instructional video upon completion. This allows users to directly initiate content generation while viewing the processing results, reducing the need to search for tasks or repeatedly describe the processing steps. Furthermore, it allows direct reading of existing stage records to generate media content, avoiding the need to perform the same recognition and measurement processes again.

[0077] In some scenarios, electronic device 110 can also present the first element as the first component. For example, such as... Figure 3D As shown, the generated media content 318 may include a first element representing the processing procedure of the intelligent system on at least one piece of media content. This first element may include elements 310-1 and 310-2.

[0078] In some cases, the first media content may include a first element, the first task includes at least one stage, and the first media content demonstrates a first processing procedure of the intelligent system on at least one piece of media content, the first processing procedure corresponding to at least one stage. As an example, such as... Figure 3DAs shown, in response to the second request, the intelligent system converts the elements used to mark the desktop, measurement start point, measurement end point, and measurement range during task execution, along with their associated stage records, into a video track. The generated instructional video retains the first element used to mark the desktop and measurement location, and uses this first element to sequentially demonstrate the first processing steps of identifying the table edge, determining the measurement range, and reading the dimensions. The first media content "demonstrating the first processing steps" means that the first media content enables viewers to understand how the intelligent system obtains intermediate or final results from the input media content, rather than simply showing the final answer. For example, the instructional video can sequentially demonstrate identifying the table edge, determining the measurement range, and reading the dimensions; a text tutorial can demonstrate the same process through consecutive pages. The first media content does not necessarily contain all the internal calculations or model parameters of the intelligent system. Therefore, the presented content output can retain interpretive clues to the results, improving comprehensibility, and the electronic device can automatically generate scripts and timelines from the structured stage records, reducing the cost of manually rearranging processing steps.

[0079] In some cases, the electronic device 110 may present a first element through a first dynamic process, which displays a first dynamic change in the first element, and the first media content displays a second dynamic change in the first element, with the first dynamic change corresponding to the second dynamic change. As an example, such as... Figure 3D As shown, the first media content can reproduce the dynamic process formed when the intelligent system processes a desktop photo. In the original processing, the electronic device 110 first presents a starting point mark at the first end of the table edge, then extends the measurement line along the table edge from the first end to the second end, and finally presents the ending point mark and dimension value, thus forming the first dynamic change. When the intelligent system generates a teaching video, it generates a second dynamic change according to the same semantic order: the video first displays the starting point, then plays the measurement line extension animation, and finally displays the ending point and dimension. The "correspondence" between the first and second dynamic changes does not require them to be identical frame by frame. They can be mapped to at least one of the following: element identity, appearance order, display state, extension path, movement direction, stage order, or processing meaning. For example, the measurement line in the processing process can extend within two seconds, while the teaching video can extend within five seconds for easier viewing; both still correspond to the same measurement action. In some scenarios, the second dynamic change can also compress, slow down, pause, or repeat the rhythm of the first dynamic change. After a user inputs "slow down the ruler alignment action," the intelligent system can extend the corresponding video segment and pause for a period of time upon completion of the alignment, while maintaining its correspondence with the original processing stage and the first element. By maintaining dynamically changing semantic correspondence, the teaching content generated on the front end can both reproduce the processing logic and adjust the pace for the viewing experience; the back end can reuse the element event sequence, only remapping the event time without rebuilding the entire animation.

[0080] In some cases, electronic device 110 may present a first element in a first style during processing, receive a third input for adjusting the first style, and cause the first media content to present the first element in a second style different from the first style. As an example, such as... Figure 3E As shown, when the intelligent system performs desktop measurements, the electronic device 110 marks the rim of the bowl to be measured with a first element of a first style, such as a circular element. Before generating the first media content, the user inputs "change the first element to a square." The electronic device 110 provides this text description as a third input to the intelligent system. The electronic device 110 can also present a message 320 corresponding to the user's input. The intelligent system can keep the bowl rim bound to the element and its timing unchanged, only rendering the first element in the first media content as a square. The final first media content (e.g., media content 322) includes the first element (e.g., element 324) presented in a second style, instead of using the first style used in the processing. The second style differs from the first style only in at least one of the following attributes: color, shape, line type, thickness, transparency, fill, text, animation, or display level. Style adjustments can affect only the first media content or simultaneously update the preview in the current processing; as long as the first media content ultimately presents the first element in the second style. Therefore, users can adjust the visibility of markers on the front end according to the viewing scenario without changing the processing meaning expressed by the elements. Furthermore, electronic devices only need to update the rendering parameters without having to re-execute object recognition and stage reasoning.

[0081] In some cases, at least one stage may include multiple stages, and the first media content may include multiple parts that respectively demonstrate the processing of the multiple stages. As an example, such as... Figure 3FAs shown, the intelligent system can divide the first task into multiple stages. For example, the first task can be divided into a first stage of measuring the length of a bowl and a second stage of measuring the length of a table. When generating the first media content, the intelligent system can generate different parts of the first media content for different stages. For example, it can generate a first part corresponding to the first stage, which shows the process of measuring the length of the bowl, and generate a second part corresponding to the second stage, which shows the process of measuring the length of the table. After the first media content is generated, the electronic device 110 can display the corresponding parts of the first media content in stages. As an example, the electronic device 110 can present a first part 326 and a second part 328 on the interface 300F. The first part 326 and the second part 328 can be different segments of the first media content, which show different stages of the multiple stages of the first task. In some scenarios, the multiple parts can also be images, pages, cards, chapters, or audio / video tracks. There can be a one-to-one correspondence between each part and the corresponding stage, or one part can show multiple closely related stages, as long as the multiple parts as a whole carry out the processing of multiple stages. Users can also adjust the order, duration, or transition of the parts. This partitioned structure enables the front end to provide interactive features such as staged browsing, navigation, and reflow.

[0082] In some cases, electronic device 110 can receive a fourth input, present a third element obtained based on the fourth input at an associated location of at least one piece of media content, and make the first media content also include the third element. As an example, such as... Figure 3G As shown, users can request the addition of a third element to an existing process. For example, if a user inputs "add an element to identify the table legs," the intelligent system determines the position of the table legs, generates a third element to mark the table legs, and further generates corresponding first media content. The electronic device 110 can present the first media content (e.g., media content 330) in the interface 300G. Media content 330 includes the third element, namely element 332, which is presented at the associated position of the table legs. As another example, if the original process has already marked the edge of the table to be measured with lines, the user can also input "add a hint to emphasize that the zero mark of the ruler should be aligned with the edge of the table." The intelligent system determines from this content that the hint target is the zero mark of the ruler, and the hint type is an arrow and text. The electronic device 110 presents an arrow at the associated position of the zero mark and the edge of the table, and displays "Start from zero mark" next to it. The final first media content also includes this arrow and text. Thus, it is possible to support lightweight annotation and teaching reinforcement of existing processes, and the newly added elements can be bound to objects and stages as separate layers, avoiding modification of the original stage data or rerunning the original task.

[0083] In some cases, when the first task includes multiple stages, the electronic device 110 can receive a second input for selecting at least one stage and present first media content based on the selected at least one stage. As an example, such as... Figure 3H and Figure 3I As shown, the complete task of calculating the number of bowls includes two stages: measuring the length of the bowls and the length of the table. Electronic device 110 presents these two stages as viewable components (e.g., components 334 and 336). The user can select the "Measure Bowl Length" stage and trigger the stage media generation control 338. Electronic device 110 then generates a second input including the selected stage identifier. The intelligent system extracts only the content relevant to this stage (e.g., identifying the left and right boundaries of the bowls, measuring the bowl length, etc.), generates and presents first media content with the bowl length measurement as its main content. For example, electronic device 110 can present media content 340 in interface 300I. The second input is used to select at least one stage and does not require the first media content to completely exclude information from other stages. For example, to ensure narrative continuity, the first media content can briefly present the result of the previous stage at the beginning and hint at the next stage at the end, but the selected stage still constitutes the main body of the first media content. The user can also select multiple discontinuous stages, and the intelligent system can supplement transition instructions based on stage dependencies. Through stage cards and stage-related controls, users can intuitively control the scope of the work and extract corresponding elements and intermediate results according to stage identifiers, reducing the generation of irrelevant content and shortening media synthesis time. Mediating the processing process is not limited to dimensional analysis. This processing method can also be used to generate media content from geometric reasoning processes, equipment operation steps, document interpretation processes, spatial arrangement processes, product comparison processes, or other processing processes with one or more stages. For example, when a user uploads a photo of a coffee machine panel and requests a cleaning tutorial, the electronic device 110 can sequentially label the water tank, cleaning button, and water outlet, and convert the aforementioned operation stages into a video.

[0084] In some scenarios, electronic device 110 and / or server 130 can resolve objects, regions, spatial structures, furniture or object outlines, colors, materials, and text regions obtained through optical character recognition in at least one piece of media content into locationable and editable visual semantic layers. Each visual semantic layer can be bound to at least one positioning method, such as a bounding box (bbox), mask, keypoint, line segment, text box, or region polygon, so that subsequent object marking, connection, and processing can be accurately placed at the corresponding position in the media content.

[0085] In some cases, to enable the processing and results to be overlaid on the media content in situ, the electronic device 110 and / or server 130 can establish a mapping relationship between the coordinates of the original media content, the coordinates used for model processing, and the coordinates used for front-end display, and decouple the visual semantic layer from the coordinate layer. In this way, elements, processing actions, and results can all reference the same coordinate system, thereby ensuring that the position of each object remains consistent between the presentation of the processing process, the presentation of the results, and subsequent local adjustments.

[0086] In some scenarios, intelligent systems can output structured intermediate representations (e.g., processing plans) during processing. These intermediate representations may include, but are not limited to, the following: task type, such as clothing judgment, decoration judgment, product comparison, or content interpretation; editable visual semantic layers; evidence anchors, such as bounding boxes, masks, key points, or text boxes; processing actions, such as color changing, replacement, local zoom, rearrangement, masking, highlighting, or contrast; user constraints and scene constraints, such as style, space size, or unmodifiable areas; candidate solutions; recommendation reasons and evidence chains; and front-end rendering requirements. In this way, the intelligent system outputs a verifiable, renderable, and executable processing intent, rather than directly outputting complex interface code or final images.

[0087] In some cases, the generation of the processing plan can be separated from the front-end rendering: the intelligent system is responsible for outputting the structured processing plan, while the renderer is responsible for consistently executing layer overlays, before-and-after comparisons, local zooms, candidate switching, and the generation of interactive components. This approach avoids rendering instability caused by the intelligent system directly generating complex hypertext markup language code or image editing code.

[0088] In some scenarios, for advisory purposes, the electronic device 110 can prioritize non-destructive processing methods, that is, prioritize generating overlay layers, candidate layers, and comparison layers, without directly overwriting the original media content. In this way, users can switch back to the original media content at any time to view the processing process and evidence, and the system can retain the processing source and recommendation basis for each candidate solution.

[0089] In some cases, the intelligent system can generate multiple candidate solutions simultaneously. Each candidate solution can include processing actions, preview results, applicable situations, risk items, and reasons for recommendation. The system can also score and rank the candidate solutions according to style matching, spatial feasibility, and other criteria.

[0090] In some cases, the identification information included in the first request can indicate media content from different sources, such as user-uploaded images, images returned by a search, generated images, or images in a cloud drive. Electronic device 110 and / or server 130 can convert the media content from the aforementioned sources into temporary resources that can be securely referenced in Hypertext Markup Language, Scalable Vector Graphics, canvases, or client-side components through resource binding, and manage the source, size, permissions, and validity period in the process. In this way, media content from multiple sources can be uniformly used for the presentation of the processing process and the visualization of the results.

[0091] In some cases, when an intelligent system invokes generative processing to obtain the final result, the generated result can be linked to the region of the original media content, input conditions, processing actions, and recommendation reasons. The result can then be assessed for quality in areas such as layer alignment, occlusion rationality, proportional consistency, perspective consistency, style matching, and security risks. In this way, the final result is not an isolated image, but a traceable and verifiable one. The corresponding evaluation conclusions can also be used for continuous optimization in subsequent processing, provided the user is aware of and authorizes them.

[0092] In some cases, the overall processing described above can be implemented collaboratively by several example modules. These modules may include an image resource access module, a renderable resource binding module, a visual semantic layering module, a consumer goal understanding module, a processing plan generation module, a visualization compilation and rendering module, a multi-scheme evaluation and ranking module, and an interactive feedback closed-loop module. The image resource access module receives media content uploaded by users, returned from searches, generated content, or from cloud storage, and parses its source, size, permissions, and metadata. It can output media content resource descriptors. The renderable resource binding module converts internal resource identifiers or cloud storage resources into temporary resources that can be securely referenced on the front end, outputting renderable resources, resource tokens, etc. The visual semantic layering module identifies objects, regions, spatial structures, outlines, colors, materials, text, and spatial relationships, outputting visual semantic layers, masks, bounding boxes, key points, and attribute labels. The consumer goal understanding module categorizes user intent into task types such as clothing judgment, decoration judgment, product comparison, and content interpretation, outputting task type, constraints, and evaluation indicators. The processing plan generation module generates executable processing actions based on the semantic layer and task objectives, outputting a structured processing plan. The visualization compilation and rendering module compiles and displays the processing plan, including the original content, evidence layer, processing layer, result layer, and interpretation layer, outputting an interactive visualization. The multi-solution evaluation and ranking module scores and ranks candidate solutions across multiple dimensions, outputting candidate rankings and recommendation reasons. The interactive feedback loop module receives user feedback such as clicks, drags, selections, locks, or negations, triggering local updates and outputting the updated processing plan and visualization results.

[0093] In some cases, the aforementioned processing actions can correspond to several example processing modes. Processing modes can include evidence annotation, non-destructive color replacement, object replacement preview, spatial rearrangement judgment, style scheme generation, and prompt mode. Evidence annotation can be used to indicate areas, objects, or text that affect the judgment; it can be presented in the form of bounding boxes, masks, arrows, label bubbles, local zooms, etc. Non-destructive color replacement can be used to evaluate the appearance colors of clothing, walls, objects, etc.; it can be presented in the form of semi-transparent color layer overlays, before-and-after comparisons, color cards, etc. Object replacement preview is used to replace objects such as tops, shoes, furniture, and objects; it can be presented in the form of object masks, candidate layers, occlusion correction, scheme switching, etc. Spatial rearrangement judgment can be used in scenarios such as furniture placement, storage, and circulation optimization; it can be presented in the form of wireframes, outline dragging, circulation arrows, and highlighting conflict areas, etc. Style scheme generation can be used in scenarios such as clothing styles, room styles, and content display styles; it can be presented in the form of multiple candidate cards, style tags, recommendation scores, and difference explanations, etc. The prompt mode can be used to prompt text, parameters or potential hazards, and it can be presented in the form of risk selection, text explanation, severity color, handling suggestions, etc.

[0094] In some cases, the above solutions can be applied to a variety of example application scenarios. For instance, in a clothing judgment scenario, clothing objects can be outlined and marked, their formality and proportions can be indicated, and multiple candidate outfits and their modification points can be provided; in a home renovation judgment scenario, furniture, walls, windows, and traffic flow can be identified and marked, highlighting crowded areas and providing before-and-after comparisons of color changes, size adjustments, and storage optimizations; in a product comparison scenario, objects in multiple media content can be aligned and their differences displayed, and sorted according to durability and space adaptability; in a content interpretation scenario, optical character recognition can be used to locate key content, zoom in on detailed areas, and generate step cards and risk warnings. It should be understood that the above application scenarios are merely illustrative and not restrictive.

[0095] Example process Figure 4 A flowchart of an example process 400 for interface interaction is shown, based on some scenarios. Process 400 can be implemented at electronic device 110. See below for reference. Figure 4 To describe process 400.

[0096] like Figure 4 As shown, in block 410, electronic device 110 receives a first request, which is used to instruct the intelligent system to perform a first task. The first request includes an identifier of at least one piece of media content.

[0097] In box 420, electronic device 110 presents a first element, which is used to mark a first object of at least one piece of media content.

[0098] In frame 430, electronic device 110 presents first media content, which is provided by an intelligent system. The first media content includes first visual content, which corresponds to a first object.

[0099] In this way, during the execution of the first task by the intelligent system, the electronic device 110 presents the element marking the first object at the associated location in the media content, and presents the first visual content corresponding to the first object in the result. This allows users to intuitively understand the processing process and results of the intelligent system without repeatedly switching between multiple interfaces, reducing the number of operation steps and interface switching required for users to understand the processing results. Since the processing process and results are both overlaid on the original media content and reuse the same set of coordinates and layers, the electronic device 110 does not need to load and render separate pages for the processing process and results, thus reducing the client's page rendering overhead, document object model refresh frequency, and cache usage. Consequently, the number of page requests initiated by the electronic device 110 to the server 130 decreases, and the query load and end-to-cloud communication bandwidth usage of the server 130 also decrease accordingly.

[0100] In some cases, the first request represents a first need, and the first object includes at least one object that matches the first need.

[0101] In this way, based on the above-mentioned scheme of presenting the processing and results at the media content-related location, the first object is further constrained to be the object that matches the user's first need. Users can more quickly locate objects relevant to their needs, reducing the manual filtering steps from a large number of objects. Since the electronic device 110 only needs to mark and render objects matching the first need, the number of elements that the front end needs to draw and refresh is reduced. Correspondingly, the server 130's analysis, calculation, and data return for irrelevant objects are also reduced, further lowering the overall front-end rendering overhead and the amount of data exchanged between the end and cloud.

[0102] In some cases, at least one piece of media content includes a second object, the first media content also includes a second visual content, the second visual content corresponds to the second object, and the first media content displays the combination of the first object and the second object.

[0103] In this way, building upon the aforementioned solution, the first media content further simultaneously displays the combination of the first and second objects, allowing users to determine the relationship between the two objects within the same result, reducing the need for users to view each object separately and then combine them manually. Since the visual content of the two objects is generated and presented simultaneously within the same media content, the electronic device 110 does not need to repeatedly initiate a rendering process for the combination result. Consequently, the server 130 does not need to return data separately for each combination, further reducing the overall solution's edge-cloud interaction rounds and front-end rendering overhead.

[0104] In some cases, the primary media content also includes a virtual avatar, with the first object corresponding to the first clothing element and the second object corresponding to the second clothing element. The primary media content displays the clothing effect of the virtual avatar, which is obtained by applying the first and second clothing elements to the virtual avatar.

[0105] In this way, building upon the aforementioned scheme of displaying outfit combinations, the first media content further demonstrates the outfit effect by applying styling elements to the virtual avatar. This allows users to preview the effect without actually trying on the clothes, reducing the offline operations required for evaluating the outfit. Since the outfit effect is synthesized and presented on the virtual avatar by the intelligent system in one go, the electronic device 110 does not need to load multiple real-life photos separately. Consequently, the number of image synthesis and return operations on the server 130 side is reduced, further lowering the overall computational overhead and the amount of data transmitted between the end and cloud.

[0106] In some cases, electronic device 110 can receive third-party media content and create virtual avatars based on that third-party media content.

[0107] In this way, building upon the aforementioned solution of showcasing outfits using virtual avatars, the virtual avatars are created based on user-provided third-party media content. This makes the outfits more closely resemble the user's own characteristics, reducing the need for users to repeatedly select and adjust between multiple generic avatars. Since the virtual avatar can be reused for multiple outfits once created, the electronic device 110 and server 130 do not need to remodel for each preview. Consequently, the overall solution further reduces the computational overhead of repetitive modeling and the number of edge-cloud interaction rounds.

[0108] In some cases, the outfit effect is the first outfit effect, and the first media content also displays the second outfit effect of the virtual character. The second outfit effect is based on the third outfit element and the fourth outfit element, and at least one media content includes the third outfit element and the fourth outfit element.

[0109] In this way, based on the above solution, the first media content further displays the first and second outfit effects side-by-side in the same result, allowing users to compare multiple outfits within the same interface, reducing the need to switch between multiple outfits. Since multiple outfit effects reuse the same virtual avatar and are synthesized in a single presentation, the electronic device 110 does not need to load a separate page for each outfit. Correspondingly, the number of requests to the server 130 and the overall end-to-cloud communication data volume are further reduced.

[0110] In some cases, at least one piece of media content includes multiple pieces of media content, and the first object and the second object originate from different pieces of media content.

[0111] In this way, based on the above-mentioned object pairing scheme, the first and second objects can originate from different media content, enabling users to combine and judge across multiple images. This expands the input scenarios supported by the overall solution and reduces the manual operation of combining multiple images. Since the system processes multiple media contents uniformly on the server 130 side and reuses the same coordinate system, the electronic device 110 does not need to load and align multiple result images separately. Correspondingly, the front-end rendering overhead and the amount of data transmitted between the end and the cloud are further reduced.

[0112] In some cases, the electronic device 110 may present a second element for connecting the first object and the second object, the second element representing that the first object and the second object have a first relationship.

[0113] In this way, building upon the aforementioned approach of presenting processing elements, a second element connects the first and second objects to represent their primary relationship. This allows users to intuitively see the pairing relationships between objects, reducing the cognitive and operational steps required for users to infer object associations. Since the relationships between objects are directly overlaid on the media content using connecting elements, the electronic device 110 does not need to render a separate text page for explaining the relationships. Consequently, the overall solution further reduces front-end rendering overhead and the amount of data exchanged between the device and the cloud.

[0114] In some cases, the electronic device 110 may receive a first input for replacing a second object with a third object; and present second media content that displays a combination of the first and third objects.

[0115] In this way, based on the above solution, users can replace the second object with the third object through the first input and obtain the second media content displaying the new combination on the spot. This allows users to make local adjustments based on the confirmed result, reducing the number of steps required for users to re-initiate the entire task for fine-tuning the combination. Since the system only regenerates the corresponding visual content for the replaced object and reuses the remaining confirmed layers, the electronic device 110 and the server 130 do not need to recalculate and render the entire result. Accordingly, the redundant calculation overhead and the amount of data transmitted between the end and the cloud are further reduced.

[0116] In some cases, at least one piece of media content includes a third object, and the electronic device 110 can present a fourth element for marking the third object, and receiving the first input includes receiving a first operation for selecting the fourth element.

[0117] In this way, based on the aforementioned replacement object scheme, the replaceable third object is marked by a fourth element in the media content. Users can specify the replacement object through a first operation on the fourth element, making the selection of the replacement target more direct and reducing the user's input steps of describing the target object in text. Since the replacement target is directly anchored to an existing object in the media content via interface elements, the server 130 does not need to perform additional intent parsing and retrieval on the natural language description. Correspondingly, the overall parsing computational overhead and the number of edge-cloud interaction rounds are further reduced.

[0118] In some cases, receiving the first input includes: receiving the first input in natural language form via an input component; or receiving fourth media content, which includes a third object.

[0119] In this way, based on the aforementioned replacement object scheme, the first input can be in natural language form or fourth media content including a third object, allowing the overall scheme to cover more input methods. Users can choose the more convenient method to specify the replacement target according to their own habits. Since the system follows the text parsing or image parsing path according to the input type and only recalculates the affected area, the electronic device 110 does not need to re-render the entire result. Correspondingly, the amount of invalid calculations and data transmitted between the end and the cloud is further reduced.

[0120] In some cases, presenting the first media content includes: receiving a second request for obtaining the first media content; and presenting the first media content based on the second request.

[0121] In this way, based on the aforementioned result presentation scheme, the first media content is obtained based on the second request triggered by the user, ensuring that the result is generated and presented only when the user explicitly needs it, avoiding the user passively receiving unwanted results. Since the first media content is generated on demand, the server 130 does not need to pre-synthesize and push complete results for each processing step. Correspondingly, the overall solution's server computing overhead, result storage usage, and end-to-cloud communication bandwidth usage are further reduced.

[0122] In some cases, presenting at least one element at an associated location of at least one piece of media content includes: presenting the first element in the first component, and receiving the second request includes: receiving the second request through the first component.

[0123] In this way, based on the above scheme, at least one element is presented in the first component and the second request is received through the first component, so that the presentation of the processing procedure and the entry point for obtaining the result are aggregated within the same component, reducing the number of steps the user has to take to find the entry point in different areas. Since the presentation and request reuse the context of the same component, the electronic device 110 does not need to create and render a separate component for obtaining the result. Accordingly, the front-end rendering overhead and memory usage of the overall scheme are further reduced.

[0124] In some cases, the first media content also includes a first element, the first task includes at least one stage, and the first media content demonstrates the first processing procedure of the intelligent system for at least one piece of media content, the first processing procedure corresponding to at least one stage.

[0125] In this way, based on the above scheme, the first media content further includes the first element of the marked object and displays the first processing procedure corresponding to the task stage, allowing users to review the processing basis of the intelligent system in the results, reducing the number of steps required for users to re-ask questions to verify the conclusions. Since the processing procedure and result are bound to the same media content and coordinate system and presented at once, the electronic device 110 does not need to load a separate page for process replay. Correspondingly, the amount of redundant calculations by the server 130 and the amount of data involved in end-to-cloud communication are further reduced.

[0126] In some cases, the first task includes multiple stages, and presenting the first media content includes: receiving a second input for selecting at least one stage; and presenting the first media content based on at least one stage.

[0127] In this way, based on the aforementioned phased display of the processing procedure, users can select at least one phase via a second input and obtain the first media content accordingly. This allows users to focus on the processing phase they are interested in, reducing the steps required to browse all phases to locate the target phase. Since the system only generates media content for the selected phase, the server 130 does not need to perform complete media compositing for all phases. Consequently, the overall solution further reduces server computing overhead and the amount of data transmitted between the end and cloud.

[0128] In some cases, presenting the first element includes: presenting the first element in a first style, and the method further includes: receiving a third input for adjusting the first style, and the first media content presenting the first element in a second style, which is different from the first style.

[0129] In this way, based on the above-mentioned presentation processing element scheme, the first element can be adjusted from the first style to a different second style via the third input, allowing users to customize the presentation form of the mark and reducing the number of steps required for users to restart the task due to unsatisfactory styles. Since style adjustment only affects the presentation attributes of existing elements and reuses already generated media content, the electronic device 110 does not need to re-execute the object recognition and processing process. Correspondingly, the redundant computing overhead of the server 130 and the number of edge-cloud interaction rounds are further reduced.

[0130] In some cases, at least one stage includes multiple stages, and the first media content includes multiple parts, each of which demonstrates the processing of the multiple stages.

[0131] In some cases, electronic device 110 may receive a fourth input; and present a third element at an associated location of at least one media content, the third element being derived based on the fourth input, wherein the first media content also includes the third element.

[0132] In this way, building upon the above approach, users can add a third element—a marker—at the relevant location within the media content via a fourth input. This allows users to supplement the markers of objects of interest as needed, reducing the need for users to input additional textual descriptions of their concerns. Since the newly added element is only superimposed on the existing media content and coordinate system, the electronic device 110 does not need to regenerate the entire result. Consequently, the overall solution further reduces the overhead of repeated rendering and the amount of data transmitted between the device and the cloud.

[0133] In some cases, presenting at least one element includes: presenting the first element through a first dynamic process, the first dynamic process displaying a first dynamic change of the first element, and the first media content displaying a second dynamic change of the first element, the first dynamic change corresponding to the second dynamic change.

[0134] In this way, based on the above-mentioned scheme for presenting processing elements, at least one element is presented through a first dynamic process and corresponds to a second dynamic change of the first element in the result. This allows the user to perceive the evolution of the processing process coherently, reducing the cognitive steps required for the user to connect and understand multiple static images. Since the dynamic changes are driven locally by the front-end rendering capability rather than by sending images frame by frame, the electronic device 110 and the server 130 do not need to transmit and synthesize images separately for each frame. Accordingly, the overall solution further reduces the amount of data transmitted between the end and the cloud and the server's computing overhead.

[0135] In some cases, presenting the first element includes: during the execution of the first task by the intelligent system, presenting at least one element at an associated location of at least one piece of media content, wherein the at least one element characterizes the processing of at least one piece of media content by the intelligent system, and the at least one element includes the first element.

[0136] In some cases, the first task includes at least a first phase and a second phase, and presenting at least one element includes: presenting a first set of elements, which corresponds to the first phase; and stopping the presentation of the first set of elements and presenting a second set of elements, which corresponds to the second phase.

[0137] In this way, based on the above solution, as the task progresses, the first set of elements corresponding to the first stage is stopped and the second set of elements corresponding to the second stage is presented. This ensures that the interface only displays elements relevant to the current stage at any given time, reducing the interference caused by too many elements on the screen. Because the interface releases and reuses the same area for rendering when switching stages, the number of document object model nodes maintained on the same screen by the electronic device 110 and the memory usage are reduced. Correspondingly, the front-end rendering overhead of the overall solution is further reduced.

[0138] In some cases, electronic device 110 may receive a third request for publishing first media content; and present the first media content on a first interface.

[0139] In this way, based on the above solution, users can publish the first media content via a third request and present it on the first interface, enabling the processing results to be further shared and consumed, providing users with a coherent operation path from result generation to content distribution. Since the published content reuses the already generated first media content instead of being re-synthesized, the server 130 does not need to repeatedly perform processing and rendering for the publishing stage. Correspondingly, the overall server computing overhead and the amount of data transmitted between the end and cloud are further reduced.

[0140] In some cases, the electronic device 110 may present a second component on a first interface, the second component being used to provide a first service, the first service being used to obtain a first object.

[0141] In this way, based on the aforementioned result publishing scheme, the first interface further presents a second component providing the first service, and this first service is associated with obtaining the first object. This allows users to obtain the relevant object within the same interface where they view the results, reducing the number of steps required for users to navigate to other interfaces to search for and obtain the object. Since the entry point and result content are aggregated on the same interface and the existing information of the first object is reused, the electronic device 110 does not need to load a separate page for the acquisition process. Consequently, the number of retrieval queries by the server 130 and the bandwidth usage for end-to-cloud communication are further reduced.

[0142] In some cases, the first interface includes at least one of the following: a playback interface for the first media content; a viewing interface for the information stream, the information stream including the first media content; and a product viewing interface related to the first object.

[0143] In this way, based on the aforementioned result publishing scheme, the first interface can be one of the following: a playback interface, an information stream viewing interface containing the first media content, or a product viewing interface related to the first object. This allows the overall scheme to present results across multiple consumption interfaces, expanding the scenarios for re-consuming the results. Since the same first media content can be reused across multiple interfaces, the server 130 does not need to generate results separately for different interfaces. Consequently, the server computational overhead and result storage usage of the overall scheme are further reduced.

[0144] In some cases, receiving a first request includes: presenting an input component for interacting with the intelligent system; and receiving the first request, which is in natural language form, through the input component.

[0145] In this way, building upon the aforementioned solution, the first request is received in natural language via the input component, allowing users to directly express their needs in everyday language. This lowers the operational threshold for users to express their needs and reduces the steps involved in structured input. Since the need is expressed in natural language and parsed by the intelligent system in one go, the electronic device 110 does not need to repeatedly render and submit for multi-step form interactions. Consequently, the overall solution further reduces front-end rendering overhead and the number of edge-cloud interaction rounds.

[0146] Example devices and equipment A corresponding apparatus for implementing the above methods or processes is also provided. Figure 5 Block diagrams of a device 500 for user interface interaction are shown in several scenarios. Device 500 can be implemented as or included in electronic device 110. The various modules / components in device 500 can be implemented by hardware, software, firmware, or any combination thereof.

[0147] like Figure 5As shown, the device 500 includes: a receiving module 510 configured to receive a first request, the first request being used to instruct an intelligent system to perform a first task, the first request including an identifier of at least one media content; a first presentation module 520 configured to present a first element, the first element being used to mark a first object of at least one media content; and a second presentation module 530 configured to present first media content, the first media content being provided by the intelligent system, the first media content including first visual content, the first visual content corresponding to the first object.

[0148] In some cases, the first request represents a first need, and the first object includes at least one object that matches the first need.

[0149] In some cases, at least one piece of media content includes a second object, the first media content also includes a second visual content, the second visual content corresponds to the second object, and the first media content displays the combination of the first object and the second object.

[0150] In some cases, the primary media content also includes a virtual avatar, with the first object corresponding to the first clothing element and the second object corresponding to the second clothing element. The primary media content displays the clothing effect of the virtual avatar, which is obtained by applying the first and second clothing elements to the virtual avatar.

[0151] In some cases, the corresponding module in device 500 can also be configured to receive third-party media content and, based on the third-party media content, create a virtual avatar.

[0152] In some cases, the outfit effect is the first outfit effect, and the first media content also displays the second outfit effect of the virtual character. The second outfit effect is based on the third outfit element and the fourth outfit element, and at least one media content includes the third outfit element and the fourth outfit element.

[0153] In some cases, at least one piece of media content includes multiple pieces of media content, and the first object and the second object originate from different pieces of media content.

[0154] In some cases, the corresponding module in device 500 may also be configured to present a second element, which connects the first object and the second object, and the second element represents that the first object and the second object have a first relationship.

[0155] In some cases, the corresponding module in device 500 may also be configured to receive a first input for replacing a second object with a third object; and to present second media content that displays a combination of the first object and the third object.

[0156] In some cases, at least one piece of media content includes a third object, and the electronic device 110 can present a fourth element for marking the third object, and receiving the first input includes receiving a first operation for selecting the fourth element.

[0157] In some cases, receiving the first input includes: receiving the first input in natural language form via an input component; or receiving fourth media content, which includes a third object.

[0158] In some cases, presenting the first media content includes: receiving a second request for obtaining the first media content; and presenting the first media content based on the second request.

[0159] In some cases, presenting at least one element at an associated location of at least one piece of media content includes: presenting the first element in the first component, and receiving the second request includes: receiving the second request through the first component.

[0160] In some cases, the first media content also includes a first element, the first task includes at least one stage, and the first media content demonstrates the first processing procedure of the intelligent system for at least one piece of media content, the first processing procedure corresponding to at least one stage.

[0161] In some cases, the first task includes multiple stages, and presenting the first media content includes: receiving a second input for selecting at least one stage; and presenting the first media content based on at least one stage.

[0162] In some cases, presenting the first element includes: presenting the first element in a first style, and the method further includes: receiving a third input for adjusting the first style, and the first media content presenting the first element in a second style, which is different from the first style.

[0163] In some cases, at least one stage includes multiple stages, and the first media content includes multiple parts, each of which demonstrates the processing of the multiple stages.

[0164] In some cases, the corresponding module in device 500 may also be configured to receive a fourth input; and to present a third element at an associated location of at least one media content, the third element being derived based on the fourth input, wherein the first media content also includes the third element.

[0165] In some cases, presenting at least one element includes: presenting the first element through a first dynamic process, the first dynamic process displaying a first dynamic change of the first element, and the first media content displaying a second dynamic change of the first element, the first dynamic change corresponding to the second dynamic change.

[0166] In some cases, the corresponding module of device 500 is also configured to present at least one element at an associated location of at least one media content during the execution of a first task by the intelligent system, the at least one element representing the processing of at least one media content by the intelligent system, the at least one element including a first element.

[0167] In some cases, the first task includes at least a first phase and a second phase, and presenting at least one element includes: presenting a first set of elements, which corresponds to the first phase; and stopping the presentation of the first set of elements and presenting a second set of elements, which corresponds to the second phase.

[0168] In some cases, the corresponding module in device 500 may also be configured to receive a third request for publishing first media content; and to present the first media content on a first interface.

[0169] In some cases, the corresponding module in device 500 may also be configured to present a second component on a first interface, the second component being used to provide a first service, the first service being used to obtain a first object.

[0170] In some cases, the first interface includes at least one of the following: a playback interface for the first media content; a viewing interface for the information stream, the information stream including the first media content; and a product viewing interface related to the first object.

[0171] In some cases, receiving a first request includes: presenting an input component for interacting with the intelligent system; and receiving the first request, which is in natural language form, through the input component.

[0172] The modules included in device 500 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some cases, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 500 can be implemented at least partially by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on.

[0173] Figure 6 A block diagram of an electronic device 600 in which one or more examples may be implemented is shown. It should be understood that... Figure 6 The electronic device 600 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 6 The illustrated electronic device 600 can be used to implement the electronic device 110 discussed above.

[0174] like Figure 6 As shown, electronic device 600 is in the form of a general-purpose electronic device. Components of electronic device 600 may include, but are not limited to, one or more processing units or processors 610, memory 620, storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. Processor 610 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 620. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 600.

[0175] Electronic device 600 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 600, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 620 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof). Storage device 630 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media capable of storing information and / or data and accessible within electronic device 600.

[0176] Electronic device 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 6 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 620 may include computer program product 625 having one or more program modules configured to perform various methods or actions of various examples.

[0177] The communication unit 640 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 600 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 600 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.

[0178] Input device 650 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 660 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 600 can also communicate with one or more external devices (not shown) via communication unit 640 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 600, or with any device that enables electronic device 600 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0179] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0180] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0181] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0182] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0183] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, as well as combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0184] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for interface interaction, comprising: Receive a first request, the first request being used to instruct the intelligent system to perform a first task, the first request including an identifier of at least one piece of media content; Present a first element, which is used to mark a first object of the at least one media content; as well as The system presents first media content, which is provided by the intelligent system. The first media content includes first visual content, which corresponds to the first object.

2. The method of claim 1, wherein the first request characterizes a first demand, and the first object includes at least one object that matches the first demand.

3. The method of claim 2, wherein the at least one media content includes a second object, the first media content further includes second visual content corresponding to the second object, and the first media content displays a combination of the first object and the second object.

4. The method according to claim 3, wherein the first media content further includes a virtual avatar, the first object corresponds to a first clothing element, the second object corresponds to a second clothing element, the first media content displays the clothing effect of the virtual avatar, and the clothing effect is obtained by applying the first clothing element and the second clothing element to the virtual avatar.

5. The method according to claim 3, wherein the at least one media content includes multiple media content, and the first object and the second object originate from different media content.

6. The method according to claim 3, further comprising: A second element is presented, which is used to connect the first object and the second object, and the second element represents that the first object and the second object have a first relationship.

7. The method of claim 3, further comprising: Receive a first input, which is used to replace the second object with a third object; as well as Presenting second media content, which displays the combination of the first object and the third object.

8. The method of claim 1, wherein presenting the first media content comprises: Receive a second request, the second request being used to obtain the first media content; as well as The first media content is presented, which is obtained based on the second request.

9. The method of claim 8, wherein the presenting the first element comprises: In the first component, the first element is presented. Furthermore, receiving the second request includes receiving the second request through the first component.

10. The method of claim 1, wherein the first media content further includes the first element, the first task includes at least one stage, and the first media content demonstrates a first processing procedure of the intelligent system on the at least one media content, the first processing procedure corresponding to the at least one stage.

11. The method of claim 10, wherein the presenting the first element comprises: The method further includes: presenting the first element in a first style; and presenting the first element in a first style. A third input is received, the third input being used to adjust the first style, and the first media content presents the first element in a second style, the second style being different from the first style.

12. The method of claim 10, wherein the at least one stage comprises multiple stages, and the first media content comprises multiple parts, each of the multiple parts illustrating the processing of the multiple stages.

13. The method of claim 1, wherein presenting the first element comprises: During the execution of the first task by the intelligent system, at least one element is presented at the associated location of the at least one media content, the at least one element representing the processing of the at least one media content by the intelligent system, the at least one element including the first element.

14. The method of claim 13, wherein the first task comprises at least a first phase and a second phase, and the presentation of at least one element comprises: Present the first group of elements, which corresponds to the first stage; as well as Stop presenting the first group of elements and present the second group of elements, which corresponds to the second stage.

15. The method of claim 1, further comprising: Receive a third request, the third request being used to publish the first media content; as well as The first interface displays the first media content.

16. The method of claim 15, further comprising: On the first interface, a second component is presented, which is used to provide a first service, and the first service is used to obtain the first object.

17. The method of claim 1, wherein receiving the first request comprises: An input component is presented, which is used to interact with the intelligent system; as well as The input component receives the first request, which is in natural language form.

18. A device for interface interaction, comprising: The receiving module is configured to receive a first request, the first request being used to instruct the intelligent system to perform a first task, the first request including an identifier of at least one piece of media content; A first presentation module is configured to present a first element, the first element being used to mark a first object of the at least one media content; as well as The second presentation module is configured to present first media content, which is provided by the intelligent system. The first media content includes first visual content, which corresponds to the first object.

19. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 17 when executed by the at least one processor.

20. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 17.

Images