Method, apparatus, device and product for interface interaction

Abstract

A method, apparatus, device and product for interface interaction are provided. The method includes receiving a first request, the first request being used to instruct a smart system to perform a first task, the first request including an identification of at least one media content; presenting first visualization information, the first visualization information representing a first processing procedure of the smart system on the at least one media content, the first processing procedure including a plurality of stages; receiving a first input, the first input including a feedback on a first stage, the plurality of stages including the first stage; and presenting second visualization information, the second visualization information representing a second processing procedure of the smart system on the at least one media content, the second processing procedure including at least a re-execution of the first stage based on the first input. In this way, the efficiency of human-machine interaction can be effectively improved.

Description

Technical Field

[0001] The examples in this article generally relate to the field of computer science, and in particular to methods, apparatuses, devices, and products for user interface interaction. Background Technology

[0002] With the development of intelligent systems, these systems are able to present graphics, web pages, or visual components in their responses to tasks, enabling users to not only read text but also understand the processing results through graphics. However, the relevant visual results are often one-off, representing only one processing path that is ultimately adopted. Therefore, how to enable users to provide feedback on specific stages of the processing during the visual interaction process and receive corresponding updated results is a problem that needs to be solved. Summary of the Invention

[0003] In a first aspect, a method for interface interaction is provided. The method includes: receiving a first request, the first request instructing an intelligent system to perform a first task, the first request including an identifier of at least one piece of media content; presenting first visual information, the first visual information representing a first processing procedure of the intelligent system on at least one piece of media content, the first processing procedure including multiple stages; receiving a first input, the first input including feedback on the first stage, the multiple stages including the first stage; and presenting second visual information, the second visual information representing a second processing procedure of the intelligent system on at least one piece of media content, the second processing procedure including at least re-execution of the first stage based on the first input.

[0004] In a second aspect, an apparatus for interface interaction is provided. The apparatus includes: a first receiving module configured to receive a first request, the first request instructing an intelligent system to perform a first task, the first request including an identifier of at least one piece of media content; a first presentation module configured to present first visual information, the first visual information representing a first processing procedure of the intelligent system on at least one piece of media content, the first processing procedure including multiple stages; a second receiving module configured to receive a first input, the first input including feedback on the first stage, the multiple stages including the first stage; and a second presentation module configured to present second visual information, the second visual information representing a second processing procedure of the intelligent system on at least one piece of media content, the second processing procedure including at least re-execution of the first stage based on the first input.

[0005] In a third aspect, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0007] Through the above solution, users can provide direct feedback on specific stages during the visualization process. The intelligent system then re-executes only the affected stages based on the feedback and presents updated visualizations, reducing the number of complete re-interrogations required by users to correct processing results, thereby improving human-computer interaction efficiency. Since the intelligent system does not need to re-execute all stages from scratch, but instead reuses the processing results of confirmed stages and only re-executes the affected stages and their downstream processes, the number of interaction rounds and the amount of data transmitted between electronic devices and servers are reduced, correspondingly lowering the server's redundant computational load.

[0008] It should be understood that the content described in this section is not intended to limit the key or important features of the examples in this article, nor is it intended to restrict the scope of the solution. Other features will become readily apparent from the following description. Attached Figure Description

[0009] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of the example environment is shown; Figures 2A to 2O The diagram shows sample interfaces for various scenarios of user interface interaction. Figure 3 The flowcharts show example processes of interface interactions in some scenarios; Figure 4 Schematic block diagrams of example devices for interface interaction in some scenarios are shown; and Figure 5 A block diagram of an electronic device capable of implementing multiple illustrative scenarios is shown. Detailed Implementation

[0010] The examples in this document will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.

[0011] It should be noted that the headings of any section / subsection provided herein are not restrictive. Various examples are described throughout this document, and examples of any type may be included under any section / subsection. Furthermore, examples described in any section / subsection may be combined in any way with any other examples described in the same section / subsection and / or different sections / subsections.

[0012] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0013] The examples in this document may involve user data, data acquisition, and / or use. All of these aspects comply with relevant laws, regulations, and rules. In the examples, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.

[0014] In this manual and the sample solutions, any processing of personal information will be conducted only under legal grounds (such as obtaining the consent of the data subject or being necessary for the performance of a contract) and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.

[0015] As used in this article, the term "intelligent system" can refer to a system capable of autonomous control based on machine learning models. An intelligent system is, for example, a virtual object or physical entity that can make decisions and autonomously execute actions based on machine learning models to achieve preset goals or complete preset tasks. An intelligent system can be an automated program that understands user intent and can utilize models or invoke tools to complete various types of tasks. In some cases, examples of intelligent systems may include, but are not limited to: intelligent agents, robot programs, chatbots, digital avatars, intelligent customer service, digital assistants, etc. Alternatively, an intelligent system can also be an intelligent role implemented based on a machine learning model. An "intelligent system" can process user requests based on generative models (e.g., language models, multimodal models) to perform specified types of tasks. In some cases, an intelligent system may also be associated with a virtual account, which may have a corresponding avatar or nickname.

[0016] As used in this document, the term "task" refers to a set of operations performed by an intelligent system in response to a request, having one or more processing objectives. A task may include performing at least one of the following operations on one or more media contents: identification, localization, counting, comparison, relationship determination, trajectory determination, size determination, information extraction, state judgment, or result generation. Task types may be determined based on processing objectives, processing objects, interaction methods, or output formats.

[0017] As used in this article, the term "type" refers to a category or classification dimension formed based on one or more attributes of a task, object, relationship, element, or step. Types can be explicitly specified upon request or determined by the intelligent system based on natural language content, media content, or conversational context. For example, task types may include object recognition, object counting, relationship determination, trajectory determination, region verification, or size determination.

[0018] As used in this document, the term "request" refers to information or instructions that enable an intelligent system to start, configure, continue, or adjust a task. Requests can include natural language content, media content, task parameters, object identifiers, locations, conditions, user actions, session context, and any combination thereof. A first request can be formed through a single user input or assembled from content provided in multiple input steps.

[0019] The term "media content" as used in this article refers to content that carries information and can be processed by an intelligent system. It typically includes, but is not limited to, images, pictures, videos, audio, documents, charts, or any combination thereof. Media content can come from user uploads, be provided by an intelligent system, or be obtained from other sources.

[0020] The term "visual information" as used in this article refers to information that graphically displays the process of an intelligent system processing media content. This information may include, but is not limited to, numbers, labels, lines, boxes, paths, animation effects, and text used to explain the processing steps, all superimposed on the relevant locations of the media content. Visual information is used to make the stages, evidence, and conclusions of the processing visible and actionable to the user.

[0021] The term "processing procedure" as used in this article refers to a series of processes performed by an intelligent system to complete its primary task. The processing procedure may include multiple stages, each of which may correspond to an observation, identification, location, annotation, calculation, or reasoning of media content, and the stages may be dependent on each other.

[0022] The term "stage" as used in this article refers to a single processing unit in the process. A stage may correspond to one or more steps and may be displayed by a set of elements at the relevant location in the media content.

[0023] The term "feedback" as used in this article refers to adjustment information given by the user for a certain stage. Feedback can take the form of natural language messages, references to elements, editing operations on elements, or a combination of the above. Feedback is used to instruct the intelligent system to adjust and re-execute the corresponding stage.

[0024] As used in this document, the term "input" refers to information that an electronic device can receive and use to control a task, stage, or interface state. Feedback is a type of input used to confirm, negate, replace, supplement, or adjust at least a portion of an existing processing procedure. The first input can be in the form of natural language or generated from direct manipulation of elements, references to stages, selection results, or a combination of the above.

[0025] As used in this document, the term "action" refers to interactive input that can be received by an electronic device and trigger changes in the state of the interface, task, or element presentation. Actions can include clicks, touches, long presses, swipes, drags, zooms, selections, keyboard input, voice commands, gestures, or other interaction methods. Actions can act directly on elements, media content, or components, or indirectly on corresponding content through reference tags.

[0026] As used in this article, the term "object" refers to a content unit within media content that can be identified, located, marked, compared, counted, or relationalized. An object can correspond to an entity, or to a region, outline, surface, text, field, icon, node, path location, or other manipulable visual unit. A group of objects can include one or more objects and can be formed based on type, relation, spatial extent, or stage result.

[0027] As used herein, the term "relationship" refers to an association between two or more objects, groups of objects, media content, processing steps, or processing results. Relationships can include matching, pairing, adjacency, inclusion, subordination, belonging, sequence, direction, spatial location, correspondence, or succession. Relationships can be directional or non-directional and can be represented by at least one of the following: connecting lines, arrows, common identifiers, styles, proximity, or text.

[0028] As used in this document, the term "element" refers to a visual identifier used to represent a process, stage, step, intermediate result, execution result, or feedback. Elements may include numbers, labels, dots, boxes, connectors, arrows, tracks, masks, zoom-in views, icons, animations, or other graphic components. An element group is one or more elements organized according to stages, steps, media content, task type, or interface hierarchy.

[0029] As used in this document, the term "associated location" refers to a location that has a spatial or display correspondence with an object, region, processing step, or processing result. An associated location can be located inside, on, at, or near an object, or at a corresponding display location within a connection endpoint, media component, or other location that maintains an identifiable correspondence. As media content is scaled, cropped, or moved, the associated location can change or update based on the display state.

[0030] As mentioned above, in some related solutions, intelligent systems can generate graphics, web pages, or visualizations in response to tasks, enabling users to not only read text but also understand the processing results through graphics. However, such visualizations are often one-off and linear; the intelligent system generates a final page or visualization component, and users can only view it or perform limited interactions.

[0031] Furthermore, linear process representations typically only characterize one final processing path. Users struggle to understand why a particular intermediate stage in the process holds true, and find it difficult to follow up, refute conclusions, add conditions, or explore alternative paths at specific intermediate stages. Consequently, in complex tasks, each user inquiry often requires the intelligent system to regenerate a complete visualization from scratch. Correctly identified intermediate stages may be rewritten, leading to redundant processing, inconsistent results, and high interaction costs.

[0032] A user interface interaction scheme is proposed. According to the scheme, an electronic device receives a first request for instructing an intelligent system to perform a first task, the first request including an identifier of at least one media content; the electronic device presents first visual information characterizing a first processing procedure of the intelligent system on at least one media content, wherein the first processing procedure includes multiple stages; the electronic device receives a first input including feedback on the first stage, the multiple stages including the first stage; the electronic device presents second visual information characterizing a second processing procedure of the intelligent system, the second processing procedure including at least re-execution of the first stage based on the first input.

[0033] Through the above solution, users can provide direct feedback on specific stages during the visualization process. The intelligent system then re-executes only the affected stages based on the feedback and presents updated visualizations, reducing the number of complete re-interrogations required by users to correct processing results, thereby improving human-computer interaction efficiency. Since the intelligent system does not need to re-execute all stages from scratch, but instead reuses the processing results of confirmed stages and only re-executes the affected stages and their downstream processes, the number of interaction rounds and the amount of data transmitted between electronic devices and servers are reduced, correspondingly lowering the server's redundant computational load.

[0034] The following describes various examples of this scheme in further detail with reference to the accompanying drawings.

[0035] Example Environment Figure 1 A schematic diagram of example environment 100 is shown. (e.g.) Figure 1 As shown, example environment 100 may include electronic device 110.

[0036] In this example environment 100, electronic device 110 can run an application 120 that supports user interface interaction. Application 120 can be any suitable type of application for user interface interaction, including but not limited to multimodal question-and-answer applications, image understanding applications, intelligent assistant applications, or other suitable applications. User 140 can interact with application 120 via electronic device 110 and / or its attached devices.

[0037] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.

[0038] In some cases, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, virtual reality (VR) / augmented reality (AR) devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some cases, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0039] Server 130 can be a single physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.

[0040] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some cases, server 130 and electronic device 110 can exchange signaling information through their communication connection.

[0041] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the scheme.

[0042] The examples described herein can be implemented on electronic device 110. It should be noted that the operations described relative to electronic device 110 can be performed by a related application 120 running on electronic device 110. The interface described relative to electronic device 110 can be provided by application 120; for example, electronic device 110 presents the corresponding interface by running application 120. Furthermore, some operations described relative to electronic device 110 may require the assistance of server 130 to complete.

[0043] The following description of the example will continue with reference to the accompanying drawings.

[0044] Example Interaction Figures 2A to 2O Schematic diagrams of example interfaces 200A to 200O for user interface interaction are shown, according to some scenarios. Interfaces 200A to 200O can, for example, be provided by... Figure 1 The electronic device 110 shown is provided. For ease of explanation, the following description uses the first task of matching images of socks as an example; however, it should be understood that this example is not limiting, and the above task is only used to illustrate the process of presentation and stage-level feedback.

[0045] Figure 2A A schematic diagram of the initial interface 200A receiving the first request is shown. See below for reference. Figure 2A To describe the process of receiving the first request. For example... Figure 2A As shown, on interface 200A, electronic device 110 presents input component 202 at the bottom of the interface. This input component 202 is used to interact with the intelligent system. Electronic device 110 can receive a second input through input component 202. The second input may include natural language content and at least one type of media content. User 140 can provide an image containing five socks as at least one type of media content (e.g., media content 206) through input component 202, and input natural language content 204 "How many unpaired socks are there in the picture?". Electronic device 110 can provide the above natural language content and the image containing five socks as a first request to the intelligent system to trigger the intelligent system to perform a first task based on the first request.

[0046] In one scenario, in response to receiving a first request sent via input component 202, electronic device 110 instructs intelligent system to perform a first task. This first request includes media content 206 and natural language content 204, where natural language content 204 describes the requirements of the first task. For example, natural language content 204 might be "How many unpaired socks are there in the picture?". After directly receiving natural language content 204, intelligent system can determine the first task based on it. The first task could be determining the number of unpaired socks in media content 206. In some scenarios, the first request includes an identifier for at least one piece of media content, meaning the first request includes information that enables electronic device 110 or intelligent system to obtain or access at least one piece of media content. Specifically, the first request may directly include at least one piece of media content, such as image data, video data, audio data, or document data; it may also include an access address for at least one piece of media content, such as a Uniform Resource Locator (URL), Uniform Resource Identifier (URLI), storage path, or object storage address; and it may also include an identifier for the at least one piece of media content, such as a media content identifier, file identifier, object key, content hash value, message location identifier, etc. The aforementioned media content, access address, and identifier may be included individually or in combination in the first request. The electronic device 110 or intelligent system may parse the corresponding information in the first request, retrieve at least one piece of media content from local storage, cache, database, server, or other storage location, and establish a correspondence between the media content and the first task.

[0047] In this way, user 140 can provide media content 206 and natural language content 204 simultaneously in the same input component 202, reducing the number of steps required to initiate a task. Since the first request carries the media content and request together in a structured manner, there is no need for additional rounds of interaction between electronic device 110 and server 130 to supplement the media content or request, thus reducing the number of requests for edge-cloud interaction.

[0048] Figure 2B A schematic diagram of interface 200B is shown, which presents object numbers and step instructions at relevant locations within the media content. See below for reference. Figure 2B The process of presenting the first visual information is described below. In response to a first request, the electronic device 110 presents the first visual information, which represents a first processing procedure of the intelligent system on at least one piece of media content 206, and the first processing procedure includes multiple stages.

[0049] As an example, after receiving a first request, the electronic device 110 can send at least one piece of media content carried in the first request, along with natural language content describing the first task, to the intelligent system. The intelligent system parses the natural language content to obtain the processing objective of the first task and analyzes the at least one piece of media content to obtain objects, regions, or relationships between objects related to the first task. Further, the intelligent system divides the first processing procedure for completing the first task into multiple stages and generates a stage identifier, stage description, processing status, dependent media content, and execution relationships between stages for each stage. Multiple stages can be executed sequentially or partially in parallel; intermediate results from previous stages can serve as input for subsequent stages.

[0050] The intelligent system can generate initial visualizations based on stage identifiers and the execution relationships between stages. These initial visualizations can include multiple stage cards, stage nodes, connecting lines, status indicators, and visual elements associated with the media content. The visual elements associated with the media content can be displayed at relevant locations within corresponding objects or areas, enabling users to correlate the processing results of a stage with specific evidence within the media content.

[0051] For example, at least one piece of media content consists of an image containing multiple socks, and the first task is to identify the number of unpaired socks in the image. The intelligent system can divide the first processing step into a sock object identification stage, a sock pairing relationship identification stage, and an unpaired sock statistics stage. In the sock object identification stage, the electronic device 110 can display object markers at the associated positions of each identified sock; in the sock pairing relationship identification stage, the electronic device 110 can use connecting lines or the same number to mark two socks with a pairing relationship; in the unpaired sock statistics stage, the electronic device 110 can display an "unpaired" status marker for socks that have not established a pairing relationship and present the corresponding statistical results. The electronic device can also update the status of the stage cards and the visual elements on the media content sequentially according to the execution progress of each stage.

[0052] In some cases, the first stage includes at least one step, and the electronic device 110 may present a first set of elements at an associated location in the media content 206, the first set of elements being used to demonstrate at least one step. Specifically, the first set of elements may include circular numbers and location descriptions overlaid on each sock object, such as circular number 212-1 and location description 212-2 overlaid on the first object (e.g., object 210-1), and circular number 214-1 and location description 214-2 overlaid on the second object (e.g., object 210-2). The first set of elements is carried in a message 208, which may be generated by an intelligent system, demonstrating at least one step of the first stage. For example, object counting and identification steps may be represented by multiple elements in the media content 206.

[0053] It should be noted that the socks in media content 206 can be identifiable objects, while the circular numbers and location descriptions covering them can be elements used to mark the objects. The numbered elements do not replace the sock objects they mark. In some cases, the style of the first group of elements can be based on the type of the first task. For example, for the matching task in this example, the first group of elements uses a style of numbers and location descriptions, while for path-type or area-labeling tasks, styles such as arrows, paths, or selection boxes can be used. In this way, users do not need to repeatedly compare plain text and images. Furthermore, the client-side page rendering overhead and the number of document object model refreshes are correspondingly reduced.

[0054] Figure 2C A schematic diagram of an interface 200C that expresses object relationships using connecting elements is shown. Figure 2C and Figure 2B These are different stages of the same processing procedure. In some cases, multiple stages include a second stage, where the electronic device 110 may stop presenting the first set of elements and present a second set of elements to display the second stage. As an example, Figure 2B and Figure 2C The interface changes when switching from the first stage to the second stage are shown. For example... Figure 2B As shown, the first stage can be the sock object identification stage. The first set of elements can include circular numbers and location descriptions presented at the associated positions of each sock object, such as circular numbers 212-1 and 214-1, and location descriptions 212-2 and 214-2. The first set of elements is used to demonstrate the steps of the intelligent system in identifying each sock object. After the first stage is completed, the electronic device 110 can switch from interface 200B to... Figure 2CThe interface 200C shown stops presenting the circular numbers and position descriptions according to the organization of the first group of elements; for example, it stops presenting position descriptions 212-2 and 214-2. The intelligent system executes the second stage, namely the sock pairing relationship identification stage, based on the sock objects and their positions determined in the first stage. Correspondingly, the electronic device 110 presents the second group of elements in the media content 206. The second group of elements includes, for example, relationship element 216-1 and relationship element 216-2. Relationship element 216-1 connects the sock objects corresponding to numbers 1 and 3, and relationship element 216-2 connects the sock objects corresponding to numbers 2 and 4, to display the sock pairing relationships obtained in the second stage.

[0055] In some cases, electronic device 110 may stop presenting the first set of elements in response to receiving confirmation of the first stage. As an example, in... Figure 2B In the interface 200B shown, the user can verify the recognition result of the sock object displayed by the circular number and location description, and confirm the first stage by clicking the confirmation control, selecting continue operation, or entering natural language content to indicate confirmation. In response to receiving this confirmation, the electronic device 110 updates the status of the first stage to confirmed, stops displaying the first set of elements used to display the first stage, and switches to... Figure 2C The interface 200C shown presents a second set of elements used to display the sock pairing relationship identification stage.

[0056] Alternatively, the electronic device 110 may stop presenting the first group of elements in response to not receiving feedback on the first stage within the first time period. The first time period may begin when the first group of elements is fully presented or when the first stage is completed. Within the first time period, the electronic device 110 may detect whether the user has clicked, edited, quoted, or entered natural language feedback on the first group of elements. If no feedback on the first stage is detected at the end of the first time period, the electronic device 110 may determine the first stage as a default confirmation state and stop presenting it. Figure 2B The first group of elements is shown, and presented. Figure 2C The second set of elements shown continues to display the second stage. Thus, the electronic device 110 can advance the processing based on the user's active confirmation or the lack of feedback after a timeout, reducing the need for the user to manually close stage elements and preventing the continuous accumulation of elements from different stages from obscuring the media content.

[0057] Figure 2D A schematic diagram of an interface 200D is shown, which marks unpaired socks and outputs stage conclusions. (See diagram 200D for details.) Figure 2DAs shown, electronic device 110 marks object 210-1 corresponding to number 5 as an unpaired object, displays circular number 212-1 as "5", displays element 213 as "no pairing" and marks object 210-1, and presents the text conclusion 222 of the first processing step: "The second sock in the second row is not paired." Thus, electronic device 110 completes the presentation of the first visual information. This first visual information, through numbering, location descriptions, relational elements, and stage conclusions, collectively reveals the intelligent system's first processing step for media content 206. In this way, users can understand the intelligent system's processing step by step along the numbering, relational elements, and conclusions, rather than simply obtaining a final quantity. Furthermore, electronic device 110 does not need to load media content separately for each stage, thus reducing client-side cache usage.

[0058] The following describes the process by which users provide feedback at a certain stage of the processing and receive updated results. Figure 2E A schematic diagram of an interface 200E that receives natural language feedback and presents updated relationships is shown. Figure 2E As shown, electronic device 110 receives a first input, which can be a message in natural language form presented and received through an input component. This first input may include feedback on the first stage of a multi-stage process. For example, the first input could be, "The second step was done incorrectly; 1 and 4 are clearly different colors." After receiving the first input, electronic device 110 can present a message 224 corresponding to the first input on interface 200E.

[0059] In some cases, the first input includes first content and second content. The first content characterizes a first stage. The second content describes the adjustment requirements for the first stage. As an example, the first content may include a stage identifier, stage name, stage summary, processing result, or a reference to an element corresponding to the first stage, enabling the intelligent system to identify the first stage to which the feedback is directed based on the first content. The second content describes the adjustment requirements for the first stage and may include at least one of the following: the object to be adjusted, the content to be adjusted, and the adjustment method, such as modifying, replacing, adding, deleting, or regenerating the processing result of the first stage. The intelligent system can locate the first stage based on the first content and obtain the specific method for adjusting the first stage based on the second content.

[0060] In some cases, the electronic device 110 presents second visual information, which characterizes a second processing procedure of the intelligent system, the second processing procedure including at least re-execution of the first stage based on the first input.

[0061] As an example, such as Figure 2EAs shown, the first input includes "The second step was done wrong; 1 and 4 are clearly different colors." This first input indicates an error in the pairing relationship identification stage and describes the need for adjustment to re-identify the pairing relationships between socks. In this example, the pairing relationship identification stage can be the first stage targeted by the first input, without limiting it to the stage that is first in the first processing step.

[0062] The intelligent system locates the pairing relationship identification stage based on the first input, and reuses the sock object identification results, object numbers, and object positions obtained in the previous stage to re-compare the color, pattern, or other pairing features of each sock object. Based on the results of the re-comparison, the intelligent system determines that the socks corresponding to numbers 2 and 4 do not have a pairing relationship, and then re-determines the pairing relationship between each sock object.

[0063] In response to the intelligent system re-execution of the first phase, the electronic device 110 presents response content 226 and second visual information on the interface 200E. The second visual information may include updated media content 228, and relationship elements 230-1 and 230-2 presented according to the updated pairing relationship. Relationship element 230-2 connects the sock objects corresponding to numbers 2 and 5, replacing the relationship element that connected the sock objects corresponding to numbers 2 and 4 before the re-execution of the first phase.

[0064] In this way, the number of times the questions need to be asked again from the beginning to correct a single stage is reduced. Furthermore, the number of interaction rounds and the amount of data transmitted between the electronic device 110 and the server 130 are reduced accordingly, thus lowering the repetitive computational load on the server 130.

[0065] Figure 2F A schematic diagram of interface 200F is shown. (As shown) Figure 2F As shown, after the relationship is corrected, the electronic device 110 associates the "no pairing" conclusion with the first black sock in the second row, i.e., the second object (e.g., object 210-2), element 232-1 is displayed as "4" and overlaid on the second object (e.g., object 210-2), element 232-2 displays "no pairing" and marks the second object (e.g., object 210-2), and presents the updated stage conclusion 234.

[0066] Figure 2G A schematic diagram of an interface 200G for directly dragging elements is shown. In addition to providing feedback in natural language, user 140 can also provide feedback through editing operations on elements. In some cases, electronic device 110 can receive a first operation. The first operation is used to edit a first element. Further, electronic device 110 can present a second element. The second element is obtained by editing the first element.

[0067] like Figure 2G As shown, the first message 208 carries the first element, which can be located in... Figure 2G The position is indicated by the dashed box. User 140 can perform a first operation. For example, the user can press and hold the first element and drag it along the direction of the dashed line to adjust the display position of the first element. After receiving the first operation, electronic device 110 can drag the display position of the first element from the position of the dashed box before editing to the vicinity of the second object to present the second element (e.g., element 235) after the position of the first element has been edited.

[0068] In some cases, the second element represents feedback to the first stage. This feedback can be expressed through at least one of the following: the display position, size, style, associated object, or connection relationship of the second element, reflecting the user's desired adjustments to the first stage. The first operation can carry the element identifier of the edited first element, the adjusted display parameters, and the adjusted associated object identifier, enabling the intelligent system to edit the first element according to the first operation to obtain the second element, and to obtain the first stage and specific adjustments targeted by the feedback through the second element. The second element can serve as a visual representation of the user feedback and is not limited to the final processing result obtained after the intelligent system re-executes the first stage.

[0069] As an example, such as Figure 2G As shown, the first element, which can be displayed within the dashed box, represents the first stage's determination that the first object does not have a paired object. The user can drag the first element along the movement trajectory to indicate that the object corresponding to this "no paired" conclusion contains an error. For example... Figure 2H As shown, based on the end position of the drag operation, the electronic device 110 adjusts the associated object of the first element from the first object to the second object, and presents the second element (e.g., element 235) obtained by editing the first element. The element is presented at the associated position of the second object (e.g., object 210-2), thereby representing the user's feedback that they want to adjust the "no pairing" conclusion from the first object (e.g., object 210-1) to the second object (e.g., object 210-2). In other scenarios, the first operation may also include adjusting the size of the first element. The user can indicate affirmation of the first stage or indicate the focus of subsequent stages by adjusting the size of the first element.

[0070] In some scenarios, at least one piece of media content includes a first object and a second object. A first element is used to label the first object, and a second element is used to label the second object. Feedback indicates that the first object should be replaced with the second object. As an example, the intelligent system can establish an association between the object identifier and object position of the first element and the first object, so that the first element, at its associated position with the first object, represents the processing result obtained in the first stage for the first object. The user can perform a first operation (e.g., a drag operation) on the first element to change the object pointed to by the processing result from the first object to the second object.

[0071] As an example, such as Figure 2D and 2G As shown, the first element can be a "no pairing" marker displayed at the associated position of the first object (e.g., object 210-1), indicating that the first stage determines that the first object (e.g., object 210-1) does not have a paired object. The user believes the "no pairing" result points to an incorrect object, and therefore drags the first element along the movement trajectory from the associated position of the first object (e.g., object 210-1) to the associated position of the second object (e.g., object 210-2). The intelligent system can identify the first object (e.g., object 210-1) based on the starting position of the drag operation and the second object (e.g., object 210-2) based on the ending position of the drag operation, and provides the object identifiers of the first object (e.g., object 210-1), the second object (e.g., object 210-2), and the object replacement indication as feedback for the first stage.

[0072] like Figure 2H As shown, in response to this feedback, electronic device 110 disconnects the first element from the first object (e.g., object 210-1) and presents a second element (e.g., element 235) obtained by editing the first element at the associated position of the second object (e.g., object 210-2). The second element is used to mark the second object (e.g., object 210-2), thereby replacing the object pointed to by the "no pairing" processing result from the first object (e.g., object 210-1) to the second object 210-2. Electronic device 110 can also update the stage conclusion 238 according to the object replacement result, so that the stage conclusion 238 is consistent with the second object (e.g., object 210-2) marked by the second element.

[0073] Figure 2I A schematic diagram of an interface 200I is shown, which references elements and provides feedback. In some cases, at least one step includes a first step, where the first input includes a reference to at least one element in the first group of elements, the at least one element corresponding to the first step, and feedback is used to adjust the first step. As an example, such as Figure 2IAs shown, user 140 can click on a first element (e.g., relation element 216-2). Clicking on relation element 216-2 can be part of the first input. Electronic device 110 can determine that the element referenced by the first input is relation element 216-2 based on the operation location or event object of the click operation, and obtain the stage identifier and step identifier associated with relation element 216-2. Relation element 216-2 connects the objects corresponding to numbers 2 and 4, and is used to characterize the step in the first stage that identifies the relationship between the two objects.

[0074] The first input may also include a first operation that instructs the user to adjust the connection relationship corresponding to the first element. Upon receiving such a first operation, the electronic device 110 may display the identifier "@element4" in component 240 to show the user the currently referenced relational element. The identifier "@element4" is a visual representation of the first input's reference to relational element 216-2 in the interface, rather than the sock object itself connected by relational element 216-2. The user may also further explain the adjustment requirements by inputting content such as "This sock is not found correctly" through component 240.

[0075] The intelligent system can directly locate the first step based on the relation element 216-2 referenced by the first input, and redetermine the relationships between the objects connected to relation element 216-2. Therefore, the user can accurately direct feedback to the first step without needing to describe the location of the relation element or all the objects it connects to, thus reducing ambiguity in the feedback target and the need for re-analysis of the entire first processing step.

[0076] In this way, user 140 can accurately pinpoint feedback to specific elements and stages, reducing the expressive costs required to describe the target stage in plain text and lowering the possibility of ambiguity in the feedback target by the intelligent system. Because the feedback explicitly points to a specific stage with structured references, the intelligent system can directly locate the affected stage without re-analyzing the entire processing flow, reducing ineffective processing and edge-cloud interactions.

[0077] Figure 2J A schematic diagram of an interface 200J is shown, illustrating the updating of relationship states after sending feedback including element references. In some cases, a first element is used to connect a first group of objects in at least one piece of media content. The first element represents a first relationship between the first group of objects. A second element is used to connect a second group of objects in at least one piece of media content. The second element represents a second relationship between the second group of objects. The feedback indicates that the first relationship should be replaced with the second relationship.

[0078] As an example, such as Figure 2I and 2JAs shown, media content 206 includes a first element (e.g., relation element 216-2). Relation element 216-2 represents a first relationship between a first group of objects. For example, relation element 216-2 connects objects numbered 2 and 4, indicating a pairing relationship between objects numbered 2 and 4. Further, user 140 can send a first input including the identifier "@element 4". Electronic device 110 can present a message 242 corresponding to the first input. Further, electronic device 110 can present a message 244, which includes second visual information. The second visual information may include corresponding text, updated media content 246, and a second element (e.g., relation element 247) corrected based on feedback. The second element (e.g., relation element 247) is a corrected relation line representing a second relationship between a second group of objects. For example, relation element 247 represents a pairing relationship between objects numbered 2 and 5.

[0079] In some cases, electronic device 110 may present a second element and a third element at an associated location of at least one piece of media content. The third element is derived based on the second element. The second and third elements are used to characterize a second processing procedure. As an example, such as Figure 2J As shown, in response to user feedback regarding relationship element 216-2, the intelligent system re-executes the identification phase of the sock pairing relationship to modify the pairing relationship. For example, the socks corresponding to number 2 and number 5 are identified as having a pairing relationship. The electronic device 110 presents a second element (e.g., relationship element 247) in the updated media content 246. The second element (e.g., relationship element 247) can be a relationship line connecting the socks corresponding to number 2 and number 5, used to represent the updated pairing relationship obtained by re-executing this phase. Based on the pairing relationship represented by the second element (e.g., relationship element 247), the intelligent system further determines that the second object (e.g., object 210-2) has not formed a pairing relationship with other socks and generates a third element (e.g., element 248). The electronic device 110 can present the third element (e.g., element 248) at the associated position of the second object (e.g., object 210-2), and the third element (e.g., element 248) can be, for example, a "no pairing" status marker. Thus, the second element (e.g., relation element 247) is used to characterize the updated pairing relationship obtained by re-executing the stage, and the third element (e.g., element 248) is used to characterize the processing result obtained based on the updated pairing relationship. Together, they characterize the second processing process in which the intelligent system re-executes the corresponding stage based on the first input and continues to execute the downstream stage.

[0080] In this way, after user 140 provides feedback on the reference to an element, they can simultaneously see the updated relationship and the subsequent results obtained based on the updated relationship. Furthermore, the intelligent system only continues to execute downstream stages based on the updated relationship stage, without needing to re-execute the upstream confirmed stages, thus reducing redundant calculations on server 130 and the amount of data transmission between the end and cloud.

[0081] Figure 2K A schematic diagram of the interface 200K is shown, illustrating the results of subsequent stages after the relationship is updated. (See diagram 200K.) Figure 2K As shown, interface 200K is located in Figure 2J Following the updated relationship state shown, message 244 continues to carry the updated downstream result. The updated media content 246 carries the reordered numbered objects and the third element (e.g., element 248), and presents the updated stage conclusion 250, "The first sock in the second row did not match." In this way, after user 140 provides feedback on a certain stage, they can continue to obtain consistent downstream conclusions along the processing flow without needing to re-initiate the entire task. Because the downstream stages reuse the confirmed upstream evidence, only the affected stages are re-executed, thus reducing the number of edge-cloud interaction rounds and the computational load on server 130.

[0082] Figure 2L A schematic diagram of the interface 200L, which displays visual information in stages, is shown. For example... Figure 2L As shown, the electronic device 110 can also display first visual information in stages through multiple messages to identify multiple stages of the first processing procedure. As an example, after the intelligent system completes the sock object identification stage, the electronic device 110 can present message 252. Message 252 includes "Step 1" to identify the first stage, media content 254, and a first set of elements presented in the media content 254. The first set of elements includes, for example, circular numbers and location descriptions at the associated positions of each sock object, to demonstrate the process by which the intelligent system identifies and locates each sock object. The intelligent system can continue to perform the sock pairing relationship identification stage based on the sock objects and their positions obtained in the first stage. After completing this stage, the electronic device 110 can present message 256 after message 252. Message 256 includes "Step 2" to identify the second stage, media content 258, and a second set of elements (e.g., relationship element 260) presented in the media content 258. Relationship element 260 is used to connect sock objects determined to have a pairing relationship to demonstrate the process by which the intelligent system determines the sock pairing relationship. Message 256 may also include a reference control 262, through which the user can reference the second stage and provide feedback on the second stage.

[0083] In some cases, the electronic device 110 can present multiple messages sequentially according to the execution order of each stage, placing the later-presented message after the earlier-presented message, while retaining the messages corresponding to the previous stages for the user to compare and view. Thus, the first visual information does not need to be presented completely at once in a single message, but can be formed stage by stage as the first processing progresses, allowing the user to distinguish the processing objects, intermediate results, and the relationships between stages, and to provide feedback for specific stages.

[0084] In some cases, the electronic device 110 may present a first identifier on the input component, the first identifier representing a reference to the first stage. As an example, such as... Figure 2L As shown, electronic device 110 can present a reference control 262 for a first stage (e.g., "step 2") in message 256, which is used to display the first stage as the feedback object, such as "step 2" in a first processing procedure. In response to a user's click on the reference control 262, electronic device 110 can present a first identifier (e.g., identifier 263) in input component 202. The first identifier (e.g., identifier 263) may include at least one of the following: the name of the first stage, the stage number, the stage abbreviation, or the stage identifier. Electronic device 110 can establish an association between the first identifier (e.g., identifier 263) and the first stage displayed in message 256, allowing the user to continue inputting feedback for that first stage in input component 202. After receiving the content sent by the user through input component 202, electronic device 110 can determine the first stage to which the feedback is directed based on the first identifier (e.g., identifier 263) and adjust the first stage according to the feedback content sent along with the first identifier (e.g., identifier 263). Therefore, users can accurately point the feedback to the first stage corresponding to message 256 without having to re-describe the stage that needs adjustment in natural language.

[0085] Figure 2M A schematic diagram of an interface 200M is shown, illustrating the process of forming the first input by abbreviating the content of the stage and adjusting the text, and then updating the interface in step 2. (See diagram 200M for details.) Figure 2MAs shown, user 140 provides feedback on step 2 via the reference control 262 of message 256. The first input includes first content (e.g., identifier 263) and second content (e.g., the content displayed in message 266). The first content (e.g., identifier 263) is the abbreviated step content above message 266, representing the first stage being fed back. The second content is "This step is wrong; steps 1 and 4 are clearly different colors," describing the adjustment requirement for the first stage. In response to the first input, electronic device 110 presents second visual information. For example, electronic device 110 can present message 268, which includes the second visual information, including the text "Okay, step 2 has been modified for you," media content 270, and a relational element 272. The relational element 272 is the updated connection relationship after re-executing step 2, replacing the relational element 260 in step 2. In this way, user 140 can accurately provide feedback on a specific stage by referencing the abbreviated step content and attaching the adjustment text, reducing the expressive cost required to describe the target stage. Since the intelligent system only re-executes the referenced step 2 and inherits the remaining confirmed stages, the amount of redundant calculations on server 130 and the amount of data transmitted between the cloud and the terminal are reduced accordingly.

[0086] Figure 2N This diagram illustrates the interface 200N from which the downstream result of step 3 is obtained after the update in step 2. (See diagram 200N for details.) Figure 2N As shown, after updating step 2, electronic device 110 continues to present message 274. Message 274 carries the title of step 3, media content 276, element 278, and conclusion 280. Element 278 displays "No pair" and marks the black sock, which can be used as the third element or third group of elements obtained based on the update relationship. Conclusion 280 displays "The first sock in the second row has no pair." In this way, after user 140 provides feedback on step 2, they can continue to receive the same result in step 3, and the overall processing result remains consistent. Since step 3 reuses the updated result of step 2 and continues to execute only on its basis, there is no need to re-execute the earlier confirmed stage, and the number of edge-cloud interaction rounds and the computing load of server 130 are reduced accordingly.

[0087] In some cases, multiple stages include a third stage. Electronic device 110 can present a first message, which includes the execution result of a first task. The first message comes from an intelligent system and includes multiple media contents. The multiple media contents include at least a first media content and a second media content. The first media content displays a first set of elements, and the second media content displays a third set of elements. The third set of elements is used in the third stage.

[0088] As an example, such as Figure 2OAs shown, the electronic device 110 presents a first message 282, which includes first media content 284 and second media content 286. The first media content 284 is used to display a first set of elements. In this example, the first set of elements may include circular numbers and relationship elements connecting sock objects with pairing relationships. For example, the relationship elements connect sock objects corresponding to numbers 1 and 3, and connect sock objects corresponding to numbers 4 and 5, to demonstrate the first stage of the intelligent system identifying sock pairing relationships.

[0089] The intelligent system can continue to execute the third stage, such as the unpaired sock identification stage, based on the sock pairing relationship displayed in the first media content 284, and generate the second media content 286 according to the processing result of the third stage. The second media content 286 can be used to display a third set of elements. The third set of elements includes, for example, circular numbers located at the associated positions of each sock object and an element used to mark the "unpaired" state of the sock corresponding to number 4. The electronic device 110 can also present the stage conclusion "the first sock in the second row is not paired" at the associated position of the second media content 286. Thus, the first media content 284 displays the object pairing relationship identified in the first stage, and the second media content 286 displays the processing result of the third stage obtained based on the object pairing relationship. The two together constitute the execution result of the first task and are carried in the same first message 282.

[0090] In this way, users can compare the intermediate processing results of the first stage and the downstream processing results of the third stage in the same message, and directly verify the pairing relationship on which the "no pairing" conclusion is based, without having to switch repeatedly between different messages or pages.

[0091] In some cases, the second processing step may also include a fourth stage. During the re-execution of the first stage based on the first input, the electronic device 110 may present a fourth set of elements, which are obtained based on the first input, and the first stage is used to obtain a first result. Specifically, the intelligent system can determine the objects, relationships, and / or steps that need to be reprocessed in the first stage based on the first input, and generate a fourth set of elements corresponding to the reprocessing process during the re-execution of the first stage. The fourth set of elements may include object identifiers, relationship elements, highlighted elements, state elements, candidate result elements, or any combination thereof, and may be updated with the re-execution of the first stage. The first result may be an object recognition result, a relationship between objects, a state judgment result, or other processing results that can be used by downstream stages after the re-execution of the first stage.

[0092] As an example, combined Figure 2M and Figure 2NThe first stage can be a sock pairing identification stage, where the first input can indicate an error in the sock pairing determined in step 2. During the re-execution of the first stage, the intelligent system can re-compare the colors, patterns, or other pairing features of the relevant sock objects based on the first input. The electronic device 110 can present a fourth set of elements to display the sock pairing determined or updated during the re-comparison process. For example, the fourth set of elements may include candidate relationship elements or updated relationship elements presented between the relevant sock objects. The intelligent system obtains a first result by re-executing the first stage, which may, for example, indicate the re-determined sock pairing.

[0093] After obtaining the first result, the electronic device 110 can stop presenting the fourth set of elements and present the fifth set of elements, which is used to display the fourth stage, derived from the first result. As an example, the fourth stage could be an unpaired sock identification stage. The intelligent system can identify sock objects that are not paired with other socks based on the updated sock pairing relationships indicated by the first result and generate the fifth set of elements. For example, combined with... Figure 2N The fifth set of elements may include element 278 for marking unpaired socks, and electronic device 110 may also present conclusion 280 based on this fourth stage: "The first sock in the second row is not paired." In this way, after providing feedback on the first stage, the user can view the re-execution process of the first stage and the subsequent stages based on the re-execution results, making the stage succession in the second processing process more intuitive. Since the fourth stage directly reuses the first result obtained from the re-execution of the first stage, without re-executing earlier stages unaffected by the first input, it can reduce redundant calculations by server 130 and the amount of data transmission between electronic device 110 and server 130.

[0094] It should be noted that, Figures 2G to 2H , Figures 2I to 2K as well as Figures 2L to 2O These are parallel interaction methods that start from common processing content. They provide feedback for specific stages through direct element editing, element references, and step references, respectively. These parallel methods do not require adherence to... Figures 2A to 2O The feedback occurs sequentially. Furthermore, the various feedback methods described above can be combined in any way. In this manner, the solution can cover different feedback scenarios with multiple input methods, expanding the user's feedback operation path. Since all feedback methods are based on partial updates at the same stage of the same processing procedure, rather than being regenerated from scratch, the client's rendering overhead and the amount of data transmitted between the client and cloud are reduced accordingly in each method.

[0095] In some cases, the above scheme can also be applied to various tasks other than pairing judgment, such as maze path planning, outfit matching, decoration schemes, and data analysis. Accordingly, the first set of elements can be implemented by numbering, connecting lines, paths, selection boxes, highlighting, or any combination thereof; the anchor points used to bind elements to media content can be replaced by image coordinates with text blocks, document blocks, table cells, 3D spatial points, video timestamps, or interface component identifiers; the first input can be replaced by clicks and selections with natural language, voice, drag and drop, selection boxes, multi-selection, or shortcuts; the re-execution of the affected stage can be completed by the same model, or by multiple models, rule engines, tool calls, retrieval modules, or edge computing; the visual thinking chain graph can be stored in the front-end state of electronic device 110, the database of server 130, or the training sample library. It should be understood that the above application scenarios are merely illustrative and not restrictive.

[0096] In some scenarios, intelligent systems can organize the processing of media content into a visual thought chain graph. This graph can be represented by a graph structure, where each node represents a visual reasoning unit, i.e., a stage in the processing; each edge represents processing dependencies, user choices, or inheritance relationships between nodes. Compared to a linear process representation that only represents a single final path, a visual thought chain graph can simultaneously accommodate candidate stages, user feedback, and branches generated by that feedback, allowing the processing to be operated along stages.

[0097] In some cases, the overall process of the above mechanism can be as follows: the intelligent system first generates an initial processing procedure based on the media content and requirements indicated by the first request, and renders each stage of the processing procedure as elements and evidence that can be presented at the associated location of the media content; the user performs operations on the elements, media content areas, or messages; the electronic device 110 parses the operations into structured feedback; the intelligent system inherits the media content, coordinates, evidence, and conclusions confirmed before the operated stage; the intelligent system only re-executes the affected stage and its downstream; the electronic device 110 presents updated visual information; the user can continue to compare, select, or further adjust.

[0098] In some scenarios, nodes in a visual thinking chain graph can maintain information such as step descriptions, coordinates, animation effects, evidence, conclusions, and confidence levels. Edges can maintain the source node, target node, relationship type, and identifier of the branch to which they belong. Branches generated by feedback can maintain the parent node, creation reason, and status. The status can include locked, confirmed, denied, pending verification, and version number. Anchors can bind nodes to image coordinates, text blocks, table cells, or interface components in media content. Events can record the event type, target node, and corresponding data.

[0099] In some scenarios, user interactions with the processing can include, but are not limited to: expanding a stage to view its evidence, zooming in on a portion, or calculating the process; creating alternatives for a stage; locking an identified coordinate, object, or conclusion so that subsequent processing inherits from that stage; negating the identification or conclusion of a stage; adding constraints; merging desirable parts of multiple alternatives; and comparing different alternatives.

[0100] In some cases, intelligent systems can transform the initial linear processing into a default backbone while retaining candidate paths, expandable stages, and branchable stages, and binding each stage to a visual anchor point in the media content, so that users provide feedback not on plain text, but on specific areas or stages of the media content.

[0101] In some situations, a user's natural language, clicks, selections, drags, or option choices can be uniformly converted into structured feedback, such as creating branches from a specified stage, locking stages, negating evidence, adding constraints, and comparing solutions. The structured feedback can include the target stage, user intent, contextual constraints, and scope of influence.

[0102] In some scenarios, when a user provides feedback on a particular stage, the intelligent system can inherit the media content, coordinates, evidence, and conclusions already confirmed for that stage, and only re-execute that stage and its downstream stages. In this way, the intelligent system avoids repeatedly executing confirmed stages and prevents confirmed evidence from being unnecessarily rewritten, thereby reducing redundant processing and lowering latency.

[0103] In some cases, each branch generated by feedback can have a separate status and version number. The intelligent system can record the source of the branch, its parent node, the reason for its creation, the model version, and the rendering version, thereby supporting rollback, comparison, and auditing.

[0104] In some scenarios, visual thought chain diagrams can be rendered in different forms depending on the task type. Examples include linear timelines suitable for problem-solving steps, tree diagrams for exploring multiple hypotheses, canvas node diagrams for complex decision-making, storyboard cards for image-based reasoning, and two-column views for comparing solutions. Correspondingly, the style of a set of elements used in the presentation phase can vary based on the type of the first task; for example, lines and numbers can be used for matching tasks, paths and arrows for path-based tasks, and selection boxes and highlights for region labeling tasks.

[0105] In some cases, if two schemes share upstream evidence but reach different conclusions, the intelligent system can mark the conflict and prompt the user to review it; if the user rejects a certain stage of evidence, the downstream conclusions that depend on that evidence can be marked as to be re-executed.

[0106] In some cases, intelligent systems do not need to present the entire internal draft to the user. Instead, they organize verifiable evidence, key assumptions, intermediate conclusions, and user interaction records into a displayable chain, thereby balancing explainability, product experience, and security boundaries.

[0107] In some scenarios, intelligent systems can distill user interactions into data, such as recording the initial chain, user feedback, results of partial re-execution, and the final adopted branch. This data forms samples for subsequent training, allowing the intelligent system to gradually learn how to generate branching and interactive processing representations. It should be noted that the collection and use of this data are conducted with the user's knowledge and authorization.

[0108] The following examples illustrate the practical performance of this solution. In one example scenario, the media content is a maze image. The first processing step displays the route from the entrance through a middle passage to the exit. The user clicks on another entrance or a specific intersection to provide feedback. The intelligent system inherits the exit coordinates and wall structure, only recalculating the reachable path corresponding to the clicked entrance. In another example scenario, the media content is a room image. The first processing step identifies objects such as doors, drawers, safes, and notes, providing clues. The user clicks on an object to provide feedback. The intelligent system zooms in on the clicked area, identifies new clues, and updates the status. In yet another example scenario, the media content is an outfit image. The first processing step evaluates formality and coordination in an interview scenario. The user locks onto shoes and provides feedback on the top. The intelligent system inherits the locked items and only regenerates outfit combinations related to the top.

[0109] In a more specific application scenario, the media content is a picture of a room. The intelligent system first identifies areas such as door locks, drawers, and notes, and renders them as clickable elements. In the first round, the user clicks on the note element. The electronic device 110 zooms in on the note and performs Optical Character Recognition (OCR) on the numbers on it, writing the recognized numbers into a candidate password and presenting it as an element for trying the safe. In the second round, the user clicks on the drawer element. The electronic device 110 zooms in on the drawer area, identifies the key, and adds it as evidence. In the third round, the user drags the key element to the door lock element. The intelligent system inherits the stage where the key is located and re-executes the process of whether the key and the door lock match. If they match, the corresponding path is updated to a passable state; if they do not match, a stage to be explored is generated. In the fourth round, the user selects a prompt for the next step. The intelligent system generates prompts from the stages with high confidence that have not yet been explored, highlighting only the explorable areas without directly giving the final result.

[0110] Example process Figure 3 A flowchart of an example process 300 for interface interaction is shown, based on some scenarios. Process 300 can be implemented at electronic device 110. See below for reference. Figure 3 To describe process 300.

[0111] like Figure 3 As shown, in block 310, electronic device 110 receives a first request, which instructs the intelligent system to perform a first task, and the first request includes an identifier of at least one piece of media content.

[0112] In frame 320, electronic device 110 presents first visual information, which characterizes a first processing procedure of the intelligent system for at least one piece of media content, the first processing procedure including multiple stages.

[0113] In box 330, electronic device 110 receives a first input, the first input including feedback to a first stage, and multiple stages including the first stage.

[0114] In box 340, electronic device 110 presents second visual information, which characterizes a second processing procedure of the intelligent system for at least one piece of media content, the second processing procedure including at least re-execution of the first stage based on the first input.

[0115] In this way, users can provide feedback on specific stages during the visualization process. The intelligent system only re-executes the affected stage based on the feedback and presents updated visualization information, reducing the number of complete re-interrogations initiated by users to correct the processing results. Because the intelligent system reuses the processing results of confirmed stages and only re-executes the affected stage and its downstream processes, the number of interaction rounds and the amount of data transmitted between the electronic device 110 and the server 130 are reduced. The redundant calculation load and processing latency of the server 130 are correspondingly reduced, and the confirmed stages are not rewritten without cause, thereby improving the consistency of processing results under multiple rounds of feedback.

[0116] In some cases, the first phase includes at least one step in which the electronic device 110 can present a first set of elements at an associated location of at least one piece of media content, the first set of elements being used to demonstrate at least one step.

[0117] In this way, users can see the first stage steps in the relevant location within the media content, reducing the need for comparison between images and text. Since the first set of elements is overlaid on the media content, the electronic device 110 does not need to load a separate instruction page for each processing step, thus reducing client-side rendering overhead and the number of document object model refreshes.

[0118] In some cases, at least one step includes a first step, a first input includes a reference to at least one element, at least one element corresponds to the first step, feedback is used to adjust the first step, and a first set of elements includes at least one element.

[0119] In this way, users can pinpoint the feedback precisely to the first step corresponding to a specific element, reducing the cost of describing the target step in plain text. Because the feedback explicitly points to the first step through a reference to the element, the intelligent system can directly locate the affected step without re-analyzing the entire processing flow, reducing unnecessary processing and edge-cloud interactions.

[0120] In some cases, at least one element includes a first element, and receiving the first input includes: receiving a first operation for editing the first element; and presenting a second element obtained by editing the first element, the second element representing feedback for the first stage.

[0121] In this way, users can provide feedback and receive a second element representing that feedback by editing an element, reducing the need to organize and input natural language. Since the electronic device 110 can directly update elements locally on the client side based on the editing operation, re-executing the corresponding stage only when necessary, the number of requests and the amount of data transmitted in the end-to-cloud interaction are correspondingly reduced.

[0122] In some cases, at least one piece of media content includes a first object and a second object, a first element is used to mark the first object, a second element is used to mark the second object, and a feedback instruction is given to replace the first object with the second object.

[0123] In this way, users can explicitly express feedback through object replacement, ensuring that the tag is placed on the correct object and the processing result matches the user's intent. Because the update of object tagging reuses the confirmed media content and numbering stages, only the stages on which the tag depends are re-executed, client rendering overhead and end-to-cloud transmission volume are reduced accordingly.

[0124] In some cases, the first element is used to connect a first group of objects in at least one piece of media content, the first element representing a first relationship between the first group of objects, and the second element is used to connect a second group of objects in at least one piece of media content, the second element representing a second relationship between the second group of objects, and the feedback instruction replaces the first relationship with the second relationship.

[0125] In this way, users can modify the connections between objects by replacing relationships, making the pairings match their intentions. Since the relationship elements are updated overlaid on the same media content, only the relationship phase is re-executed, and the electronic device 110 does not need to switch pages for relationship display, thus reducing the number of page switches and rendering overhead on the client side.

[0126] In some cases, receiving the first operation includes at least one of the following: adjusting the display position of the first element; adjusting the size of the first element; adjusting the connection relationship corresponding to the first element.

[0127] In this way, users can provide feedback in various editing ways, such as adjusting the display position, size, or connection relationships, thus expanding the operational path for providing feedback. Since adjustments to position or size can be completed locally on the client side without requiring a complete reprocessing, the number of requests for edge-cloud interaction is correspondingly reduced.

[0128] In some cases, presenting the second visualization information includes presenting a second element and a third element at an associated location of at least one piece of media content, wherein the third element is derived from the second element and the second and third elements are used to characterize the second processing procedure.

[0129] In this way, after providing feedback, users can simultaneously see the updated second element and the third element derived from the second element, intuitively understanding the updated processing procedure. Since the third element is derived from the second element, the intelligent system only continues to execute downstream processes based on the affected stages, without needing to re-execute the upstream confirmed stages, thus reducing redundant calculations on server 130 and the amount of data transmitted between the cloud and the endpoint.

[0130] In some cases, multiple stages include a second stage, where electronic device 110 may stop presenting the first set of elements; and present a second set of elements used to display the second stage.

[0131] In this way, the interface can focus on the current stage of interest as the processing progresses, reducing the number of elements presented simultaneously. By stopping the presentation of the first group of elements that are no longer of interest and presenting the second group of elements for the second stage, the number of element nodes contained in the interface of the electronic device 110 is reduced accordingly, and the rendering overhead and memory usage of the client are reduced accordingly.

[0132] In some cases, stopping the presentation of the first set of elements includes: stopping the presentation of the first set of elements in response to receiving confirmation of the first phase; or stopping the presentation of the first set of elements in response to not receiving feedback on the first phase within the first time period.

[0133] In this way, the interface can automatically collapse the elements of the first stage when the user confirms or there is no feedback for a period of time, reducing the extra operations that the user needs to perform to collapse the elements. Because the first group of elements is stopped from being displayed in a timely manner based on confirmation or timeout conditions, the number of elements maintained by the client is reduced accordingly, and rendering overhead and memory usage are reduced accordingly.

[0134] In some cases, multiple stages include a third stage. Electronic device 110 can present a first message, which includes the execution result of a first task. The first message comes from an intelligent system and includes multiple media contents. The multiple media contents include at least a first media content and a second media content. The first media content displays a first set of elements, and the second media content displays a third set of elements. The third set of elements is used to display the third stage.

[0135] In this way, users can view multiple stages side-by-side in the same message and provide feedback on any stage, reducing the need to switch between stages. Since multiple media contents are presented side-by-side in the same message, the electronic device 110 does not need to load each stage separately, thus reducing the number of requests to the cloud.

[0136] In some cases, the style of the first group of elements is derived from the type of the first task.

[0137] In this way, the style of the first set of elements can be adapted to the type of the first task, making the visualization more task-oriented and reducing the cognitive cost required for users to understand the processing. By selecting appropriate element styles according to task type, the electronic device 110 can avoid presenting redundant elements unrelated to the task, and the rendering overhead on the client side is reduced accordingly.

[0138] In some cases, electronic device 110 may present an input component for interacting with an intelligent system; and receive first input, which is in the form of natural language, through the input component.

[0139] In this way, users can provide feedback in natural language through the input component, lowering the barrier to providing feedback. Since the feedback is transmitted to the intelligent system in a structured manner via the input component in natural language, the electronic device 110 does not need to provide an additional dedicated interface for collecting feedback, and the number of interface elements maintained by the client is correspondingly reduced.

[0140] In some cases, the first input includes a first content and a second content, where the first content is used to characterize the first stage and the second content describes the adjustment requirements for the first stage.

[0141] In this way, users can combine the first element representing the first stage with the second element describing the adjustment needs to form feedback, enabling the intelligent system to clearly identify the stage and adjustment target of the feedback. Because the first input structurally distinguishes between the target stage and the adjustment needs, the intelligent system can directly locate the affected stage, reducing the need for re-analysis and invalid calculations throughout the entire process.

[0142] In some cases, the electronic device 110 may present a first identifier in the input component, the first identifier representing a reference to the first stage.

[0143] In this way, users can see the first identifier representing the reference to the first stage in the input component, thus confirming the stage to which the feedback is directed and reducing repeated clarifications due to unclear objectives. Because the first identifier explicitly points to the first stage in a structured manner, the intelligent system can directly locate the affected stage, reducing invalid processing and edge-cloud interactions.

[0144] In some cases, electronic device 110 may receive a second input via an input component, the second input including at least one piece of media content and natural language content, the natural language content describing the requirements of the first task.

[0145] In some cases, the second processing procedure may also include a fourth stage, during which the electronic device 110 may present a fourth set of elements, which are obtained based on the first input, while re-executing the first stage, and the first stage is used to obtain the first result; and stop presenting the fourth set of elements and present a fifth set of elements, which are displayed in the fourth stage, which is obtained based on the first result.

[0146] Example devices and equipment A corresponding apparatus for implementing the above methods or processes is also provided. Figure 4 A block diagram of a device 400 for interface interaction is shown, depending on several scenarios. Device 400 can be implemented as or included in electronic device 110. The various modules / components in device 400 can be implemented by hardware, software, firmware, or any combination thereof.

[0147] like Figure 4 As shown, the device 400 includes: a first receiving module 410 configured to receive a first request, the first request being used to instruct an intelligent system to perform a first task, the first request including an identifier of at least one media content; a first presentation module 420 configured to present first visual information, the first visual information representing a first processing procedure of the intelligent system on at least one media content, the first processing procedure including multiple stages; a second receiving module 430 configured to receive a first input, the first input including feedback on the first stage, the multiple stages including the first stage; and a second presentation module 440 configured to present second visual information, the second visual information representing a second processing procedure of the intelligent system on at least one media content, the second processing procedure including at least re-execution of the first stage based on the first input.

[0148] In some cases, the first phase includes at least one step, and the first presentation module 420 may also be configured to present a first set of elements at an associated location of at least one piece of media content, the first set of elements being used to display at least one step.

[0149] In some cases, at least one step includes a first step, a first input includes a reference to at least one element, at least one element corresponds to the first step, feedback is used to adjust the first step, and a first set of elements includes at least one element.

[0150] In some cases, at least one element includes a first element, and receiving the first input includes: receiving a first operation for editing the first element; and presenting a second element obtained by editing the first element, the second element representing feedback for the first stage.

[0151] In some cases, at least one piece of media content includes a first object and a second object, a first element is used to mark the first object, a second element is used to mark the second object, and a feedback instruction is given to replace the first object with the second object.

[0152] In some cases, the first element is used to connect a first group of objects in at least one piece of media content, the first element representing a first relationship between the first group of objects, and the second element is used to connect a second group of objects in at least one piece of media content, the second element representing a second relationship between the second group of objects, and the feedback instruction replaces the first relationship with the second relationship.

[0153] In some cases, receiving the first operation includes at least one of the following: adjusting the display position of the first element; adjusting the size of the first element; adjusting the connection relationship corresponding to the first element.

[0154] In some cases, the second presentation module 440 may also be configured to present a second element and a third element at an associated location of at least one piece of media content, wherein the third element is derived based on the second element, and the second and third elements are used to characterize the second processing procedure.

[0155] In some cases, multiple stages include a second stage, and the second presentation module 440 can also be configured to stop presenting the first set of elements; and present the second set of elements used to display the second stage.

[0156] In some cases, stopping the presentation of the first set of elements includes: stopping the presentation of the first set of elements in response to receiving confirmation of the first phase; or stopping the presentation of the first set of elements in response to not receiving feedback on the first phase within the first time period.

[0157] In some cases, multiple stages include a third stage. The first presentation module 420 can also be configured to present a first message, which includes the execution result of a first task. The first message comes from an intelligent system and includes multiple media contents. The multiple media contents include at least a first media content and a second media content. The first media content displays a first set of elements, and the second media content displays a third set of elements. The third set of elements is used to display the third stage.

[0158] In some cases, the style of the first group of elements is derived from the type of the first task.

[0159] In some cases, the second receiving module 430 may also be configured to present an input component for interacting with the intelligent system; and to receive a first input, which is in the form of natural language, through the input component.

[0160] In some cases, the first input includes a first content and a second content, where the first content is used to characterize the first stage and the second content describes the adjustment requirements for the first stage.

[0161] In some cases, the second presentation module 440 may also be configured to present a first identifier in the input component, the first identifier representing a reference to the first stage.

[0162] In some cases, the first receiving module 410 may also be configured to receive a second input via an input component, the second input including at least one piece of media content and natural language content, the natural language content describing the requirements of the first task.

[0163] In some cases, the second processing procedure further includes a fourth stage, and the second presentation module 440 may also be configured to present a fourth set of elements based on the first input during the re-execution of the first stage, the first stage being used to obtain a first result; and to stop presenting the fourth set of elements and present a fifth set of elements that represent the fourth stage, the fourth stage being based on the first result.

[0164] The modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some cases, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 400 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on.

[0165] Figure 5 A block diagram of an electronic device 500 in which one or more examples may be implemented is shown. It should be understood that... Figure 5 The electronic device 500 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 5 The electronic device 500 shown can be used to implement the electronic device 110 discussed above.

[0166] like Figure 5 As shown, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processing units or processors 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0167] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0168] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 5 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various examples.

[0169] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.

[0170] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0171] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0172] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0173] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0174] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0175] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0176] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for interface interaction, comprising: Receive a first request, the first request being used to instruct the intelligent system to perform a first task, the first request including an identifier of at least one piece of media content; Presenting first visual information, the first visual information characterizing the first processing process of the intelligent system on the at least one media content, the first processing process including multiple stages; Receive a first input, the first input including feedback on a first stage, the plurality of stages including the first stage; as well as The system presents a second visualization that characterizes a second processing procedure of the intelligent system for the at least one media content, the second processing procedure including at least re-execution of the first stage based on the first input.

2. The method of claim 1, wherein the first stage comprises at least one step, and the presentation of the first visual information comprises: At the associated location of the at least one piece of media content, a first set of elements is presented, the first set of elements being used to display the at least one step.

3. The method of claim 2, wherein the at least one step includes a first step, the first input includes a reference to at least one element corresponding to the first step, the feedback is used to adjust the first step, and the first set of elements includes the at least one element.

4. The method of claim 3, wherein the at least one element comprises a first element, and the receiving of the first input comprises: Receive a first operation, which is used to edit the first element; as well as A second element is presented, which is obtained by editing the first element, and the second element represents the feedback for the first stage.

5. The method of claim 4, wherein the at least one media content comprises a first object and a second object, the first element is used to mark the first object, the second element is used to mark the second object, and the feedback indicates that the first object is replaced with the second object.

6. The method of claim 4, wherein the first element is used to connect a first group of objects in the at least one media content, the first element representing a first relationship between the first group of objects, the second element is used to connect a second group of objects in the at least one media content, the second element representing a second relationship between the second group of objects, and the feedback indication replaces the first relationship with the second relationship.

7. The method of claim 4, wherein receiving the first operation comprises at least one of the following: Adjust the display position of the first element; Adjust the size of the first element; Adjust the connection relationships corresponding to the first element.

8. The method of claim 4, wherein presenting the second visual information comprises: At the associated location of the at least one media content, the second element and the third element are presented, the third element being derived from the second element, and the second element and the third element being used to characterize the second processing procedure.

9. The method of claim 2, wherein the plurality of stages includes a second stage, and the method further comprises: Stop displaying the first group of elements; as well as Present the second set of elements, which are used to demonstrate the second stage.

10. The method of claim 9, wherein stopping the presentation of the first set of elements comprises: In response to receiving confirmation of the first stage, the presentation of the first group of elements is stopped; or If no feedback is received for the first phase within the first time period, the presentation of the first group of elements is stopped.

11. The method of claim 2, wherein the plurality of stages includes a third stage, and presenting the first set of elements at the associated location of the at least one media content comprises: The system presents a first message, which includes the execution result of the first task. The first message comes from the intelligent system and includes multiple media contents, including at least a first media content and a second media content. The first media content displays a first set of elements, and the second media content displays a third set of elements. The third set of elements is used to display the third stage.

12. The method of claim 2, wherein the style of the first group of elements is obtained based on the type of the first task.

13. The method of claim 1, wherein receiving the first input comprises: An input component is presented, which is used to interact with the intelligent system; as well as The input component receives the first input, which is in natural language form.

14. The method of claim 13, wherein the first input includes a first content and a second content, the first content being used to characterize the first stage, and the second content describing adjustment requirements for the first stage.

15. The method of claim 14, further comprising: The input component presents a first identifier, which represents a reference to the first stage.

16. The method of claim 1, wherein receiving the first request comprises: Receive a second input, which includes the at least one piece of media content and natural language content, wherein the natural language content describes the requirements of the first task.

17. The method of claim 1, wherein the second processing step further comprises a fourth stage, and the presentation of the second visualization information comprises: During the re-execution of the first phase, a fourth set of elements is presented, which is obtained based on the first input, and the first phase is used to obtain the first result. as well as Stop presenting the fourth group of elements and present the fifth group of elements, which displays the fourth stage, which is based on the first result.

18. A device for interface interaction, comprising: A first receiving module is configured to receive a first request, the first request being used to instruct the intelligent system to perform a first task, the first request including an identifier of at least one piece of media content; A first presentation module is configured to present first visual information, the first visual information representing a first processing procedure of the intelligent system for the at least one media content, the first processing procedure including multiple stages; The second receiving module is configured to receive a first input, the first input including feedback on a first stage, and the plurality of stages including the first stage; as well as The second presentation module is configured to present second visual information, which characterizes a second processing procedure of the intelligent system for the at least one media content, the second processing procedure including at least re-execution of the first stage based on the first input.

19. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 17 when executed by the at least one processor.

20. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 17.

Images