Method, apparatus, device and program product for interface interaction

Abstract

Methods, apparatuses, devices, and program products for interface interaction are provided. The method includes: presenting, in a first mode, a first component in an authoring area, the first mode including presenting a first number of media content in the first component; presenting a first element corresponding to a first media content associated with the first component; and in response to a first operation on the first element, presenting, in a second mode, the first component in the authoring area, the second mode including presenting a second number of media content including the first media content in the first component. In this way, the efficiency of a user viewing media content can be improved.

Description

Technical Field

[0001] The examples in this article generally relate to the field of computers, and in particular to methods, apparatuses, devices, and computer program products for user interface interaction. Background Technology

[0002] With the development of computer technology, users can access and process various content through the interfaces presented by electronic devices. For example, users can perform corresponding operations on the content presented on the interface to view or use the content they need. Therefore, how to improve the efficiency of users obtaining the content they need through the interface is worthy of attention. Summary of the Invention

[0003] In a first aspect of this document, a method for interface interaction is provided. The method includes: in a creation area, presenting a first component in a first mode, the first mode including presenting a first number of media contents in the first component; presenting a first element, the first element corresponding to the first media contents, the first media contents being associated with the first component; and in response to a first operation on the first element, in the creation area, presenting the first component in a second mode, the second mode including presenting a second number of media contents in the first component, the second number of media contents including the first media contents.

[0004] In a second aspect of this document, an apparatus for interface interaction is provided. The apparatus includes: a first presentation module configured to present a first component in a creation area in a first mode, the first mode including presenting a first number of media contents in the first component; a second presentation module configured to present a first element corresponding to the first media contents, the first media contents being associated with the first component; and a third presentation module configured to, in response to a first operation on the first element, present the first component in a second mode in the creation area, the second mode including presenting a second number of media contents in the first component, the second number of media contents including the first media contents.

[0005] In a third aspect of this document, an electronic device is provided. The electronic device includes at least one processor and at least one memory. The at least one memory is coupled to the at least one processor and stores instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the electronic device to perform the method of the first aspect.

[0006] In a fourth aspect of this document, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0007] In a fifth aspect of this document, a computer program product is provided. This computer program product is tangibly stored in a computer storage medium and includes computer-executable instructions. When executed by an electronic device, the computer-executable instructions cause the electronic device to perform the method of the first aspect.

[0008] In this way, in response to operations on elements corresponding to media content, the associated components can switch from a mode that presents less media content to a mode that presents more media content, thereby improving the efficiency of users obtaining the media content they need.

[0009] It should be understood that the content described in this section is not intended to limit the key or important features of the examples in this article, nor is it intended to restrict the scope of the solution. Other features will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of the example environment is shown; Figures 2A to 2K Example interfaces for some scenarios are shown; Figure 3 Flowcharts illustrating example processes for interface interaction in several scenarios are shown; Figure 4 Schematic block diagrams of example devices for interface interaction in some scenarios are shown; and Figure 5 A block diagram of an electronic device capable of implementing multiple illustrative scenarios is shown. Detailed Implementation

[0011] The examples in this document will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.

[0012] It should be noted that the headings of any section / subsection provided herein are not restrictive. Various examples are described throughout this document, and examples of any type may be included under any section / subsection. Furthermore, examples described in any section / subsection may be combined in any way with any other examples described in the same section / subsection and / or different sections / subsections.

[0013] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0014] The examples in this document may involve user data, data acquisition, and / or use. All of these aspects comply with relevant laws, regulations, and rules. In the examples, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.

[0015] In this manual and the sample solutions, any processing of personal information will be conducted only under legal grounds (such as obtaining the consent of the data subject or being necessary for the performance of a contract) and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.

[0016] In one context, an intelligent system is an information processing system. This intelligent system uses at least one or more models to process one or more inputs. The intelligent system may include the one or more models as components, or it may use models external to the system for processing. Those skilled in the art will recognize that there are various implementations of intelligent systems in the industry, including but not limited to agents, artificial intelligence (AI) assistants, AI workers, copilot systems, and chatbots. The inputs include data in one or more modalities. The modal data includes, but is not limited to, text, audio, images, video, application-specific data, or scientific computing data. The models include, but are not limited to, one or more combinations of the following: large-scale parametric models, deep learning models, neural network models, machine learning models, statistical models, rule-based models, or other models capable of processing the inputs. The specific implementation of the models can employ various existing or improved models. The intelligent system may involve one or more of the following operations: receiving single-round or multi-round input; recognizing and / or understanding the input; generating answers, decisions, or processing results using one or more models; invoking one or more external tools, interfaces, knowledge bases, or other systems to obtain information or perform operations; processing in a self-decision-making or human-machine collaborative manner, or transferring tasks to human or other systems for processing. Self-decision-making refers to execution without human intervention. Human-machine collaboration refers to partial human participation or confirmation. The above explanation of "intelligent system" is illustrative, and each description is an example, not necessarily necessary, and does not constitute an exhaustive list.

[0017] As used in this article, the term "creation area" refers to the visible area of ​​an interface used to present one or more components. The creation area can be used to support users in viewing, selecting, creating, arranging, connecting, or editing components and the media content associated with them. When the canvas area is larger than the currently visible area of ​​the interface, the creation area can present a portion of the canvas, and can present other parts of the canvas as the canvas is moved.

[0018] As used in this article, the term "canvas" refers to an interface space capable of holding one or more components. The canvas can also represent connections between components. The canvas can be larger than the currently displayed area of ​​the creation area and can move relative to the creation area in response to panning, scrolling, zooming, navigation, or other operations, allowing different portions of the canvas to be displayed within the creation area.

[0019] As used in this document, the term "component" refers to an interface object or area that can carry, present, or process one or more media content within an interface. Components may include image components, video components, audio components, or components capable of carrying other types of content. Different components may have the same or different component types, presentation formats, processing functions, or connection relationships.

[0020] The terms "first component," "second component," and "third component" used in this document are used to distinguish different components involved in the description, and do not necessarily indicate differences in order, hierarchy, or importance between the corresponding components. A second component can be connected to a first component via a connector element. A third component can be obtained by copying a first component or formed in other ways.

[0021] As used herein, the term "media content" refers to digital content that can be presented, stored, transmitted, or processed by electronic devices. Media content can include images, video, audio, text, animation, three-dimensional content, or any combination thereof. Media content can be provided by users, obtained from other devices, generated based on existing content, or otherwise acquired.

[0022] As used in this document, "current media content" refers to the media content that a component is currently presenting, selecting, using, or as input for subsequent processing. Current media content can be one of multiple media content items associated with the component. In response to a user selecting another media content item from multiple media content items, the electronic device can determine the selected media content as the new current media content.

[0023] As used herein, the terms "first mode" and "second mode" refer to different presentation states of a component. In some of the scenarios described herein, the first mode includes presenting a first amount of media content in the component, and the second mode includes presenting a second amount of media content in the component, where the second amount is greater than the first amount. For example, the first mode could be a collapsed state presenting less media content, and the second mode could be an expanded state presenting more media content. Collapsed and expanded states are merely examples of different modes, and the first and second modes can also differ in component size, content layout, UI controls, or other presentation attributes.

[0024] The terms "first number" and "second number" as used in this document are used to distinguish the number of media contents presented by the component in different modes. Both the first number and the second number can be positive integers. Alternatively, the second number can be greater than the first number. For example, the first number can be one, and the second number can be an integer greater than one.

[0025] As used in this document, the term "element" refers to an object in an interface that can be presented and optionally receive actions. Elements can include thumbnails, icons, cards, buttons, text items, list items, or other visual objects. Elements can be associated with media content or components through media content identifiers, request identifiers, component identifiers, item identifiers, or other related data. Elements do not necessarily need to be presented in the same interface area as their corresponding media content.

[0026] As used in this document, the term "operation" refers to interactive input that can be detected by an input device and processed by an electronic device. Operations can include clicks, touches, double-clicks, long presses, swipes, drags, scrolls, hovers, keyboard input, voice input, or other types of input. The terms "first operation" through "sixth operation" used in this document are primarily used to distinguish different operations and do not necessarily limit the execution order, operation type, or executing entity of the corresponding operations.

[0027] As used herein, the term "control" refers to a user interface object capable of presenting information and / or receiving actions. Controls may include buttons, icons, input boxes, checkboxes, labels, sliders, menus, toggles, directional controls, or combinations thereof. For example, a first control may present the number of content sets associated with a component and may receive actions for switching between different content sets.

[0028] As used herein, the term "request" refers to data used to enable an electronic device, server, or both to obtain one or more media contents. A request can be used to generate, process, transform, retrieve, or otherwise obtain media contents. A request may include input media content, text input, number of items generated, resolution, aspect ratio, model information, or other processing parameters. The terms "first request" and "second request" are used to distinguish between different requests and do not necessarily limit the order in which the two requests are initiated or the type of request.

[0029] As used in this document, the term "generate request" can be an example of a request that instructs an electronic device, a server, or both to generate one or more media contents. A generate request can be formed based on zero, one, or more input media contents, and can be used to generate corresponding media contents based on multiple input media contents respectively.

[0030] As used herein, the term "content set" refers to one or more media content sets that are related to each other. In some cases, the media content sets within the same content set correspond to the same request. For example, a first content set may include multiple media content sets generated by a first request, and a second content set may include multiple media content sets generated by a second request. The same component may be associated with one or more content sets, and the number of media content sets included in different content sets may be the same or different.

[0031] As used in this document, the term "history list" refers to an interface area used to present historical information about stored requests, tasks, processes, or media content. The history list may be presented as a list, panel, grid, or other format and may include one or more entries.

[0032] As used in this document, the term "entry" refers to an interface object in the history list that corresponds to a request, task, or process. For example, the first entry may correspond to the first request and may include at least one element. Entries may also include a request identifier, task name, generation time, generation status, generation progress, or other information related to the corresponding request.

[0033] As used herein, the term "information" refers to perceptible content that conveys quantity, status, location, correspondence, or other information to a user through an interface. Information may include text, numbers, graphics, colors, animations, sounds, or combinations thereof. For example, first information may include the number of multiple content sets associated with a component; second information may include at least the number of media contents presented by the component in a second mode.

[0034] As used in this document, the term "hint" refers to perceptible information used to indicate a state, relationship, result of an action, or available action to a user. Hints can include text, numbers, borders, color blocks, icons, animations, sounds, or combinations thereof. For example, a first hint might be used to indicate a first media content within a component that corresponds to a first element, and a second hint might be used to indicate that the first element is associated with multiple components.

[0035] As used herein, the term "identifier" refers to information used to identify or distinguish media content, components, requests, entries, tasks, or other objects. Identifiers may include names, numbers, thumbnails, icons, text, time information, status information, or combinations thereof. For example, a first identifier may be associated with a first entry presentation and linked to a first request corresponding to that first entry.

[0036] As used in this document, the term "connection element" refers to a UI object in the authoring area used to represent data associations, referencing relationships, or processing dependencies between two or more components. Connection elements can include connectors, arrows, ports, or combinations thereof. Connection elements can indicate that media content in one component is referenced by another component or serves as input when another component performs processing.

[0037] As used in this document, the term "copy" can refer to the process of creating another component based on an existing component. A copied component may inherit at least one of the following from the existing component: media content, content set, request association information, component attributes, or connectivity. A copied component and an existing component may have different component identifiers, component names, canvas positions, or connectivity.

[0038] As used herein, the term "association" or "related" can refer to a direct or indirect correspondence, reference, data relationship, processing relationship, or other relationship that can be recognized by an electronic device between two objects. For example, media content can be associated with a component through a component identifier and a media content identifier, and an element can be associated with media content through a request identifier, an entry identifier, or a media content identifier. Associating two objects does not require that the two objects be displayed simultaneously or located in the same interface area.

[0039] The term "presentation" as used herein can include displaying all or part of an object, bringing an object into the visible range of an interface, updating the display state of an object, or otherwise perceptibly providing an object. The term "stop rendering" as used herein can include hiding, removing, collapsing, replacing, or stopping updating the corresponding object, but does not necessarily mean deleting the data corresponding to that object.

[0040] The term "moving the canvas" as used in this article can include panning, scrolling, zooming, changing canvas coordinates, moving a target component into the creation area, or placing a target component in a preset position within the creation area. Moving the canvas does not require a change in the relative positions of the components within the canvas.

[0041] As mentioned above, users can access and process various content through the interface presented by electronic devices. For example, electronic devices can present media content through corresponding components in the creation area, and can also present interface elements associated with the media content or components to support users in viewing or using the corresponding media content. In some solutions, due to factors such as the interface display area, only part of the media content may be presented in the component. When users need to view the media content corresponding to the interface element and other media content associated with that media content, they may need to repeatedly search and switch between different interface areas or different display states, thereby increasing the interactive operations required for users to obtain the required content.

[0042] This paper proposes a user interface interaction scheme. According to this scheme, a first component can be presented in a first mode within the creation area. The first mode includes presenting a first number of media contents within the first component. A first element can be presented, corresponding to the first media contents. The first media contents are associated with the first component. Further, in response to a first operation on the first element, the first component can be presented in a second mode within the creation area. The second mode includes presenting a second number of media contents within the first component. The second number of media contents includes the first media contents, and the second number is greater than the first number.

[0043] In this way, associations can be established between interface elements, media content, and components used to present the media content. In response to operations on interface elements, the associated components can switch from a display mode presenting less media content to a display mode presenting more media content. This allows users to directly view the corresponding media content and other media content associated with it based on the interface elements. For example, this reduces the number of interface switching and search operations required by users to find the desired media content, improving the efficiency of users obtaining the required content through the interface. Furthermore, by presenting less media content in the first mode and more media content after receiving a corresponding operation, the amount of content that needs to be loaded and rendered simultaneously during the initial interface rendering process can be reduced, lowering the data processing overhead of electronic devices.

[0044] The following describes various examples of this scheme in further detail with reference to the accompanying drawings.

[0045] Example Environment Figure 1 A schematic diagram of example environment 100 is shown. (e.g.) Figure 1 As shown, environment 100 may include electronic device 110.

[0046] In this example environment 100, electronic device 110 can run an application 120 that supports user interface interaction. Application 120 can be any suitable type of application for user interface interaction, including but not limited to: media applications, authoring applications, or other suitable applications. User 140 can interact with application 120 via electronic device 110 and / or its attached devices.

[0047] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.

[0048] In some cases, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, virtual reality (VR) / augmented reality (AR) devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some cases, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0049] Server 130 can be a single physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and data processing and intelligent computing platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.

[0050] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some cases, server 130 and electronic device 110 can exchange signaling information through their communication connection.

[0051] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the scheme.

[0052] The following description of the example will continue with reference to the accompanying drawings.

[0053] Example Interaction Figures 2A to 2K Example interfaces 200A to 200K are shown according to some scenarios. Interfaces 200A to 200K can, for example, be derived from... Figure 1 The electronic device 110 shown is provided. Interfaces 200A to 200K can represent different display states of the creation interface, used to illustrate the process of batch generating media content in the creation area, associating and positioning between the generation history and canvas components, expanding or collapsing batch media content, switching the current media content, and positioning among multiple matching components.

[0054] In some cases, interfaces 200A to 200K can be infinite canvas interfaces used for creating and editing media content. Media content can include images, videos, audio, or other content that can be presented, edited, or processed by an intelligent system on the canvas. The following description uses image content as an example, but this is not intended to limit the types of media content.

[0055] Figure 2A The authoring interface 200A is shown according to some scenarios. For example... Figure 2A As shown, interface 200A may include a canvas, and electronic device 110 may display at least a portion of the canvas in creation area 202. The canvas may be a movable interface space for carrying one or more components and the connection relationships between the components, and the area of ​​the canvas may be larger than the area currently displayed in creation area 202. Creation area 202 may be a visible area in interface 200A used to display the currently visible portion of the canvas and support user operation on the corresponding components.

[0056] Electronic device 110 can arrange components 204-1, 204-2, and 204-3 on the canvas and display these components in the creation area 202. Different components can be used to carry different media content. For example, component 204-1 can display content 1, component 204-2 can display content 2, and component 204-3 can display content 3. The media content displayed by the components can be user-provided media content or media content obtained based on a corresponding request.

[0057] Taking component 204-2 as the first component as an example, in Figure 2A In the illustrated state, the first component can be in a first mode. The first mode may include presenting a first number of media contents in the first component. For example, the first number may be one, such that the first component presents one piece of media content in the first mode. The first component may also be associated with a request for obtaining the media content and corresponding historical information.

[0058] Users can change the currently displayed portion of the canvas in the creation area 202 by panning, scrolling, zooming, or other canvas operations. For example, when the target component is located in a portion of the canvas that is not currently displayed, the electronic device 110 can move the canvas to bring the target component into the currently visible range of the creation area 202.

[0059] The electronic device 110 can also display a history control 206 in the interface 200A. The history control 206 can be used to trigger the display of historical information associated with the generation or processing of media content. In response to a trigger operation on the history control 206, the electronic device 110 can further display information while maintaining the display of the creation area 202. Figure 2B The history component 208 is shown. Alternatively, the electronic device 110 may also stop displaying the history component 208 in response to triggering the history control 206 again or to an operation on the close control.

[0060] Figure 2B The interface 200B of the presentation history component 208 is shown according to some circumstances. For example... Figure 2B As shown, in response to Figure 2A When the history control 206 is triggered, the electronic device 110 can further display the history component 208 while maintaining the presentation of the creation area 202. The history component 208 may include a history list, which can be used to display entries corresponding to media content generation requests or processing tasks. The history component 208 may be displayed on one side of the creation area 202, or it may be displayed together with the creation area 202 as a pop-up, panel, or other form.

[0061] For example, electronic device 110 can present entries 210, 212, and 214 in a history list. Different entries can correspond to different requests or tasks and may include elements corresponding to at least one piece of media content obtained from the corresponding request. For example, elements 216-1 to 216-3 can be different elements distributed across different entries, each corresponding to different media content. Each entry may also include the name of the corresponding request, generation time, generation status, generation progress, or other information related to the corresponding request.

[0062] Taking element 216-1 as an example, element 216-1 can correspond to the first media content, and the first media content can be associated with component 204-2. Electronic device 110 can receive a selection operation for element 216-1. In response to the selection operation, electronic device 110 can present component 204-2 in the creation area 202 based on the correspondence between element 216-1 and the first media content, and the association between the first media content and component 204-2.

[0063] For example, if component 204-2 is located in a portion of the canvas that is not currently visible, electronic device 110 can move the canvas to bring component 204-2 into the currently visible area of ​​the creation area 202. If component 204-2 is already visible in the creation area 202, electronic device 110 can maintain or adjust the position of the canvas and indicate component 204-2 by selecting a border or other distinguishing display method.

[0064] Alternatively, in response to component 204-2 being selected, electronic device 110 may display connection entry points and toolbar 230 around component 204-2. Toolbar 230 may include entry points for intelligent processing, image expansion, intelligent super-resolution, image cutout, multi-angle processing, or other media processing. For example, an image expansion entry point may be used to expand the content area of ​​an image, an intelligent super-resolution entry point may be used to improve the resolution of an image or supplement image details, an image cutout entry point may be used to separate target objects from the background in an image, and a multi-angle processing entry point may be used to generate media content that presents target objects from different angles.

[0065] In response to component 204-2 being selected, electronic device 110 can also present input component 220 associated with component 204-2. Input component 220 may include a model selection control 222, an add control 224, a reference control 226, a generation settings control 228, and a generation control. Model selection control 222 can be used to select a model to perform the generation task. Add control 224 can be used to add text, images, videos, audio, or other inputs. Reference control 226 can be used to identify one or more media contents in the canvas as reference content for the request to component 204-2. Generation settings control 228 can be used to trigger the presentation of a settings interface for generation parameters. Generation settings control 228 can be used to initiate a request based on the content and parameters received via input component 220. The following will combine... Figure 2C The process of configuring the generation parameters by generating the setting control 228 is further described.

[0066] In this way, users can bring up the history component 208 through the history control 206, and by selecting the element in the history component 208 that corresponds to the target media content, the electronic device 110 moves the canvas and presents the component associated with the target media content in the creation area 202, thereby establishing an interface association between historical information, media content, canvas and components in the creation area.

[0067] Figure 2C The generation settings interface 200C is shown according to some scenarios. See below for reference. Figure 2B and Figure 2C This describes a process for configuring and generating parameters. Electronic device 110 can receive parameters for... Figure 2BThe triggering operation of the generation settings control 228 is triggered. In response to this triggering operation, the electronic device 110 can present the configuration panel 232 in the creation area 202. For example, the configuration panel 232 can be presented in association with the input component 220 and can cover a portion of the creation area 202.

[0068] The configuration panel 232 may include a scaling ratio setting area, a resolution setting area, and a generation quantity setting area. The scaling ratio setting area can be used to receive selections of aspect ratios (e.g., "16:9", "9:16", etc.). The resolution setting area can be used to receive selections of resolutions (e.g., 2K, 4K, or others). The generation quantity setting area can be used to receive selections of any generation quantity from one to N, where N is a positive integer greater than 1. In some cases, the default value for the generation quantity can be one. When the user has batch generation requirements, the generation quantity can be set to a number greater than one.

[0069] In some scenarios, electronic device 110 can present multiple media contents in the creation area 202 and receive a third operation for selecting multiple media contents. Electronic device 110 can then determine the selected multiple media contents as input for a first request. The intelligent system can generate corresponding media content based on each of the multiple media contents. For example, if a user selects multiple images and initiates an intelligent ultra-high definition request, the intelligent system can perform intelligent ultra-high definition processing on each image separately.

[0070] In response to the user completing the configuration of the corresponding parameters and triggering the generation control, the electronic device 110 can receive a first request. The first request can be formed based on the input received via the input component 220 and the parameters configured via the configuration panel 232, and is used to generate a second number of media contents based on multiple media contents. The electronic device 110 can provide the first request to the intelligent system.

[0071] Figure 2D Interface 200D is shown during the generation process according to some scenarios. In response to receiving a first request, electronic device 110 may stop displaying configuration panel 232 and present component 204-2 as being generated in the creation area 202. For example, electronic device 110 may display placeholder graphics, loading animations, progress information, or other prompts in component 204-2 to indicate that media content is being generated.

[0072] The electronic device 110 can also display a quantity indicator 218 in component 204-2. The quantity indicator 218 can indicate the number of media contents involved in the first component or the number of media contents currently being generated. For example, if the first component is associated with five media contents, the quantity indicator 218 can display the number "5". As the generation process progresses, the quantity indicator 218 can either maintain the total number of media contents generated or be updated to the number of media contents that have not yet been generated or the number of media contents that have been generated.

[0073] When the first request is based on multiple media content items, a second number of media content items can be generated by the intelligent system based on each of the multiple media content items. For example, the intelligent system can generate a first set of media content items based on a first input image and a second set of media content items based on a second input image. The generation results corresponding to different input media content items can be associated with their respective original components.

[0074] In some cases, the second number of media contents belongs to the first content set, which corresponds to the first request used to generate the second number of media contents. Multiple media contents generated by the same request can constitute a content set and be stored or presented in association according to preset arrangement rules. Each content set may include one or more media contents, and the content sets corresponding to different requests may include different numbers of media contents.

[0075] Figure 2E An interface 200E is shown after at least one type of media content has been generated, depending on several conditions. In response to the completion of media content generation corresponding to the first request, the electronic device 110 may stop displaying the generation state in component 204-2 and display component 204-2 in the creation area 202 in a first mode.

[0076] exist Figure 2E In the illustrated state, component 204-2 can act as a first component and present a single media content in a first mode. This single media content may include third media content; for example, it may be third media content currently used by the first component 204-2 or used to represent a corresponding content set. The first component can be associated with multiple content sets, each corresponding to a different generation request. Control 236 can act as a first control, and information 234 can act as first information. Electronic device 110 can present the first control 236 within the first component, and the first control 236 presents the first information 234, which includes the number of multiple content sets. For example, "1 / 2" could indicate that the first component is associated with two content sets, and the first content set is currently being presented. The first control 236 can be used to receive operations that switch between multiple content sets.

[0077] In some cases, if component 204-2 is associated with only one piece of media content, electronic device 110 can directly present that media content without presenting the collapsible structure used to indicate a batch of media content. If component 204-2 is associated with multiple pieces of media content, electronic device 110 can present component 204-2 as a batch component that can switch between a first mode and a second mode.

[0078] Users can repeatedly initiate generation or editing requests for the same component. The media content obtained from each request can constitute a corresponding content set, and can be counted in the number of content sets or tasks associated with component 204-2. Information 234 can be used to indicate the cumulative number of content sets, tasks, or the position of the current content set. Control 236 can be used to receive content set switching operations, causing the electronic device 110 to stop displaying the current content set and display another content set associated with component 204-2.

[0079] Figure 2F An interface 200F is shown in which component 204-2 presents another content set depending on certain conditions. Electronic device 110 can receive a second operation via first control 236, the second operation being associated with first component 204-2. In response to the second operation, electronic device 110 can stop presenting the first content set corresponding to the first request in first component 204-2, and present a second content set corresponding to the second request in first component 204-2.

[0080] exist Figure 2F In the example shown, the second content set may include four media content items, which the electronic device 110 may present in component 204-2 in a grid, list, stack, or other format. Information 234 may be updated from "1 / 2" to "2 / 2" accordingly to indicate that the currently presented content set is the second content set among the two content sets associated with component 204-2.

[0081] The number of media contents included in different content sets may vary. For example, the first content set may include one or two media contents, while the second content set may include four media contents. The electronic device 110 can adjust the presentation of component 204-2 according to the actual number of media contents included in each content set, without mixing media contents from different content sets or using media contents from other content sets to supplement the current content set.

[0082] Figure 2G An interface 200G is shown that simultaneously presents the creation area 202 and the history component 208, depending on the situation. In other situations, Figures 2G to 2H The process of locating based on the historical list shown can be independent of Figures 2E to 2F The content set switching process is shown below. For ease of description, it will be described in conjunction with... Figures 2G to 2H In the described scenario, the request corresponding to entry 238 in the history list is referred to as the first request. The first request is used to distinguish it from other requests, and does not indicate the order in which the requests were initiated or the position of its corresponding content set among multiple content sets. The electronic device 110 may, in response to a trigger operation on the history control 206, re-present the history component 208.

[0083] Electronic device 110 can present entry 238 in the history list included in history component 208. Entry 238 can serve as a first entry, corresponding to a first request, and includes at least one element. This at least one element can include elements 240-1, 240-2, and 240-3, where element 240-2 can serve as the first element. Different elements can correspond to different media content generated by the first request, which is used to generate a second number of media contents. Electronic device 110 can also associate a first identifier with the first entry, the first identifier being associated with the first request. For example, at least one of the request name, request type, generation time, or task name presented in the first entry can serve as the first identifier.

[0084] The same component can be associated with multiple entries in historical component 208. For example, a user can make multiple requests to component 204-2, thereby creating multiple entries in historical component 208 corresponding to different requests. Different entries can correspond to different content sets associated with component 204-2, and the number of elements included in different entries can be the same or different.

[0085] The History component 208 can also display requests that are currently being executed and synchronously update the generation status or progress of the corresponding requests. Users can view different types of historical information through category entries such as "All," "Images," "Videos," and "Audio" in the History component 208, and can also search for corresponding entries by time, component, or task status.

[0086] In some cases, even if the user removes the corresponding component or media content from the canvas, the history component 208 can still retain the association between the corresponding request, entry and element to support the user in finding, locating or re-adding the corresponding media content later.

[0087] Figure 2H The interface 200H is shown, which locates and expands component 204-2 based on elements in historical component 208 according to certain scenarios. See below for reference. Figure 2G and Figure 2H Describes a process for locating media content from historical component 208.

[0088] Electronic device 110 can receive a first operation on element 240-2. Element 240-2 can be a first element and correspond to first media content. The first media content can be associated with component 204-2, which is a first component. The first operation can include a click, double-click, long press, or other selection operation.

[0089] Upon receiving the first operation, the creation area 202 can present a first portion of the canvas, which may also include a second portion, including the first component 204-2. In response to the first operation, the electronic device 110 can move the canvas and present the second portion of the canvas in the creation area 202 to present the first component 204-2. In response to the first operation, the electronic device 110 can also present the first component 204-2 in the creation area 202 in a second mode based on the correspondence between the first element 240-2 and the first media content, and the association between the first media content and the first component 204-2.

[0090] In the second mode, the first component 204-2 can present a second number of media contents, which includes the first media contents and the second media contents, and the second number is greater than the first number presented in the first mode. The electronic device 110 can also present a first prompt 242 in the first component 204-2, which indicates that the first media contents are media contents corresponding to the first element 240-2. For example, the first prompt 242 may include a highlighted border, color change, mask change, magnified display, top-mounted display, or other distinguishing display methods.

[0091] In some cases, even without highlighting the border, the electronic device 110 can indicate the correspondence between the first media content and the element 240-2 by displaying the first media content in a preset position in the component 204-2, changing the display level of the first media content, or making the first media content selected.

[0092] Figure 2I An interface 200I is shown that selects media content in the first component 204-2 and updates the component state according to certain conditions. When the first component 204-2 is in a second mode, the electronic device 110 can receive a fourth operation, which includes a trigger operation on the first media content. The fourth operation can be used to determine the first media content as the current media content of the first component 204-2.

[0093] In response to the fourth operation, the electronic device 110 may stop presenting the second media content in the first component 204-2 and present the first component 204-2 in a first mode, whereby the first component 204-2 presents the first media content. In response to the fourth operation, the electronic device 110 may also present second information in the first component 204-2, the second information including at least a second number to indicate the number of media contents associated with the first component 204-2.

[0094] Component 204-2 may include connection control 244-1 and connection control 244-2. Connection control 244-1 and connection control 244-2 may be displayed on different sides of component 204-2 and may be used to trigger the creation of new components or to establish a connection between component 204-2 and existing components in the canvas.

[0095] For example, in response to a click, touch, or other triggering action on the connection control 244-1, the electronic device 110 can present a node-adding component 246. The node-adding component 246 may include a selection entry for text, image, video, audio, timeline, subject, or other node types. In response to an operation on the corresponding selection entry, the electronic device 110 can create a new component in the canvas and connect component 204-2 to the newly created component via a connection element.

[0096] Additionally or alternatively, the electronic device 110 can receive drag operations from connection control 244-1 or connection control 244-2 pointing to existing components in the canvas. For example, component 204-2 can be a first component, and component 204-3 can be a second component. The user can start dragging from connection control 244-1 and move the drag position to the second component 204-3 or its connection control. In response to the drag operation, the electronic device 110 can present connection elements in the creation area 202 to connect the first component 204-2 and the second component 204-3, thereby establishing a data association or processing dependency between the first component 204-2 and the second component 204-3.

[0097] Prior to the fourth operation, the first component 204-2 can present the third media content, and the second component 204-3 can present the fourth media content, which is derived from the third media content. In response to the fourth operation, the electronic device 110 can stop presenting the fourth media content in the second component 204-3 and instead present a fifth media content in the second component 204-3, which is derived from the first media content. This update can also continue to propagate along the connections between components to other components connected to the second component 204-3, updating subsequent processing results accordingly.

[0098] Figure 2JAn interface 200J is shown where the same historical element is associated with multiple components under certain conditions. For example, component 204-2 can serve as a first component. Electronic device 110 can receive a copy operation for the first component 204-2 and, in response to the copy operation, create a third component 204-4 based on the first component 204-2. The third component 204-4 is obtained by copying the first component 204-2 and can be placed in a position on the canvas different from that of the first component 204-2. The third component 204-4 can inherit at least one of the media content, content set, or request information associated with the first component 204-2 and can present the first media content corresponding to the first element 240-2. Thus, the first element 240-2 can be matched with both the first component 204-2 and the third component 204-4 simultaneously.

[0099] In response to a first operation on the first element 240-2, the electronic device 110 may present a second prompt indicating that the first element 240-2 is associated with multiple components. For example, the positioning control 248 and information such as "Found 1 / 2 node" presented by the positioning control 248 may serve as the second prompt and may indicate the position of the currently positioned component among multiple components.

[0100] Positioning control 248 may include directional controls for switching between multiple components. Electronic device 110 may receive a fifth operation via a corresponding directional control, the fifth operation being used to select the first component 204-2. In response to the fifth operation, electronic device 110 may move the canvas and present the first component 204-2 in a second mode within the creation area 202. Electronic device 110 may also receive a sixth operation via another directional control. In response to the sixth operation, electronic device 110 may continue moving the canvas and present the third component 204-4 in a second mode within the creation area 202.

[0101] In some cases, components 204-2 and 204-4 can have different component names, component identifiers, canvas positions, or connection relationships. For example, the copied component 204-4 can have "copy," a serial number, or other distinguishing information added to the original component name to allow users to differentiate between multiple matching components.

[0102] Figure 2K The interface shown in 200K demonstrates how to re-add media content that has been removed from the canvas based on certain scenarios. For example... Figure 2K As shown, even if the media content or the component carrying the media content has been removed from the canvas, the electronic device 110 can still retain the entries and elements corresponding to the media content in the history component 208.

[0103] For example, the history component 208 may display element 250, which may correspond to media content that has been removed from the canvas. The electronic device 110 may display a tooltip 252 associated with element 250. Tooltip 252 may indicate that the corresponding media content has been removed from the canvas and may include a re-add control for re-adding the media content to the canvas.

[0104] In response to the operation of re-adding the control, the electronic device 110 can re-add the media content corresponding to element 250 to the canvas based on the request information, media content and association information retained in the history component 208, and present the component carrying the media content in the creation area 202.

[0105] In some situations, in response to a user re-adding an element, the electronic device 110 may prioritize re-adding one piece of media content corresponding to that element, rather than automatically adding all media content obtained from the same request. When the user continues to re-add other elements, the electronic device 110 may add the corresponding media content to the canvas or aggregate it into the same component according to the order in which the elements were selected.

[0106] Alternatively or additionally, the electronic device 110 may retain the original request association or content set association of the re-added media content. If the corresponding media content originally belonged to a content set that included multiple media contents, the re-formed component may have a batch form that can switch between a first mode and a second mode; if the corresponding request corresponds to only one media content, the re-formed component may only present that media content.

[0107] When a user re-adds media content from multiple entries corresponding to different requests, the electronic device 110 can save the media content corresponding to different requests into different content sets and switch between them using corresponding controls. Different content sets can include different numbers of media content and can be arranged according to the actual number of media content they contain.

[0108] Based on the process described above, the entries and elements in the history component 208 can remain associated with the media content and components in the canvas. Users can use the history component 208 to locate the corresponding component in the canvas, expand to view other media content associated with the target media content, switch between multiple matching components, or re-add media content that has been removed from the canvas, thereby improving the efficiency of finding, locating, and reusing media content.

[0109] Example process Figure 3A flowchart illustrating an example process 300 for interface interaction under certain conditions is shown. Process 300 can be implemented at electronic device 110. See below for reference. Figure 1 To describe process 300.

[0110] In frame 310, electronic device 110 can present a first component in a first mode in the creation area, the first mode including presenting a first number of media contents in the first component.

[0111] In box 320, electronic device 110 can present a first element, which corresponds to first media content, and the first media content is associated with a first component.

[0112] In frame 330, in response to a first operation on the first element, the electronic device 110 can present the first component in a second mode in the creation area. The second mode includes presenting a second number of media contents in the first component, the second number of media contents including the first media contents.

[0113] In some cases, process 300 further includes: in the first component, presenting a first prompt, the first prompt indicating that the first media content is media content corresponding to the first element.

[0114] In some cases, the second number of media contents belongs to the first content set, which corresponds to the first request used to generate the second number of media contents.

[0115] In some cases, process 300 further includes: receiving a second operation associated with the first component; and in response to the second operation, stopping the rendering of the first content set in the first component and rendering a second content set in the first component, the second content set corresponding to the second request.

[0116] In some cases, the first component is associated with multiple content sets, which correspond to different generation requests, and receiving the second operation includes: in the first component, presenting a first control, the first control presenting first information, the first information including the number of multiple content sets; and receiving the second operation through the first control.

[0117] In some cases, process 300 further includes: presenting multiple media contents in the creation area; receiving a third operation for selecting multiple media contents; and receiving a first request for generating a second number of media contents based on the multiple media contents.

[0118] In some cases, the second number of media contents is generated by the intelligent system based on multiple media contents.

[0119] In some cases, presenting the first element includes: presenting a first entry in a history list, the first entry corresponding to a first request, the first entry including at least one element, the at least one element including the first element, and the first request being used to generate a second number of media contents.

[0120] In some cases, process 300 may also include: presenting a first identifier associated with the first entry, the first identifier being associated with the first request.

[0121] In some cases, presenting the first component in the first mode includes: in the first component, presenting a single media content, which includes third media content.

[0122] In some cases, the second number of media contents also includes a second media content, and process 300 further includes: in response to the first component being in a second mode, receiving a fourth operation, the fourth operation including a trigger operation on the first media content; and stopping the presentation of the second media content and presenting the first component in a first mode, the first component presenting the first media content.

[0123] In some cases, process 300 further includes: in the creation area, presenting a second component and a connecting element, the connecting element being used to connect the first component and the second component, the second component presenting fourth media content, the fourth media content being derived from the third media content; and in response to a fourth operation, stopping the presentation of the fourth media content in the second component and presenting fifth media content in the second component, the fifth media content being derived from the first media content.

[0124] In some cases, process 300 further includes: in response to a fourth operation, presenting second information in the first component, the second information including at least a second number.

[0125] In some cases, the creation area presents a first portion of the canvas, which also includes a second portion that includes the first component. In the creation area, presenting the first component in a second mode includes: moving the canvas in response to a first operation; and presenting the second portion in the creation area to present the first component.

[0126] In some cases, the creation area also includes a third component, which is obtained by copying the first component. The process 300 also includes: in response to the first operation, presenting a second prompt, which indicates that the first element is associated with multiple components.

[0127] In some cases, presenting the first component in the creation area in a second mode includes: receiving a fifth operation for selecting the first component; and presenting the first component in the second mode.

[0128] In some cases, process 300 also includes: receiving a sixth operation; and in the creation area, presenting a third component in a second mode.

[0129] In this way, the electronic device 110 can respond to a first operation on the first element, presenting the first media content corresponding to the first element and other media content associated with the first component in the first component, thereby enabling the first component to switch between modes that present different numbers of media contents. By associating and switching content sets, history entries, different parts of the canvas, and multiple components obtained through copying, it is also easier for users to locate the corresponding components and media content, and to enable the second component to present media content corresponding to the media content currently presented by the first component, thereby improving the efficiency of interface interaction and creative processing.

[0130] Example devices and equipment A corresponding apparatus for implementing the above methods or processes is also provided. Figure 4 A schematic structural block diagram of an example device 400 for interface interaction under certain conditions is shown. Device 400 can be implemented as or included in electronic device 110. The various modules / components in device 400 can be implemented by hardware, software, firmware, or any combination thereof.

[0131] like Figure 4 As shown, the device 400 includes: a first presentation module 410 configured to present a first component in a creation area in a first mode, the first mode including presenting a first number of media contents in the first component; a second presentation module 420 configured to present a first element corresponding to the first media contents associated with the first component; and a third presentation module 430 configured to, in response to a first operation on the first element, present the first component in a second mode in the creation area, the second mode including presenting a second number of media contents in the first component, the second number of media contents including the first media contents.

[0132] In some cases, the device 400 also includes a first prompt presentation module configured to: present a first prompt in the first component, the first prompt indicating that the first media content is media content corresponding to the first element.

[0133] In some cases, the second number of media contents belongs to the first content set, which corresponds to the first request used to generate the second number of media contents.

[0134] In some cases, the device 400 also includes a content set switching module configured to: receive a second operation associated with the first component; and in response to the second operation, stop displaying the first content set in the first component and display a second content set in the first component, the second content set corresponding to the second request.

[0135] In some cases, the first component is associated with multiple content sets, which correspond to different generation requests, and the content set switching module is also configured to: present a first control in the first component, the first control presenting first information, the first information including the number of multiple content sets; and receive a second operation through the first control.

[0136] In some cases, the device 400 also includes a first request receiving module configured to: present multiple media contents in the creation area; receive a third operation for selecting multiple media contents; and receive a first request for generating a second number of media contents based on the multiple media contents.

[0137] In some cases, the second number of media contents is generated by the intelligent system based on multiple media contents.

[0138] In some cases, the second presentation module 420 is also configured to present a first entry in a history list, the first entry corresponding to a first request, the first entry including at least one element, the at least one element including a first element, the first request being used to generate a second number of media contents.

[0139] In some cases, the device 400 also includes a first identifier presentation module configured to: present a first identifier associated with the first entry, the first identifier being associated with the first request.

[0140] In some cases, the first presentation module 410 is also configured to: in the first component, present a single media content, the single media content including third media content.

[0141] In some cases, the second number of media contents also includes a second media content, and the device 400 also includes a first component mode switching module configured to: receive a fourth operation in response to the first component being in a second mode, the fourth operation including a trigger operation on the first media content; and stop presenting the second media content and present the first component in a first mode, the first component presenting the first media content.

[0142] In some cases, device 400 also includes a second component update module configured to: present a second component and a connecting element in the creation area, the connecting element being used to connect the first component and the second component, the second component presenting fourth media content, the fourth media content being derived from the third media content; and in response to a fourth operation, stop presenting the fourth media content in the second component and present a fifth media content in the second component, the fifth media content being derived from the first media content.

[0143] In some cases, the device 400 also includes a second information presentation module configured to present second information, which includes at least a second number, in response to a fourth operation.

[0144] In some cases, the creation area presents a first portion of the canvas, the canvas also includes a second portion, the second portion includes the first component, and the third presentation module 430 is further configured to: move the canvas in response to the first operation; and present the second portion in the creation area to present the first component.

[0145] In some cases, the creation area also includes a third component, which is obtained by copying the first component. The device 400 also includes a second prompt presentation module, configured to present a second prompt in response to the first operation. The second prompt is used to indicate that the first element is associated with multiple components.

[0146] In some cases, the third presentation module 430 is also configured to: receive a fifth operation for selecting the first component; and present the first component in a second mode.

[0147] In some cases, the device 400 also includes a third component presentation module, configured to: receive a sixth operation; and present the third component in the creation area in a second mode.

[0148] The modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some cases, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 400 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on.

[0149] Figure 5 A block diagram of an electronic device 500 in which one or more examples can be implemented is shown. It should be understood that... Figure 5 The electronic device 500 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 5 The electronic device 500 shown can be used to implement the electronic device 110 discussed above.

[0150] like Figure 5 As shown, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processing units or processors 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0151] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof). Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0152] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 5 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various examples.

[0153] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.

[0154] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0155] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0156] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0157] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0158] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0159] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0160] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for interface interaction, comprising: In the creation area, the first component is presented in a first mode, the first mode including presenting a first number of media contents in the first component; Present a first element, which corresponds to first media content, which is associated with the first component; as well as In response to a first operation on the first element, the first component is presented in a second mode in the creation area, the second mode including presenting a second number of media contents in the first component, the second number of media contents including the first media contents.

2. The method according to claim 1, further comprising: In the first component, a first prompt is presented, which indicates that the first media content is media content corresponding to the first element.

3. The method according to claim 1, wherein the second number of media contents belongs to a first content set, the first content set corresponds to a first request, and the first request is used to generate the second number of media contents.

4. The method according to claim 3, further comprising: Receive a second operation, which is associated with the first component; as well as In response to the second operation, the rendering of the first content set in the first component is stopped, and a second content set corresponding to the second request is rendered in the first component.

5. The method of claim 4, wherein the first component is associated with a plurality of content sets, the plurality of content sets corresponding to different generation requests, and the receiving of the second operation comprises: In the first component, a first control is presented, and the first control presents first information, which includes the number of the plurality of content sets; as well as The second operation is received through the first control.

6. The method according to claim 3, further comprising: The creation area displays multiple media content; Receive a third operation, the third operation being used to select the multiple media contents; as well as The first request is received, which is used to generate the second number of media contents based on the plurality of media contents.

7. The method of claim 6, wherein the second number of media contents are generated by the intelligent system based on the plurality of media contents respectively.

8. The method of claim 1, wherein presenting the first element comprises: The first entry is presented in the history list. The first entry corresponds to the first request. The first entry includes at least one element, which includes the first element. The first request is used to generate the second number of media contents.

9. The method according to claim 8, further comprising: Associated with the first entry, a first identifier is presented, which is associated with the first request.

10. The method of claim 1, wherein presenting the first component in a first mode comprises: In the first component, a single media content is presented, which includes third media content.

11. The method of claim 10, wherein the second number of media contents further includes second media content, and the method further includes: In response to the first component being in the second mode, a fourth operation is received, the fourth operation including a trigger operation on the first media content; as well as Stop presenting the second media content and present the first component in the first mode, whereby the first component presents the first media content.

12. The method of claim 11, further comprising: In the creation area, a second component and a connecting element are presented. The connecting element is used to connect the first component and the second component. The second component presents fourth media content, which is derived from the third media content. as well as In response to the fourth operation, the presentation of the fourth media content in the second component is stopped, and a fifth media content, which is derived from the first media content, is presented in the second component.

13. The method of claim 11, further comprising: In response to the fourth operation, the first component presents second information, which includes at least the second number.

14. The method of claim 1, wherein the creation area presents a first portion of a canvas, the canvas further comprising a second portion including the first component, and presenting the first component in a second mode in the creation area comprises: In response to the first operation, the canvas is moved; as well as The second part is presented in the creation area to present the first component.

15. The method of claim 1, wherein the creation area further comprises a third component, the third component being obtained by copying the first component, and the method further comprises: In response to the first operation, a second prompt is displayed, which indicates that the first element is associated with multiple components.

16. The method of claim 15, wherein presenting the first component in a second mode in the creative area comprises: Receive a fifth operation, the fifth operation being used to select the first component; as well as The first component is presented in the second mode.

17. The method of claim 16, further comprising: Receive the sixth operation; as well as In the creation area, the third component is presented in the second mode.

18. A device for interface interaction, comprising: A first presentation module is configured to present a first component in a first mode in the creation area, the first mode including presenting a first number of media contents in the first component; The second presentation module is configured to present a first element, which corresponds to first media content, and the first media content is associated with the first component. as well as A third presentation module is configured to, in response to a first operation on the first element, present the first component in the creation area in a second mode, the second mode including presenting a second number of media contents on the first component, the second number of media contents including the first media contents.

19. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 17 when executed by the at least one processor.

20. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 17.

Images