Methods, apparatuses, devices, media, and program products for interface interaction

Abstract

Methods, apparatuses, devices, media, and program products for interface interaction are provided. The method includes: presenting first description information, the first description information being used to generate first media content, wherein the first description information includes a first element, the first element corresponding to a first media object, the first media object including a plurality of materials, the first element indicating a first use state of a first material, the first material being one of the plurality of materials; receiving a first operation, updating the first element to indicate a second use state of the first material, the second use state being different from the first use state. In this way, by indicating the use state of the material included in the media object in the description information and supporting updating the use state through operation in the original position of the description information, the change of the material use state can be immediately reflected in the description information, and the transparency and operation efficiency of material management are improved.

Description

Technical Field

[0001] The examples in this article generally relate to the field of computer science, and in particular to methods, apparatuses, devices, media, and program products for user interface interaction. Background Technology

[0002] In media content generation scenarios, users typically need to use various types of materials (such as images, videos, audio, and text). Users can reference materials into the information used for media content generation (e.g., scripts) through text input, drag-and-drop uploads, or selection from a material library. When the referenced materials exceed the generation capacity's limits, an out-of-limit warning is usually given. Users need to adjust the referenced materials to meet the generation requirements. Summary of the Invention

[0003] In a first aspect of this paper, a user interface interaction method is provided. The method includes: presenting first descriptive information, the first descriptive information being used to generate first media content, wherein the first descriptive information includes a first element, the first element corresponding to a first media object, the first media object including multiple media, the first element indicating a first usage state of the first media, and the first media being one of the multiple media; receiving a first operation to update the first element to indicate a second usage state of the first media, the second usage state being different from the first usage state.

[0004] In a second aspect of this document, an apparatus for interface interaction is provided. The apparatus includes: a description information presentation module configured to present first description information used to generate first media content, wherein the first description information includes a first element, the first element corresponds to a first media object, the first media object includes multiple media, the first element indicates a first usage state of the first media, and the first media is one of the multiple media; and a state update module configured to receive a first operation and update the first element to indicate a second usage state of the first media, the second usage state being different from the first usage state.

[0005] In a third aspect of this document, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect of this document, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0007] In a fifth aspect of this document, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0008] In this way, by indicating the usage status of the media objects contained in the description information and supporting the updating of the usage status through operations in the original position of the description information, changes in the usage status of the media can be reflected in the description information in real time, thereby improving the transparency and operational efficiency of media management.

[0009] It should be understood that the content described in this section is not intended to limit the key or important features of the examples in this article, nor is it intended to restrict the scope of the solution. Other features will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of the example environment is shown; Figure 2 The diagram illustrates sample interfaces for media content generation in several scenarios. Figures 3A to 3B The diagram illustrates the media selection interface for situations where media of a certain type exceeds the limits. Figures 4A to 4C The diagram illustrates the media selection interface for situations where media of various types exceed the limits. Figure 5A The diagram shows the material selection interface when the total size and a certain type of material all exceed the limit in some scenarios; Figure 5B The diagram shows the material selection interface when the total size exceeds the limit in some situations; Figure 5C The diagrams show some scenarios of the updated interface after the material was updated; Figure 6 The diagram shows schematics of the interface after the material usage status is updated in some scenarios; Figure 7 The diagram illustrates some scenarios where the usage status of materials is updated in the description information; Figure 8A A schematic diagram of the interface showing updated descriptive information for some scenarios is shown; Figure 8BThe diagram illustrates the interface for storyboard content generated based on updated description information in some scenarios. Figure 9 The diagram illustrates example flows for interface interaction in several scenarios. Figure 10 Flowcharts illustrating example processes for interface interaction in several scenarios are shown; Figure 11 Block diagrams of devices for interface interaction in several scenarios are shown; and Figure 12 A block diagram of an electronic device capable of implementing multiple illustrative scenarios is shown. Detailed Implementation

[0011] The examples in this document will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.

[0012] It should be noted that the headings of any section / subsection provided herein are not restrictive. Various examples are described throughout this document, and examples of any type may be included under any section / subsection. Furthermore, examples described in any section / subsection may be combined in any way with any other examples described in the same section / subsection and / or different sections / subsections.

[0013] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0014] The examples in this document may involve user data, data acquisition, and / or use. All of these aspects comply with relevant laws, regulations, and rules. In the examples, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.

[0015] In this manual and the sample solutions, any processing of personal information will be conducted only under legal grounds (such as obtaining the consent of the data subject or being necessary for the performance of a contract) and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.

[0016] As mentioned above, in media content generation scenarios (such as video generation), users typically need to reference multiple types of materials in their creation scripts. When the number, duration, or total size of materials referenced in a script exceeds the limits allowed by the media content generation capabilities, traditional solutions usually only provide a general over-limit warning or require the user to delete the materials before generation.

[0017] In traditional solutions, after receiving an over-limit notification, users often struggle to ascertain the specific over-limit status of various materials and lack effective criteria for selection, requiring them to repeatedly experiment with different material combinations. Furthermore, if users need to restore or remove references to materials that have already been removed or adjusted, they typically need to search for the resources again or rewrite the script, making the correction process cumbersome.

[0018] A scheme for interface interaction is proposed. According to this scheme, each material contained within a media object is provided with an element that individually indicates its usage status within the description information. Users can update the usage status of a material by triggering operations on these elements, thus ensuring a comprehensible correspondence between the material status visible in the description information and the actual input involved in generating media content. This scheme transforms the management of material usage status from a simple deletion operation to a status switching operation that can be performed within the original location of the description information. This reduces the number of times users need to leave their current editing position during material adjustments, improving the transparency and convenience of material management.

[0019] Figure 1 A schematic diagram of example environment 100 is shown. (e.g.) Figure 1 As shown, example environment 100 may include electronic device 110.

[0020] In example environment 100, electronic device 110 can run an application 120 that supports user interface interaction. Application 120 can be any suitable type of application for media content creation and generation, such as a video editing application, an animation production application, or a multimedia content generation application. User 140 can interact with application 120 via electronic device 110 and / or its attached devices (e.g., stylus, mouse, keyboard, or external monitor). Alternatively, application 120 can also be other types of applications integrating media content creation and generation capabilities, such as media content sharing applications, video applications, social applications, etc., without limitation.

[0021] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.

[0022] In some cases, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, virtual reality (VR) / augmented reality (AR) devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some cases, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0023] Server 130 can be a single physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and artificial intelligence platforms. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.

[0024] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some cases, server 130 and electronic device 110 can exchange signaling information through their communication connection.

[0025] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the scheme.

[0026] The examples described herein can be implemented on electronic device 110. It should be noted that the operations described relative to electronic device 110 can be performed by a related application 120 running on electronic device 110. The interface described relative to electronic device 110 can be provided by application 120; for example, electronic device 110 presents the corresponding interface by running application 120. Furthermore, some operations described relative to electronic device 110 may require the assistance of server 130 to complete.

[0027] The following description, in conjunction with the accompanying drawings, illustrates an example from this article.

[0028] Figure 2 A schematic diagram of an example interface 200 for media content generation is shown, based on several scenarios. For example... Figure 2 As shown, on interface 200, electronic device 110 presents description information editing area 205, asset library area 210, multiple elements 215, 220, 225, 230, 235 and generation control 240.

[0029] Description information is textual information used to guide the generation of media content, such as script text or storyboard description text. Users can reference media objects in the description information through text input, dragging and dropping from the asset library, or selecting from the media library. A media object can include multiple media of different types; for example, a character media object can include visual and audio media.

[0030] When a user references a media object in the description information, the electronic device 110 presents an element corresponding to that media object in the description information. This element is embedded in the description information as a visual component representing the reference to the media object. The element indicates the usage status of each material contained in the media object, indicating whether and how the material participates in media content generation.

[0031] like Figure 2 As shown, the description information embeds multiple elements: 215, 220, 225, 230, and 235. These elements correspond to the various media objects that the user has added to the script. Figure 2 In the initial state shown, the electronic device 110 has not yet verified the material referenced by the script, and each element and its contained instruction information can be in the default state.

[0032] In some scenarios, when creating a script and adding a media object, users can directly configure which materials within that media object are used and which are not. For example, element 225 can correspond to a media object (e.g., a character) that includes a first material (e.g., a visual) and a second material (e.g., an audio). Element 225 can include indications to show the usage status of different materials. In this way, users can complete the material-level usage status configuration the moment the media object is introduced into the script, allowing the elements in the description information to directly reflect the usage status of each material without needing to navigate to a separate material management interface.

[0033] After the script is created and the media object is configured, the electronic device 110 can generate media content when the user triggers the generation control 240. In some cases, the electronic device 110 first verifies the materials referenced in the current description information before generating media content. This verification may include constraint checks on materials of different media types. When it is detected that a material of a certain media type does not meet the corresponding usage conditions, the electronic device 110 presents a corresponding material selection interface to guide the user to adjust the material configuration.

[0034] Usage conditions are set separately for different media types. For example, a maximum quantity limit can be set for visual materials, such as allowing a maximum of M visual materials. A maximum quantity and total duration limit can be set for audio materials, such as allowing a maximum of N audio clips with a total duration not exceeding X seconds. Similarly, a maximum quantity and total duration limit can be set for video materials, such as allowing a maximum of Y video clips with a total duration not exceeding Z seconds. It should be understood that the above values ​​are merely illustrative and can be adjusted in other implementations based on the capabilities of the generative model, the task type, or the configuration strategy.

[0035] When the electronic device 110 detects that the material of a certain media type does not meet the corresponding usage conditions mentioned above, it presents the first component to guide the user to select the part that needs to be retained from the referenced materials of that type. The unselected materials will not participate in the subsequent media content generation.

[0036] The following combination Figures 3A to 5CTo describe the material selection process under different exceedance scenarios, among which Figures 3A to 3B This involves exceeding the limit for a single media type. Figures 4A to 4C Involving multiple media types simultaneously exceeding limits Figures 5A to 5C The total size of the materials involved exceeds the limit.

[0037] Figures 3A to 3B A schematic diagram of the media type media selection interface 300A to 300B when the media exceeds the limit is shown.

[0038] like Figure 3A As shown, in response to the user's trigger operation on the generation control 240, the electronic device 110 verifies the materials referenced in the current script. When the electronic device 110 detects that materials of a certain media type do not meet the corresponding usage conditions, it presents a material selection component 305 (i.e., an example of the first component). This component includes a prompt message informing the user that the materials of this type added in the current script exceed the allowed range, and guiding the user to select the parts to be retained from the referenced materials in the form below. The unselected materials will not be used in subsequent processing. This component also includes a selection control 310 for this type of material, presenting multiple elements 315, 320, and 325 of this type of material. In some cases, the user can directly delete each element to delete the corresponding material. The user can click the OK button 330 to complete the material update.

[0039] In other situations, users can also update materials via a drop-down menu. For example... Figure 3B As shown, the first component 335 lists the referenced materials under this type. Each material corresponds to a selection control, and the user can indicate whether the material is used by operating the selection control. The user performs a second operation through the first component, selecting at least one material from multiple materials to participate in the generation. For example, the material corresponding to the selected control 340 is material used for media content generation. When the number of materials selected by the user reaches the upper limit limited by the usage conditions of this type, the remaining unselected options become unselectable, and the user can no longer select more materials of this type.

[0040] For example, in the case of exceeding the limit for visual content, the first component can list all visual content added to the current script. The user can then select the content they want to use to generate media content; unselected content will not be generated. When the maximum number of visual content is 9 and the user has selected 9, the remaining visual content in the list will become unselectable. Similarly, in the case of exceeding the limit for audio content, the first component can list all audio content added to the current script, allowing the user to select the audio content they want to keep.

[0041] In this way, users can intuitively understand the reasons for exceeding the limits and complete the material selection in a unified selection interface, reducing the number of repeated operations.

[0042] In some situations, different media types can have their own usage conditions. For example, visual materials can have a quantity limit, while audio materials can have both a quantity limit and a total duration limit. When multiple media types do not meet their respective usage conditions, the electronic device 110 can handle multiple types of exceeding limits within the same component.

[0043] Figures 4A to 4C A schematic diagram of the media selection interface 400A to 400C, showing multiple media types exceeding the time limit simultaneously, is provided.

[0044] like Figure 4A As shown, the electronic device 110 merges multiple out-of-limit types into a single media selection component for processing. This component includes a prompt message 405 informing the user that multiple media types added to the current script exceed the allowed limits. The component also provides selection areas for different media types, such as selection area 410 for type A media and selection area 415 for type B media. Each area lists all referenced media under the corresponding type and allows the user to perform individual selection operations for media of that type. In some cases, the component may also include a drop-down menu 420 for switching between multiple out-of-limit types.

[0045] like Figures 4B to 4C As shown, users make selections in each material selection area. For example, three materials 440 from the character library 435 are selected for media content generation. When the number of selected materials of a certain type reaches the upper limit stipulated by the usage conditions for that type, the remaining unselected options in that area become unavailable, and the user can no longer select more materials of that type.

[0046] In this way, users do not have to face multiple separate prompts and can handle multiple types of over-limit issues simultaneously on the same interface, reducing the number of interface jumps.

[0047] In addition to the usage conditions set individually for each media type, there may also be usage requirements for the total size of all materials in some cases. For example, the generative model may have a limit on the total volume of the input materials. When the materials for each media type meet their respective usage conditions, but the total size of all materials does not meet the total size requirement, the electronic device 110 presents the second component.

[0048] The second component includes information corresponding to one or more individual assets. Unlike the first component, the second component manages assets on a total scale, rather than filtering by media type. Through the second component, users can view all referenced assets and their individual sizes, and adjust the total size to meet requirements by removing or resizing one or more assets.

[0049] Figure 5A This diagram illustrates the material selection interface 500A when both the total size and a certain type of material exceed the limits. (For example...) Figure 5A As shown, the message indicates that the total size of the materials exceeds the limit, and the quantity / duration of one or more materials exceeds the limit. The second component lists the various types of materials referenced in the current script. In this example, the component groups the materials by media type, such as material type A area 505, material type B area 510, and material type C area 515. The content of these areas is cleared. Each material area corresponds to a drop-down selection control, allowing users to select the parts they want to keep from the referenced materials of that type using the drop-down menu. After the materials are updated, the user is redirected to... Figure 5C The interface shown.

[0050] Figure 5B This diagram illustrates the media selection interface 500B when the total size exceeds the limit. In this example, the quantity / duration of various media items is within the limits. Figure 5B As shown, the prompt message indicates that only the total size of the materials exceeds the limit. The areas corresponding to various materials have not been cleared. Users can delete some materials on this interface to make the total size of the materials meet the requirement. Users can also select the materials they want to keep in each material area using the drop-down selection control. As the user selects, the accumulated size at the bottom updates in real time, displaying the total size of the currently selected materials. After deselecting a material, that material will not participate in the generation, and the accumulated size at the bottom will decrease accordingly. Alternatively, users can adjust the size of the materials themselves, such as reducing the resolution or image quality to reduce the material size. After the materials are updated, the user will be redirected to... Figure 5C The interface shown.

[0051] Figure 5C A schematic diagram of the updated interface 500C is shown. (For example...) Figure 5C As shown, users can reduce the accumulated size using the methods described above. If the reduced accumulated size meets the total size requirement, the user can confirm the current configuration. Selected materials will be used for media content generation, while unselected materials will not be used for media content generation.

[0052] In this way, users can intuitively view the contribution of each type of material to the total size in the same component, reducing the need for manual calculation.

[0053] After the user completes the selection of materials through the first or second component, the electronic device 110 updates the material usage status indicated by each element in the updated description information based on the user's operation, thus obtaining the updated description information. The following is combined with... Figure 6 To describe the state changes of each element in the updated description information.

[0054] Figure 6 This diagram illustrates the interface 600 after the material usage status has been updated. (For example...) Figure 6 As shown, electronic device 110 writes the usage status of each material to the corresponding element in the description information according to media type. For example, element 235 originally indicated that all materials of the media object were used. After the update, it includes indication information 620, such as "Video not used," indicating that audio materials in the media object are not involved in the generation, while other types of materials remain in use. Elements 605 and 615 are updated to present "Removed" indication information, indicating that none of the materials contained in the corresponding media object are involved in the generation. Element 610 is updated to include "Audio not used" indication information, indicating that video materials in the media object are not involved in the generation.

[0055] In some cases, the update of an element's usage status may also include other changes. For example, when a visual material in a media object is not selected, the element may display a "Visual Unused" indicator. When some materials in a media object are selected while others are not, the element may contain multiple indicators, each indicating the usage status of a different material. As another example, when a user deselects a material in the first or second component, the indicator for that material changes from "Normal" to "Unused." When the user re-enables a material, the indicator changes from "Unused" back to "Normal." It should be understood that the above examples are merely illustrative; the specific state changes of elements depend on the user's choices within each component, and this document does not impose any limitations on this.

[0056] In this way, users can intuitively identify which materials are not being used and why, without having to switch back and forth between description information and material management interface.

[0057] In some cases, the first description also includes a third element corresponding to the second media object. This third element indicates that the individual materials included in the second media object are not used to generate media content. When all materials of the media object are not involved in the generation, the corresponding element is still retained in the description, indicating a "removed" status so that the user can identify the affected location in the description. The user can trigger a fourth action on the third element, such as clicking the delete control, to remove the third element from the description.

[0058] After the description information is updated, users can also directly trigger operations on elements within the description information to further adjust the usage status of the material. The following combines... Figure 7 This describes the interactive process of updating the usage status of materials in the description information.

[0059] Figure 7 A schematic diagram of an interface 700 for updating the usage status of materials in the description information is shown.

[0060] like Figure 7 As shown, the elements in the first description information are interactive. Users can trigger operations on the indication information in the elements to update the usage status of the corresponding materials. For example, the removed element 605 corresponds to a media object, and none of the materials contained in this media object participate in the generation. Users can trigger a fourth operation on this element, such as clicking the delete control 705 to remove this third element from the description information. As another example, element 620 includes the "Audio Unused" indication information, indicating that the corresponding audio type material does not participate in the generation. Users can trigger the restore usage operation 710 on this indication information to update the usage status of the material from unused to used.

[0061] In some situations, users can also trigger different types of actions on other indicators within an element. For example, for an indicator in a "visually unused" state, a user can trigger a "restore" action to reuse the visual material in generating media content. Similarly, for a removed element, in addition to triggering a delete action to completely remove it from the description, a restore action can be triggered to reinstate all materials of that media object into the generation scope. It should be understood that the specific interactive actions supported by an element depend on its current indicated usage state; the actions that can be triggered may differ in different states, and this document does not impose any restrictions on this.

[0062] In this way, users can complete the correction operation in the original position of the description information without having to jump to a separate material management interface, thus reducing the number of interface jumps.

[0063] In some cases, a single element can include multiple indicator messages, each corresponding to different materials within the same media object. For example, a character media object can include visual and audio materials. The element corresponding to this character can contain two indicator messages: one indicating the usage status of the character's visual materials, and the other indicating the usage status of the character's audio materials. Users can trigger separate operations on different indicator messages. In other words, the indicator messages for different materials within the same element can be operated on independently without affecting each other. For example, a user can trigger a first operation on the audio material's indicator message, updating it from "Audio Unused" to "Normal" to restore the audio material's participation; simultaneously, a third operation can be triggered on the visual material's indicator message, updating it from "Normal" to "Visual Unused" to remove the visual material. The operations on each indicator message are independent of each other; updating one indicator message will not affect the usage status indicated by other indicator messages within the same element.

[0064] When a user triggers an action on a certain instruction, the usage status of the corresponding media is updated. In response to this update, the electronic device 110 re-verifies whether the media referenced in the current description meets the usage conditions. If the verification passes, the elements in the description remain in the updated state, and the user can continue to edit the script or trigger generation. If the verification fails, for example, if the user restores a certain media causing the media type to exceed the allowed range again, the above verification and selection process will be re-entered the next time the user triggers a generation operation, prompting the user to adjust the media configuration again.

[0065] In some cases, the first descriptive information may also include a fourth element. This fourth element corresponds to the same media object as the first element, but is located in a different position within the descriptive information. For example, the same character may be referenced multiple times in different positions within the script, each reference corresponding to a separate element. The fourth element includes fifth indication information, which indicates the fifth usage state of the same material, different from the first usage state. When the user performs a first operation on the first element, the fifth indication information in the fourth element remains unchanged. That is, usage state indications for the same media object in different positions within the descriptive information can exist independently and without affecting each other. For example, if the user performs a remove operation on the visual material of the character at the beginning of the script, the indication information for the same visual material of the character at the end of the script will still retain its original usage state and will not change due to the former operation.

[0066] In this way, users no longer need to search and manipulate multiple controls separately to adjust the usage status of different materials within the same media object. They can centrally manage different materials within a single element, reducing operational steps. Simultaneously, elements in different positions within the description information of the same media object maintain their own indications without affecting each other. This allows users to configure materials differently for the media object in different script contexts, eliminating the need to re-check and correct configurations in other positions after adjusting the status of one position, thus improving editing efficiency in multi-position referencing scenarios.

[0067] After the material usage status is updated, when the user triggers the generation operation, the electronic device 110 generates media content based on the updated description information. The following is combined with... Figures 8A to 8B To describe the generated result.

[0068] Figure 8A The updated description information interface 800A is shown. Figure 8B The interface 800B, which is generated based on the updated description information, is shown.

[0069] like Figure 8A As shown, in the updated description information editing area 805, the material usage status indicated by each element is consistent with the actual set of materials involved in the generation. The "Generate Video" button 810 is in a triggerable state; after the user clicks it, the electronic device 110 generates media content based on the material usage status indicated by each element in the current description information. In some cases, a "Save" button and a "Cancel" button may also be presented before the "Generate Video" button 810 is presented. For example, the user can first save the material usage status configuration in the current description information for subsequent editing, or cancel the current generation operation and discard unsaved changes. The user's triggering of the "Save" button allows the electronic device 110 to store the current description information and the material usage status indicated by each element, while the triggering of the "Cancel" button allows the electronic device 110 to close the current interface or restore to the previously saved state without generating media content. It is understood that the functions and layout of the above buttons are only illustrative examples and can be adjusted according to needs in other embodiments; this document does not impose any limitations on them.

[0070] like Figure 8BAs shown, the electronic device 110 generates media content based on the updated description information, presenting storyboard content 815. Storyboard content 815 only includes materials marked as usable in the description information. For example, visual materials selected to be retained by the user in the selection component appear in the storyboard content, while audio materials belonging to the same media object but marked as "audio unused" are not included in the generated result. All materials of media objects marked as "removed" are also excluded from generation. In this way, storyboard content 815 corresponds one-to-one with the currently valid material configuration in the description information.

[0071] Figure 9 A schematic diagram of an example flow 900 for interface interaction is shown, based on some scenarios.

[0072] like Figure 9 As shown, process 900 describes the complete closed loop from user-triggered generation to the final completion of media content generation. This process includes a verification phase, a material selection phase, a status write-back phase, and an in-situ correction phase.

[0073] At the beginning of the process, the user has completed script creation and media object configuration, triggering the "Generate" operation. Electronic device 110 then verifies all materials referenced in the current script, checking whether the materials of each media type meet the corresponding usage conditions.

[0074] The verification results may fall into several categories. If all media types' materials meet their corresponding usage conditions, and the total size of all materials meets the total size requirement, the verification passes, and the electronic device 110 directly enters the generation stage, generating media content based on the current description information. If materials of a certain media type do not meet their corresponding usage conditions, for example, the number of visual materials exceeds the allowed upper limit for that type, the electronic device 110 enters the material selection stage, presenting the first component, listing all referenced materials of that type, and guiding the user to select the materials to keep. The user's selection is constrained by the usage conditions of that type; when the selected quantity reaches the upper limit, the remaining options become unselectable. After the user completes the selection, the unselected materials will be removed. If materials of multiple media types do not meet their respective usage conditions, the electronic device 110 merges the processing of multiple types exceeding limits in the same component, presenting material selection areas for each type in the component, allowing the user to complete the selection operation individually in each area. If materials of each media type meet their respective usage conditions, but the total size of all materials does not meet the total size requirement, the electronic device 110 presents the second component, listing all referenced materials and their respective sizes, with the cumulative size displayed at the bottom in real time. Users can remove some materials or adjust the size of materials to meet the total size requirement. The cumulative size is updated in real time, and users can confirm the current configuration when the total size requirement is met.

[0075] After the user completes the selection of materials, the status write-back phase begins. The electronic device 110 writes the usage status of each material back to the corresponding element in the description information based on the user's selection in the selection component. For materials selected by the user to keep, the corresponding element remains in a normal state; for materials not selected by the user, the corresponding element is updated to the corresponding unused state, such as "Audio Unused," indicating that the material will not participate in the generation; when all materials of a media object are not selected, the corresponding element is updated to the "Removed" state.

[0076] After the status write-back is complete, the in-situ correction phase begins. Users can directly trigger operations on elements within the description information to further adjust the usage status of the materials. For example, triggering a "restore use" operation on an element in the "audio unused" state will reuse the material to generate media content; triggering a "delete" operation on an element in the "removed" state will completely remove the element from the description information. When a user triggers an operation on a certain instruction, the electronic device 110 re-verifies whether the materials referenced in the current description information meet the usage conditions. If the verification fails, the above verification and selection process will be re-entered the next time the user triggers a generation operation. If the verification passes, the status of each element in the script will return to normal.

[0077] Through the above process, users can experience a complete closed loop of verification, selection, status write-back, and in-situ correction after generation and triggering. Ultimately, this ensures that the material usage status indicated by each element in the description information is consistent with the actual set of materials involved in the generation, thereby ensuring that the generated media content meets the user's creative intent.

[0078] In some scenarios, the above approach can also be applied to conversational creation scenarios. For example, when a user engages in multi-turn dialogues with an agent to create a script, the agent can embed elements into the generated content, allowing the user to adjust the usage status of the materials through interaction with these elements. Alternatively, during agent-assisted creation, the agent can proactively suggest adjustments to the usage status of certain materials based on the user's current material configuration and generation needs, and directly provide interactive elements within the dialogue content for the user to manipulate. It should be understood that the above application scenarios are merely illustrative and not restrictive. This approach can also be applied to other scenarios requiring a combination of descriptive information and material references, such as presentation creation, web page content editing, and interactive story creation; this document does not impose any limitations on these applications.

[0079] Figure 10 A flowchart of an example process 1000 for interface interaction is shown, based on some scenarios. Process 1000 can be implemented at electronic device 110. See below for reference. Figure 10 To describe process 1000.

[0080] like Figure 10As shown, in box 1010, electronic device 110 presents first description information. The first description information is used to generate first media content. The first description information includes a first element, which corresponds to a first media object. The first media object includes multiple materials. The first element indicates the first usage state of the first material. The first material is one of the multiple materials.

[0081] In frame 1020, electronic device 110 receives a first operation and updates the first element to indicate a second usage state of the first material, the second usage state being different from the first usage state.

[0082] Using the above method, users can update the usage status of materials in the original location of the description information, reducing the number of interface jumps and operation steps.

[0083] In some cases, the first element includes first indication information indicating a first usage state, and updating the first element to indicate a second usage state of the first material includes updating the first indication information in the first description information to second indication information indicating a second usage state of the first material. In this way, users can intuitively identify changes in the material's usage state through changes in the indication information within the element, reducing the interactive steps required for users to view and understand the material's status.

[0084] In some cases, the usage status includes at least one of the following: the corresponding material is not used to generate the first media content; all of the corresponding material's content is used to generate the first media content; or a portion of the corresponding material's content is used to generate the first media content. In this way, based on the above solution, the usage status is differentiated in a finer granular manner, allowing users to accurately understand the usage of the material and reducing the need for users to perform additional viewing operations to confirm the specific method by which the material is used in the generation process.

[0085] In some cases, the electronic device 110 can, before presenting the first descriptive information, further include: receiving at least one second operation, the at least one second operation being used to configure the corresponding usage state of one or more materials in at least one media object, the at least one media object being used to generate first media content and including the first media object. In this way, based on the above scheme, the user can pre-configure the usage state of the materials before presenting the descriptive information, reducing the number of steps required for the user to adjust the state after the descriptive information is presented.

[0086] In some scenarios, the electronic device 110 may receive at least one second operation including: presenting a first component, the first component including information corresponding to a plurality of first materials, the plurality of first materials belonging to one or more materials, and the plurality of first materials having a first media type; and receiving at least one second operation through the first component, the at least one second operation selecting at least one first material from the plurality of first materials to generate first media content. In this way, based on the above scheme, by presenting a dedicated selection component for materials of a specific media type, users can focus on selecting materials of that type, reducing the number of steps required to switch between viewing different types of materials.

[0087] In some cases, the electronic device 110 may present a first component by responding to multiple first materials not meeting a first usage condition, wherein the first usage condition is set for materials of a first media type. In this way, based on the above scheme, the presentation of the selection component is triggered by materials of a specific media type not meeting the usage condition, avoiding presenting unnecessary selection interfaces to the user when the materials are not in violation of the condition, and reducing redundant interactive elements for the user.

[0088] In some cases, the media type of the material includes at least one of the following: visual, audio, or multimodal. In this way, based on the above scheme, the media type of the material is clearly categorized and defined, enabling the electronic device 110 to process materials by type during verification and selection, reducing the logical complexity when mixing different types of material.

[0089] In some scenarios, the electronic device 110 can receive at least one second operation, including: presenting a second component, the second component including information corresponding to one or more media; and receiving at least one second operation through the second component, the at least one second operation instructing at least one of the following: removing one or more media, or resizing one or more media. In this way, based on the above-described scheme, by presenting a second component containing all media information, users can uniformly manage media in terms of total quantity, supporting both media removal and media resizing operations, reducing situations where users are forced to abandon desired media due to only having a single removal option.

[0090] In some cases, presenting information corresponding to each material is a response to the fact that: the materials corresponding to different media types within each material meet their respective usage conditions, and the total size of all materials does not meet the usage requirements. In this way, based on the above solution, it is clarified that the second component is presented when each type meets its individual conditions but the total size does not meet the requirements. Users only need to reduce a small number of materials to meet the total size requirement, reducing the need to reselect all materials.

[0091] In some cases, the electronic device 110 can present second descriptive information, which includes a second element corresponding to a first media object, indicating that multiple materials are used to generate the first media content; and present prompt information indicating that at least one media type of material does not meet the usage conditions, wherein at least one media object includes at least one media type of material, and the first descriptive information is obtained by updating the second descriptive information based on at least one second operation. In this way, based on the above scheme, by presenting the original descriptive and prompt information before the update, the user can understand the reason and background of the update, reducing the number of steps the user takes to navigate between exceeding limits, making choices, and viewing results.

[0092] In some cases, the first element includes first and third instruction information. The first instruction information indicates a first usage state, and the third instruction information indicates a third usage state of a second material, which is a different material from the first material among multiple materials. In this way, based on the above scheme, the usage state information of different materials within the same media object can be presented simultaneously within the same element, allowing users to understand the usage status of each material within a single element, reducing the number of viewing operations.

[0093] In some scenarios, the electronic device 110 can perform a first operation triggered by a first indication message, and the method further includes: receiving a third operation to update the third indication message in the first element to a fourth indication message, wherein the third operation is triggered by the third indication message, and the fourth indication message indicates a fourth usage state of the second material, which is different from the third usage state. In this way, based on the above scheme, the user can trigger separate operations for the indication messages of different materials within the same element, achieving fine-grained control over the usage states of different materials within the same media object and reducing the number of interface jumps.

[0094] In some cases, the first description information also includes a third element, which corresponds to the second media object. This third element indicates that the various materials included in the second media object are not used to generate the first media content. In this way, based on the above scheme, when all materials of the media object are not involved in the generation, the description information still retains the corresponding element and uses this element to indicate the removed state, allowing users to identify the affected locations in the description information and reducing the time overhead of location operations.

[0095] In some cases, a fourth operation is received for the third element, removing the third element from the first description information. In this way, based on the above scheme, users can trigger a deletion operation on an element that has been removed, completely removing the element from the description information and reducing the risk of accidental operation.

[0096] In some cases, the first description information also includes a fourth element, which corresponds to the first media object. The first and fourth elements are located in different positions within the first description information. The fourth element includes fifth indication information, which indicates a fifth usage state of the first material, which is different from the first usage state. In this way, based on the above scheme, the same media object can have different usage state indications in different positions within the description information, reducing the number of jump operations required by users to view the usage state of the same media object in different positions.

[0097] In some cases, electronic device 110 can respond to the first operation by maintaining the presentation of the fifth indication information in the fourth element. In this way, based on the above scheme, when the user performs an operation on an element at a certain location, the elements in other locations in the description information corresponding to the same media object retain their original indication information, reducing the number of operation steps that the user needs to check and correct due to unexpected association changes.

[0098] A corresponding apparatus for implementing the above methods or processes is also provided.

[0099] Figure 11 Block diagrams of a device 1100 for user interface interaction are shown in several scenarios. Device 1100 can be implemented as or included in electronic device 110. Various modules / components in device 1100 can be implemented by hardware, software, firmware, or any combination thereof.

[0100] like Figure 11 As shown, the device 1100 includes a description information presentation module 1110, configured to present first description information, which is used to generate first media content. The first description information includes a first element, which corresponds to a first media object. The first media object includes multiple materials, and the first element indicates a first usage state of the first material. The first material is one of the multiple materials. The device also includes a status update module 1120, configured to receive a first operation and update the first element to indicate a second usage state of the first material, which is different from the first usage state.

[0101] In some cases, the first element includes first instruction information indicating a first usage state, and updating the first element to indicate a second usage state of the first material includes updating the first instruction information in the first description information to second instruction information indicating a second usage state of the first material.

[0102] In some cases, the status update module 1120 can also be configured to use a status that includes at least one of the following: the corresponding material is not used to generate the first media content, all the content of the corresponding material is used to generate the first media content, and part of the content of the corresponding material is used to generate the first media content.

[0103] In some cases, the description information presentation module 1110 may also be configured such that, before presenting the first description information, the method further includes: receiving at least one second operation, the at least one second operation being used to configure the corresponding usage state of one or more materials in at least one media object, the at least one media object being used to generate first media content and including the first media object.

[0104] In some cases, the state update module 1120 may also be configured to receive at least one second operation including: presenting a first component, the first component including information corresponding to a plurality of first materials, the plurality of first materials belonging to one or more materials, the plurality of first materials having a first media type; and receiving at least one second operation through the first component, the at least one second operation selecting at least one first material from the plurality of first materials to generate first media content.

[0105] In some cases, the description information presentation module 1110 may also be configured to present a first component including: in response to multiple first materials not meeting a first usage condition, presenting the first component, wherein the first usage condition is set for materials of a first media type.

[0106] In some cases, the status update module 1120 can also be configured for media types of materials including at least one of the following: visual type, audio type, and multimodal type.

[0107] In some cases, the status update module 1120 may also be configured to receive at least one second operation including: presenting a second component, the second component including information corresponding to one or more materials respectively; and receiving at least one second operation through the second component, the at least one second operation indicating at least one of the following: removing one or more materials, resizing one or more materials.

[0108] In some cases, the description information presentation module 1110 can also be configured to present information corresponding to each material in response to: the materials corresponding to different media types in each material meet the corresponding usage conditions, and the total size of each material does not meet the usage requirements.

[0109] In some cases, the description information presentation module 1110 may also be configured to present second description information, which includes a second element corresponding to the first media object, the second element indicating that multiple materials are used to generate the first media content; and to present prompt information indicating that at least one type of material does not meet the usage conditions, at least one media object including at least one type of material, wherein the first description information is obtained by updating the second description information based on at least one second operation.

[0110] In some cases, the first element includes a first instruction message and a third instruction message. The first instruction message indicates a first usage state, and the third instruction message indicates a third usage state of the second material. The second material is a material that is different from the first material among multiple materials.

[0111] In some cases, the status update module 1120 can also be configured such that the first operation is triggered in response to the first indication information, and the method further includes: receiving a third operation to update the third indication information in the first element to a fourth indication information, wherein the third operation is triggered in response to the third indication information, and the fourth indication information indicates a fourth usage state of the second material, the fourth usage state being different from the third usage state.

[0112] In some cases, the first description information also includes a third element, which corresponds to the second media object, indicating that the various materials included in the second media object are not used to generate the first media content.

[0113] In some cases, the state update module 1120 can also be configured to receive a fourth operation for the third element, removing the third element from the first description information.

[0114] In some cases, the first description information also includes a fourth element, which corresponds to the first media object. The first element and the fourth element are located in different positions in the first description information. The fourth element includes fifth instruction information, which indicates a fifth usage state of the first material, which is different from the first usage state.

[0115] In some cases, the state update module 1120 can also be configured to maintain the presentation of the fifth indication information in the fourth element in response to the first operation.

[0116] The modules included in device 1100 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some cases, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 1100 can be implemented at least partially by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on.

[0117] Figure 12 A block diagram of an electronic device 1200 in which one or more examples can be implemented is shown. It should be understood that... Figure 12 The electronic device 1200 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 12 The illustrated electronic device 1200 can be used to implement the electronic device 110 discussed above.

[0118] like Figure 12 As shown, electronic device 1200 is in the form of a general-purpose electronic device. Components of electronic device 1200 may include, but are not limited to, one or more processing units or processors 1210, memory 1220, storage device 1230, one or more communication units 1240, one or more input devices 1250, and one or more output devices 1260. Processor 1210 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 1220. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 1200.

[0119] Electronic device 1200 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 1200, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 1220 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof). Storage device 1230 can be removable or non-removable media and may include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 1200.

[0120] Electronic device 1200 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 12 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 1220 may include computer program product 1225 having one or more program modules configured to perform various methods or actions of various examples.

[0121] The communication unit 1240 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 1200 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 1200 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.

[0122] Input device 1250 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 1260 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 1200 can also communicate with one or more external devices (not shown) via communication unit 1240 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 1200, or with any device that enables electronic device 1200 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0123] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0124] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0125] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0126] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0127] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0128] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A user interface interaction method, comprising: Presenting first description information, the first description information is used to generate first media content, wherein the first description information includes a first element, the first element corresponds to a first media object, the first media object includes multiple materials, the first element indicates a first usage state of the first material, and the first material is one of the multiple materials; Upon receiving a first operation, the first element is updated to indicate a second usage state of the first material, the second usage state being different from the first usage state.

2. The method of claim 1, wherein the first element includes first indication information, the first indication information indicating the first usage state, and updating the first element to indicate a second usage state of the first material includes: The first indication information in the first description information is updated to the second indication information, which indicates the second usage status of the first material.

3. The method according to claim 1, further comprising: Receive at least one second operation, the at least one second operation being used to configure the corresponding usage state of one or more materials, the one or more materials being materials included in at least one media object, the at least one media object being used to generate the first media content and including the first media object.

4. The method of claim 3, wherein receiving the at least one second operation comprises: A first component is presented, the first component including information corresponding to a plurality of first-type materials, the plurality of first-type materials belonging to the one or more materials, the plurality of first-type materials having a first media type; as well as The first component receives at least one second operation, wherein the at least one second operation selects at least one first type material from the plurality of first type materials to generate the first media content.

5. The method of claim 4, wherein presenting the first component comprises: In response to the plurality of first-type materials not meeting the first usage condition, the first component is presented, wherein the first usage condition is set for materials of the first media type.

6. The method of claim 3, wherein receiving the at least one second operation comprises: A second component is presented, the second component including information corresponding to each of the one or more materials; as well as The at least one second operation is received by the second component, the at least one second operation indicating at least one of the following: removing one or more materials, or resizing one or more materials.

7. The method of claim 3, further comprising: Presenting second descriptive information, the second descriptive information includes a second element, the second element corresponds to the first media object, and the second element indicates that all of the plurality of materials are used to generate the first media content; as well as A prompt message is displayed indicating that at least one media type of material does not meet the usage conditions, and the at least one media object includes material of the at least one media type. The first description information is obtained by updating the second description information based on the at least one second operation.

8. The method according to claim 1, wherein the first element includes first indication information and third indication information, the first indication information indicating the first usage state, the third indication information indicating the third usage state of the second material, and the second material being a material different from the first material among the plurality of materials.

9. The method of claim 8, wherein the first operation is triggered in response to the first indication information, and the method further comprises: A third operation is received, which updates the third indication information in the first element to a fourth indication information. The third operation is triggered in response to the third indication information. The fourth indication information indicates a fourth usage state of the second material, which is different from the third usage state.

10. The method of claim 1, wherein the first description information further includes a third element, the third element corresponding to a second media object, the third element indicating that the various materials included in the second media object are not used to generate the first media content.

11. The method according to claim 1, wherein the first description information further includes a fourth element, the fourth element corresponding to the first media object, the first element and the fourth element being located at different positions in the first description information, the fourth element including fifth indication information, the fifth indication information indicating a fifth usage state of the first material, the fifth usage state being different from the first usage state.

12. The method of claim 11, further comprising: In response to the first operation, the fifth indication information is maintained in the fourth element.

13. A device for interface interaction, comprising: The description information presentation module is configured to present first description information, which is used to generate first media content. The first description information includes a first element, which corresponds to a first media object. The first media object includes multiple materials, and the first element indicates a first usage state of the first material. The first material is one of the multiple materials. The status update module is configured to receive a first operation and update the first element to indicate a second usage status of the first material, wherein the second usage status is different from the first usage status.

14. An electronic device, comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions executable by the at least one processor, which, when executed by the at least one processor, cause the electronic device to perform the method according to any one of claims 1 to 12.

15. A computer-readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, implement the method according to any one of claims 1 to 12.

16. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 12.

Images