Methods, apparatuses, devices, media, and products for interface interaction

Abstract

The present disclosure relates to methods, apparatuses, devices, media and products for interface interaction. The method includes displaying first text content and at least one slot in a first interface; wherein the at least one slot is used to fill media content, the first text content includes at least one slot identifier, the at least one slot identifier corresponds to the at least one slot, and the first text content and the media content filled in the at least one slot are used to generate first media content. The method further includes receiving a first operation, the first operation is triggered for a first slot identifier, the first slot identifier is one of the at least one slot identifier in the first text content, and the first slot identifier corresponds to a first slot of the at least one slot. The method further includes displaying at least one candidate media content, the at least one candidate media content is available to fill the first slot. Through the method, the convenience of content creation can be improved, the interest of users in creation can be increased, and the interactive experience of users can be improved.

Description

Technical Field

[0001] This article generally covers the field of interface interaction, specifically methods, devices, equipment, media, and products used for interface interaction. Background Technology

[0002] With the continuous development of short video, text and image content platforms, and interactive communities, users can conveniently browse various media content on their devices. For ordinary viewers, content platforms offer a wealth of videos, images, text, and interactive information, enabling users to quickly access content of interest in scenarios such as leisure and entertainment, learning and reference, interest exploration, and social sharing. During browsing, users can interact with the content through watching, liking, commenting, saving, and sharing, thereby obtaining a more immersive and continuous content consumption experience.

[0003] In recent years, content platforms have seen a continuous enrichment of page formats and interaction methods. Users can browse relevant content around different themes, interests, or scenarios, and recreate existing media content based on their own creative needs, or even create content from scratch. This interactive approach allows users to become more immersed in content creation according to their own needs, and makes the platform's content more diverse. As a result, users can discover and create high-quality content more efficiently, enhancing the convenience, immersion, and participation in content creation. Summary of the Invention

[0004] This article provides a method, apparatus, device, medium, and product for interface interaction.

[0005] According to a first aspect of this document, a method for interface interaction is provided. The method includes displaying first text content and at least one slot in a first interface; wherein the at least one slot is used to fill media content, the first text content includes at least one slot identifier, the at least one slot identifier corresponding to at least one slot, and the first text content and the media content filled in the at least one slot are used to generate first media content. The method also includes receiving a first operation triggered in response to a first slot identifier, the first slot identifier being one of at least one slot identifiers in the first text content, the first slot identifier corresponding to a first slot among the at least one slots. The method further includes displaying at least one candidate media content, the at least one candidate media content being available to fill the first slot. This method can improve the convenience for users in content creation, increase user interest in creation, and also improve the user's interactive experience during the content creation process.

[0006] According to a second aspect of this document, an apparatus for interface interaction is provided. The apparatus includes an information display module configured to display first text content and at least one slot in a first interface; wherein the at least one slot is used to fill media content, the first text content includes at least one slot identifier, the at least one slot identifier corresponding to at least one slot, and the first text content and the media content filled in the at least one slot are used to generate first media content; a first operation receiving module configured to receive a first operation triggered by a first slot identifier, the first slot identifier being one of at least one slot identifiers in the first text content, the first slot identifier corresponding to a first slot among the at least one slots; and a content display module configured to display at least one candidate media content, the at least one candidate media content being available to fill the first slot. This apparatus can improve the convenience for users in content creation, increase users' interest in creation, and also improve the user's interactive experience during the content creation process.

[0007] In a third aspect of this document, an electronic device is provided, including at least one processor and a storage device for storing at least one program, which, when executed by the at least one processor, causes the at least one processor to implement the method according to the first aspect of this document. This electronic device can improve the convenience of content creation for users and increase their interest in creation when executing programs related to interface interaction, while also enhancing the user's interactive experience during the content creation process.

[0008] In a fourth aspect of this document, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the method according to the first aspect of this document. The program stored in this computer-readable storage medium allows the processor to improve the convenience of content creation for users, increase user interest in creation, and enhance the interactive experience during the content creation process.

[0009] In a fifth aspect of this document, a computer program product is provided. This computer program product includes a computer program that, when executed by a processor, implements the method according to the first aspect of this document. This computer program product can improve the convenience for users in content creation when the program is executed by a processor, increase user interest in creation, and also enhance the user's interactive experience during the content creation process.

[0010] It should be understood that the content described in this section is not intended to define the key or essential features of this document, nor is it intended to limit the scope of this document. Other features of this document will become readily apparent from the following description. Attached Figure Description

[0011] The above and other objects, features and advantages of this document will become more apparent from a more detailed description taken in conjunction with the accompanying drawings, wherein like reference numerals generally denote like parts.

[0012] Figure 1 The illustration shows a schematic diagram of an example environment in which the device and / or method may be implemented;

[0013] Figure 2 The diagram illustrates an example method of user interface interaction.

[0014] Figures 3A to 3B The illustration shows an example of enabling public keywords and reference images;

[0015] Figures 4A to 4C The illustration shows another example of enabling public keywords and reference images;

[0016] Figures 5A to 5E The illustration shows an example of following a subject when public keywords and reference images are disabled;

[0017] Figures 6A to 6H The illustration shows an example of following the subject when public keywords and reference images are enabled;

[0018] Figures 7A to 7C The illustration shows an example of generating media content;

[0019] Figures 8A to 8B The illustration shows examples of users following someone else's account and then following them again.

[0020] Figure 9 The diagram illustrates a schematic block diagram of a device used for interface interaction.

[0021] Figure 10 A schematic block diagram is shown for an example device used to implement the contents of this article. Detailed Implementation

[0022] It is understood that the data involved in this article (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0023] It is understandable that before using the technical content disclosed in this article, users should be informed of the type, scope of use, and usage scenarios of the personal information involved in this article in an appropriate manner in accordance with relevant laws and regulations, and their authorization should be obtained.

[0024] For example, upon receiving a user's proactive request, a prompt message can be sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as electronic devices, applications, servers, or storage media, that perform the operations described in this document.

[0025] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0026] It is understood that the above notification and user authorization process is merely illustrative and does not limit the implementation method described in this article. Other methods that comply with relevant laws and regulations may also be applied to the implementation method described in this article.

[0027] The present invention will now be described in more detail with reference to the accompanying drawings. While the drawings illustrate the contents of this document, it should be understood that this document can be implemented in various forms and should not be construed as limited to the contents set forth herein; rather, these contents are provided to provide a more thorough and complete understanding of the document. It should be understood that the drawings and contents of this document are for illustrative purposes only and are not intended to limit the scope of this document.

[0028] In this description, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0029] In existing content creation technologies, similar creation products (such as AI-powered creation products) typically do not establish a strong correlation between prompts and the materials used during the creation process. Some products support referencing materials within prompts, such as " Figure 1 "", Figure 2 However, there is a lack of linkage between the material references in the prompts and the material slots in the material area.

[0030] For example, in related technologies, when editing long prompts, it is difficult for users to batch replace or uniformly modify a certain material within the prompt area; in addition, the material slots and prompts cannot be adjusted synchronously, leading to problems such as inconsistent prompt references.

[0031] To address this, this paper proposes a user interface interaction method. In this method, a first interface displays first text content and at least one slot. The at least one slot is used to fill media content. The first text content includes at least one slot identifier, which corresponds to at least one slot. The first text content and the media content filled in the at least one slot are used to generate first media content. Then, a first operation is received, triggered by the first slot identifier, which is one of at least one slot identifiers in the first text content and corresponds to the first slot among the at least one slots. Finally, at least one candidate media content is displayed, which can be used to fill the first slot. This method associates and links the slot identifiers in the text content with the slots in the interface, thereby improving the convenience of content creation for users, increasing their interest in creation, and enhancing the user's interactive experience during the content creation process.

[0032] The following will describe this article in further detail with reference to the accompanying drawings. Figure 1 An example environment 100 is shown in which the devices and / or methods described herein may be implemented. Figure 1 As shown, environment 100 may include computing device 102 and application 104 running on computing device 102. Computing device 102 can display a corresponding interface, receive user operations, process interface data, and display processing results by running application 104.

[0033] Examples of computing device 102 include, but are not limited to, personal computers, server computers, handheld or laptop devices, mobile devices (such as mobile phones, personal digital assistants (PDAs), media players, etc.), multiprocessor systems, consumer electronics, minicomputers, mainframe computers, and distributed computing environments that include any of the above systems or devices. The application 104 running on the computing device may be a content platform application, a social application, a content creation application, a shopping application, an office application, a live streaming application, or a combined application that includes one or more of the above functions.

[0034] The steps performed by the computing device 102 in this article, such as interface display, information presentation, operation reception, data processing, content updating, page switching, and result display, can all be implemented by the application 104 running in the computing device 102, and will not be described in detail hereafter.

[0035] The above combination Figure 1 A schematic diagram illustrating an example environment in which the devices and / or methods described herein may be implemented is provided below. Figure 2 A diagram illustrating example methods of interface interaction based on this article. Figure 2 The method in can be derived from Figure 1The computing device 102, the application in the computing device 102, or any suitable device executes the application.

[0036] like Figure 2 As shown in example method 200, at box 202, first text content and at least one slot are displayed on the first interface. The at least one slot is used to fill media content. The first text content includes at least one slot identifier, which corresponds to at least one slot. The first text content and the media content filled in the at least one slot are used to generate first media content. The number of slots in the at least one slot can be set according to needs, for example, 3 or 4, or other numbers. The at least one slot identifier corresponds to and is displayed in an associative manner with the at least one slot. This method associates the slot identifiers in the text content with the slots, improving the convenience for users when creating content.

[0037] In one scenario, at least one slot identifier may be displayed as text content within the first text content of the first interface. In another scenario, at least one slot identifier may also be displayed as image content within the first text content of the first interface. Furthermore, at least one slot and the first text content may be located in different areas of the first interface; for example, at least one slot may be located in a first area of ​​the first interface, and the first text content may be located in a second area of ​​the first interface. Additionally, the first and second areas do not overlap.

[0038] In one scenario, at least one slot and the first text content correspond to the generated first media content. In another scenario, the media content and the first text content filling at least one slot can be applied to a media content generation model, such as using an artificial intelligence (AI) model, to generate the first media content. Additionally, the media content and the first text content filling at least one slot constitute prompt content for generating the first media content. After the prompt content is input to the AI ​​model, the AI ​​model generates the first media content. The AI ​​model can be any commercially available AIGC model, such as a large video generation model, a large image generation model, etc., and these large models can be multimodal large models. The first media content can be video content, image content, or text content.

[0039] In one scenario, the content filled in at least one slot is the material portion that generates the first media content, and the first text is the textual description prompt portion.

[0040] In one scenario, in each of at least one slot, if the media content being filled is an image, the image or a thumbnail of the image can be displayed in the slot. If the media content being filled is video, a frame from the video or a corresponding animated GIF can be displayed in the slot. Additionally, if a video frame is displayed, the video frame can be the first frame or a keyframe of the video.

[0041] At box 204, a first operation can be received. This first operation is triggered by a first slot identifier, which is one of at least one slot identifier in the first text content. The first slot identifier corresponds to the first slot among at least one slots. The user can perform operations on the slot identifiers in the first text content, such as performing various appropriate operations on the slot identifiers. For example, the first operation could be a click operation or a long press operation.

[0042] At box 206, at least one candidate media content can be displayed, which can be used to fill the first slot. Upon receiving the first operation, a window can be presented on the first interface, displaying various types of materials that can be filled, which can serve as at least one second media content.

[0043] In one scenario, when displaying at least one candidate media content, one could open the phone's local photo album interface to select from images or videos within the album. In another scenario, when displaying at least one candidate media content, one could display a media library outside the photo album, such as local files or a cloud-based media library, from which media content to be selected. These scenarios are for descriptive purposes only and are not intended to limit the scope of this document.

[0044] In one scenario, a second operation can also be received, triggered by a second media content among at least one candidate media content. In one example, after receiving a second operation on the second media content, the second media content can be displayed in a first slot on the first interface. Additionally, the second media content can be image content or video content. For example, after receiving a second operation on one media content among multiple images or videos in an album, the selected media content can be displayed in the first slot on the first interface. The second operation can be an operation to determine the selected media content; for example, the second operation can be at least one click operation or at least one other type of operation.

[0045] In one scenario, a third operation can be received. This third operation can be used to delete a second slot identifier from at least one slot identifier in the first text. The second slot identifier corresponds to the second slot in the at least one slot. After receiving the third operation, the display of the second slot identifier and the second slot itself can be removed from the first interface. In one example, after receiving the third operation, the second slot can be directly deleted from the first area containing at least one slot, and the corresponding second slot identifier will also be deleted from the first text content. This method allows for the deletion of interconnected slots and their identifiers, enhancing the convenience and efficiency of content creation for users. Furthermore, if the operation deletes the second slot, the corresponding slot identifier will no longer be displayed in the first text content.

[0046] In addition, multiple secondary media content items can be displayed in corresponding slots on the first interface. This method allows media content to be displayed in the corresponding slots, improving the efficiency of content creation for users.

[0047] In one scenario, the first interface is the interface displayed after triggering the recording of third media content. The first interface has at least one slot. This at least one slot includes a slot that is initially empty and a slot initially filled with fourth media content. For example, in the interface displaying third media content, a task to record third media content is triggered, and then the first interface is displayed. The fourth media content is reference content used to generate the third media content. The slot initially displayed as empty can be referred to as a first type of slot, and the slot initially filled with fourth media content can be referred to as a second type of slot. The media content filled in the first type of slot serves as key content when generating the first media content, and the media content filled in the second type of slot serves as reference content when generating the first media content. Therefore, the first interface can include a first type of slot for presenting key content and a second type of slot for presenting reference content.

[0048] In one context, key content refers to the main subject in a video or image, such as a person or animal, while reference content refers to environmental elements in the video or image, such as the scene in which the main subject is located, background images, and background music.

[0049] In one scenario, a fourth operation can also be received through the first interface. This fourth operation, triggered by the first interface, instructs the generation of first media content based on the first text content and media content filled in at least one slot. Then, a second interface is displayed, which is used to publish the first media content. Next, a fifth operation can be received, triggered by the second interface. This fifth operation sets whether, when the published first media content is followed by video recording, at least one of the following should be displayed: the first text content and media content filled in at least one slot. Additionally, the fifth operation sets whether, when the first media content is followed by video recording, the first text content and media content in a second type of slot should be displayed. For example, this fifth operation is performed on a control in the second interface, which can control whether the first text content and media content in a second type of slot are displayed. Additionally, the at least one slot includes a first type of slot and a second type of slot. The media content filled in the first type of slot serves as key content when generating the first media content, and the media content filled in the second type of slot serves as reference content when generating the first media content.

[0050] In one scenario, the display of the first text content and the media content filling at least one slot can be set by the publisher when publishing the first media content, or it can be set by the publisher after the first media content has been published. For example, a third interface can also be displayed, which is a settings interface for the published first media content. The third interface can be a settings interface for the first media content, displayed by clicking an advanced settings control on a previous page. The third interface includes a control for controlling whether to display the first text content and reference content identifying the first media content. An operation on the control can be received, and the operation on the control can display the control switching from a second state to a first state or from a first state to a second state in the third interface. In one example, the control can include a first state and a second state; the first state of the control can be an on state, which allows the display of the first text content and reference content identifying the first media content, and the second state of the control can be a off state, which disables the display of the first text content and reference content identifying the first media content.

[0051] In one scenario, the first interface can be an editing interface for the first media content. In this case, while displaying at least one slot and the first text content on the first interface, a sixth operation can also be received. This sixth operation is used to add a third slot to the first interface. For example, after clicking "Add Material" on a slot marked with the option to add material, an additional slot is created, including the added material, and another slot for adding material is subsequently displayed. At this point, a third slot can be added to the first interface, and a third slot identifier can be added to the first text content. This third slot identifier corresponds to the third slot, and the media content filled in the third slot is also used to generate the first media content.

[0052] In one scenario, further operations can be performed based on the content displayed on the first interface. For example, a seventh operation can be received, triggered for one of the at least one slot. After receiving the seventh operation, at least one third media content can be displayed on the first interface. Then, an eighth operation can be received, triggered for the third media content among the at least one third media content, and subsequently, the third media content is displayed in that slot. In one example, after clicking the slot, at least one media content from the corresponding media library can be displayed, and then, after receiving an operation to click on media content, the corresponding media content is displayed in that slot.

[0053] In one scenario, during content tracking, if the publisher of the first media content is the same as the publisher of the third media content, controls can be displayed on the first media content's publishing interface to control the display of the first text content and reference content. For example, if user A creates third media content, and user A tracks the third media content to generate first media content, user A can control whether the first media content publicly displays its first text content and reference content. In another scenario, if the publisher of the first media content is different from the publisher of the third media content, and the first text content and reference content are modified, controls can be displayed on the first media content's publishing interface to control the display of the modified first text content and modified reference content. For example, if user A creates third media content, and user B tracks the third media content to generate first media content and modifies the first text content and reference content, user B can control whether the first media content publicly displays the modified first text content and modified reference content. In another scenario, if the publisher of the first media content is different from the publisher of the third media content, and the first text content and reference content have not been modified, the controls for controlling the display of the first text content and the reference content should be disabled on the publishing interface of the first media content. For example, if user A creates third media content, and user C generates first media content by following the third media content without modifying the first text content and reference content, user C cannot control whether the first media content makes the first text content and reference content public.

[0054] This method can link and interact slot markers in text content with slots in the interface, thereby improving the convenience of content creation for users, increasing their interest in creation, and enhancing their interactive experience during the content creation process.

[0055] The above combination Figure 2 The diagram below illustrates the example methods of the interface interaction described in this article. Figure 3A and Figure 3B This document describes an example of an open keyword and reference figure based on the description in this article. Figure 3A and Figure 3B The example shown can be achieved by running the corresponding application on a computing device.

[0056] In the AI-generated content creation process, if the platform directly displays the prompts, reference images, or reference videos used during the AI ​​creation process to other users—meaning that if the system publicly discloses the keywords used to generate media content or effects by default—other users can directly copy or reuse the publisher's prompts. This makes it difficult for publishers to protect their creative methods and assets, especially for top creators, commercial creators, or users who spend a lot of time debugging prompts. Displaying the original reference images and videos by default may leak the creator's material assets, and inconsistencies between the displayed content and the materials used in the actual generation process can easily lead to user misunderstanding. To avoid these problems, the following diagram illustrates improvements to prevent them.

[0057] like Figures 3A to 3B As shown in Example 300A, a schematic diagram illustrates enabling public keywords and reference images. In Interface 302, before creating and publishing content, actions such as clicks can be received on Control 304.

[0058] Subsequently, the interface of Example 300B is displayed, showing several operable controls. Control 306 is used to turn the "Public AI Keywords and Reference Images" function on or off. Users can manipulate control 306 to control its on / off state as needed. In one example, when the user is the publisher of a work, the display of AI keywords and reference images is adjusted when publishing the work. In another example, when multiple works by the same user use the same AI keywords and reference images, and the user is the author of the AI ​​keywords and reference images, the on / off state of control 306 remains consistent across all works; that is, all controls 306 are either all on or all off.

[0059] In one scenario, User A writes prompt content 1, generates work 1 based on prompt content 1, and sets prompt content 1 to be public when publishing work 1. User B follows up with work 1 and generates work 2, without modifying prompt content 1. In this case, published work 2 will have prompt content 1 publicly visible by default, and User B cannot modify this public setting. When User A follows up with work 1 and generates work 3, User A can control whether the prompt content of work 3 is made public. If User C follows up with work 1 but modifies the prompt content and generates work 4, User C can control whether the prompt content of work 4 is made public.

[0060] This method allows users to control whether others are allowed to use AI keywords and reference images of their works in the follow-up shooting mode before the work is published, based on their needs, thus protecting the originality and corresponding rights of users as content creators.

[0061] The above combination Figure 3Aand Figure 3B The following is a schematic diagram illustrating an example of enabling public access to keywords and reference figures based on this article; combined with... Figures 4A to 4C This diagram illustrates another example of enabling public keywords and reference images, and Figures 4A to 4C The example shown could be achieved by a computing device running a corresponding application.

[0062] like Figures 4A to 4C As shown, in Example 400A, control 404 exists in interface 402. Users can set the public status of published works. For example, after receiving an operation on control 404, the user can enter the interface in Example 400B. In the interface of Example 400B, in addition to setting work permissions, users can also access advanced settings by operating control 406.

[0063] Subsequently, upon receiving an operation on control 406, you can enter the interface of example 400C. Within example 400C, you can manipulate control 408 as needed to enable or disable the "Publicize AI Keywords and Reference Images" function. It should be noted that the on / off state of control 408 is enabled by default.

[0064] This method allows users to control whether others are allowed to use AI keywords and reference images of their work in follow-up mode after it has been published, based on their needs, thus protecting the originality and corresponding rights of users as content creators.

[0065] The above combination Figures 4A to 4C This diagram illustrates another example of enabling public keywords and reference images. Below, we combine... Figures 5A to 5E A diagram illustrating an example of following a subject when public keywords and reference images are disabled, and... Figures 5A to 5E The example shown can be achieved by a computing device running a corresponding application.

[0066] like Figures 5A to 5E As shown in Example 500A, after receiving an operation on control 502, the function "Publicize AI Keywords and Reference Images" is switched to the off state. It should be noted that operating on control 502 does not redirect to other pages; it only toggles the state of the "Publicize AI Keywords and Reference Images" function. In Example 500B, after a work is published, when other users are creating follow-up videos, they can enter the editing interface of their follow-up videos, where the effect name is displayed, such as "Template One". During the editing process of other users, operations on control 504 can be received in Example 500B.

[0067] Subsequently, in Example 500C, only the identifier of the work is displayed, such as Template 1, and the main slots corresponding to the main materials used in that work can be further displayed. For example... Figure 1 The indicated slot 506 is empty. At this time, an operation on slot 506 can be received, which in turn displays the interface of example 500D in the user interface. The interface of example 500D includes multiple pictures and / or videos from the system album. Then, a selection operation on material 9 508 is received, and an operation on control 510 is received.

[0068] Finally, after receiving an operation on control 510, the interface of example 500E is entered, at which point material 9 is displayed in slot 506. If the user receives an operation to generate content, material 9 can be used to update template 1 to generate new content.

[0069] This method allows users to create their own prompts, images, videos, or other thematic content or reference materials when the AI ​​keyword and reference image functions are not enabled during the filming process, thus protecting the rights of the original authors of the keywords and reference images.

[0070] The above combination Figures 5A to 5E This illustration depicts an example of following a subject when public keywords and reference images are disabled. The following section combines... Figures 6A to 6G This illustration shows an example of following a subject when public keywords and reference images are enabled. Figures 6A to 6G The examples shown all demonstrate how computing devices achieve this by running corresponding applications.

[0071] like Figures 6A to 6G As shown in Example 600A, after receiving an operation on control 602, the function "Publicize AI Keywords and Reference Images" is switched to the off state. It should be noted that operating on control 602 does not redirect to other pages; it only toggles the state of the "Publicize AI Keywords and Reference Images" function. In Example 600B, when other users are filming, they can enter the filming editing interface, which can display media content or effects "Template 1." While other users are editing "Template 1," they can receive operations on control 604 in Example 600B.

[0072] Subsequently, in Example 600C, it can be seen that the area of ​​the prompt content contains a material area 614 and a keyword area 624, both of which are marked with dashed lines. The text description content in the keyword area 624 contains a slot marker "". Figure 1"608 corresponds to slot 606. The text description also includes slot identifier "Video 1" 618, corresponding to video 1 slot 616 in material area 614. Next, operations on slot 606 or slot identifier 608 can be received, both of which can be displayed on the interface of example 600D, which includes multiple images and / or videos from the system album. Then, a selection operation on material 9 610 and an operation on control 612 are received."

[0073] Next, after receiving the operation for control 612, proceed to... Figure 6E The interface shown in Example 600C displays material 9 610 in slot 606. Subsequently, it can receive operations on either identifier 618 or slot 616, and proceed to the interface in Example 600F. Thereafter, it can receive selection operations on material 6 620 and operations on control 622.

[0074] Finally, after receiving the operation for control 622, proceed to... Figure 6G In the interface of Example 600C shown, material 6 620 is displayed in slot 616. Furthermore, upon receiving a deletion operation for the content identifier "Video 1" in the prompt content, slot 616 corresponding to the "Video 1" identifier is also deleted in Example 600H. After receiving an operation to generate content, the above information can be used to generate new multimedia content or effects.

[0075] With this method, when the AI ​​keyword and reference image functions are enabled during the follow-up shooting process, users can select images, videos, or other themes or reference materials based on AI keywords, which increases the fun of content creation and improves the efficiency of content creation.

[0076] In some situations, when users initiate AI-generated content, they can directly enter a similar... Figure 5C The interface is as follows. The interaction when adding materials and editing text prompts is the same as the shooting process described above.

[0077] The above combination Figures 6A to 6G This illustration depicts an example of following a subject when public keywords and reference images are enabled. The following section combines... Figures 7A to 7C A schematic diagram illustrating an example of generating media content, and Figures 7A to 7C The examples shown all demonstrate how computing devices achieve this by running corresponding applications.

[0078] like Figures 7A to 7CAs shown in Example 700A, during the user's content creation process, after entering the editing page, slot 702 can be displayed for the user to fill in media content. Slot 702 can be a main slot, which can be empty by default and selected according to the user's needs. For example, it can receive operations on slot 702 and select media content as the main image for slot 702. The user's created text content can also be added to the prompt area in the dotted box 704 below. For example, in the interface of Example 700B, the user can enter the media library and select media content by clicking slot 702. Figure 1 As media content, slot 702 was subsequently filled. Figure 1 And display Figure 1 The thumbnail of the slot can be displayed. Additionally, a slot identifier 708 corresponding to the slot can be added to the text content area. Subsequently, a slot 706 can be added to the editing interface for users to continue adding media content. For example, a user can click slot 706 and select video 1 from the media library as media content. Then, slot 706 will be filled with video 1 and its thumbnail will be displayed. At this time, a slot identifier 710 corresponding to the slot will also be added to the text content area. Users can also add text content to the prompt content area 704.

[0079] Additionally, the slot identifier can be automatically updated based on the type of media content selected by the user. For example, if the user selects "Video 1" as the content for slot 702, the identifier for slot 702 can be automatically updated to "Video 1". Furthermore, as... Figure 7C As shown, if slot identifier 710 is deleted, the slot corresponding to video 1 and its corresponding media content will also be deleted.

[0080] This method can enhance the interactivity of user content creation and improve the efficiency of content creation.

[0081] The above combination Figures 7A to 7C This illustration shows an example of adding footage and text in a situation involving filming. Below is a combination of... Figures 8A to 8B The illustration depicts examples of subsequent filming by other users, and... Figures 8A to 8B The examples shown all demonstrate how computing devices achieve this by running corresponding applications.

[0082] like Figures 8A to 8B As shown in Example 800A, after the user edits the video, both slots 802 and 804 contain thumbnails of the media content selected by the user. Subsequently, if other users follow up with videos, in Example 800B, slots 806 and 808 will be empty, while retaining the AI ​​keyword suggestions.

[0083] Figure 9 A schematic block diagram of the interface interaction device according to this article is shown. Figure 9 As shown, device 900 can Figure 1 The device 900 is implemented in a computing device 102, and the device 900 includes an information display module 902 configured to display first text content and at least one slot in a first interface; wherein the at least one slot is used to fill media content, the first text content includes at least one slot identifier, the at least one slot identifier corresponds to at least one slot, and the first text content and the media content filled in the at least one slot are used to generate first media content; a first operation receiving module 904 configured to receive a first operation triggered for a first slot identifier, the first slot identifier being one of at least one slot identifiers in the first text content, the first slot identifier corresponding to a first slot in the at least one slot; and a content display module 906 configured to display at least one candidate media content, the at least one candidate media content being available to fill the first slot.

[0084] In one embodiment, the device 900 further includes: a second operation receiving module configured to receive a second operation triggered for a second media content among at least one candidate media content; and a first display module configured to display the second media content in a first slot.

[0085] In one embodiment, the device 900 further includes: a third operation receiving module configured to receive a third operation, the third operation being used to delete a second slot identifier from at least one slot identifier in the first text, the second slot identifier corresponding to a second slot in at least one slot; and a cancellation display module configured to cancel the display of the second slot identifier in the first text content and cancel the display of the second slot in the first interface.

[0086] In one scenario, at least one slot is located in a first area of ​​the first interface, and the first text content is located in a second area of ​​the first interface.

[0087] In one scenario, the first interface is the interface that appears after triggering the filming of third media content. The first interface has at least one slot, including: a slot that is initially empty and a slot that is initially filled with fourth media content.

[0088] In one scenario, fourth media content serves as reference material used to generate third media content.

[0089] In one scenario, the slots initially presented as empty are type 1 slots, and the slots initially filled with fourth media content are type 2 slots; wherein the media content filled in type 1 slots serves as key content when generating first media content, and the media content filled in type 2 slots serves as reference content when generating first media content.

[0090] In one embodiment, the device 900 further includes: a fourth operation receiving module configured to receive a fourth operation triggered in response to a first interface, the fourth operation instructing the generation of first media content based on first text content and media content filled in at least one slot; a second interface display module configured to display a second interface, the second interface being an interface for publishing the first media content; and a fifth operation receiving module configured to receive a fifth operation triggered in response to the second interface, the fifth operation being used to set whether, when the published first media content is followed by filming, at least one of the following is displayed: the first text content and media content filled in at least one slot.

[0091] In one scenario, the fifth operation is used to determine whether to display the first text content and the media content in the second type of slot when the first media content is being filmed; wherein at least one slot includes a first type of slot and a second type of slot, the media content filled in the first type of slot is used as key content when generating the first media content, and the media content filled in the second type of slot is used as reference content when generating the first media content.

[0092] In one scenario, the device 900 includes: a sixth operation receiving module configured to receive a sixth operation for adding a third slot in a first interface; and a module configured to add a display third slot in the first interface and add a display third slot identifier in first text content, the third slot identifier corresponding to the third slot, wherein the media content filled in the third slot is also used to generate the first media content.

[0093] Figure 10 A schematic block diagram of an example device 1000 that can be used to implement this document is shown. Figure 1 The computing device 102 can be implemented using device 1000. As shown, device 1000 includes a central processing unit (CPU) 1001, which can perform various appropriate actions and processes according to computer program instructions stored in read-only memory (ROM) 1002 or loaded from storage unit 1008 into random access memory (RAM) 1003. The RAM 1003 can also store various programs and data required for the operation of device 1000. The CPU 1001, ROM 1002, and RAM 1003 are interconnected via bus 1004. Input / output (I / O) interface 1007 is also connected to bus 1004.

[0094] Multiple components in device 1000 are connected to I / O interface 1007, including: input unit 1006, such as keyboard, mouse, etc.; output unit 1007, such as various types of monitors, speakers, etc.; storage unit 1008, such as disk, optical disk, etc.; and communication unit 1009, such as network card, modem, wireless transceiver, etc. Communication unit 1009 allows device 1000 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0095] The various processes and handling described above, such as method 200, can be executed by processing unit 1001. For example, in one case, method 200 can be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 1008. In another case, part or all of the computer program can be loaded and / or installed on device 1000 via ROM 1002 and / or communication unit 1009. When the computer program is loaded into RAM 1003 and executed by CPU 1001, one or more actions of example method 200 described above can be performed.

[0096] This document can be a method, apparatus, system, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for performing various aspects of this document.

[0097] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0098] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0099] The computer program instructions used to perform the operations described herein may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In one scenario, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing state information from the computer-readable program instructions. This electronic circuitry can execute the computer-readable program instructions to implement various aspects of this document.

[0100] Various aspects of this document are described herein with reference to flowchart illustrations and / or block diagrams of the methods, apparatus (systems), and computer program products thereof. It should be understood that each block of the flowchart illustrations and / or block diagrams, as well as combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0101] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0102] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0103] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of the systems, methods, and computer program products according to this document. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0104] The above description is exemplary and not exhaustive, nor is it limited to the disclosed content. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the description. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the disclosure herein.

Claims

1. A method for interface interaction, comprising: The first interface displays first text content and at least one slot; wherein, the at least one slot is used to fill media content, the first text content includes at least one slot identifier, the at least one slot identifier corresponds to the at least one slot, and the first text content and the media content filled in the at least one slot are used to generate first media content; Receive a first operation, the first operation being triggered for a first slot identifier, the first slot identifier being one of the at least one slot identifiers in the first text content, the first slot identifier corresponding to a first slot among the at least one slots; and Display at least one candidate media content, which can be used to fill the first slot.

2. The method according to claim 1, further comprising: Receive a second operation, which is triggered for a second media content among the at least one candidate media content; as well as The second media content is displayed in the first slot.

3. The method according to claim 1, further comprising: A third operation is received, the third operation being used to delete the second slot identifier in the at least one slot identifier in the first text, the second slot identifier corresponding to the second slot in the at least one slot; as well as In the first interface, the display of the second slot identifier in the first text content is canceled, and the display of the second slot is also canceled.

4. The method according to claim 1, wherein the at least one slot is located in a first area of ​​the first interface, and the first text content is located in a second area of ​​the first interface.

5. The method according to claim 1, wherein, The first interface is the interface that appears after triggering the filming of the third media content. The at least one slot on the first interface includes: a slot that is initially empty and a slot that is initially filled with the fourth media content.

6. The method according to claim 5, wherein, The fourth media content is the reference content used to generate the third media content.

7. The method according to claim 5, wherein, The slots that are initially presented as empty are the first type of slots, and the slots that are initially filled with the fourth media content are the second type of slots. The media content filled in the first type of slot is used as key content when generating the first media content, while the media content filled in the second type of slot is used as reference content when generating the first media content.

8. The method according to claim 5, further comprising: In response to the fact that the publisher of the first media content is the same as the publisher of the third media content, controls for controlling the display of the first text content and reference content are displayed on the publishing interface of the first media content. In response to the fact that the publisher of the first media content is different from the publisher of the third media content and the first text content and the reference content are modified, a control for controlling the display of the modified first text content and the modified reference content is displayed on the publishing interface of the first media content. as well as In response to the fact that the publisher of the first media content is different from the publisher of the third media content and the first text content and the reference content have not been modified, the controls used to control the display of the first text content and the reference content are disabled on the publishing interface of the first media content.

9. The method according to claim 1, further comprising: A fourth operation is received, which is triggered for the first interface, and the fourth operation instructs the generation of the first media content based on the first text content and the media content filled in the at least one slot. Display a second interface, which is used to publish the first media content; as well as The fifth operation is received, which is triggered for the second interface. The fifth operation is used to set whether to display at least one of the following when the first media content after publication is followed: the first text content and the media content filled in the at least one slot.

10. The method according to claim 8, wherein, The fifth operation is used to set whether to display the first text content and the media content in the second type of slot when the first media content is being filmed. The at least one slot includes a first type of slot and a second type of slot. The media content filled in the first type of slot is used as key content when generating the first media content, and the media content filled in the second type of slot is used as reference content when generating the first media content.

11. The method according to claim 1, wherein, The method includes: Receive a sixth operation, the sixth operation being used to add a third slot in the first interface; and A third slot is added to the first interface, and a third slot identifier is added to the first text content. The third slot identifier corresponds to the third slot, and the media content filled in the third slot is also used to generate the first media content.

12. A device for interface interaction, comprising: An information display module is configured to display first text content and at least one slot in a first interface; wherein, the at least one slot is used to fill media content, the first text content includes at least one slot identifier, the at least one slot identifier corresponds to the at least one slot, and the first text content and the media content filled in the at least one slot are used to generate first media content; A first operation receiving module is configured to receive a first operation triggered by a first slot identifier, wherein the first slot identifier is one of the at least one slot identifiers in the first text content, and the first slot identifier corresponds to a first slot among the at least one slots; and The content display module is configured to display at least one candidate media content, which can be used to fill the first slot.

13. An electronic device, comprising: At least one processor; as well as A memory for storing at least one program, which, when executed by the at least one processor, causes the at least one processor to implement the method according to any one of claims 1-11.

14. A computer-readable storage medium having a computer program stored thereon, the computer program implementing the method according to any one of claims 1-11 when executed by a processor.

15. A computer program product comprising a computer program that, when executed by a processor, implements the method according to any one of claims 1-11.

Images