Interaction method and apparatus, electronic device, and storage medium

Abstract

The present disclosure relates to an interaction method and device, electronic equipment and storage medium. The method comprises: receiving a first reference image and displaying identification information of the received first reference image in a guide sentence input area; the number of the first reference images is multiple; receiving a text prompt word and displaying the text prompt word in the guide sentence input area; the text prompt word comprises an object description phrase, the object description phrase corresponds to the first reference image; the object description phrase is used to describe an object in the first reference image corresponding thereto; the identification information of the first reference image is interspersed in the text prompt word; the number of characters between the position of the object description phrase in the text prompt word and the position of the identification information of the first reference image corresponding thereto in the text prompt word is less than a preset character number; and generating a first video based on the content in the guide sentence input area. It can meet the demand of the user who wants to generate a video based on multiple first reference images.

Description

Technical Field

[0001] This disclosure relates to the field of video production technology, and more particularly to an interactive method, apparatus, electronic device, and storage medium. Background Technology

[0002] With the rapid development of technology, video generation technology has become one of the most important achievements in the digital field today. This technology, through video generation models, automatically generates video content that meets expectations based on reference images and / or text prompts, bringing new innovative opportunities to various fields such as film and television creation and advertising design.

[0003] In related technologies, applications supporting video generation typically only offer the ability to generate video based on a single reference image, or given a first frame and a last frame. However, in practice, users often want to generate video based on multiple reference images. Therefore, how to assist users in generating video based on multiple reference images is a problem that urgently needs to be solved. Summary of the Invention

[0004] In order to solve the above-mentioned technical problems, or at least partially solve the above-mentioned technical problems, this disclosure provides an interaction method, apparatus, electronic device, and storage medium.

[0005] Firstly, this disclosure provides an interaction method, including:

[0006] The video generation configuration page is displayed, which includes a guide input area, a first reference image addition option, and a first generation option.

[0007] The system receives a first reference image by adding an option to the first reference image, and displays the identification information of the received first reference image in the guide input area; the number of first reference images is multiple.

[0008] The system receives and displays text prompts in the guidance input area. The text prompts include object description phrases that correspond to the first reference image. These object description phrases describe objects in the corresponding first reference image. Identification information of the first reference image is interspersed within the text prompts. The number of characters between the position of the object description phrase in the text prompts and the position of the identification information of the corresponding first reference image in the text prompts is less than a preset number of characters.

[0009] In response to the selection of the first generation option, a first video is generated based on the content in the guide input area.

[0010] Secondly, this disclosure also provides an interactive device, including:

[0011] The first display module is used to display the video generation configuration page, which includes a guide input area, a first reference image addition option, and a first generation option.

[0012] The first collection module is used to receive the first reference image through the option to add the first reference image, and to display the identification information of the received first reference image in the guide input area; the number of the first reference images is multiple;

[0013] The second collection module is used to receive text prompts through the guidance input area and display the text prompts in the guidance input area; the text prompts include object description phrases, which correspond to the first reference image; the object description phrases are used to describe the objects in the corresponding first reference image; the identification information of the first reference image is interspersed in the text prompts; the number of characters between the position of the object description phrase in the text prompts and the position of the identification information of the corresponding first reference image in the text prompts is less than a preset number of characters;

[0014] A generation module is configured to generate a first video based on the content in the guide input area in response to a selection operation of the first generation option.

[0015] Thirdly, this disclosure also provides an electronic device, the electronic device comprising:

[0016] One or more processors;

[0017] Storage device for storing one or more programs;

[0018] When the one or more programs are executed by the one or more processors, the one or more processors implement the interaction method as described above.

[0019] Fourthly, this disclosure also provides a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the interaction method described above.

[0020] The technical solution provided in this disclosure has the following advantages compared with the prior art:

[0021] The technical solution provided in this embodiment receives a first reference image through an option to add a first reference image, and displays the identification information of the received first reference image in the guidance input area; there are multiple first reference images; text prompts are received through the guidance input area, and the text prompts are displayed in the guidance input area; the text prompts include object description phrases, which correspond to the first reference images; the object description phrases are used to describe objects in the corresponding first reference images; the identification information of the first reference images is interspersed in the text prompts; the number of characters between the position of the object description phrase in the text prompts and the position of the identification information of the corresponding first reference images in the text prompts is less than a preset number of characters; in response to the selection operation of the first generation option, a first video is generated based on the content in the guidance input area. Essentially, it provides an interactive link for video generation based on multiple first reference images, which can meet the user's need to generate videos based on multiple first reference images. Attached Figure Description

[0022] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0023] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 A flowchart of an interaction method provided in an embodiment of this disclosure;

[0025] Figures 2-11 This is a schematic diagram of several pages in the embodiments of this disclosure;

[0026] Figure 12 This is a schematic diagram of the structure of an interactive device according to an embodiment of the present disclosure;

[0027] Figure 13 This is a schematic diagram of the structure of an electronic device according to an embodiment of this disclosure. Detailed Implementation

[0028] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0029] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.

[0030] Figure 1 This flowchart illustrates an interaction method provided in an embodiment of the present disclosure. This embodiment is applicable to interactions performed on a client side. The method can be executed by an interaction device, which can be implemented in software and / or hardware. This device can be configured in an electronic device, such as a terminal, specifically including but not limited to smartphones, PDAs, tablets, wearable devices with displays, desktop computers, laptops, all-in-one computers, smart home devices, etc. Alternatively, this embodiment can be applied to interactions performed on a server side. The method can be executed by an interaction device, which can be implemented in software and / or hardware. This device can be configured in an electronic device, such as a server.

[0031] like Figure 1 As shown, the method may specifically include:

[0032] S110. Display the video generation configuration page, which includes a guide input area, a first reference image addition option, and a first generation option.

[0033] The video generation configuration page can be, for example, a page used to collect the necessary information required to generate the video. In practice, this application does not limit the specific information that the video generation configuration page needs to collect. For example, the video generation configuration page can be used to collect introductory text, version information of the video generation model used to generate the video, the motion speed, camera movement method, and format of the generated video, etc.

[0034] The prompts can be, for example, information input into a video generation model to control the video generation process. In this application, the prompts displayed in the prompt input area are those used to generate the first video, that is, the prompts corresponding to the first video. The prompts corresponding to the first video include text prompts and a first reference image.

[0035] The prompt input area can be, for example, a region used to collect text prompts and display the currently collected prompts. In some scenarios, users can input text in the prompt input area.

[0036] The option to add a first reference image could be, for example, an option for adding a first reference image. The first reference image can be understood as a guide image that needs to be input into the video generation model; it is part of the guiding information. Once the first reference image is input into the video generation model, it will participate in controlling the video generation process.

[0037] The first generation option could be, for example, an option used to trigger the video generation model to run. When the first generation option is selected, it means that the user agrees to generate a video based on the information collected on the current video generation configuration page.

[0038] For example, see Figure 2 The video generation configuration page includes a prompt input area, a first reference image addition option, and a first generation option.

[0039] S120. Receive the first reference image through the first reference image addition option, and display the identification information of the received first reference image in the prompt input area; the number of first reference images is multiple.

[0040] The identification information of the first reference image may be, for example, information used to distinguish different first reference images. For example, the identification information of the first reference image may include a thumbnail, name, or number of the first reference image. Further, if the identification information of the first reference image includes a number of the first reference image, this number may be determined based on the arrangement order of the reference images in the prompt input area.

[0041] Receiving a first reference image means using that first reference image as part of the introductory text.

[0042] The purpose of “displaying the identification information of the first reference image received in the guidance input area” is to make it clear to the user which images are currently being used as the first reference images by visually displaying the identification information of the first reference images.

[0043] There are multiple ways to implement this step, and this application does not limit them. For example, the implementation method of this step may include: in response to the selection operation of adding an option to the first reference image, displaying an image selection page; the image selection page includes multiple images; in response to the selection operation of the target image on the image selection page, using the target image as the first reference image, and displaying the identification information of the first reference image in the prompt input area.

[0044] An image selection page could be, for example, a page that provides multiple images for a user to choose from. The target image could be, for example, the image selected by the user on the image selection page. Exemplarily, an image selection page could be a photo album page.

[0045] S130. Receive text prompts through the prompt input area and display the text prompts in the prompt input area; the text prompts include object description phrases, which correspond to the first reference image; the object description phrases are used to describe the objects in the corresponding first reference image; the identification information of the first reference image is interspersed in the text prompts; the number of characters between the position of the object description phrase in the text prompts and the position of the identification information of the corresponding first reference image in the text prompts is less than a preset number of characters.

[0046] The object can be, for example, something in the first reference image, or the environment created by the first reference image. If the object is something in the first reference image, it can specifically be a person, animal, plant, building, or other object. If the object is the environment created by the first reference image, it can specifically be a bedroom environment, a movie theater environment, a coffee shop environment, a forest environment, a morning environment, or an evening environment.

[0047] The object description phrase can be, for example, a phrase in a text prompt that corresponds to a specific first reference image and is used to describe the object or features of the object in the corresponding first reference image, so that the video generation model "understands" which object in the first reference image the user wants to include in the newly generated video; or, so that the video generation model "understands" which feature of which object in the first reference image the user wants to include in the newly generated video.

[0048] The identification information of the first reference image is interspersed within the text prompts. For example, this could mean that within the prompt input area, the identification information of the first reference image and the text prompts are mixed together, rather than further dividing the prompt input area into two non-overlapping sub-regions, one sub-region for displaying the identification information of the first reference image and the other sub-region for displaying the text prompts.

[0049] The preset character count can be, for example, a pre-set parameter used to determine whether the object description phrase and the first reference image have a corresponding relationship. This application does not limit the specific value of the preset character count. If the number of characters between the position of the object description phrase in the text prompt and the position of the first reference image in the text prompt is less than the preset character count, they are considered to have a corresponding relationship; otherwise, they are considered not to have a corresponding relationship. Therefore, the number of characters between the position of the object description phrase in the text prompt and the position of its corresponding first reference image identification information in the text prompt is less than the preset character count. For example, this could mean that the position of the object description phrase in the text prompt and the position of its corresponding first reference image identification information in the text prompt are close, so that the correspondence between the object description phrase and the first reference image can be clearly distinguished based on their positions in the text prompt. It should be emphasized that in practice, the text prompt can be understood as a sentence. The closeness of the position of the object description phrase in the text prompt and the position of its corresponding first reference image identification information in the text prompt means that the number of characters between them is small; in some scenarios, this can be represented as being in the same clause. To reiterate, "closer in location" here refers to the character spacing between the object description phrase and the first reference image in the text prompt, not to their physical proximity.

[0050] For example, see Figure 3 Users can add images 1, 2, and 3 sequentially as first reference images using the first reference image addition option. The input area displays the identification information for images 1, 2, and 3. The identification information for image 1 includes its thumbnail and its number. Figure 3 The thumbnail of image 1 in the middle Figure 1 The number representing image 1 is determined based on the arrangement order of the reference images in the prompt input area.

[0051] See also Figure 3The prompt input area also includes text prompts, which are the remaining text in the information displayed in the prompt input area, excluding the identification information of the first reference image. Specifically, it reads "A kitten with patterned fur and a puppy are chasing each other in the park." This text prompt includes three object description phrases: "kitten with patterned fur," "puppy," and "park." "Kitten with patterned fur" corresponds to Image 1 and describes the object in Image 1; in other words, Image 1 includes a kitten with patterned fur. In practical use, since the user wants to input "kitten with patterned fur" from Image 1 into the video generation model to control video generation, the user uses the first reference image addition option to set Image 1 as the first reference image, displays the identification information of Image 1 in the prompt input area, and inputs the corresponding object description phrase "kitten with patterned fur" in the prompt input area for Image 1. The situation for other object description phrases is similar. Further details are omitted here.

[0052] See also Figure 3 In the prompt input area, the identification information of the first reference image is interspersed within the text prompts. The number of characters between the identification information of image 1 and "a kitten with patterned fur" is less than the preset number of characters. Based on the content of this prompt input area, it can be concluded without doubt that image 1 corresponds to "a kitten with patterned fur". The correspondence between other first reference images and object description phrases is similar and will not be elaborated here.

[0053] It should be noted that in practical applications, users can construct guidance messages through various interactive methods. For example, users can first set multiple first reference images at once using the first reference image addition option, and the electronic device will display the identification information of each first reference image in the guidance message input area. Then, users can move the input cursor between the first reference image identification information and text prompts to form a guidance message that combines the first reference image identification information and text prompts. Alternatively, users can first input a complete text prompt in the guidance message input area, and then position the input cursor in the appropriate position within the text prompt, and set the first reference image using the first reference image addition option to form a guidance message that combines the first reference image identification information and text prompts. In addition, users can add a first reference image using the first reference image addition option, and then input some text prompts; then add another first reference image using the first reference image addition option, and continue to input some text prompts; and so on, gradually constructing a guidance message that combines the first reference image identification information and text prompts.

[0054] S140. In response to the selection operation of the first generation option, generate the first video based on the content in the guide input area.

[0055] The content in the prompt input area constitutes the prompt. Optionally, in response to the selection of the first generation option, the content in the prompt input area is input into the video generation model to obtain the first video. The first video is a video generated based on multiple first reference images.

[0056] The above technical solution receives a first reference image through an option to add a first reference image, and displays the identification information of the received first reference image in the guidance input area; there are multiple first reference images; text prompts are received through the guidance input area and displayed in the guidance input area; the text prompts include object description phrases, which correspond to the first reference images; the object description phrases are used to describe the objects in their corresponding first reference images; the identification information of the first reference images is interspersed in the text prompts; the number of characters between the position of the object description phrase in the text prompts and the position of the identification information of its corresponding first reference image in the text prompts is less than a preset number of characters; in response to the selection operation of the first generation option, a first video is generated based on the content in the guidance input area. Essentially, it provides an interactive link for video generation based on multiple first reference images, which can meet the user's need to generate videos based on multiple first reference images.

[0057] It should be noted that, in practice, a key technical challenge in generating videos based on multiple first reference images is organizing the prompts to enable users to more accurately express the impact and / or function of the multiple first reference images they input on the video generation process. The aforementioned technical solution addresses this by setting text prompts that include object description phrases, each corresponding to a first reference image. These object description phrases describe objects within their corresponding first reference images. The identification information of the first reference images is interspersed within the text prompts. The number of characters between the position of the object description phrase in the text prompts and the position of the identification information of its corresponding first reference image is less than a preset number. This provides a method for organizing prompts that helps users accurately express the impact and / or function of the multiple first reference images they input on the video generation process, thereby ensuring that the generated first video meets the user's needs for complex scene construction and refined content control.

[0058] Based on the above technical solution, optionally, after S130 and before S140, the method may further include: in response to a first selection operation on the target first reference image in the guide input area, displaying a first replacement option; in response to the selection operation on the first replacement option, replacing the target first reference image and replacing the identification information of the target first reference image in the guide input area.

[0059] The target first reference image may be, for example, a first reference image selected by the user. The first replacement option may be, for example, an option corresponding to the target first reference image, used to replace the target first reference image. Replacing the target first reference image may, for example, mean no longer using the image currently used as the target first reference image, but instead using another image as the new target first reference image, which will subsequently be input into the video generation model to generate the first video.

[0060] For example, see Figure 4 If the user clicks on the identifier of image 2 in the guidance input area, image 2 will be used as the target first reference image. The user's action of clicking on the identifier of image 2 in the guidance input area is considered a selection operation of the target first reference image in the guidance input area, and the first replacement option corresponding to image 2 will be displayed (i.e.,...). Figure 4 The "Replace" option is located above the identification information of image 2. If the user clicks the "Replace" option again, an image selection page will be displayed; the image selection page includes multiple images; in response to the selection of the target image on the image selection page, the target image is used to replace... Figure 2 Assuming the target image is image 4, the identifier information of image 4 will replace the identifier information of image 2 and be displayed in the guidance input area. Image 4 will then be input into the video generation model, but image 2 will not be input.

[0061] By setting a response to a first selection operation on the target first reference image in the guidance input area, a first replacement option is displayed; in response to the selection operation of the first replacement option, the target first reference image is replaced, and the identification information of the target first reference image in the guidance input area is also replaced. Essentially, this allows the user to replace the first reference image, thereby satisfying the user's need to modify the guidance text already entered in the guidance input area.

[0062] Based on the above technical solution, optionally, after S130 and before S140, the method may further include: displaying a deletion option in response to a second selection operation on the target first reference image in the guide input area; deleting the target first reference image in response to the selection operation on the deletion option; and deleting identification information of the target first reference image from the guide input area.

[0063] The target first reference image can be, for example, a first reference image selected by the user. The first selection operation and the second selection operation can be the same interaction operation or different interaction operations; this application does not impose any restrictions on this. The interaction operation here can be a click operation, a swipe operation, a drag operation, or a long press operation, etc.

[0064] The deletion option could be, for example, an option corresponding to the target first reference image, used to delete the target first reference image. Deleting the target first reference image could mean, for example, no longer using the current target first reference image, and not subsequently inputting the current target first reference image into the video generation model to generate the first video.

[0065] For example, if the first selection operation and the second selection operation are the same interactive operation, it is a click operation. If the user clicks the identification information of image 2 in the guidance input area, image 2 is used as the target first reference image, and the first replacement option corresponding to image 2 is displayed (i.e., Figure 4 The "Replace" option and the delete option (i.e.) Figure 4 The user can click the "Delete" option to remove image 2. After image 2 is deleted, its identifier will no longer be displayed in the prompt input area, and it will not be input into the video generation model again.

[0066] By setting a second selection operation in response to the target first reference image in the guidance input area, a deletion option is displayed; in response to the selection operation of the deletion option, the target first reference image is deleted, along with the identification information indicating that the target first reference image has been deleted from the guidance input area. Essentially, this allows the user to delete the first reference image, thus satisfying the user's need to modify the guidance text already entered in the guidance input area.

[0067] Based on the above technical solution, the method may optionally further include: in response to the operation of publishing the second video as a template, displaying a publishing configuration page; the second video includes the first video; the publishing configuration page includes identification information of the first reference image used by the first video and publishing options; in response to the third selection operation of the target first reference image on the publishing configuration page, displaying a constraint input box corresponding to the first target slot; the first target slot is the material slot represented by the target first reference image; using the content received through the constraint input box as the constraint condition corresponding to the first target slot; in response to the selection operation of the publishing options, publishing the second video as a template based on the correspondence between the first target slot and the constraint condition.

[0068] The second video includes the first video. For example, the second video may include one or more video segments, and the first video is one of the video segments that constitute the second video. When the second video includes multiple video segments, the multiple video segments are organized together in at least one of the following ways: spliced ​​sequentially on a certain track in chronological order, and a layered picture effect is achieved by overlaying multiple tracks.

[0069] Publishing a second video as a template means transforming it into a reusable, standardized creative framework that template users can quickly apply to generate videos in a similar style. Here, a "template" is essentially a semi-finished product containing preset editing logic, visual effects, and structural layout. By opening up replaceable areas (such as materials, text, and music), it lowers the creative threshold for others. These "replaceable areas" are also known as material slots.

[0070] The publishing configuration page could be a page for configuring basic information about the template, material slots, etc.

[0071] Publishing options, for example, could be used to trigger the publishing of a second video as a template. When a publishing option is selected, it means the user agrees to publish the template based on the information configured on the current publishing configuration page.

[0072] The target first reference image can be, for example, the first reference image selected by the user. The third selection operation can be the same as or different from the first or second selection operation mentioned above; this application does not impose any restrictions on this. The interaction operation here can be a click operation, a swipe operation, a drag operation, or a long press operation, etc.

[0073] When the second video is used as a template, since the second video includes the first video, and the generation of the first video used the target first reference image, the second video can be understood as an example of this template, and the target first reference image is the source material used to obtain the second video. The first target slot is the source material slot represented by the target first reference image; for example, it can be the position or empty space occupied by the target first reference image in the template. In some scenarios, it can also be understood that the target first reference image fills the first target slot.

[0074] In some scenarios, when using a second video template, if the target first reference image is replaced, the image used to replace the target first reference image will be inserted into the material slot (i.e., the first target slot) represented by the target first reference image. In other words, the image used to replace the target first reference image will fill the material slot (i.e., the first target slot) represented by the target first reference image.

[0075] The constraints corresponding to the first target slot can be, for example, information indicating the conditions that the image used to replace the first target reference image must meet. Only when the image used to replace the first target reference image meets the constraints corresponding to the first target slot will the new video created based on the template have better visual effects. The constraint input box corresponding to the first target slot is used to receive the constraints corresponding to the first target slot.

[0076] Because the introductory text used to generate the first video requires a correspondence between the object description phrase and the first reference image, during the template application stage, if a new image is chosen inappropriately to replace the first reference image, the correspondence between the new image and the object description phrase may become invalid. For example, in the introductory text used to generate the first video, a certain object description phrase is "puppy," and the first reference image corresponding to this object description phrase includes a puppy. If an image including a kitten is used to replace the first reference image, the object description phrase "puppy" will not match the kitten in the new first reference image, meaning the correspondence between the new image and the object description phrase will become invalid. This situation will result in poor visual quality in the subsequent video generated based on the new image. By configuring constraints, template users can be reminded which images will not cause the correspondence between the new image and the object description phrase to become invalid. In other words, by configuring constraints, template users can be reminded which images will result in a high degree of matching between the new image and the object description phrase.

[0077] Optionally, in some scenarios, the second video may also include other video clips besides the first video, and the publishing configuration page may also include identification information for the other video clips.

[0078] For example, suppose the first video is based on Figure 3 The introductory text is generated from the first video. The second video includes video clip 1 and the first video, where video clip 1 was generated in a different way than the first video; for example, video clip 1 was recorded by a terminal. Assume that the page used to display the second video includes a "Publish as Template" option. If the user clicks the "Publish as Template" option, see... Figure 5 This displays the publishing configuration page. On this page, you can configure the template's basic information (such as the template's theme, the characteristics of the videos that can be created with the template, and the template's cover image) and media slots.

[0079] exist Figure 5 The publishing configuration page includes identification information for video clip 1 and identification information for the first reference images (i.e., images 1, 2, and 3) used to obtain the first video. The publishing configuration page also includes "Modify" options corresponding to the identification information of each first reference image. If a user selects a "Modify" option, it is considered as selecting the first reference image corresponding to that "Modify" option. The first reference image corresponding to that "Modify" option is the target first reference image. For example, see [link to example]. Figure 5 If the user clicks the "Modify" option corresponding to the identification information of image 2, image 2 will be used as the target first reference image. See [link / reference]. Figure 6The text displays the constraint input box corresponding to Image 2. In this example, since the description phrase for the object corresponding to Image 2 in the introductory text for generating the first video is "puppy," the user can enter words such as "puppy," "dog," or "animal" in the constraint input box corresponding to Image 2. The words entered by the user in the constraint input box corresponding to Image 2 will serve as the constraint conditions for the media slot represented by Image 2. After publishing the second video as a template, the constraint conditions for the media slot represented by Image 2 will be displayed to the template user. If they wish to replace Image 2, selecting an image that meets the constraint conditions of the media slot represented by Image 2 will result in a video with better visual effects.

[0080] Therefore, by setting a response to the third selection operation of the target first reference image on the publishing configuration page, a constraint input box corresponding to the first target slot is displayed; the first target slot is the material slot represented by the target first reference image; the content received through the constraint input box is used as the constraint condition corresponding to the first target slot; its essence is to allow the configuration of the constraint condition corresponding to the material slot during the template publishing process, so that the template user can be guided to correctly select the image to replace the target first reference image through the constraint condition, thereby ensuring that the template can ultimately generate a video with better visual effects.

[0081] Furthermore, in response to the selection operation of the publishing option, before publishing the second video as a template based on the correspondence between the first target slot and the constraint conditions, the method may further include: in response to the fourth selection operation of the target first reference image on the publishing configuration page, setting the state of the first target slot to the allow replacement state.

[0082] The fourth selection operation can be the same as or different from the first, second, or third selection operations mentioned above; this application does not impose any restrictions on this. The interaction operation here can be a click, swipe, drag, or long press, etc.

[0083] The status of a media slot can include an allowed replacement status and a restricted replacement status. When the first target slot is in the allowed replacement status, the template user is allowed to fill the first target slot with other images during the application of the second video template. When the first target slot is in the restricted replacement status, the template user is not allowed to fill the first target slot with other images during the application of the second video template. If a media slot is in the restricted replacement status, when creating a new video using the second video template, the image or video used to fill that media slot in the second video can be reused.

[0084] For example, in Figure 5In the image, the circle in the upper right corner of the identifier for video clip 1 has a checkmark, indicating that the media slot represented by video clip 1 is in a replaceable state. The circle in the upper right corner of the identifier for image 1 does not have a checkmark, indicating that the media slot represented by image 1 is in a restricted replaceable state. Similarly, in... Figure 5 In the image, the material slots represented by Image 2 and Image 3 are in a state where replacement is allowed.

[0085] In some scenarios, certain first reference images have a crucial impact on the first video generation process, such as determining the overall style, main content, or key visual features of the video. In such cases, there are often stringent requirements for the quality, content, or format of the first reference image. To address this, by setting a response to the selection operation of the target first reference image on the publishing configuration page, setting a fourth selection operation of the target first reference image on the publishing configuration page, and setting the status of the first target slot to allow replacement, the essence is to allow the template publisher to set restrictions on which first reference images can be replaced and which cannot be replaced based on the characteristics of the template they created during the template publishing configuration stage. This avoids a decrease in video output quality due to the replacement of relatively important first reference images during the template usage stage.

[0086] Based on the above technical solutions, the method may optionally further include: in response to an application operation on a third video template, displaying a first slot filling page; the third video includes a first video; the first video corresponds to multiple first material slots; the first slot filling page includes identification information of the first material slots and a second generation option; in response to a configuration operation on a target first material slot, configuring a second reference image for filling the target first material slot; in response to a selection operation on the second generation option, obtaining a fourth video based on the second reference image, the correspondence between the second reference image and the first material slots, and the third video template; the fourth video includes a fifth video, which is generated based on the second reference image.

[0087] Third-party video templates can be standardized templates generated based on the content and editing logic of third-party videos, allowing for secondary creation. In other words, third-party video templates can solidify the editing structure of third-party videos (such as video clip order, transition effects, subtitle styles, and background music rhythm) into a reusable template framework, retaining the core design logic of third-party videos while opening up some material slots (such as images, video clips, and text content) for other users to replace.

[0088] The third video includes the first video. For example, the third video may include one or more video segments, and the first video is one of the video segments constituting the third video. The first video is a video generated based on a method for generating video from multiple first reference images. When the third video includes multiple video segments, the multiple video segments are organized together in at least one of the following ways: sequentially spliced ​​on a certain track in chronological order, achieving a layered picture effect through multi-track overlay.

[0089] The application of a third-party video template can be used to trigger video creation based on that template. A key operation in creating a video based on a third-party video template is configuring the media slots in the template that are in a replaceable state to fill those slots with the appropriate media.

[0090] The first slot filling page could be, for example, a page used by the template user to configure the filling of images or videos in the material slots of the third video template that are in a replaceable state.

[0091] In the third video, the first video is generated based on multiple first reference images. In the third material template, each first reference image represents a first material slot.

[0092] The identification information for the first material slot could be, for example, information used to distinguish different material slots.

[0093] The second generation option could be, for example, an option to trigger video generation based on the information configured on the current first slot fill page and the third video template. When the second generation option is selected, it means that the user approves the information configured on the current first slot fill page.

[0094] The target first media slot can be, for example, a selected first media slot or a first media slot that is currently selected. The configuration operation for the target first media slot can be, for example, an operation to instruct a specific image to be filled into that target first media slot. In some scenarios, it can be configured that when a first media slot is detected to be selected and a selection operation of an image in the album is received, that first media slot is determined as the target first media slot, and the selection operation of the image in the album is treated as the configuration operation for the target first media slot.

[0095] The image specified in the configuration operation for filling the target first material slot is designated as the second reference image. The essence of "configuring the second reference image for filling the target first material slot" is to specify which image to use to fill the target first material slot. In other words, the essence of "configuring the second reference image for filling the target first material slot" is to establish a correspondence between the target first material slot and the second reference image.

[0096] The fourth video could be the result of re-creating a video based on the third video template.

[0097] In some scenarios, since the third video includes the first video, the creation process of the third video can be divided into two processes. The first process is generating the first video based on multiple first reference images. The second process is organizing the first video as source material with other materials (such as video clips, audio, text, and special effects). Based on this, the third video template can be understood as a nested result of the first template and the second template. The first template is a reusable template framework that solidifies the generation process of the first video. The second template is a reusable template framework that solidifies the process of organizing the first video and other materials (such as video clips, audio, text, and special effects).

[0098] Since the fourth video is derived from the third video template, the fifth video within the fourth video can be considered as a video derived from the second reference image, the correspondence between the second reference image and the first material slot, and the first template. In other words, the fifth video corresponds to the first video. The reason the fifth video and the first video are different is that the first video used the first reference image during its generation process, while the fifth video used the second reference image during its generation process.

[0099] Optionally, in response to the target first material slot being selected, the constraint conditions corresponding to the target first material slot are displayed on the first slot filling page. The purpose of this setting is to ensure that the template user can select a suitable image as a second reference image to fill the target first material slot under the guidance of the constraint conditions, thereby ensuring that the final generated fourth video has better visual effects.

[0100] Optionally, the first slot filling page also includes multiple selectable images or videos that can be used to fill the media slot.

[0101] For example, suppose the third video includes two video segments, namely video segment 2 and the first video, and the first video is generated based on three first reference images: image 1, image 2, and image 3. When creating a video based on the third video template, see [link to relevant documentation]. Figure 7 The first slot filling page is displayed, which includes identification information for three first media slots and identification information for one second media slot. The second media slot is represented by video clip 2, the first media slot 1 is represented by image 1, the first media slot 2 is represented by image 2, and the first media slot 3 is represented by image 3. Assuming the user clicks on the identification information of the first media slot 2, the first media slot 2 will be selected as the target first media slot. (See [link to documentation]). Figure 7Set the first material slot 2 to be selected, and display the constraint corresponding to the first material slot 2 on the first slot filling page. The constraint is "Please use an image that includes a puppy". Figure 7 In the first slot filling page, there are also multiple images to be selected that can be used to fill the material slot, namely images a to i. Suppose the user then clicks on image b and confirms that image b will be used to fill the first material slot 2, that is, a correspondence is established between image b and the first material slot 2. Figure 7 The "Next" option is the second generated option. If the user clicks... Figure 7 The "Next" option will generate a fourth video based on the information configured on the current first slot fill page and the third video template.

[0102] By setting up a response to the application operation of the third video template, the first slot filling page is displayed; the third video includes the first video; the first video corresponds to multiple first material slots; the first slot filling page includes the identification information of the first material slot and the second generation option; in response to the configuration operation of the target first material slot, a second reference image is configured to fill the target first material slot. Essentially, in the application stage of the third video template, the material slot represented by the first reference image used to generate the first video is made available to the user of the third video template, so that the user of the third video template can replace the first reference image and generate a fifth video that meets their own needs and corresponds to the first video, thereby satisfying the user's personalized usage needs.

[0103] Furthermore, the method may also include: displaying a video display page, the video display page including a fourth video; the video display page also including identification information of a fifth video; in response to a selection operation of the fifth video on the video display page, displaying a second replacement option corresponding to the fifth video; in response to a selection operation of the second replacement option, displaying a second slot filling page, the second slot filling page including identification information of the first material slot and constraints corresponding to the first material slot.

[0104] The video display page could be, for example, a page for displaying a fourth video. "The video display page includes a fourth video" could mean, for example, that the video display page includes a video playback area and playback control options, where the video playback area is the area for playing the fourth video, and the playback control options could be options for adjusting playback. For example, the playback control options could include one or more of the following: play, pause, fast forward, rewind, and full-screen playback.

[0105] The video display page may also include identification information for other video segments that constitute the fourth video, excluding the fifth video.

[0106] The selection of the fifth video on the video display page could be, for example, selecting the identifier information of the fifth video. The second replacement option could be, for example, an option to trigger the replacement of the second reference image used to generate the fifth video.

[0107] The second slot filling page could be, for example, a page used to assist the user in replacing the second reference image used to generate the fifth video. Since the second reference image used to generate the fifth video occupies the first media slot, or in other words, the second reference image is used to generate the fifth video because of the correspondence between the second reference image and the first media slot. Therefore, the second slot filling page should include the identification information of the first media slot and the corresponding constraints. Optionally, the second slot filling page may also include multiple selectable images or videos that can be used to fill the media slots.

[0108] The second slot filling page displays the identification information of the first material slot and the corresponding constraints of the first material slot. The purpose is to help the template user reconfigure the reference image used to fill the first material slot.

[0109] Furthermore, in response to the configuration operation of the target first material slot on the second slot filling page, a third reference image can be configured to fill the target first material slot, that is, to remove the correspondence between the second reference image and the target first material slot, and to establish a correspondence between the third reference image and the target first material slot.

[0110] For example, suppose the third video includes two video segments, namely video segment 2 and the first video, where the first video is generated based on three first reference images: image 1, image 2, and image 3. When a video is created based on the third video template, the resulting video is the fourth video. The fourth video includes video segment 3 and a fifth video, where video segment 3 corresponds to video segment 2, and the fifth video corresponds to the first video. The fifth video is generated based on three second reference images: image a, image b, and image c. See also... Figure 8 The video display page includes a playback area for the fourth video, identification information for video clip 3, and identification information for the fifth video. If the user clicks on the identification information for the fifth video, see [link to video display page]. Figure 9 Display the second replacement option corresponding to the fifth video (i.e. Figure 9 The "Replace" option in the video). If the user further clicks the second replacement option corresponding to the fifth video (i.e. Figure 9 (See the "Replace" option in the text). Figure 10 This displays the second content slot filling page. The second content slot filling page includes the identifier information of the first content slot and the corresponding constraints for that slot. Figure 10 In the middle, because the identification information of the first material slot 2 is selected, the constraint conditions corresponding to the first material slot 2 are displayed on the second slot filling page. See also Figure 10 The second slot fill page also includes multiple candidate images that can be used to fill the first material slot. Figure 10 Based on this, users can select a target first material slot on the second slot filling page, and select a third reference image to fill the selected target first material slot.

[0111] By configuring the system to respond to the selection of the fifth video on the video display page, a second replacement option corresponding to the fifth video is displayed. In response to the selection of the second replacement option, a second slot filling page is displayed, which includes the identifier information of the first material slot and the corresponding constraints. Essentially, after the fourth video is generated, the template user can replace the image used to fill the first material slot. When the second reference image used to fill the first material slot is replaced with the third reference image, it means that the fifth video will be regenerated, and the fourth video will be updated. This configuration satisfies the user's need to edit and update the fourth video if they are not satisfied with it.

[0112] In some embodiments, based on the above technical solutions, the method may optionally further include: displaying a guide modification option in response to a selection operation of a fifth video on the video display page; displaying a guide corresponding to the fifth video in response to a selection operation of the guide modification option; the guide including identification information of a second reference image and text prompts; and replacing the second reference image in the guide and replacing the identification information of the second reference image in the guide in response to a replacement operation of the second reference image in the guide. Further, the method may further include: modifying the text prompts in the guide in response to a modification operation of the text prompts in the guide.

[0113] For example, the option to modify the introductory text could be an option for modifying the introductory text.

[0114] The first video is generated based on a prompt, which includes a first reference image and text prompts. Since the fifth video corresponds to the first video, assuming that to generate the fifth video, at least a portion of the first reference image used to generate the first video is replaced with a second reference image, but the text prompts are not modified, then the prompt corresponding to the fifth video includes the first reference image and text prompts that were not replaced in the prompt corresponding to the first video, as well as the second reference image used to replace the first reference image. For example, assuming... Figure 3The introductory text provided corresponds to the first video. To generate the fifth video, image 2 was replaced with image b, and image 3 was replaced with image c. Image 1 was not replaced, and the text prompts were not modified. The introductory text corresponding to the fifth video includes images 1, b, c, and the text prompts. The text prompts in the introductory text for the fifth video are the same as those in the introductory text for the first video.

[0115] The organization of the prompts corresponding to the fifth video is the same as that corresponding to the first video, that is, the identification information of the reference image is interspersed in the text prompts, and the number of characters between the position of the object description phrase in the text prompts and the position of the identification information of the corresponding reference image in the text prompts is less than the preset number of characters.

[0116] For example, see Figure 8 If the user clicks on the fifth video's icon, see [link / reference]. Figure 9 Display the options to modify the introductory text corresponding to the fifth video (i.e. Figure 9 The "Modify Effects" option in the video. If the user further clicks the option to modify the introductory text corresponding to the fifth video (i.e. Figure 9 (See the "Modify Effects" option in the settings). Figure 11 The system displays the introductory text corresponding to the fifth video. Assuming the user wants to replace image b, they can select the identifier information for image b in the introductory text. Optionally, after selecting the identifier information for image b, an image selection page can be invoked to choose the image to replace image b. When image b is replaced, the identifier information for image b in the introductory text will also be updated synchronously. Furthermore, in... Figure 11 Based on this, users can modify the text prompts in the guidance messages.

[0117] By setting a response to the selection of options to modify the introductory text, the introductory text corresponding to the fifth video is displayed. The introductory text includes the identifier information of the second reference image and text prompts. In response to the replacement of the second reference image in the introductory text, the second reference image in the introductory text is replaced. In response to the modification of the text prompts in the introductory text, the text prompts in the introductory text are modified. Essentially, this displays the introductory text used to generate the fifth video to the template user. This helps the template user better understand the reasons for the poor visual effect of the fifth video from the perspective of the correspondence between the object description phrases and the second reference image, thereby reconfiguring the reference image or text prompts to improve the matching degree between the corresponding object description phrases and the second reference image, and ultimately optimize the effect of using the third video template for video creation.

[0118] It should be noted that, in the technical solutions provided in this application, the selection of specific options or identification information can be achieved through direct physical contact (such as touchscreen operation), indirect physical input devices (such as mouse, touchpad), or contactless input methods (such as gesture recognition, voice control). If it is achieved through direct physical contact (such as touchscreen operation) or indirect physical input devices (such as mouse, touchpad), it can include, but is not limited to, the following user interaction methods: click operation, swipe operation, drag operation, or long press operation. Furthermore, depending on different application scenarios and technical implementation conditions, the selection operation can be extended to employ more advanced interaction technologies, such as eye tracking, brain-computer interfaces, and other emerging human-computer interaction methods.

[0119] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0120] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0121] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0122] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0123] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0124] Figure 12This is a schematic diagram of the structure of an interactive device according to an embodiment of this disclosure. The interactive device provided in this embodiment can be configured in a client or in a server. See also Figure 12 The interactive device specifically includes:

[0125] The first display module 310 is used to display a video generation configuration page, which includes a guide input area, a first reference image addition option, and a first generation option.

[0126] The first collection module 320 is used to receive a first reference image through the first reference image addition option, and to display the identification information of the received first reference image in the guide input area; the number of the first reference images is multiple;

[0127] The second collection module 330 is used to receive text prompts through the guidance input area and display the text prompts in the guidance input area; the text prompts include object description phrases, which correspond to the first reference image; the object description phrases are used to describe the objects in the corresponding first reference image; the identification information of the first reference image is interspersed in the text prompts; the number of characters between the position of the object description phrase in the text prompts and the position of the identification information of the corresponding first reference image in the text prompts is less than a preset number of characters;

[0128] The generation module 340 is configured to generate a first video based on the content in the guide input area in response to the selection operation of the first generation option.

[0129] Furthermore, the device also includes a first modification module for:

[0130] In response to a first selection operation on the target first reference image in the guide input area, a first replacement option is displayed;

[0131] In response to the selection of the first replacement option, the target first reference image is replaced, and the identification information of the target first reference image in the guide input area is replaced.

[0132] Furthermore, the device also includes a second modification module for:

[0133] In response to a second selection operation on the target first reference image in the guide input area, a deletion option is displayed;

[0134] In response to the selection of the deletion option, the target first reference image is deleted, and the identification information of the target first reference image is deleted from the guidance input area.

[0135] Furthermore, the device also includes a publishing module for:

[0136] In response to the operation of publishing the second video as a template, a publishing configuration page is displayed; the second video includes the first video; the publishing configuration page includes identification information of the first reference image used by the first video and publishing options;

[0137] In response to the third selection operation of the target first reference image on the publishing configuration page, a constraint input box corresponding to the first target slot is displayed; the first target slot is the material slot represented by the target first reference image.

[0138] The content received through the constraint input box is used as the constraint condition corresponding to the first target slot.

[0139] In response to the selection of the publishing option, the second video is published as a template based on the correspondence between the first target slot and the constraint conditions.

[0140] Furthermore, the publishing module is also used for:

[0141] In response to the selection operation of the publishing option, based on the correspondence between the first target slot and the constraint conditions, before publishing the second video as a template, in response to the fourth selection operation of the target first reference image on the publishing configuration page, the status of the first target slot is set to the allow replacement status.

[0142] Furthermore, the device also includes an application module for:

[0143] In response to the application operation of the third video template, the first slot filling page is displayed; the third video includes the first video; the first video corresponds to multiple first material slots; the first slot filling page includes the identification information of the first material slots and a second generation option;

[0144] In response to the configuration operation of the target first material slot, a second reference image is configured to fill the target first material slot;

[0145] In response to the selection of the second generation option, a fourth video is obtained based on the second reference image, the correspondence between the second reference image and the first material slot, and the third video template; the fourth video includes a fifth video, which is generated based on the second reference image.

[0146] Furthermore, the application module is also used for:

[0147] In response to the target first material slot being selected, the constraint conditions corresponding to the target first material slot are displayed on the first slot filling page.

[0148] Furthermore, the application module is also used for:

[0149] A video display page is provided, which includes a fourth video; the video display page also includes the identification information of the fifth video.

[0150] In response to the selection operation of the fifth video on the video display page, a second replacement option corresponding to the fifth video is displayed;

[0151] In response to the selection of the second replacement option, a second slot filling page is displayed, which includes the identification information of the first material slot and the constraints corresponding to the first material slot.

[0152] Furthermore, the application module is also used for:

[0153] In response to the selection of the fifth video on the video display page, an option to modify the introductory text is displayed;

[0154] In response to the selection of the option to modify the introductory text, an introductory text corresponding to the fifth video is displayed; the introductory text includes identification information of the second reference image and text prompts;

[0155] In response to the replacement operation of the second reference image in the prompt, the second reference image is replaced, and the identification information of the second reference image in the prompt is replaced.

[0156] Furthermore, the application module is also used for:

[0157] In response to a modification operation on the text prompt in the guidance, the text prompt in the guidance is modified.

[0158] The interactive device provided in this disclosure can execute the steps performed by the client or server in the interactive method provided in this disclosure, and has the functions of execution steps and beneficial effects, which will not be described in detail here.

[0159] The first reference image 13 below illustrates a structural schematic diagram suitable for implementing the electronic device 1000 in the embodiments of this disclosure. The electronic device 1000 in the embodiments of this disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), wearable electronic devices, etc., as well as fixed terminals such as digital TVs, desktop computers, smart home devices, etc. Figure 13 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0160] like Figure 13 As shown, the electronic device 1000 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003 to implement the interaction method as described in the embodiments of this disclosure. The RAM 1003 also stores various programs and information required for the operation of the electronic device 1000. The processing device 1001, ROM 1002, and RAM 1003 are interconnected via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0161] Typically, the following devices can be connected to the I / O interface 1005: input devices 1006 including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 1007 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1008 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows electronic device 1000 to exchange information with other devices wirelessly or via wired communication. Although Figure 13 An electronic device 1000 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0162] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts, thereby implementing the interactive methods as described above. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1009, or installed from storage device 1008, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of embodiments of this disclosure.

[0163] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include information signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated information signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0164] In some implementations, clients and servers may communicate using any known or future network protocol, such as HTTP (Hypertext Transfer Protocol), and may interconnect with any form or medium of digital information communication (e.g., a communication network). Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any known or future network.

[0165] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0166] The aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to:

[0167] The video generation configuration page is displayed, which includes a guide input area, a first reference image addition option, and a first generation option.

[0168] The system receives a first reference image by adding an option to the first reference image, and displays the identification information of the received first reference image in the guide input area; the number of first reference images is multiple.

[0169] The system receives and displays text prompts in the guidance input area. The text prompts include object description phrases that correspond to the first reference image. These object description phrases describe objects in the corresponding first reference image. Identification information of the first reference image is interspersed within the text prompts. The number of characters between the position of the object description phrase in the text prompts and the position of the identification information of the corresponding first reference image in the text prompts is less than a preset number of characters.

[0170] In response to the selection of the first generation option, a first video is generated based on the content in the guide input area.

[0171] Optionally, when one or more of the above-described procedures are executed by the electronic device, the electronic device may also perform other steps described in the above embodiments.

[0172] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0173] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0174] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.

[0175] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0176] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0177] According to one or more embodiments of this disclosure, this disclosure provides an electronic device, including:

[0178] One or more processors;

[0179] Memory, used to store one or more programs;

[0180] When the one or more programs are executed by the one or more processors, the one or more processors implement any of the interaction methods provided in this disclosure.

[0181] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements an interaction method as described in any of the present disclosure.

[0182] This disclosure also provides a computer program product, which includes a computer program or instructions that, when executed by a processor, implement the interaction method described above.

[0183] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0184] The above description is merely a specific embodiment of this disclosure, enabling those skilled in the art to understand or implement it. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An interaction method, characterized in that, include: The video generation configuration page is displayed, which includes a guide input area, a first reference image addition option, and a first generation option. The system receives a first reference image by adding an option to the first reference image, and displays the identification information of the received first reference image in the guide input area; the number of first reference images is multiple. The system receives and displays text prompts in the guidance input area. The text prompts include object description phrases that correspond to the first reference image. These object description phrases describe objects in the corresponding first reference image. Identification information of the first reference image is interspersed within the text prompts. The number of characters between the position of the object description phrase in the text prompts and the position of the identification information of the corresponding first reference image in the text prompts is less than a preset number of characters. In response to the selection of the first generation option, a first video is generated based on the content in the guide input area; In response to the operation of publishing the second video as a template and the operation of configuring constraints, the second video is published as a template; the second video includes the first video; the constraints correspond to the first reference image and are used to indicate the conditions that the new image needs to meet when replacing the first reference image.

2. The method according to claim 1, characterized in that, The method further includes: In response to a first selection operation on the target first reference image in the guide input area, a first replacement option is displayed; In response to the selection of the first replacement option, the target first reference image is replaced, and the identification information of the target first reference image in the guide input area is replaced.

3. The method according to claim 1, characterized in that, The method further includes: In response to a second selection operation on the target first reference image in the guide input area, a deletion option is displayed; In response to the selection of the deletion option, the target first reference image is deleted, and the identification information of the target first reference image is deleted from the guidance input area.

4. The method according to claim 1, characterized in that, The operation of publishing the second video as a template in response to the operation of publishing the second video as a template and the operation of configuring constraints include: In response to the operation of publishing the second video as a template, a publishing configuration page is displayed; the publishing configuration page includes the identification information of the first reference image used by the first video and publishing options; In response to the third selection operation of the target first reference image on the publishing configuration page, a constraint input box corresponding to the first target slot is displayed; the first target slot is the material slot represented by the target first reference image. The content received through the constraint input box is used as the constraint condition corresponding to the first target slot. In response to the selection of the publishing option, the second video is published as a template based on the correspondence between the first target slot and the constraint conditions.

5. The method according to claim 4, characterized in that, In response to the selection of the publishing option, before publishing the second video as a template based on the correspondence between the first target slot and the constraints, the method further includes: In response to the fourth selection operation of the target first reference image on the release configuration page, the status of the first target slot is set to allow replacement.

6. The method according to claim 1, characterized in that, The method further includes: In response to the application operation of the third video template, the first slot filling page is displayed; the third video includes the first video; the first video corresponds to multiple first material slots; the first slot filling page includes the identification information of the first material slots and a second generation option; In response to the configuration operation of the target first material slot, a second reference image is configured to fill the target first material slot; In response to the selection of the second generation option, a fourth video is obtained based on the second reference image, the correspondence between the second reference image and the first material slot, and the third video template; the fourth video includes a fifth video, which is generated based on the second reference image.

7. The method according to claim 6, characterized in that, The method further includes: In response to the target first material slot being selected, the constraint conditions corresponding to the target first material slot are displayed on the first slot filling page.

8. The method according to claim 6, characterized in that, The method further includes: A video display page is provided, which includes a fourth video; the video display page also includes the identification information of the fifth video. In response to the selection operation of the fifth video on the video display page, a second replacement option corresponding to the fifth video is displayed; In response to the selection of the second replacement option, a second slot filling page is displayed, which includes the identification information of the first material slot and the constraints corresponding to the first material slot.

9. The method according to claim 8, characterized in that, The method further includes: In response to the selection of the fifth video on the video display page, an option to modify the introductory text is displayed; In response to the selection of the option to modify the introductory text, an introductory text corresponding to the fifth video is displayed; the introductory text includes identification information of the second reference image and text prompts; In response to the replacement operation of the second reference image in the prompt, the second reference image is replaced, and the identification information of the second reference image in the prompt is replaced.

10. The method according to claim 9, characterized in that, The method further includes: In response to a modification operation on the text prompt in the guidance, the text prompt in the guidance is modified.

11. An interactive device, characterized in that, include: The first display module is used to display the video generation configuration page, which includes a guide input area, a first reference image addition option, and a first generation option. The first collection module is used to receive the first reference image through the option to add the first reference image, and to display the identification information of the received first reference image in the guide input area; the number of the first reference images is multiple; The second collection module is used to receive text prompts through the guidance input area and display the text prompts in the guidance input area; the text prompts include object description phrases, which correspond to the first reference image; the object description phrases are used to describe the objects in the corresponding first reference image; the identification information of the first reference image is interspersed in the text prompts; the number of characters between the position of the object description phrase in the text prompts and the position of the identification information of the corresponding first reference image in the text prompts is less than a preset number of characters; A generation module is configured to generate a first video based on the content in the guide input area in response to a selection operation of the first generation option; The publishing module is used to publish the second video as a template in response to the operation of publishing the second video as a template and the operation of configuring constraints. The second video includes the first video. The constraints correspond to the first reference image and are used to indicate the conditions that the new image needs to meet when replacing the first reference image.

12. An electronic device, characterized in that, The electronic device includes: One or more processors; Storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1-10.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-10.

Images